Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] Training Donkey Car Without Simulator Rendering #417

Open
5 tasks done
Gribesh opened this issue Oct 31, 2023 · 2 comments
Open
5 tasks done

[Question] Training Donkey Car Without Simulator Rendering #417

Gribesh opened this issue Oct 31, 2023 · 2 comments
Labels
question Further information is requested

Comments

@Gribesh
Copy link

Gribesh commented Oct 31, 2023

❓ Question

I've been training a reinforcement learning agent for the Donkey Car environment using Stable Baselines3 Zoo. My training command is as follows:

python train.py --algo tqc --env donkey-waveshare-v0 --eval-freq -1 --save-freq 20000 --tensorboard-log ./tblog

I've noticed that the visual rendering of the simulator significantly slows down the training process. I'd like to speed up the training by disabling this simulator rendering. Upon checking the training code, I didn't find any parameter or flag that controls the rendering.

Is there a way to train it without rendering the env? If so, could you please guide me on how to train the agent without the visual overhead of the simulator? Any insights or document recommendations would be highly appreciated!

Thank you

Checklist

@Gribesh Gribesh added the question Further information is requested label Oct 31, 2023
@araffin
Copy link
Member

araffin commented Oct 31, 2023

Hello,

Is there a way to train it without rendering the env? If so, could you please guide me on how to train the agent without the visual overhead of the simulator?

This is more a question for the donkey car simulation.
I tried in the past but without success, however, you can now play the simulation faster than realtime.

@Gribesh
Copy link
Author

Gribesh commented Nov 1, 2023

Oh okay. Thanks for the information.

Actually, I wanted to run the algorithm for a few million steps in the AWS Sagemaker.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants