Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New parallel PyTorchRL library based on this one #267

Open
giadefa opened this issue Feb 11, 2021 · 0 comments
Open

New parallel PyTorchRL library based on this one #267

giadefa opened this issue Feb 11, 2021 · 0 comments

Comments

@giadefa
Copy link

giadefa commented Feb 11, 2021

@ikostrikov We have developped a new library starting from this one. We have submitted now what we think that is a practically final version.

It is still based on pytorch but has two differences:

  • It is scalable on multi GPUs and multi nodes and
  • It provides a modular approach which helps in developping multiple algorithms, both on-policy and off-policy, We provide several.

Few years ago we used your PPO implementation to get second position in this challenge from Unity: https://blogs.unity3d.com/2019/08/07/announcing-the-obstacle-tower-challenge-winners-and-open-source-release/

But we felt we would have won if the library was parallel, so here it is PyTorchRL:
https://github.com/PyTorchRL/pytorchrl

and the paper:
https://arxiv.org/abs/2007.02622

The docs:
https://pytorchrl.readthedocs.io/en/latest/

I think that this is relevant for people who would like to try multiple algorithms or scale it up. We would be happy to work with you somehow if you still keen in this. In any case, I hope that this message is useful for you and everyone else, but feel free to close it, if it's not.

Best,
Gianni

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant