Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ddp fail with new pl_lightning / pytorch #274

Open
ragier opened this issue Nov 17, 2022 · 1 comment
Open

ddp fail with new pl_lightning / pytorch #274

ragier opened this issue Nov 17, 2022 · 1 comment
Assignees
@thibo73800
Labels
alobugdays bug Something isn't working hard

Comments

@ragier
Copy link
Contributor

ragier commented Nov 17, 2022

@thibo73800 To reproduce, you can launch a train (detr for example) with this modification if you have only one GPU :

Replace :
accelerator=None if torch.cuda.device_count() <= 1 else "ddp",
by
accelerator="ddp",
@ragier ragier added bug Something isn't working hard alobugdays labels Nov 17, 2022
@anhtu293
Copy link
Contributor

anhtu293 commented Mar 15, 2023 •
edited
Loading

It's fixed in the latest version of aloception-oss (v0.5.1).
Since v1.8 of lightning, it doesnt accept ddp as value for accelerator anymore. We have strategy for that instead.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@thibo73800 thibo73800

Labels
alobugdays bug Something isn't working hard
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@thibo73800 @ragier @anhtu293