Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[REFACTOR] amp 적용 등을 통한 성능 최적화 #9

Open
3 tasks done
2018007956 opened this issue Jan 25, 2024 · 0 comments · May be fixed by #12
Open
3 tasks done

[REFACTOR] amp 적용 등을 통한 성능 최적화 #9

2018007956 opened this issue Jan 25, 2024 · 0 comments · May be fixed by #12
Assignees

Comments

@2018007956
Copy link
Contributor

2018007956 commented Jan 25, 2024

Background

To do

  • Add AMP scaler
  • Set gradients to None rather than 0 : optimizer(set_to_none=True)
  • Asynchronous data transfer to device : data.to(device, non_blocking=True)
@2018007956 2018007956 self-assigned this Jan 25, 2024
2018007956 added a commit that referenced this issue Jan 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant