Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练缓慢 GPU利用率很低 cuda利用率100% 每次it需要花费35s以上 #613

Open
aaqq112 opened this issue Sep 27, 2023 · 4 comments
Open

训练缓慢 GPU利用率很低 cuda利用率100% 每次it需要花费35s以上 #613

aaqq112 opened this issue Sep 27, 2023 · 4 comments

Comments

@aaqq112
Copy link

aaqq112 commented Sep 27, 2023

我的显卡是 NIVIDIA3080TI CUDA11.3 pytorch1.10
image
image
CUDA使用率100% GPU使用率2% 请各位帮忙看一下哪里出了问题
@a897456
Copy link

a897456 commented Sep 27, 2023

一样的，哥们，我也是，跑了4天，epoch才40，需要5000次，跑完需要一年半跑完。

@aaqq112 aaqq112 closed this as completed Oct 7, 2023
@aaqq112
Copy link
Author

aaqq112 commented Oct 7, 2023

解决了吗

@a897456
Copy link

a897456 commented Oct 7, 2023

没解决，我看了是GPU已经是100%了，所以不知道哪里出了问题，你怎么关闭问题了？

@aaqq112 aaqq112 reopened this Oct 7, 2023
@ndz2011
Copy link

ndz2011 commented Mar 18, 2024

batchsize设了多少啊？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@a897456 @ndz2011 @aaqq112