Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix workspace limit in cudnn-8 #28611

Merged
merged 1 commit into from
Nov 16, 2020

Conversation

zhiqiu
Copy link
Contributor

@zhiqiu zhiqiu commented Nov 13, 2020

PR types

Others

PR changes

OPs

Describe

Fix workspace limit in cudnn-8

In previous changes, the FLAGS_conv_workspace_size_limit is made invalid in CUDNN-8, which leads to great increases of GPU memory usage in many models.

This PR fixes that.

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

}
VLOG(3) << "Can not find alog that requires memory < "
<< static_cast<double>(workspace_byte) / (1 << 20) << " MB";
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

如果所有的候选算法 workspace都超出限制,会得到什么样的报错信息呢?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

不会报错,会使用第一个算法进行计算。

@zhiqiu zhiqiu requested a review from zhangting2020 November 16, 2020 04:16
Copy link
Contributor

@zhangting2020 zhangting2020 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zhiqiu zhiqiu merged commit f962bd3 into PaddlePaddle:develop Nov 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants