-
Notifications
You must be signed in to change notification settings - Fork 5.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
"add nccl cmake enforce" #4818
"add nccl cmake enforce" #4818
Conversation
Please add nccl as a cmake external project, just like pybind/eigen3/... And make ci pass first. |
We have to ways to introduce NCCL to paddle:
|
NCCL2 has a good back compatible ability, which can used base CUDA 7.0 - CUDA 9.x.
|
This will be closed since #5001 cherry-picked this code. |
To support Multi-GPU, we use NCCL library to do parameter/gradients integration and distribution. This PR adds an enforce macro helper module, cmake scripts to support NCCL. Cause NCCL library needs to compatible with different CUDA version, we use the
DSO
loading technical, same as other module cublas, cudnn does.