New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NCCL_Algo=Tree #246

Open

afattaholman opened this issue Aug 9, 2024 · 1 comment

afattaholman commented Aug 9, 2024

Hi,
I was wondering if it makes sense to set the NCCL_Algo=Tree while performing the all2all test?
Thanks,

Collaborator

AddyLaddy commented Aug 9, 2024

NCCL_ALGO has no effect on A2A (P2P operations).
NCCL does not have an A2A collective API either, it's implemented with P2P Send/Recv calls.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment