-
Notifications
You must be signed in to change notification settings - Fork 304
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enables MG python tests using a single-GPU LocalCUDACluster in CI #3596
Enables MG python tests using a single-GPU LocalCUDACluster in CI #3596
Conversation
…6-sg_localcudacluster_ci_testing
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approving but we should wait before merging to see amount of time added , CC: @rlratzel
… set up, adds temporary skips to MG tests that do not/cannot run in SG environments.
…6-sg_localcudacluster_ci_testing
I ran the MG tests using This isn't ideal but it's a decent tradeoff for getting the additional coverage. A few notes:
|
…6-sg_localcudacluster_ci_testing
/merge |
closes #3413
This PR enables MG python tests using a single-GPU
LocalCUDACluster
in CI by setting theDASK_WORKER_DEVICES
to0
. This does not affect SG tests, which continue to run in CI as they previously did.PR #3540 added support for
DASK_WORKER_DEVICES
to the pytest fixture used in python MG tests, allowing CI scripts (and developers) to restrict workers to specific devices, which should now allow single-GPU CI runs to cover the MG/dask code paths in python.Note: despite the changes here to now run python MG tests, it should be noted that this isn't actual multi-GPU test coverage in
libcugraph
since multiple GPUs are not communicating and the code to set up comms, distribute graph data, etc. is not being exercised using >1 GPU.