Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update python/dask cugraph implementation to use new PLC features from #3947 #3948

Closed
rlratzel opened this issue Oct 20, 2023 · 1 comment · Fixed by #3941
Closed

Update python/dask cugraph implementation to use new PLC features from #3947 #3948

rlratzel opened this issue Oct 20, 2023 · 1 comment · Fixed by #3941
Assignees
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change

Comments

@rlratzel
Copy link
Contributor

When #3947 is closed, the cugraph python code for MG graphs needs to be updated.
There are three updates here, and I can create separate issues if that's better.

Remove code that computes num_edges from a dask_cudf edgelist

Once #3947 is closed, the num_edges arg to the PLC MGGraph is optional and no longer needs to be computed. This will allow the python code to bypass the need to persist/compute the distributed edgelist.

Remove code that combines (and modifies) the copied input dask_cudf edgelist

Once #3947 is closed, the code that combines the src/dst columns from each partition can be removed. This should greatly simplify the MG graph creation code.

Re-enable MG tests in CI

Once the above changes are made, MG tests in CI should pass reliably.

@rlratzel rlratzel added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Oct 20, 2023
@BradReesWork
Copy link
Member

closed by PR #3941

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants