Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cugraph: Build CUDA 12 packages #3456

Merged
merged 38 commits into from
Jul 20, 2023

Conversation

vyasr
Copy link
Contributor

@vyasr vyasr commented Apr 7, 2023

First attempt at building libcugraph with CUDA 12 and nvidia channel packages

Closes #3271

@vyasr vyasr added feature request New feature or request DO NOT MERGE Hold off on merging; see PR for details non-breaking Non-breaking change labels Apr 7, 2023
@vyasr vyasr self-assigned this Apr 7, 2023
@vyasr vyasr changed the title Build CUDA 12 packages of libcugraph cugraph: Build CUDA 12 packages Apr 10, 2023
@BradReesWork BradReesWork added this to the 23.08 milestone May 24, 2023
@BradReesWork BradReesWork changed the base branch from branch-23.06 to branch-23.08 May 30, 2023 12:00
raydouglass pushed a commit that referenced this pull request Jul 18, 2023
We are planning to enable CUDA 12 CI jobs on July 18, per rapidsai/shared-workflows#112. This PR must be merged to disable CUDA 12 CI jobs for cugraph until #3271 / #3456 are merged.

Authors:
   - Bradley Dice (https://github.com/bdice)

Approvers:
   - Ray Douglass (https://github.com/raydouglass)
@rlratzel rlratzel removed the DO NOT MERGE Hold off on merging; see PR for details label Jul 18, 2023
@jakirkham
Copy link
Member

Need to merge the very latest changes in branch-23.08 and revert the changes from PR ( #3713 )

cc @bdice @vyasr (feel free to update this guidance as needed)

…f temporary cuda-120 branches to workflow files now that they've been merged to branch-23.08.
.github/workflows/pr.yaml Outdated Show resolved Hide resolved
conda/recipes/libcugraph/build.sh Outdated Show resolved Hide resolved
conda/recipes/libcugraph/meta.yaml Outdated Show resolved Hide resolved
conda/recipes/libcugraph/meta.yaml Outdated Show resolved Hide resolved
conda/recipes/libcugraph/meta.yaml Show resolved Hide resolved
conda/recipes/libcugraph/meta.yaml Outdated Show resolved Hide resolved
dependencies.yaml Outdated Show resolved Hide resolved
…eded static and dev dependencies, removes unneeded cuda_spec pins, adds missing use of cuda-version meta-package.
@rlratzel rlratzel marked this pull request as ready for review July 19, 2023 15:13
@rlratzel rlratzel requested a review from a team as a code owner July 19, 2023 15:13
@jakirkham
Copy link
Member

jakirkham commented Jul 19, 2023

Seeing errors like this on CI. This is happening on all Python jobs. Did something else change?

# cython layer but users are encourage to switch to device_resources
cdef extern from "raft/core/handle.hpp" namespace "raft" nogil:
    cdef cppclass handle_t:
        handle_t() except +
        handle_t(cuda_stream_view stream_view) except +
                ^
------------------------------------------------------------

$PREFIX/lib/python3.9/site-packages/pylibraft/common/handle.pxd:34:17: 'cuda_stream_view' is not a type identifier

Edit: Bradley determine this was an upstream issue in RAFT and submitted PR ( rapidsai/raft#1656 ) to address

Comment on lines 61 to 62
# TODO: Remove rmm once https://github.com/rapidsai/raft/pull/1656 is merged (fixes pylibraft use of rmm)
- rmm ={{ minor_version }}
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are there any linkages to RMM from pylibcugraph itself? Does it use rmm's Cython interface?

- python
# TODO: Remove rmm once https://github.com/rapidsai/raft/pull/1656 is merged (fixes pylibraft use of rmm)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jakirkham FYI, this is the line where this rmm dependency existed before. This TODO just makes it clear that it's a workaround with an upstream fix in progress. I'd be fine merging this PR with this dependency still in place since it affects both CUDA 11 and CUDA 12.

rapids-bot bot pushed a commit to rapidsai/raft that referenced this pull request Jul 19, 2023
…1656)

There is a build error in rapidsai/cugraph#3456:
```
$PREFIX/lib/python3.9/site-packages/pylibraft/common/handle.pxd:47:8: 'cuda_stream_view' is not a type identifier
```

pylibraft should have a `run` dependency on `rmm` so that Cython users of pylibraft (pylibcugraph in this case) can `cimport` and use pylibraft Cython at build time.

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Corey J. Nolet (https://github.com/cjnolet)
  - AJ Schmidt (https://github.com/ajschmidt8)
  - https://github.com/jakirkham

URL: #1656
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! CI passed in the previous commit, I pushed another small tweak for pylibraft and this should be ready to merge tomorrow morning.

@BradReesWork
Copy link
Member

/merge

@rapids-bot rapids-bot bot merged commit 54b43e1 into rapidsai:branch-23.08 Jul 20, 2023
56 checks passed
rapids-bot bot pushed a commit that referenced this pull request Jul 24, 2023
This PR adds the CUDA 12.0 conda environment, which was missed in #3456. It is automatically generated by `rapids-dependency-file-generator` from `dependencies.yaml` but was not committed to the repo.

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Ray Douglass (https://github.com/raydouglass)

URL: #3725
@vyasr vyasr deleted the feat/cuda12_nvidia_build branch July 25, 2023 21:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

cuGraph: CUDA 12 Conda Packages
7 participants