Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplify wheel build scripts and allow alphas of RAPIDS dependencies #3809

Merged
merged 20 commits into from
Aug 31, 2023

Conversation

vyasr
Copy link
Contributor

@vyasr vyasr commented Aug 17, 2023

This PR makes a handful of changes aimed at simplifying the CI pipeline for building wheels as a precursor to switching RAPIDS nightlies to using proper alpha versions:

  • Inlines apply_wheel_modifications.sh in build_wheel.sh. Now that the build doesn't rely excessively on logic in shared workflows, there's no real benefit to having a separate script (previously apply_wheel_modification.sh was a special script that the shared workflow knew to execute i.e. it was a hook into an externally controlled workflow).
  • Consolidates the textual replacements using for loops and makes the replacements more targeted by only modifying the Python package being built in a given script. For instance, python/cugraph/pyproject.toml is no longer overwritten when building pylibcugraph.
  • Modifies dependency specs for RAPIDS packages to include a >=0.0.0a0 component. This is the key change that will allow alpha dependencies to be discovered. dask-cuda is the canary here because we already upload alphas of it, so the installation of cugraph in the test job should pull the latest dask-cuda alpha now without requiring direct installation from git.

@vyasr vyasr added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Aug 17, 2023
@vyasr vyasr self-assigned this Aug 17, 2023
@vyasr vyasr requested a review from a team as a code owner August 17, 2023 16:16
@vyasr vyasr marked this pull request as draft August 17, 2023 16:16
@vyasr vyasr changed the title Build wheels without isolation Simplify wheel build scripts and allow alphas of RAPIDS dependencies Aug 24, 2023
@vyasr vyasr marked this pull request as ready for review August 24, 2023 15:43
@vyasr vyasr requested a review from a team as a code owner August 24, 2023 15:43
@vyasr
Copy link
Contributor Author

vyasr commented Aug 24, 2023

ci/build_wheel_cugraph.sh Outdated Show resolved Hide resolved
ci/build_wheel.sh Show resolved Hide resolved
@vyasr
Copy link
Contributor Author

vyasr commented Aug 31, 2023

/merge

@rapids-bot rapids-bot bot merged commit f13feff into rapidsai:branch-23.10 Aug 31, 2023
55 checks passed
@vyasr vyasr deleted the feat/build_without_isolation branch August 31, 2023 16:28
rlratzel pushed a commit to rlratzel/cugraph that referenced this pull request Sep 8, 2023
…apidsai#3809)

This PR makes a handful of changes aimed at simplifying the CI pipeline for building wheels as a precursor to switching RAPIDS nightlies to using proper alpha versions:
- Inlines apply_wheel_modifications.sh in build_wheel.sh. Now that the build doesn't rely excessively on logic in shared workflows, there's no real benefit to having a separate script (previously apply_wheel_modification.sh was a special script that the shared workflow knew to execute i.e. it was a hook into an externally controlled workflow).
- Consolidates the textual replacements using for loops and makes the replacements more targeted by only modifying the Python package being built in a given script. For instance, python/cugraph/pyproject.toml is no longer overwritten when building pylibcugraph.
- Modifies dependency specs for RAPIDS packages to include a `>=0.0.0a0` component. This is the key change that will allow alpha dependencies to be discovered. dask-cuda is the canary here because we already upload alphas of it, so the installation of cugraph in the test job should pull the latest dask-cuda alpha now without requiring direct installation from git.

Authors:
  - Vyas Ramasubramani (https://github.com/vyasr)

Approvers:
  - AJ Schmidt (https://github.com/ajschmidt8)
  - Brad Rees (https://github.com/BradReesWork)

URL: rapidsai#3809
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants