Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update runtime's python packages #706

Merged
merged 1 commit into from
Sep 25, 2024

Conversation

atheo89
Copy link
Member

@atheo89 atheo89 commented Sep 20, 2024

Related to: https://issues.redhat.com/browse/RHOAIENG-13121

Description

How Has This Been Tested?

Merge criteria:

  • The commits are squashed in a cohesive manner and have meaningful messages.
  • Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
  • The developer has manually tested the changes and verified that the changes work

@@ -1,24 +1,24 @@
# Copied from: https://github.com/elyra-ai/elyra/blob/main/etc/generic/requirements-elyra.txt

# This is a comprehensive list of python dependencies that Elyra requires to execute Jupyter notebooks.
ipykernel==6.13.0
ipython==8.10.0
ipykernel==6.29.5
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@harshad16 I've manually updated this file to the latest versions, and I've applied the same versions to the Pipfiles example as well.

The packages on the requirments.txt on elyra repo looks old: https://github.com/elyra-ai/elyra/blob/main/etc/generic/requirements-elyra.txt

Since I wasn't certain which versions to use, I opted to go with the latest updates.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Personally I would remove any changes to these requirements-elyra.txt files from this PR. Or delete them completely to comply with: https://issues.redhat.com/browse/RHOAIENG-11068.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the changes look good.
as we are not using the requirements-elyra.txt, we would anyway use the https://issues.redhat.com/browse/RHOAIENG-11068, to de-clutter this.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tnx for pointing this out, the changes have been incorporated under this commit 664ea37

Copy link
Member

@harshad16 harshad16 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

everything looks good
just one note

runtimes/datascience/ubi9-python-3.11/Pipfile Outdated Show resolved Hide resolved
scipy = "~=1.14.1"
skl2onnx = "~=1.17.0"
onnxconverter-common = "~=1.13.0" # Required for skl2onnx, as upgraded version is not compatible with protobuf
codeflare-sdk = "~=0.18.0"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this version decrease intentional? 🤔 (same applies for this change in the rest of the files)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, because on jupyter ds notebook we have onnxconverter-common = "~=1.13.0" I kept the same on the runtime as well

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I understand the reason for the onnxconverter-common - but my question was for the codeflare-sdk.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I looked here - so I guess you tried to aligned these images... well, it's probably not a big deal for now as the regular codeflare-sdk update should fix it for all the images. But we should be sure we'll run it explicitly before the release then...

Copy link
Member

@harshad16 harshad16 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please separate the change of removing requirements.txt , out of this PR
for smooth moment of this work.
664ea37

As de-clutter of requirements.txt needs a little bit more work, which should be addressed in a separate PR. The reason being, till we have this env var set here:

export ELYRA_REQUIREMENTS_URL="file:///opt/app-root/bin/utils/requirements-elyra.txt"
, we can't remove requirements.txt.
Best to separate it out in a different PR, to be address that.

@atheo89
Copy link
Member Author

atheo89 commented Sep 25, 2024

Good point, here you may find the draft PR for this specific workload #708 (The commit has been removed from the current one)

Copy link
Member

@harshad16 harshad16 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

Thanks 💯

@openshift-ci openshift-ci bot added the lgtm label Sep 25, 2024
Copy link
Contributor

openshift-ci bot commented Sep 25, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: harshad16

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@harshad16
Copy link
Member

/override ci/prow/images
/override ci/prow/rocm-runtimes-ubi9-e2e-tests
/override ci/prow/runtime-rocm-pytorch-ubi9-python-3-11-pr-image-mirror
/override ci/prow/runtime-rocm-tensorflow-ubi9-python-3-11-pr-image-mirror
/override ci/prow/runtimes-ubi9-e2e-tests

Copy link
Contributor

openshift-ci bot commented Sep 25, 2024

@harshad16: Overrode contexts on behalf of harshad16: ci/prow/images, ci/prow/rocm-runtimes-ubi9-e2e-tests, ci/prow/runtime-rocm-pytorch-ubi9-python-3-11-pr-image-mirror, ci/prow/runtime-rocm-tensorflow-ubi9-python-3-11-pr-image-mirror, ci/prow/runtimes-ubi9-e2e-tests

In response to this:

/override ci/prow/images
/override ci/prow/rocm-runtimes-ubi9-e2e-tests
/override ci/prow/runtime-rocm-pytorch-ubi9-python-3-11-pr-image-mirror
/override ci/prow/runtime-rocm-tensorflow-ubi9-python-3-11-pr-image-mirror
/override ci/prow/runtimes-ubi9-e2e-tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@openshift-merge-bot openshift-merge-bot bot merged commit 93f441c into opendatahub-io:main Sep 25, 2024
30 of 35 checks passed
@jstourac
Copy link
Member

Since this is merged with the codeflare-sdk 0.18.0 - do we plan to update it to the latest version before the release?

@atheo89
Copy link
Member Author

atheo89 commented Sep 26, 2024

Since this is merged with the codeflare-sdk 0.18.0 - do we plan to update it to the latest version before the release?

Exactly, there is a tracker for this, once all the related issues are done we could proceed on the upgrade https://issues.redhat.com/browse/RHOAIENG-12507

@atheo89 atheo89 deleted the RHOAIENG-13121 branch October 23, 2024 08:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants