Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PowerPC #66

Merged
merged 12 commits into from
May 13, 2021
Merged

Add PowerPC #66

merged 12 commits into from
May 13, 2021

Conversation

jaimergp
Copy link
Member

Checklist

  • Used a personal fork of the feedstock to propose changes
  • Bumped the build number (if the version is unchanged)
  • Reset the build number to 0 (if the version changed)
  • Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
  • Ensured the license file is being packaged.

Questions:

  • Are the compiler versions ok?
  • How do we need to handle the sysroot-* dependencies?

Closes #21

MNT: Re-rendered with conda-build 3.20.5, conda-smithy 3.10.0, and conda-forge-pinning 2021.04.17.14.54.41
@conda-forge-linter
Copy link

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

@jaimergp jaimergp mentioned this pull request Apr 19, 2021
@jaimergp
Copy link
Member Author

Ok, that did the trick. Now we need to wait for the docker-images PR.

@jaimergp
Copy link
Member Author

The Docker images are now available and the packages can get built!

A question is still pending though: what do we do about the sysroot dependency? PowerPC CUDA 11.0+ uses CentOS 8, so I guess that requires a new sysroot or am I mistaken? @isuruf @kkraus14 @jakirkham

@jakirkham
Copy link
Member

^ @beckermr do you know what we need to do to add CentOS 8 support?

@beckermr
Copy link
Member

We have no support for centos8.

@jaimergp
Copy link
Member Author

That means we are stuck with CUDA 10.2 on ppc64le for now (I'm ok with that).

@beckermr
Copy link
Member

CentOS 8 is reaching EOL very early compared to 7. I am wondering if maybe upstream can keep to centos 7?

@jakirkham ?

@jakirkham
Copy link
Member

Unfortunately there are no CUDA Toolkit versions for CentOS 7 and CUDA 11.0+ on PowerPC or ARM. Only CentOS 8

cc @kkraus14 (in case I'm missing anything here)

@kkraus14
Copy link
Contributor

As far as I know the only supported platform is RHEL 8 for CUDA 11.0+. That being said, the installers are all based on the runfile, which typically aren't OS specific in any way. For PPC64 that is https://developer.download.nvidia.com/compute/cuda/11.3.0/local_installers/cuda_11.3.0_465.19.01_linux_ppc64le.run for CUDA 11.3.

We could possibly check the glibc versioning in there and see?

@beckermr
Copy link
Member

It is technically feasible to support cos8 in conda-forge, but the expected lifetime of that distribution is small because they shortened the support period. Thus I'd prefer to not spend time on that. Maybe @isuruf has thoughts?

@beckermr
Copy link
Member

Another comment: We should support newer glibc's than cos7, but we might want to get them some other place (e.g. rocky linux).

@jaimergp
Copy link
Member Author

That being said, the installers are all based on the runfile, which typically aren't OS specific in any way

The Docker images are based on COS8, though.

And 11.3 is also available now 🤦

@jakirkham
Copy link
Member

Going on a little bit of a tangent, but do we know to what extent other things like CDTs and yum installs will change when moving to Rocky?

@isuruf
Copy link
Member

isuruf commented Apr 26, 2021

The Docker images are based on COS8, though.

We can just install the runfile on centos 7 docker image. I checked and cudatoolkit=11.0.3 conda ppc64le package only uses glibc_2.17 which is centos 7.

@beckermr
Copy link
Member

Going on a little bit of a tangent, but do we know to what extent other things like CDTs and yum installs will change when moving to Rocky?

I have no idea. We'll want to confer with anaconda as well since they might choose a different solution and that could matter.

cc @chenghlee

@isuruf
Copy link
Member

isuruf commented Apr 26, 2021

Can we please move the conversation about centos 8 or other distro to another issue?

Let's keep the discussion here about whether we need centos 8 or not for cuda.

@jaimergp
Copy link
Member Author

What is the estimated effort for the two feasible options now?

  • Package sysroot for COS8.
  • Frankenstein Docker images for CUDA 11.
    • What happens if CUDA12 jumps to COS9?

@jakirkham
Copy link
Member

Opened issue ( conda-forge/conda-forge.github.io#1432 ) to discuss how to handle CentOS 8

@isuruf
Copy link
Member

isuruf commented May 3, 2021

Package sysroot for COS8.

A few weeks probably and would have to fix some fires while we get it right.

Frankenstein Docker images for CUDA 11.

A day

What happens if CUDA12 jumps to COS9?

There's no COS9

@jaimergp
Copy link
Member Author

jaimergp commented May 4, 2021

I see, thanks for the answers!

In the meantime, would it make sense to merge only for CUDA 10.2 while we figure out how to support CUDA 11+? I wouldn't even add the migrator yet, but some packages in "manual CUDA mode" (like OpenMM) could benefit from having the infrastructure pieces ready and build some packages with the stable bits.

@jakirkham
Copy link
Member

Makes sense to me :)

@jaimergp
Copy link
Member Author

I'll take that as a yes! I'll commit something shortly.

@jaimergp
Copy link
Member Author

@conda-forge/nvcc everybody ok with merging this for 10.2 only?

@jakirkham jakirkham merged commit 25f3222 into conda-forge:master May 13, 2021
@jakirkham
Copy link
Member

Thanks Jaime! 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

PowerPC builds
6 participants