-
-
Notifications
You must be signed in to change notification settings - Fork 14.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hardware.nvidia-container-toolkit.enable
doesn't work with Jetson devices
#344729
Comments
Thank you for the report @jmbaur. What is the generated contents of |
This is the non-working CDI support file
And this is the working CDI support file
|
I am not familiar with the Jetson devices, as I don't have one. I can see
What are the arguments that make the difference in this case? |
No worries, I have hardware access and I can work on this, just making the issue so we are all tracking :)
IIRC, Jetson support for CDI requires running NVIDIA's tooling in "CSV" mode, which is just a mode of operation where the files, char devices, etc that need to be passed through to the container are encoded in a CSV file they ship in their BSP rather than dynamically discovering these files at runtime. |
Ah, I parsed your message incorrectly, just realized it’s actually two JSONs :) |
I would also recommend that we don't remove the currently deprecated |
Yes, we don’t have any immediate plans (read: not for 24.11 for sure) of removing them. We just notify users so that they are aware that CDI is a somewhat preferable option and hopefully at some point we will sunset the runtime wrappers. But not anytime soon. |
Describe the bug
Doing something like
podman run --device=nvidia.com/gpu=all ubuntu
on a jetson device withhardware.nvidia-container-toolkit.enable = true
does not successfully pass through the nvidia hardware to the container.Steps To Reproduce
Steps to reproduce the behavior:
hardware.nvidia-container-toolkit.enable
for a nixos config targeting a jetson device--device=nvidia.com/gpu=all
/dev/nvidiactl
) is available for usage in the containerExpected behavior
It just works (TM)
Screenshots
If applicable, add screenshots to help explain your problem.
Additional context
In jetpack-nixos,
nvidia-ctk
is invoked with slightly different arguments that are tailored to work with jetson devices. IMO, this work should be integrated with the nvidia-container-toolkit module in order to get this working OOTB.Notify maintainers
@ereslibre
Metadata
Please run
nix-shell -p nix-info --run "nix-info -m"
and paste the result.Add a 👍 reaction to issues you find important.
The text was updated successfully, but these errors were encountered: