-
Notifications
You must be signed in to change notification settings - Fork 9.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
server: add cURL support to server Dockerfiles #6474
server: add cURL support to server Dockerfiles #6474
Conversation
Thanks, I think you can do all images in one PR for server |
Roger that. I'll add to this PR :) |
full.Dockerfile
I'm having some issues testing some of the platform-specific images locally e.g. CUDA/Rocm/Vulkan. Will our CI pipeline catch issues if I just submit a PR? e.g the CUDA images don't find the CUDA libraries (is it because I'm on a Mac?)
e.g.2: the ROCm images error out when installing packages due to GPG signature issues
e.g.3: Intel server image downloads the model but fails to load it (probably because I'm on a Mac)
e.g.4: Vulcan can't install SDK due to GPG key errors
|
You cannot test CUDA image without nvidia container runtime. It's OK. Probably linked with: |
be01d76
to
42f31ca
Compare
Co-authored-by: Georgi Gerganov <[email protected]>
* server: add cURL support to `full.Dockerfile` * server: add cURL support to `full-cuda.Dockerfile` and `server-cuda.Dockerfile` * server: add cURL support to `full-rocm.Dockerfile` and `server-rocm.Dockerfile` * server: add cURL support to `server-intel.Dockerfile` * server: add cURL support to `server-vulkan.Dockerfile` * fix typo in `server-vulkan.Dockerfile` Co-authored-by: Georgi Gerganov <[email protected]> --------- Co-authored-by: Georgi Gerganov <[email protected]>
Adding cURL to support
--hf-repo
and--hf-file
params when running through Docker.