Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Request for prebuilt CUDA wheels for newer version #1824

Open
XJF2332 opened this issue Nov 5, 2024 · 7 comments
Open

Request for prebuilt CUDA wheels for newer version #1824

XJF2332 opened this issue Nov 5, 2024 · 7 comments

Comments

@XJF2332
Copy link

XJF2332 commented Nov 5, 2024

I noticed that 0.3.0 and 0.3.1 have no prebuilt CUDA wheels
I would be grateful if there are prebuilt wheels for newer versions.
@pabl-o-ce
Copy link

+1 here jeje

@pabl-o-ce
Copy link

it seems that there some issues creating windows wheels https://github.com/abetlen/llama-cpp-python/actions/runs/11148387475

@iwr-redmond iwr-redmond mentioned this issue Nov 14, 2024
Open
@John6666cat
Copy link

+1 here

@pabl-o-ce
Copy link

I get this github actions to change over installing manually cuda drivers - Jimver/cuda-toolkit on windows/ubuntu. Im exploring to set this

@pabl-o-ce
Copy link

I fix the wheels for linux just for testing this Jimver/cuda-toolkit.

But I think I can solve the one for windows and I think what is the issue (just come in a moment to see if work that take to much time to run it)

@Muzixin
Copy link

Muzixin commented Nov 21, 2024

+1 here

@pabl-o-ce
Copy link

I fixed guys

send the PR #1838

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@pabl-o-ce @Muzixin @XJF2332 @John6666cat