Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

0.0.3 wheels not in flashinfer.ai/whl/ #168

Closed
Qubitium opened this issue Mar 10, 2024 · 5 comments
Closed

0.0.3 wheels not in flashinfer.ai/whl/ #168

Qubitium opened this issue Mar 10, 2024 · 5 comments

Comments

@Qubitium
Copy link
Contributor

Release 0.0.3 does not have proper wheels built/uploaded to https://flashinfer.ai/whl/cu121/torch2.2/flashinfer/

Please upload the prebuilt wheels. Thanks!

Normally this is not a problem but flashinfer is a quite a beast to compile.

@yzh119
Copy link
Collaborator

yzh119 commented Mar 11, 2024

Hi @Qubitium , thanks for your notification.

Please upload the prebuilt wheels. Thanks!

We have a continuous integration process that compiles and uploads wheels automatically, the latest run is still in progress: https://github.com/flashinfer-ai/flashinfer/actions/runs/8226582215, we are considering more CI machines to facilitate the process.

@Qubitium
Copy link
Contributor Author

@yzh119 I am working on a PR to cut the compile time by quite a bit plus fix some other compile issues I have encountered. Will post it when ready. Flashinfer will bring even my 48 core zen3 2x9334 to its knees. I am not cuda guru, but compile is something I can help with.

@yzh119
Copy link
Collaborator

yzh119 commented Mar 11, 2024

That sounds great, thank you!

@Qubitium
Copy link
Contributor Author

@yzh119 PR created. #171.

@yzh119
Copy link
Collaborator

yzh119 commented Mar 11, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants