Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

> **Bug**:Interesting finding: The official pip package v0.6.3 is broken. However, installing https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl fixes this issue. (vLLM API server version 0.6.3.post2.dev139+g622b7ab9) #9828

Closed
Wiselnn570 opened this issue Oct 30, 2024 · 3 comments

Comments

@Wiselnn570
Copy link

          > Interesting finding: The official pip package v0.6.3 is broken. However, installing `https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl` fixes this issue. (`vLLM API server version 0.6.3.post2.dev139+g622b7ab9`)

@SinanAkkoyun What does python 3.10.15 should install, seemly I meet the same issue, thanks a lot!!

Originally posted by @Wiselnn570 in #9732 (comment)

@Wiselnn570
Copy link
Author

When I run

pip install https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl

I get

...

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for xformers
  Running setup.py clean for xformers
Failed to build xformers
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (xformers)

@Wiselnn570 Wiselnn570 reopened this Oct 30, 2024
@SinanAkkoyun
Copy link

Hi, in what environment are you running?
I created a new env: conda create python=3.11 -n vllm
Then I simply ran pip install https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl
If you run into issues you could also try to first run pip install vllm and then the dev installation

@Wiselnn570
Copy link
Author

Hi, in what environment are you running? I created a new env: conda create python=3.11 -n vllm Then I simply ran pip install https://vllm-wheels.s3.us-west-2.amazonaws.com/nightly/vllm-1.0.0.dev-cp38-abi3-manylinux1_x86_64.whl If you run into issues you could also try to first run pip install vllm and then the dev installation

Thanks, have solved yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants