[Installation]: Stuck for two hours during the installation of vllm

[loxs123]

Stuck for two hours during the installation of vllm(pip install vllm), Does anyone know the reason and how to solve it

How you are installing vllm

pip install vllm

[youkaichao]

you need internet access to google cloud storage. check https://github.com/vllm-project/vllm-nccl for details.

[GallonDeng]

@youkaichao is there a way to offline download, and where to put it?

[GallonDeng]

put the file libnccl.so.2.18.1 in ~/.config/vllm/nccl/cu12 and install the vllm successfully

[youkaichao]

Sorry for the trouble. This might be not necessary when NVIDIA/nccl#1234 is resolved. But we have to wait ...

[Ricardokevins]

i encounter the similar issue...

[Kaka23333]

same issue. already have libnccl.so.2.18.1 in ~/.config/vllm/nccl/cu12 but still stucking.

[ZiruiYan]

same issue.

[youkaichao]

which version do you install and how do you install vllm?