Skip to content

Commit

Permalink
[Bugfix] fix docker build for xpu (vllm-project#8652)
Browse files Browse the repository at this point in the history
Signed-off-by: Sumit Dubey <[email protected]>
  • Loading branch information
yma11 authored and sumitd2 committed Nov 14, 2024
1 parent bbe3bd0 commit f0c4420
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 14 deletions.
10 changes: 1 addition & 9 deletions Dockerfile.xpu
Original file line number Diff line number Diff line change
Expand Up @@ -10,19 +10,11 @@ RUN wget -O- https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRO
RUN apt-get update -y \
&& apt-get install -y curl libicu70 lsb-release git wget vim numactl python3 python3-pip ffmpeg libsm6 libxext6 libgl1

RUN git clone https://github.com/intel/pti-gpu && \
cd pti-gpu/sdk && \
mkdir build && \
cd build && \
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_TOOLCHAIN_FILE=../cmake/toolchains/icpx_toolchain.cmake -DBUILD_TESTING=OFF .. && \
make -j && \
cmake --install . --config Release --prefix "/usr/local"

COPY ./ /workspace/vllm

WORKDIR /workspace/vllm

RUN pip install -v -r requirements-xpu.txt
RUN pip install -v -r requirements-xpu.txt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

RUN VLLM_TARGET_DEVICE=xpu python3 setup.py install

Expand Down
6 changes: 3 additions & 3 deletions docs/source/getting_started/xpu-installation.rst
Original file line number Diff line number Diff line change
Expand Up @@ -17,8 +17,8 @@ Requirements
------------

* OS: Linux
* Supported Hardware: Intel Data Center GPU (Intel ARC GPU WIP)
* OneAPI requirements: oneAPI 2024.1
* Supported Hardware: Intel Data Center GPU, Intel ARC GPU
* OneAPI requirements: oneAPI 2024.2

.. _xpu_backend_quick_start_dockerfile:

Expand All @@ -40,7 +40,7 @@ Quick start using Dockerfile
Build from source
-----------------

- First, install required driver and intel OneAPI 2024.1 or later.
- First, install required driver and intel OneAPI 2024.2 or later.

- Second, install Python packages for vLLM XPU backend building:

Expand Down
4 changes: 2 additions & 2 deletions requirements-xpu.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@

setuptools < 70.0.0 # IPEX's torch have some dependency. to be removed.

ray >= 2.9
# Following pkgs retrieved from https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
torch == 2.3.1+cxx11.abi
intel-extension-for-pytorch == 2.3.110+xpu
oneccl_bind_pt == 2.3.100+xpu

triton-xpu == 3.0.0b2

--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/

0 comments on commit f0c4420

Please sign in to comment.