Skip to content

Commit

Permalink
fix TORCH_CUDA_ARCH_LIST
Browse files Browse the repository at this point in the history
  • Loading branch information
youkaichao committed Apr 2, 2024
1 parent 0739b19 commit 07c5071
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion .github/workflows/scripts/build.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ $python_executable -m pip install -r requirements.txt
export MAX_JOBS=1
# Make sure punica is built for the release (for LoRA)
export VLLM_INSTALL_PUNICA_KERNELS=1

# Make sure release wheels are built for the following architectures
export TORCH_CUDA_ARCH_LIST="7.0 7.5 8.0 8.6 8.9 9.0+PTX"
# Build
$python_executable setup.py bdist_wheel --dist-dir=dist

0 comments on commit 07c5071

Please sign in to comment.