Skip to content

Commit

Permalink
Update to Unified ROCm 6.2 base image (#155)
Browse files Browse the repository at this point in the history
* optimizations for process output step

* Llama3.1 (#129)

* Add support for a rope extension method (vllm-project#6553)

* [BugFix] Fix RoPE error in Llama 3.1 (vllm-project#6693)

---------

Co-authored-by: Simon Mo <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>

* Update hipblaslt and FA revs to match what was used for MLPerf

* Switch to "unified docker" with a ROCm 6.2 base image

This base image includes current libraries, so there is no need for
us to rebuild hipblaslt, RCCL, and Flash Attention.

---------

Co-authored-by: Shomy <[email protected]>
Co-authored-by: Gregory Shtrasberg <[email protected]>
Co-authored-by: Simon Mo <[email protected]>
Co-authored-by: Woosuk Kwon <[email protected]>
  • Loading branch information
5 people authored Aug 27, 2024
1 parent 0c7a2b6 commit 4ff722a
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions Dockerfile.rocm
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
# default base image
ARG BASE_IMAGE="rocm/pytorch:rocm6.1.2_ubuntu20.04_py3.9_pytorch_staging"
ARG BASE_IMAGE="rocm/pytorch-private:20240819_exec_dashboard_unified_rc3_added_triton_fa_vllm"

ARG COMMON_WORKDIR=/app

# The following ARGs should be "0" or "1". If "1", the respective component will be built and installed on top of the base image
ARG BUILD_HIPBLASLT="1"
ARG BUILD_RCCL="1"
ARG BUILD_FA="1"
ARG BUILD_HIPBLASLT="0"
ARG BUILD_RCCL="0"
ARG BUILD_FA="0"
ARG BUILD_CUPY="0"
ARG BUILD_TRITON="1"
# This ARG should also be "0" or "1". If "1", the vLLM development directory is obtained via git clone.
Expand All @@ -26,7 +26,7 @@ ARG PYTORCH_ROCM_ARCH="gfx90a;gfx942"
ENV PYTORCH_ROCM_ARCH=${PYTORCH_ROCM_ARCH}

# Install some basic utilities
RUN apt-get update && apt-get install python3 python3-pip -
RUN apt-get update && apt-get install -y python3 python3-pip -
RUN apt-get update && apt-get install -y \
sqlite3 libsqlite3-dev libfmt-dev libmsgpack-dev libsuitesparse-dev

Expand Down

0 comments on commit 4ff722a

Please sign in to comment.