Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ci] Add grouped tests & mark tests to run by default for fastcheck pipeline #6365

Merged
merged 21 commits into from
Jul 12, 2024
29 changes: 29 additions & 0 deletions .buildkite/test-pipeline.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,33 @@


steps:
- label: Async Engine, Inputs, Utils, Worker Test
fast_check: true
fast_check_only: true
commands:
- pytest -v -s async_engine # Async Engine
- bash ../.buildkite/download-images.sh # Inputs
- pytest -v -s test_inputs.py
- pytest -v -s multimodal
- pytest -v -s test_utils.py # Utils
- pytest -v -s worker # Worker

- label: Tensorizer, Metrics, Tracing Test
fast_check: true
fast_check_only: true
commands:
- apt-get install curl libsodium23 && pytest -v -s tensorizer_loader # Tensorizer
- pytest -v -s metrics # Metrics
- "pip install \
opentelemetry-sdk \
opentelemetry-api \
opentelemetry-exporter-otlp \
opentelemetry-semantic-conventions-ai" # Tracings
- pytest -v -s tracing

- label: Regression Test
mirror_hardwares: [amd]
fast_check: true
command: pytest -v -s test_regression.py
working_dir: "/vllm-workspace/tests" # optional

Expand All @@ -18,6 +43,7 @@ steps:

- label: Basic Correctness Test
mirror_hardwares: [amd]
fast_check: true
commands:
- pip install https://github.com/flashinfer-ai/flashinfer/releases/download/v0.0.8/flashinfer-0.0.8+cu121torch2.3-cp310-cp310-linux_x86_64.whl
- VLLM_ATTENTION_BACKEND=XFORMERS pytest -v -s basic_correctness/test_basic_correctness.py
Expand All @@ -29,6 +55,7 @@ steps:

- label: Core Test
mirror_hardwares: [amd]
fast_check: true
commands:
- pytest -v -s core
- pytest -v -s distributed/test_parallel_state.py
Expand Down Expand Up @@ -95,6 +122,7 @@ steps:
- pytest -v -s tokenization

- label: Entrypoints Test
fast_check: true
mirror_hardwares: [amd]

commands:
Expand Down Expand Up @@ -229,6 +257,7 @@ steps:
- label: Documentation Build
working_dir: "/vllm-workspace/test_docs/docs"
no_gpu: True
fast_check: true
commands:
- pip install -r requirements-docs.txt
- SPHINXOPTS=\"-W\" make html
Expand Down
Loading