Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commit

Permalink
fix if
Browse files Browse the repository at this point in the history
  • Loading branch information
@derekk-nm
derekk-nm committed Jul 9, 2024
1 parent ef34d58 commit 9e5ffa9
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/nm-upload-assets-to-gcp.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ jobs:
# want to push RELEASE assets to the external pypi.org
# publish the wheel file
- name: push wheel to pypi.org
if: ${{ inputs.wf_category == "RELEASE" }}
if: ${{ inputs.wf_category == 'RELEASE' }}
uses: neuralmagic/nm-actions/actions/publish_whl/[email protected]
with:
username: ${{ secrets.PYPI_PUBLIC_USER }}
Expand All @@ -97,7 +97,7 @@ jobs:

# publish the tar.gz file
- name: push tar.gz to pypi.org
if: ${{ inputs.wf_category == "RELEASE" }}
if: ${{ inputs.wf_category == 'RELEASE' }}
uses: neuralmagic/nm-actions/actions/publish_whl/[email protected]
with:
username: ${{ secrets.PYPI_PUBLIC_USER }}
Expand Down

1 comment on commit 9e5ffa9

@github-actions
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

smaller_is_better

Benchmark suite Current: 9e5ffa9 Previous: 537957c Ratio
{"name": "mean_ttft_ms", "description": "VLLM Serving - Dense\nmodel - meta-llama/Meta-Llama-3-8B-Instruct\nmax-model-len - 4096\nsparsity - None\nbenchmark_serving {\n \"nr-qps-pair_\": \"300,1\",\n \"dataset\": \"sharegpt\"\n}", "gpu_description": "NVIDIA L4 x 1", "vllm_version": "0.5.1", "python_version": "3.10.12 (main, Jun 7 2023, 13:43:11) [GCC 11.3.0]", "torch_version": "2.3.0+cu121"} 187.75822579997717 ms 186.92139306662284 ms 1.00
{"name": "mean_tpot_ms", "description": "VLLM Serving - Dense\nmodel - meta-llama/Meta-Llama-3-8B-Instruct\nmax-model-len - 4096\nsparsity - None\nbenchmark_serving {\n \"nr-qps-pair_\": \"300,1\",\n \"dataset\": \"sharegpt\"\n}", "gpu_description": "NVIDIA L4 x 1", "vllm_version": "0.5.1", "python_version": "3.10.12 (main, Jun 7 2023, 13:43:11) [GCC 11.3.0]", "torch_version": "2.3.0+cu121"} 84.31205957314259 ms 83.59149550139291 ms 1.01
{"name": "mean_ttft_ms", "description": "VLLM Serving - Dense\nmodel - facebook/opt-350m\nmax-model-len - 2048\nsparsity - None\nbenchmark_serving {\n \"nr-qps-pair_\": \"300,1\",\n \"dataset\": \"sharegpt\"\n}", "gpu_description": "NVIDIA L4 x 1", "vllm_version": "0.5.1", "python_version": "3.10.12 (main, Jun 7 2023, 13:43:11) [GCC 11.3.0]", "torch_version": "2.3.0+cu121"} 25.003556546616892 ms 23.563603496677388 ms 1.06
{"name": "mean_tpot_ms", "description": "VLLM Serving - Dense\nmodel - facebook/opt-350m\nmax-model-len - 2048\nsparsity - None\nbenchmark_serving {\n \"nr-qps-pair_\": \"300,1\",\n \"dataset\": \"sharegpt\"\n}", "gpu_description": "NVIDIA L4 x 1", "vllm_version": "0.5.1", "python_version": "3.10.12 (main, Jun 7 2023, 13:43:11) [GCC 11.3.0]", "torch_version": "2.3.0+cu121"} 6.166333641928236 ms 5.977048247888172 ms 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.