Update comment (vllm-project#2934)

xjpang · Feb 22, 2024 · d7f3964 · d7f3964
1 parent 8fbd84b
commit d7f3964
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/benchmarks/benchmark_serving.py b/benchmarks/benchmark_serving.py
@@ -7,7 +7,7 @@
         --disable-log-requests
 
     (TGI backend)
-    ./launch_hf_server.sh <your_model>
+    ./launch_tgi_server.sh <your_model> <max_batch_total_tokens>
 
 On the client side, run:
     python benchmarks/benchmark_serving.py \