[Doc]Add asynchronous engine arguments to documentation. (vllm-projec…

…t#3810) Co-authored-by: Simon Mo <[email protected]> Co-authored-by: Roger Wang <[email protected]>
Temirulan · Apr 5, 2024 · 68c595a · 68c595a
1 parent 94ec8b0
commit 68c595a
Showing 1 changed file with 16 additions and 0 deletions.
diff --git a/docs/source/models/engine_args.rst b/docs/source/models/engine_args.rst
@@ -118,3 +118,19 @@ Below, you can find an explanation of every engine argument for vLLM:
 .. option:: --quantization (-q) {awq,squeezellm,None}
 
     Method used to quantize the weights.
+
+Async Engine Arguments
+----------------------
+Below are the additional arguments related to the asynchronous engine:
+
+.. option:: --engine-use-ray
+
+    Use Ray to start the LLM engine in a separate process as the server process.
+
+.. option:: --disable-log-requests
+
+    Disable logging requests.
+
+.. option:: --max-log-len
+
+    Max number of prompt characters or prompt ID numbers being printed in log. Defaults to unlimited.