[Bug]: v0.4.2
python3.8 TypeError: 'type' object is not subscriptable
(python3.9 syntax)
#4617
Labels
bug
Something isn't working
Your current environment
🐛 Describe the bug
python -m vllm.entrypoints.openai.api_server --model microsoft/Phi-3-mini-4k-instruct --dtype auto --max-model-len 2000
Error
Used python3.10 syntax
The text was updated successfully, but these errors were encountered: