[Benchmark] Change mii to use persistent deployment and support tensor parallel#3628

Merged

simon-mo merged 2 commits intovllm-project:mainfrom efeslab:offline_throughput_fix

Mar 29, 2024

+5-3

Commits on Mar 26, 2024