[Performance] Enable chunked prefill and prefix caching together (#8120) · Hyper-Accel/vllm@bd852f2 · GitHub

Commit

[Performance] Enable chunked prefill and prefix caching together (vll…

Browse files

…m-project#8120)

Co-authored-by: Tao He <[email protected]>
Co-authored-by: Juelianqvq <[email protected]>

Loading branch information

3 people authored Sep 3, 2024

1 parent ec26653 commit bd852f2