Fix assertion failure in Qwen 1.5 with prefix caching enabled#3373

Merged

simon-mo merged 7 commits intovllm-project:mainfrom chenxu2048:qwen_1_5_sliding_window

Mar 14, 2024

+55-2

Commits on Mar 13, 2024

fix: Qwen1.5 with prefix cache
chenxu2048
committed