[Feature] [Spec decode]: Combine chunked prefill with speculative decoding#9291
Merged
njhill merged 13 commits intovllm-project:mainfrom NickLucche:chunk-spec-decoding-rebaseNov 7, 2024
+477-147
Commits
Commits on Oct 31, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Nov 4, 2024
Commits on Nov 5, 2024
- committed