Skip to content

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding#9291

Merged
njhill merged 13 commits intovllm-project:mainfrom NickLucche:chunk-spec-decoding-rebaseNov 7, 2024

Commits

Commits on Oct 31, 2024

Commits on Nov 4, 2024

Commits on Nov 5, 2024

Commits on Nov 7, 2024