Skip to content

[Continious Batching] Speculative decoding based on paged attention#608

Closed
iefode wants to merge 5 commits intoopenvinotoolkit:masterfrom iefode:speculative_decoding
+1,209-73

Commits