Skip to content

[ Misc ] Apply MoE Refactor to Qwen2 + Deepseekv2 To Support Fp8#6417

Merged
comaniac merged 23 commits intovllm-project:mainfrom neuralmagic:deepseek-fp8Jul 14, 2024

Commits

Commits on Jul 3, 2024

Commits on Jul 13, 2024