Skip to content

[ Misc ] Enable Quantizing All Layers of DeekSeekv2#6423

Merged
robertgshaw2-neuralmagic merged 2 commits intovllm-project:mainfrom neuralmagic:fix-deepseek-fp8Jul 14, 2024