[ Bugfix ] Enabling Loading Models With Fused QKV/MLP on Disk with FP8#5921

Merged

robertgshaw2-redhat merged 4 commits intovllm-project:mainfrom neuralmagic:fp8-phi

Jun 28, 2024

+32-23

Commits on Jun 27, 2024

enable loading fp8 phi
Robert Shaw
committed
formatted
Robert Shaw
committed
address mgoin comment
Robert Shaw
committed

Commits on Jun 28, 2024

Merge branch 'main' into fp8-phi
Robert Shaw
committed