[Bugfix] Fix weight loading issue by rename variable. (vllm-project#8293

) Signed-off-by: Alvant <[email protected]>
compressa-ai · Oct 26, 2024 · f06e1b2 · f06e1b2
1 parent c4a0d45
commit f06e1b2
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/vllm/model_executor/models/phimoe.py b/vllm/model_executor/models/phimoe.py
@@ -600,7 +600,7 @@ def load_weights(self, weights: Iterable[Tuple[str, torch.Tensor]]):
                     weight_loader(
                         param,
                         loaded_weight,
-                        weight_name,
+                        name,
                         shard_id=shard_id,
                         expert_id=expert_id,
                     )