Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Bugfix] Eagle: change config name for fc bias
- Changes were made to load fc bias from config as part of this PR - vllm-project#8790 - `bias` param in config is also used to decide if attention has a bias or not in [LlamaDecoderLayer](https://github.com/vllm-project/vllm/blob/main/vllm/model_executor/models/llama.py#L215) - Due to the same param name, model is not loaded properly for cases which do not have attention in decoder layer but have a bias in eagle fc layer. - Have changed the param to `eagle_fc_bias` to avoid conflict.
- Loading branch information