Code

Feature add lora support for Qwen2#3177

Code

Merged

simon-mo merged 6 commits intovllm-project:mainvllm-project/vllm:mainfrom whyiug:feature_add_lora_support_for_qwenwhyiug/vllm:feature_add_lora_support_for_qwenCopy head branch name to clipboardMar 8, 2024

+26

Commits

Commits on Mar 4, 2024

• Update Qwen2Model and Qwen2ForCausalLM classes

  whyiug

  committed
  c281f95

• Add new narrow value in bgmv_kernel function and remove unused code in Qwen2Model class

  whyiug

  committed
  55a3cc1

• Add import statement for KVCache

  whyiug

  committed
  5f9ca94

Commits on Mar 5, 2024

• Add LoRAConfig support to QWenLMHeadModel

  whyiug

  committed
  53f2bc9

Commits on Mar 6, 2024

• Add support for new narrow value in bgmv_kernel for Qwen1.5-0.5B

  whyiug

  committed
  be749fe

Commits on Mar 7, 2024

• Refactor QWenLMHeadModel class in qwen.py

  whyiug

  committed
  23234cd