Code

Add vllm awq loading logic#11987

Code

Merged

gc-fu merged 3 commits intointel-analytics:ipex-vllm-mainlineintel-analytics/ipex-llm:ipex-vllm-mainlinefrom ACupofAir:junwang/add_awq_loadingACupofAir/BigDL:junwang/add_awq_loadingCopy head branch name to clipboardSep 6, 2024

+132-2

Commits

Commits on Sep 2, 2024

• [ADD] Add vllm awq loading logic

  ACupofAir

  committed
  f016ec2

Commits on Sep 3, 2024

• [FIX] fix the module.linear_method path

  ACupofAir

  committed
  fc795ef

Commits on Sep 4, 2024

• [FIX] fix quant_config path error

  ACupofAir

  committed
  694672c