Code

deepspeed zero3 QLoRA finetuning#11625

Code

Merged

Uxito-Ada merged 30 commits intointel-analytics:mainintel-analytics/ipex-llm:mainfrom Uxito-Ada:heyang_24_7_19Uxito-Ada/BigDL:heyang_24_7_19Copy head branch name to clipboardAug 13, 2024

+119-14

Commits

Commits on Jul 19, 2024

• deepspeed zero3 QLoRA finetuning

  Uxito-Ada

  committed
  526aa20

Commits on Jul 21, 2024

• Update convert.py

  Uxito-Ada

  authored
  ce04901

• Update low_bit_linear.py

  Uxito-Ada

  authored
  e8c083a

• Update utils.py

  Uxito-Ada

  authored
  baec9e9

• Update qlora_finetune_llama2_13b_arch_2_card.sh

  Uxito-Ada

  authored
  a329756

• Update low_bit_linear.py

  Uxito-Ada

  authored
  2f7ba16

• Update alpaca_qlora_finetuning.py

  Uxito-Ada

  authored
  65d5403

• Update low_bit_linear.py

  Uxito-Ada

  authored
  6bd5811

• Update utils.py

  Uxito-Ada

  authored
  876266a

• Update convert.py

  Uxito-Ada

  authored
  154a110

• Update alpaca_qlora_finetuning.py

  Uxito-Ada

  authored
  dc2bb4d

• Update alpaca_qlora_finetuning.py

  Uxito-Ada

  authored
  ccd53ee

• Update low_bit_linear.py

  Uxito-Ada

  authored
  8b3e9e4

• Update deepspeed_zero3.json

  Uxito-Ada

  authored
  1f53ba8

• Update qlora_finetune_llama2_13b_arch_2_card.sh

  Uxito-Ada

  authored
  3f4b35b

Commits on Jul 22, 2024

• Update low_bit_linear.py

  Uxito-Ada

  authored
  a69d038

Commits on Aug 2, 2024

• Update low_bit_linear.py

  Uxito-Ada

  authored
  dad4684

• Update utils.py

  Uxito-Ada

  authored
  6df300c

• Merge branch 'main' into heyang_24_7_19

  Uxito-Ada

  authored
  4d243ff

• fix style

  Uxito-Ada

  authored
  3f3d612

• fix style

  Uxito-Ada

  authored
  2ab7220

Commits on Aug 12, 2024

• Update alpaca_qlora_finetuning.py

  Uxito-Ada

  authored
  5118595

• Update qlora_finetune_llama2_13b_arch_2_card.sh

  Uxito-Ada

  authored
  13884f5

• Update convert.py

  Uxito-Ada

  authored
  486da9c

• Update low_bit_linear.py

  Uxito-Ada

  authored
  2d8550f

• Update model.py

  Uxito-Ada

  authored
  95c252b

• Update alpaca_qlora_finetuning.py

  Uxito-Ada

  authored
  369c369

Commits on Aug 13, 2024

• Update low_bit_linear.py

  Uxito-Ada

  authored
  ce99bca

• Update low_bit_linear.py

  Uxito-Ada

  authored
  17dbf80

• Update low_bit_linear.py

  Uxito-Ada

  authored
  1c8cd6c