Code

Phi3 support compresskv#11733

Code

Merged

cyita merged 19 commits intointel-analytics:mainintel-analytics/ipex-llm:mainfrom cyita:phi3-compresskvcyita/BigDL:phi3-compresskvCopy head branch name to clipboardAug 9, 2024

+146-82

Commits

Commits on Aug 7, 2024

• phi3 support compresskv

  cyita

  committed
  6f96028

• Merge remote-tracking branch 'upstream/main' into phi3-compresskv

  cyita

  committed
  2b8b2a4

• fix phi3 mtl error

  cyita

  committed
  210f575

• fix conflict with quant kv

  cyita

  committed
  2ab2ab6

• fix abnormal on mtl

  cyita

  committed
  8a1aef8

• fix style

  cyita

  committed
  2f072b8

Commits on Aug 8, 2024

• use slide windows size to compress kv

  cyita

  committed
  964ca58

• support sliding window

  cyita

  committed
  a121ff5

• fix style

  cyita

  committed
  2dbe245

• fix style

  cyita

  committed
  91007e0

• temp: partial support quant kv

  cyita

  committed
  397ffe5

• support quant kv with compress kv, todo: model check

  cyita

  committed
  a0fbd25

• temp

  cyita

  committed
  c6c3fd5

Commits on Aug 9, 2024

• Merge remote-tracking branch 'upstream/main' into phi3-compresskv

  cyita

  committed
  a687670

• fix style

  cyita

  committed
  e9d5817

• fix style

  cyita

  committed
  18a1f95

• remove prepare

  cyita

  committed
  f5594d2

• address comment

  cyita

  committed
  11a920e

• default -> 1.8k

  cyita

  committed
  31af88a