Code

Support Adept Persimmon 8b#3410

Code

Merged

ggerganov merged 30 commits intoggerganov:masterggerganov/llama.cpp:masterfrom phillip-kravtsov:phillip-kravtsov/support-adept-persimmon-8bphillip-kravtsov/llama.cpp:phillip-kravtsov/support-adept-persimmon-8bCopy head branch name to clipboardOct 7, 2023

+854-76

Commits

Commits on Sep 21, 2023

• Produces garbage output

  phillip-kravtsov

  committed
  7cdc3ea

  Copy full SHA for 7cdc3ea

Commits on Sep 26, 2023

• wip: correct tensors up to RoPE

  phillip-kravtsov

  committed
  4bcf412

  Copy full SHA for 4bcf412

• correct tensors thru RoPE

  phillip-kravtsov

  committed
  c9e1446

  Copy full SHA for c9e1446

• Correct outputs through masked & softmax'd KQ

  phillip-kravtsov

  committed
  d1b40ef

  Copy full SHA for d1b40ef

• fp32 works

  phillip-kravtsov

  committed
  db2181a

  Copy full SHA for db2181a

Commits on Sep 28, 2023

• Rename adept->persimmon

  phillip-kravtsov

  committed
  3f31799

  Copy full SHA for 3f31799

• Merge branch 'master' of github.com:phillip-kravtsov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  720503b

  Copy full SHA for 720503b

Commits on Sep 29, 2023

• Produces correct outputs

  phillip-kravtsov

  committed
  d61eed0

  Copy full SHA for d61eed0

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  d0a7143

  Copy full SHA for d0a7143

• clean up convert scripts

  phillip-kravtsov

  committed
  fa92f6e

  Copy full SHA for fa92f6e

• remove printing logic from ggml.c

  phillip-kravtsov

  committed
  c28a6c5

  Copy full SHA for c28a6c5

• remove prints from llama.cpp & fix merge

  phillip-kravtsov

  committed
  47dcb9f

  Copy full SHA for 47dcb9f

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  7473773

  Copy full SHA for 7473773

• trivial cleanups

  phillip-kravtsov

  committed
  d904aff

  Copy full SHA for d904aff

• Add offload funcs

  phillip-kravtsov

  committed
  ec0ce97

  Copy full SHA for ec0ce97

• update conversion script to directly take adept artifacts rather than .saftensors file

  phillip-kravtsov

  committed
  3db04db

  Copy full SHA for 3db04db

• Fix norm eps bug

  phillip-kravtsov

  committed
  f28f52c

  Copy full SHA for f28f52c

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  d93cf1e

  Copy full SHA for d93cf1e

Commits on Sep 30, 2023

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  574a9e1

  Copy full SHA for 574a9e1

• Support sqr and concat on metal, persimmon-8b-q4 runs correctly

  phillip-kravtsov

  committed
  2b56591

  Copy full SHA for 2b56591

Commits on Oct 2, 2023

• Small changes from review

  phillip-kravtsov

  committed
  e6bf87f

  Copy full SHA for e6bf87f

• Formatting changes

  phillip-kravtsov

  committed
  cd4d3df

  Copy full SHA for cd4d3df

• Minor changes to conversion script

  phillip-kravtsov

  committed
  422b110

  Copy full SHA for 422b110

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  5a0990c

  Copy full SHA for 5a0990c

• Remove old script

  phillip-kravtsov

  committed
  7a279fe

  Copy full SHA for 7a279fe

Commits on Oct 3, 2023

• Fix editorconfig formatting

  phillip-kravtsov

  committed
  c90ed9f

  Copy full SHA for c90ed9f

Commits on Oct 5, 2023

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b. ggml-ci

  phillip-kravtsov

  committed
  5d259d3

  Copy full SHA for 5d259d3

• Fix build

  phillip-kravtsov

  committed
  1d518d6

  Copy full SHA for 1d518d6

Commits on Oct 6, 2023

• Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-kravtsov/support-adept-persimmon-8b

  phillip-kravtsov

  committed
  0c1a8f6

  Copy full SHA for 0c1a8f6

• add overlooked offload code ggml-ci

  phillip-kravtsov

  committed
  485a471

  Copy full SHA for 485a471