Code

Merge dev branch#6421

Code

Merged

oobabooga merged 47 commits intomainoobabooga/text-generation-webui:mainfrom devoobabooga/text-generation-webui:devCopy head branch name to clipboardOct 1, 2024

+467-307

Commits

Commits on Aug 21, 2024

• update API documentation with examples to list/load models (#5902)

  joachimchauvet

  authored
  c24966c

  Copy full SHA for c24966c

Commits on Aug 22, 2024

• Bump ExLlamaV2 to 0.1.9

  oobabooga

  committed
  1f288b4

  Copy full SHA for 1f288b4

Commits on Sep 3, 2024

• Training pro update script.py (#6359)

  FartyPants

  authored
  41a8eb4

  Copy full SHA for 41a8eb4

• Fix UnicodeDecodeError for BPE-based Models (especially GLM-4) (#6357)

  GralchemOz

  authored
  4c74c7a

  Copy full SHA for 4c74c7a

• API: Relax multimodal format, fixes HuggingFace Chat UI (#6353)

  Papierkorb

  authored
  9a150c3

  Copy full SHA for 9a150c3

• Bump ExLlamaV2 to 0.2.0

  oobabooga

  committed
  d1168af

  Copy full SHA for d1168af

• Merge remote-tracking branch 'refs/remotes/origin/dev' into dev

  oobabooga

  committed
  68d52c6

  Copy full SHA for 68d52c6

• Bump flash-attention to 2.6.3

  oobabooga

  committed
  64919e0

  Copy full SHA for 64919e0

• Bump llama-cpp-python to 0.2.90

  oobabooga

  committed
  2cb8d4c

  Copy full SHA for 2cb8d4c

Commits on Sep 4, 2024

• llama.cpp: prevent prompt evaluation progress bar with just 1 step

  oobabooga

  committed
  c5b40eb

  Copy full SHA for c5b40eb

• Don't import PEFT unless necessary

  oobabooga

  committed
  bba5b36

  Copy full SHA for bba5b36

Commits on Sep 6, 2024

• typo in OpenAI response format (#6365)

  jsboige

  authored
  4924ee2

  Copy full SHA for 4924ee2

Commits on Sep 7, 2024

• Pin fastapi/pydantic requirement versions

  oobabooga

  committed
  27797a9

  Copy full SHA for 27797a9

• Merge remote-tracking branch 'refs/remotes/origin/dev' into dev

  oobabooga

  committed
  e86ab37

  Copy full SHA for e86ab37

• Apply the change to all requirements (oops)

  oobabooga

  committed
  a50477e

  Copy full SHA for a50477e

Commits on Sep 26, 2024

• Bump transformers to 4.45

  oobabooga

  committed
  c497a32

  Copy full SHA for c497a32

Commits on Sep 27, 2024

• Fix the sampling monkey patch (and add more options to sampler_priority) (#6411)

  oobabooga

  authored
  7424f78

  Copy full SHA for 7424f78

• Bump ExLlamaV2 to 0.2.2

  oobabooga

  committed
  c5f048e

  Copy full SHA for c5f048e

• Bump llama-cpp-python to 0.3.0 (except for AMD)

  oobabooga

  committed
  78b8705

  Copy full SHA for 78b8705

• Make it possible to sort DRY

  oobabooga

  committed
  5c918c5

  Copy full SHA for 5c918c5

• Force /bin/bash shell for conda (#6386)

  Thireus

  authored
  626b0a0

  Copy full SHA for 626b0a0

• Bump bitsandbytes to 0.44

  oobabooga

  committed
  3492e33

  Copy full SHA for 3492e33

Commits on Sep 28, 2024

• Exclude Top Choices (XTC): A sampler that boosts creativity, breaks writing clichés, and inhibits non-verbatim repetition (#6335)

  p-e-w

  authored
  3013758

  Copy full SHA for 3013758

• ExllamaV2 tensor parallelism to increase multi gpu inference speeds (#6356)

  RandomInternetPreson

  authored
  46996f6

  Copy full SHA for 46996f6

• Fix a typo

  oobabooga

  committed
  7276dca

  Copy full SHA for 7276dca

• Bump rocm to 6.1.2

  oobabooga

  committed
  ca5a2db

  Copy full SHA for ca5a2db

• Bump pytorch to 2.4.1

  oobabooga

  committed
  85994e3

  Copy full SHA for 85994e3

Commits on Sep 29, 2024

• Remove AutoAWQ and AutoGPTQ from requirements (no wheels available)

  oobabooga

  committed
  1a870b3

  Copy full SHA for 1a870b3

• Update README

  oobabooga

  committed
  65e5864

  Copy full SHA for 65e5864

• Add warnings for when AutoGPTQ, TensorRT-LLM, or HQQ are missing

  oobabooga

  committed
  b92d7fd

  Copy full SHA for b92d7fd

• Simplify the warning when flash-attn fails to import

  oobabooga

  committed
  c61b29b

  Copy full SHA for c61b29b

• Remove HQQ and AQLM from requirements

  oobabooga

  committed
  3b99532

  Copy full SHA for 3b99532

• Update README

  oobabooga

  committed
  3fb02f4

  Copy full SHA for 3fb02f4

• Update README

  oobabooga

  committed
  3f0571b

  Copy full SHA for 3f0571b

• Update README

  oobabooga

  committed
  57160cd

  Copy full SHA for 57160cd

• Fix after #6386 (thanks @Touch-Night)

  oobabooga

  committed
  055f3f5

  Copy full SHA for 055f3f5

• Do not set value for histories in chat when --multi-user is used (#6317)

  mashb1t

  authored
  0f90a1b

  Copy full SHA for 0f90a1b

• Add beforeunload event to add confirmation dialog when leaving page (#6279)

  leszekhanusz

  authored
  e4b0467

  Copy full SHA for e4b0467

• Bump exllamav2 to 0.2.4

  oobabooga

  committed
  0136268

  Copy full SHA for 0136268

Commits on Sep 30, 2024

• Make sampler priority high if unspecified

  oobabooga

  committed
  bbdeed3

  Copy full SHA for bbdeed3

• Bump llama-cpp-python to 0.3.1

  oobabooga

  committed
  9ca0cd7

  Copy full SHA for 9ca0cd7

• Update llama_cpp_python_hijack.py, fix llamacpp_hf

  oobabooga

  committed
  4d9ce58

  Copy full SHA for 4d9ce58

• Update accelerate requirement from ==0.33.* to ==0.34.* (#6416)

  dependabot[bot]

  authored
  6063a66

  Copy full SHA for 6063a66

Commits on Oct 1, 2024

• Revert "Update accelerate requirement from ==0.33.* to ==0.34.* (#6416)"

  Show description for 617cd7b
  oobabooga

  committed
  617cd7b

  Copy full SHA for 617cd7b

• Merge branch 'main' into dev

  oobabooga

  authored
  7cb9835

  Copy full SHA for 7cb9835

• Lint

  oobabooga

  committed
  c6b50f8

  Copy full SHA for c6b50f8

• Lint

  oobabooga

  committed
  cca9d6e

  Copy full SHA for cca9d6e