v3.0.0-beta.5

3.0.0-beta.5 (2024-01-24)

Bug Fixes

• build Metal by default for Apple silicone devices (#150) (187627e)

Features

• minor: add more flags to the chat command (#149) (cab617a)

---

Shipped with llama.cpp release b1961

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.4

3.0.0-beta.4 (2024-01-21)

Features

• minor: add --printTimings option to the chat CLI command (#138) (c0f5bd8)

---

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v3.0.0-beta.3

3.0.0-beta.3 (2024-01-21)

Features

• get embedding for text (#144) (4cf1fba)

---

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest. (learn more)

v2.8.5

2.8.5 (2024-01-21)

Features

• minor: add --printTimings option to the chat CLI command (#138) (c0f5bd8)

v3.0.0-beta.2

3.0.0-beta.2 (2024-01-20)

Bug Fixes

• adapt to breaking changes of llama.cpp (#117) (595a6bc)
• threads parameter (#139) (5fcdf9b)
• disable Metal for x64 arch by default (#139) (5fcdf9b)

Features

• function calling (#139) (5fcdf9b)
• chat syntax aware context shifting (#139) (5fcdf9b)
• stateless LlamaChat (#139) (5fcdf9b)
• improve chat wrapper (#139) (5fcdf9b)
• LlamaText util (#139) (5fcdf9b)
• show llama.cpp release in GitHub releases (#142) (36c779d)

---

Shipped with llama.cpp release b1892

To use the latest llama.cpp release available, run npx --no node-llama-cpp download --release latest (learn more)

v2.8.4

2.8.4 (2024-01-20)

v2.8.3

2.8.3 (2023-12-18)

Bug Fixes

• optional typescript peer dependency (#127) (ba975e9)

v2.8.2

2.8.2 (2023-12-09)

Bug Fixes

• adapt to breaking changes of llama.cpp (#117) (595a6bc)

v2.8.1

2.8.1 (2023-12-06)

v3.0.0-beta.1

3.0.0-beta.1 (2023-11-26)

Features

• automatic batching (#104) (4757af8)

BREAKING CHANGES

• completely new API (docs will be updated before a stable version is released)