Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Efficient few-shot learning with Sentence Transformers

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

LLM(😽)

🔊 Text-Prompted Generative Audio Model

Classify and extract structured data with LLMs

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Library for clinical NLP with spaCy.

📋 A list of open LLMs available for commercial use.

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

CODER: Knowledge infused cross-lingual medical term embedding for term normalization. [JBI, ACL-BioNLP 2022]

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

SoTA LLM for converting natural language questions to SQL queries

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Minimalist ML framework for Rust

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

LLama.cpp rust bindings

Google's SoundStorm: Efficient Parallel Audio Generation

Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch

Implementation of SoundStorm built upon SpeechTokenizer.

Cross-Platform, GPU Accelerated Whisper 🏎️

Llama2 LLM ported to Rust burn