mlc-ai

All

27 repositories

mlc-llm
Public
Universal LLM Deployment Engine with ML Compilation
language-model tvm llm machine-learning-compilation
Python
•
Apache License 2.0
•1.6k•20k•215•9•Updated Jan 4, 2025Jan 4, 2025
mlc-ai.github.io
Public
HTML
•3•6•0•0•Updated Jan 3, 2025Jan 3, 2025
mlc-python
Public
C++
•
Apache License 2.0
•5•21•0•0•Updated Jan 1, 2025Jan 1, 2025
relax
Public
Python
•
Apache License 2.0
•77•153•12•0•Updated Dec 29, 2024Dec 29, 2024
xgrammar
Public
Efficient, Flexible and Portable Structured Generation
large-language-models structured-generation
C++
•
Apache License 2.0
•30•540•12•0•Updated Dec 25, 2024Dec 25, 2024
web-llm
Public
High-performance In-browser LLM Inference Engine
deep-learning language-model webgpu tvm webml llm chatgpt
TypeScript
•
Apache License 2.0
•916•14k•75•2•Updated Dec 23, 2024Dec 23, 2024
package
Public
Shell
•
Apache License 2.0
•14•12•2•0•Updated Dec 16, 2024Dec 16, 2024
web-llm-chat
Public
Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
chat privacy ai nextjs chatbot llama hermes chat-application gemma webgpu
TypeScript
•
Apache License 2.0
•73•548•5•6•Updated Dec 10, 2024Dec 10, 2024
web-llm-assistant
Public
AI Assistant running within your browser.
chrome-extension agent machine-learning foundation-models large-language-models
TypeScript
•
Apache License 2.0
•8•53•3•0•Updated Dec 3, 2024Dec 3, 2024
web-agent-interface
Public
An interface for AI Agents to interact with various web platforms.
TypeScript
•2•14•1•0•Updated Dec 3, 2024Dec 3, 2024
blog
Public
HTML
•2•4•0•0•Updated Nov 26, 2024Nov 26, 2024
notebooks
Public
Jupyter Notebook
•
Apache License 2.0
•65•198•10•0•Updated Nov 22, 2024Nov 22, 2024
tokenizers-cpp
Public
Universal cross-platform tokenizers binding to HF and sentencepiece
C++
•
Apache License 2.0
•66•289•9•2•Updated Nov 15, 2024Nov 15, 2024
binary-mlc-llm-libs
Public
48•215•21•0•Updated Nov 4, 2024Nov 4, 2024
mlc-en
Public
Python
•
Apache License 2.0
•43•390•0•1•Updated Oct 16, 2024Oct 16, 2024
webllm-playground
Public
Run LLMs in the Browser with MLC / WebLLM ✨
TypeScript
•18•8•0•0•Updated Oct 5, 2024Oct 5, 2024
docs
Public
The documents for TVM Unity
Shell
•
Apache License 2.0
•2•11•0•2•Updated Aug 9, 2024Aug 9, 2024
mlc-zh
Public
Python
•
Apache License 2.0
•66•596•3•1•Updated Jun 4, 2024Jun 4, 2024
jekyll-theme-mlc
Public
SCSS
•
Apache License 2.0
•1•0•0•0•Updated May 27, 2024May 27, 2024
llm-perf-bench
Public
Python
•
Apache License 2.0
•13•116•3•2•Updated Apr 22, 2024Apr 22, 2024
web-data
Public
supporting data for web
Apache License 2.0
•5•2•0•0•Updated Apr 16, 2024Apr 16, 2024
web-stable-diffusion
Public
Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.
deep-learning web-assembly webgpu tvm webml stable-diffusion
Jupyter Notebook
•
Apache License 2.0
•228•3.6k•35•2•Updated Mar 12, 2024Mar 12, 2024
env
Public
repo for docker related builds
Shell
•
Apache License 2.0
•0•3•0•0•Updated Jan 21, 2024Jan 21, 2024
text-generation-webui
Public
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Python
•
GNU Affero General Public License v3.0
•5.4k•3•0•0•Updated Nov 16, 2023Nov 16, 2023
dlight-bench
Public
Python
•
Apache License 2.0
•4•3•0•1•Updated Nov 6, 2023Nov 6, 2023
auditwheel
Public
Auditing and relabeling cross-distribution Linux wheels.
Python
•
Other
•149•0•0•0•Updated Jun 14, 2023Jun 14, 2023
mlc-training
Public
Relax Training APIs Tutorial and Examples
Jupyter Notebook
•3•6•0•0•Updated Apr 17, 2023Apr 17, 2023