Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 7 2

2. DeepSeek-LLM DeepSeek-LLM Public

   Forked from deepseek-ai/DeepSeek-LLM

   DeepSeek LLM: Let there be answers

   Makefile

3. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

4. AutoGPTQ AutoGPTQ Public

   Forked from AutoGPTQ/AutoGPTQ

   An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

   Python

5. AutoAWQ AutoAWQ Public

   Forked from casper-hansen/AutoAWQ

   AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

   Python

6. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python