Popular repositories Loading

1. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++ 1

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

3. ray ray Public

   Forked from ray-project/ray

   Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python 1

4. tock tock Public

   Forked from theopenconversationkit/tock

   Tock, the open source conversational AI toolkit.

   Kotlin 1

5. autogen autogen Public

   Forked from microsoft/autogen

   A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

   Jupyter Notebook 1

6. lmdeploy lmdeploy Public

   Forked from InternLM/lmdeploy

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 1