Highlights
- Pro
Pinned Loading
-
-
NVIDIA/TensorRT-LLM
NVIDIA/TensorRT-LLM PublicTensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…
-
NVIDIA/FasterTransformer
NVIDIA/FasterTransformer PublicTransformer related optimization, including BERT, GPT
-
codefuse-ai/FasterTransformer4CodeFuse
codefuse-ai/FasterTransformer4CodeFuse Public archiveHigh-performance LLM inference based on our optimized version of FastTransfomer
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.