InfMoE is currently not stable and under active development. See Harry-Chen/InfMoE for source code & usage.
The code will be available here once officially released.
-
Notifications
You must be signed in to change notification settings - Fork 0
Inference framework for MoE layers based on TensorRT with Python binding
TsinghuaAI/InfMoE
About
Inference framework for MoE layers based on TensorRT with Python binding
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published