Add distributed model executor abstraction#3191
Merged
zhuohan123 merged 19 commits intomainfrom add-executor-abstractionMar 11, 2024
+818-509
Commits
Commits on Mar 5, 2024
- committed
- committed
- committed
Commits on Mar 6, 2024
Commits on Mar 9, 2024
- committed
Commits on Mar 10, 2024
- committed
- committed
- committed
- committed
- committed
- committed
Merge branch 'add-executor-abstraction' of https://github.com/vllm-project/vllm into add-executor-abstraction
committed- committed