Mixtral MoE support?
#126
Replies: 1 comment 2 replies
-
|
@stduhpf I've just released a new version with the latest |
Beta Was this translation helpful? Give feedback.
2 replies
-
|
The next beta version will also support it when it comes out |
Beta Was this translation helpful? Give feedback.
-
|
Works great, thanks! |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
As of today, Mixtral models run fine on "vanilla"
llama.cpp. Is there any plans for supporting this architecture on here too?Beta Was this translation helpful? Give feedback.
All reactions