fp8 moe configs. Mixtral-8x(7B,22B) TP=1,2,4,8 (#250) #739

Sign in to view logs

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
mypy (3.8)	32s
mypy (3.9)	46s
mypy (3.10)	31s
mypy (3.11)	29s
mypy (3.12)	33s
	2m 51s