Why is A3 mega gke cluster bluepriny beta status?

[donggrame]

Is it because significantly slower than slurm blueprint?

We are considering to spin up A3 mega GKE for LLM training and would like to know what could go wrong before even start it due to high expanse.

[ighosh98]

Hi @donggrame
Thanks for reaching out. A3 mega GKE is GA and no longer in beta. We have a backlog task associated with updating the documentation for provisioning a GKE cluster with cluster-toolkit. Please consider filing a Google Support Case so that we can resolve your issue quicker.

[donggrame]

Thanks for reply @ighosh98.
I may have confused you, but what I meant was the reason why blueprint for GKE A3 Mega has experimental label but Slurm example does not, which I interpreted it as stable.

I was wondering if the reason behind experimental label includes slower performance than Slurm due to whatever reasons I can not tell.

[ighosh98]

We should update it in one of the upcoming releases. Thanks for pointing this out!

[ighosh98]

There should be no performance issues if you use GKE A3 Mega blueprint. You could reach out to us if you see any issues.

[donggrame]

Many thanks! 👍