Raise error if build config is incompatible with cloud compute

[awaelchli]

🚀 Feature

Generate an error when a custom image is specified through the build config and the default cloud compute is selected.

Motivation

#14125
#14230 (comment)

Pitch

Validate the setting of Work.cloud_compute and Work.build_config. If it is incompatible (e.g. custom image + default cpu), raise an error.

Alternatives

Additional context

---

If you enjoy Lightning, check out our other projects! ⚡

• Metrics: Machine learning metrics for distributed, scalable PyTorch applications.

• Lite: enables pure PyTorch users to scale their existing code on any kind of device while retaining full control over their own loops and optimization logic.

• Flash: The fastest way to get a Lightning baseline! A collection of tasks for fast prototyping, baselining, fine-tuning, and solving problems with deep learning.

• Bolts: Pretrained SOTA Deep Learning models, callbacks, and more for research and production with PyTorch Lightning and PyTorch.

• Lightning Transformers: Flexible interface for high-performance research using SOTA Transformers leveraging PyTorch Lightning, Transformers, and Hydra.

cc @Borda @tchaton @rohitgr7

[hhsecond]

Reducing priority since platform is still accepting a custom image for the "default" compute configuration. The backend changes for implementing this and reducing cost of running works is going to happen only in few weeks.

[awaelchli]

@hhsecond Would you have a quick look at #14929? It's a very simple addition and could be the placeholder until the backend either supports the custom image or adds an error message of its own. What do you think?