Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multiple image builds in custom builders #6452

Open
cmellard opened this issue Oct 26, 2024 · 1 comment
Open

Support multiple image builds in custom builders #6452

cmellard opened this issue Oct 26, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@cmellard
Copy link

Describe the Feature You Want

When running builds/runs with Bazel it is efficient to define targets that build and push multiple images in one go rather than having to orchestrate multiple Bazel runs from Tilt and queuing up a large series of these - it's almost always more efficient to use multirun in Bazel to push multiple oci images to a remote or load them locally. Even if we let Tilt handle the pushing which does work concurrently we still have a sequential problem with Bazel run and oci_load loading these images in to the local docker registry. Not entirely sure how the contract would look for custom_build but I imagine some list of image refs to build that we can pipe to bazel rathe than a single ref.

Current Behavior

We define a custom_build for each image and Bazel queues up many bazel run and we wait a long time until it has finished building and pushing all of those.

Why Do You Want This?

Tilt is unusable when using Bazel as a custom builder when you have a high number of images that share cross cutting libraries and need rebuilding at the same time. The cycle time is very high.

@cmellard cmellard added the enhancement New feature or request label Oct 26, 2024
@nicks
Copy link
Member

nicks commented Nov 19, 2024

it's been a while since i worked on Bazel stuff 🧓 but shouldn't rebuilding an artifact that's already been built be pretty fast? like <200ms? like, the whole point of the Bazel graph was to avoid having to do your own build graph on top of bazel.

or is this an artifact of how the oci image bazel rules work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants