Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--remote-download-minimal does not behave correctly with RBE and bazel test. #17190

Closed
antter opened this issue Jan 11, 2023 · 5 comments
Closed
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team type: bug untriaged

Comments

@antter
Copy link
Contributor

antter commented Jan 11, 2023

Description of the bug:

When I set --remote-download-minimal, the behavior for downloading outputs is different depending on whether I am running bazel test or bazel build (during RBE). With bazel build, everything works as normal. with bazel test, it appears that the top-level artifacts of a target are downloaded.

I stumbled upon this because our CI runs bazel test //.... We noticed that on each invocation, we are downloading a large amount of outputs from the remote cache.

What's the simplest, easiest way to reproduce this bug? Please provide a minimal example if possible.

With remote execution enabled and --remote_download_minimal, create a target. bazel build that target. Check that the target's outputs are not in the output base. Now bazel test that target. Confirm that the target's outputs are indeed in the output base.

Which operating system are you running Bazel on?

M1 Mac 12.3.1

What is the output of bazel info release?

release 6.0.0

Any other information, logs, or outputs that you want to share?

slack thread here
https://bazelbuild.slack.com/archives/CA31HN1T3/p1673458583459269

and an example repo here
https://github.com/antter/bazel_remote_error

@brentleyjones
Copy link
Contributor

@bazelbuild/remote-execution

@antter
Copy link
Contributor Author

antter commented Jan 11, 2023

seems like the offending line is here:

if (configuredTarget instanceof RuleConfiguredTarget) {

I'm in pretty deep over my head though when it comes to fixing this, unless it would just be as easy as removing this check, or having it check for the downloadToplevel attribute.

@ShreeM01 ShreeM01 added type: bug untriaged team-Remote-Exec Issues and PRs for the Execution (Remote) team labels Jan 11, 2023
ShreeM01 added a commit that referenced this issue Jan 19, 2023
…#17234)

This fixes #17190

Closes #17195.

PiperOrigin-RevId: 501555041
Change-Id: Ie52f72fb82912dde135eaa56c02d9756eb31365b

Co-authored-by: Anthony Ter-Saakov <[email protected]>
@joeljeske
Copy link
Contributor

Could we pick this fix into an earlier 6.0 release? This looks like a recent regression

@brentleyjones
Copy link
Contributor

It will be in the 6.1.0 release, which is the next planned release.

@joeljeske
Copy link
Contributor

Great thank you. I was not sure if there would be a 6.0.1 that this could make it into.

hvadehra pushed a commit that referenced this issue Feb 14, 2023
This fixes #17190

Closes #17195.

PiperOrigin-RevId: 501555041
Change-Id: Ie52f72fb82912dde135eaa56c02d9756eb31365b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
team-Remote-Exec Issues and PRs for the Execution (Remote) team type: bug untriaged
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants