Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable build cache for packaging tests #51717

Merged

Conversation

mark-vieira
Copy link
Contributor

For packaging tests, calculating inputs is complicated as the thing we are testing could be an archive (tar/zip), a installer package (deb/rpm) or a Docker image. In our build logic we don't make any attempt to track any of these things as an input to the Java packaging tests so there are times where we might be getting false cache hits for these tests. In practice, this hasn't happened because the build cache has been disabled for our packaging test CI builds, but a) we should enable the cache there, and for all other builds and b) we could get incorrect results when running locally with the cache.

@mark-vieira mark-vieira requested a review from rjernst January 30, 2020 23:25
@mark-vieira mark-vieira added the :Delivery/Build Build or test infrastructure label Jan 30, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (:Core/Infra/Build)

@@ -137,6 +137,7 @@ processTestResources {
}

task integTest(type: Test) {
outputs.doNotCacheIf('Build cache is disabled for Docker tests') { true }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't actually a packaging test, it's running rest tests with docker. I don't think we disable caching for the rest of rest or qa tests do we?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True it's not a packaging test, but the same applies, we aren't considering the Docker image as an input here.

We don't use the Docker image in any other tests, with the exception of those being added in #51658, which prompted me to look into this. For other rest and qa tests we use test clusters, which handles tracking the node distribution as a proper task input.

Copy link
Member

@rjernst rjernst left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mark-vieira mark-vieira merged commit 378b27b into elastic:master Jan 31, 2020
@mark-vieira mark-vieira deleted the disable-packaging-test-caching branch January 31, 2020 01:23
@mark-vieira mark-vieira self-assigned this Feb 5, 2020
@polyfractal polyfractal added v7.6.0 and removed v7.6.1 labels Feb 7, 2020
@mark-vieira mark-vieira added the Team:Delivery Meta label for Delivery team label Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team v7.6.0 v7.7.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants