Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DocsClientYamlTestSuiteIT times out #59297

Closed
danielmitterdorfer opened this issue Jul 9, 2020 · 3 comments
Closed

DocsClientYamlTestSuiteIT times out #59297

danielmitterdorfer opened this issue Jul 9, 2020 · 3 comments
Labels
:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team >test-failure Triaged test failures from CI

Comments

@danielmitterdorfer
Copy link
Member

Note: We had raised such an issue earlier already (#49753) but I felt a new issue is warranted

While we did not see any timeouts for a while they have come back in recent months so I wanted to raise this issue for us to keep track of these. Here is a time series of the last five months (#49753 has been closed on February 5):

timeouts-last-five-months

Before June 16, timeouts affected Linux workers but after all timeouts happened on Darwin workers (see attached build stats report generated via filtering for test.failed-testcases.summary: "FAILURE DocsClientYamlTestSuiteIT classMethod" AND test.failed-testcases.message: "java.lang.Exception: Suite timeout exceeded (>= 1800000 msec)." in the last three months).

Build scan: https://gradle-enterprise.elastic.co/s/g3rrfj7scx7ki

Repro line:

./gradlew ':docs:integTestRunner' --tests "org.elasticsearch.smoketest.DocsClientYamlTestSuiteIT" \
  -Dtests.seed=A25554FFC677D4B5 \
  -Dtests.security.manager=true \
  -Dtests.locale=en-US \
  -Dtests.timezone=America/Los_Angeles \
  -Druntime.java=11

Reproduces locally?: no

Applicable branches: 7.8, master (see failure history link below for details)

Failure history: timeouts within the last three months

Failure excerpt:

The test suite fails with a timeout:

java.lang.Exception: Suite timeout exceeded (>= 1800000 msec).
@danielmitterdorfer danielmitterdorfer added :Delivery/Build Build or test infrastructure >test-failure Triaged test failures from CI labels Jul 9, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra (:Core/Infra/Build)

@elasticmachine elasticmachine added the Team:Core/Infra Meta label for core/infra team label Jul 9, 2020
@droberts195
Copy link
Contributor

I think this is #58286. The parallelism was increased on the macOS workers and they cannot cope with it so various suites time out. It's not just the docs tests. Any of the test suites that start up external clusters and run a lot of tests can be affected.

@danielmitterdorfer
Copy link
Member Author

Thanks for the pointer @droberts195! IMHO there is no point having multiple issues for the same underlying cause. I'll close this one then.

@mark-vieira mark-vieira added Team:Delivery Meta label for Delivery team and removed Team:Core/Infra Meta label for core/infra team labels Nov 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Delivery/Build Build or test infrastructure Team:Delivery Meta label for Delivery team >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

4 participants