Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] TransformIT testStopWaitForCheckpoint failing #106113

Open
jfreden opened this issue Mar 8, 2024 · 9 comments
Open

[CI] TransformIT testStopWaitForCheckpoint failing #106113

jfreden opened this issue Mar 8, 2024 · 9 comments
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml/Transform Transform Team:ML Meta label for the ML team >test-failure Triaged test failures from CI

Comments

@jfreden
Copy link
Contributor

jfreden commented Mar 8, 2024

Build scan:
https://gradle-enterprise.elastic.co/s/zc5izwxayffgm/tests/:x-pack:plugin:transform:qa:multi-node-tests:javaRestTest/org.elasticsearch.xpack.transform.integration.TransformIT/testStopWaitForCheckpoint

Reproduction line:

./gradlew ':x-pack:plugin:transform:qa:multi-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.transform.integration.TransformIT.testStopWaitForCheckpoint" -Dtests.seed=EFA8DB76DD3CD4F1 -Dtests.locale=ro-RO -Dtests.timezone=Pacific/Fakaofo -Druntime.java=21

Applicable branches:
main

Reproduces locally?:
No

Failure history:
Failure dashboard for org.elasticsearch.xpack.transform.integration.TransformIT#testStopWaitForCheckpoint

Failure excerpt:

java.lang.AssertionError: 
Expected: "stopped"
     but: was "stopping"

  at __randomizedtesting.SeedInfo.seed([EFA8DB76DD3CD4F1:927DF71D11A83EC7]:0)
  at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
  at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:6)
  at org.elasticsearch.test.ESTestCase.assertThat(ESTestCase.java:2130)
  at org.elasticsearch.xpack.transform.integration.TransformIT.testStopWaitForCheckpoint(TransformIT.java:428)
  at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
  at java.lang.reflect.Method.invoke(Method.java:580)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
  at java.lang.Thread.run(Thread.java:1583)
@jfreden jfreden added :SearchOrg/Extract&Transform Label for the Search E&T team >test-failure Triaged test failures from CI labels Mar 8, 2024
@elasticsearchmachine elasticsearchmachine added blocker Team:Search - Extract & Transform Team:SearchOrg Meta label for the Search Org (Enterprise Search) labels Mar 8, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ent-search-eng (Team:SearchOrg)

@elasticsearchmachine elasticsearchmachine added the needs:risk Requires assignment of a risk label (low, medium, blocker) label Apr 24, 2024
@kkrik-es
Copy link
Contributor

kkrik-es commented May 1, 2024

Another failure today: https://gradle-enterprise.elastic.co/s/cwvxwpgwkb4xu

@thecoop
Copy link
Member

thecoop commented May 23, 2024

Another one: https://gradle-enterprise.elastic.co/s/imizn6inj7jpe/tests/task/:x-pack:plugin:transform:qa:multi-node-tests:javaRestTest/details/org.elasticsearch.xpack.transform.integration.TransformIT/testStopWaitForCheckpoint?top-execution=1

@maxhniebergall
Copy link
Member

https://gradle-enterprise.elastic.co/s/htscuh6xold3w/tests/task/:x-pack:plugin:transform:qa:multi-node-tests:javaRestTest/details/org.elasticsearch.xpack.transform.integration.TransformIT/testStopWaitForCheckpoint?top-execution=1

@jedrazb
Copy link
Member

jedrazb commented Jul 8, 2024 •
edited
Loading

Hi! Extract & Transform team doesn't own code under :x-pack:plugin:transform, it seems that our team might have been assigned by mistake. @przemekwitek 👋 I see that you modified this file recently, could you re-label this issue?

EDIT: I used labels from your recent PRs, please change them if they are not correct

@jedrazb jedrazb added :ml/Transform Transform Team:ML Meta label for the ML team and removed :SearchOrg/Extract&Transform Label for the Search E&T team Team:Search - Extract & Transform Team:SearchOrg Meta label for the Search Org (Enterprise Search) labels Jul 8, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@elasticsearchmachine
Copy link
Collaborator

This has been muted on branch 8.15

Mute Reasons:

  • [8.15] 2 failures in test testStopWaitForCheckpoint (0.7% fail rate in 289 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Jul 29, 2024
@elasticsearchmachine
Mute org.elasticsearch.xpack.transform.integration.TransformIT testSt…
e004076 
…opWaitForCheckpoint #106113
@lkts lkts mentioned this issue Aug 13, 2024
Closed
@elasticsearchmachine
Copy link
Collaborator

This has been muted on branch main

Mute Reasons:

  • [main] 3 failures in test testStopWaitForCheckpoint (0.6% fail rate in 511 executions)
  • [main] 2 failures in step part-5 (0.9% fail rate in 217 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (0.9% fail rate in 218 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Sep 26, 2024
@elasticsearchmachine
Mute org.elasticsearch.xpack.transform.integration.TransformIT testSt…
1b5d75f 
…opWaitForCheckpoint #106113
@davidkyle davidkyle added low-risk An open issue or test failure that is a low risk to future releases and removed needs:risk Requires assignment of a risk label (low, medium, blocker) labels Nov 4, 2024
@davidkyle
Copy link
Member

Low risk as it appears to be a slow test timing out

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
low-risk An open issue or test failure that is a low risk to future releases :ml/Transform Transform Team:ML Meta label for the ML team >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@davidkyle @thecoop @mark-vieira @jedrazb @elasticsearchmachine @jfreden @kkrik-es @maxhniebergall