Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] ReindexIT testDeleteByQuery failing #75327

Closed
tvernum opened this issue Jul 14, 2021 · 2 comments · Fixed by #77822
Closed

[CI] ReindexIT testDeleteByQuery failing #75327

tvernum opened this issue Jul 14, 2021 · 2 comments · Fixed by #77822
Assignees
@henningandersen
Labels
:Distributed Indexing/Reindex Issues relating to reindex that are not caused by issues further down Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. >test-failure Triaged test failures from CI

Comments

@tvernum
Copy link
Contributor

tvernum commented Jul 14, 2021

findTaskToRethrottle has a comment

        // check that the task initialized enough that it can rethrottle too.

But it doesn't look like we quite get there.

Relates: #73018

Build scan:
https://gradle-enterprise.elastic.co/s/uytsdrap32qne/tests/:client:rest-high-level:asyncIntegTest/org.elasticsearch.client.ReindexIT/testDeleteByQuery

Reproduction line:
./gradlew ':client:rest-high-level:asyncIntegTest' --tests "org.elasticsearch.client.ReindexIT.testDeleteByQuery" -Dtests.seed=A0D60EC47C0FF9FE -Dtests.locale=es-CL -Dtests.timezone=Etc/GMT-8 -Druntime.java=8

Applicable branches:
7.x

Reproduces locally?:
No

Failure history:
https://gradle-enterprise.elastic.co/scans/tests?tests.container=org.elasticsearch.client.ReindexIT&tests.test=testDeleteByQuery

Failure excerpt:

java.lang.AssertionError: 
Expected: an empty collection
     but: <[[MdmmzVLHT_yGPMjbMzSwRw][12680] failed, reason [ElasticsearchException[Elasticsearch exception [type=illegal_argument_exception, reason=task [12680] has not yet been initialized to the point where it knows how to rethrottle itself]]]]>

  at __randomizedtesting.SeedInfo.seed([A0D60EC47C0FF9FE:AE190BEF25C08668]:0)
  at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
  at org.junit.Assert.assertThat(Assert.java:956)
  at org.junit.Assert.assertThat(Assert.java:923)
  at org.elasticsearch.client.ReindexIT.testDeleteByQuery(ReindexIT.java:266)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(NativeMethodAccessorImpl.java:-2)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
  at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
  at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
  at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
  at java.lang.Thread.run(Thread.java:748)
@tvernum tvernum added :Distributed Indexing/Reindex Issues relating to reindex that are not caused by issues further down >test-failure Triaged test failures from CI labels Jul 14, 2021
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Jul 14, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@tvernum
Copy link
Contributor Author

tvernum commented Jul 14, 2021

Assigned to @henningandersen because it looks like this is related to #73018

henningandersen added a commit to henningandersen/elasticsearch that referenced this issue Sep 15, 2021
@henningandersen
Rethrottle tests wait for task to start
36dc272 
Improved how we wait for tasks to really start, to ensure that
rethrottle does not fail the test.

Closes elastic#75327
@henningandersen henningandersen mentioned this issue Sep 15, 2021
Merged
henningandersen added a commit that referenced this issue Oct 27, 2021
@henningandersen
Rethrottle tests wait for task to start (#77822)
9c79112 
Improved how we wait for tasks to really start, to ensure that
rethrottle does not fail the test.

Closes #75327
henningandersen added a commit that referenced this issue Oct 27, 2021
@henningandersen
Rethrottle tests wait for task to start (#77822)
889651d 
Improved how we wait for tasks to really start, to ensure that
rethrottle does not fail the test.

Closes #75327
henningandersen added a commit that referenced this issue Oct 27, 2021
@henningandersen
Rethrottle tests wait for task to start (#77822)
3cad9c1 
Improved how we wait for tasks to really start, to ensure that
rethrottle does not fail the test.

Closes #75327
henningandersen added a commit that referenced this issue Oct 27, 2021
@henningandersen
Rethrottle tests wait for task to start (#77822)
cda052e 
Improved how we wait for tasks to really start, to ensure that
rethrottle does not fail the test.

Closes #75327
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@henningandersen henningandersen

Labels
:Distributed Indexing/Reindex Issues relating to reindex that are not caused by issues further down Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Rethrottle tests wait for task to start henningandersen/elasticsearch
3 participants
@tvernum @elasticmachine @henningandersen