Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] S3BlobContainerRetriesTests testReadWithIndicesPurposeRetriesForever failing #105958

Closed
fcofdez opened this issue Mar 5, 2024 · 2 comments · Fixed by #106000
Closed

[CI] S3BlobContainerRetriesTests testReadWithIndicesPurposeRetriesForever failing #105958

fcofdez opened this issue Mar 5, 2024 · 2 comments · Fixed by #106000
Assignees
@ywangd
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs low-risk An open issue or test failure that is a low risk to future releases Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. >test-failure Triaged test failures from CI

Comments

@fcofdez
Copy link
Contributor

fcofdez commented Mar 5, 2024 •
edited by ywangd
Loading

Build scan:
https://gradle-enterprise.elastic.co/s/syattgaeo6eqe/tests/:modules:repository-s3:test/org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests/testReadWithIndicesPurposeRetriesForever

Reproduction line:

./gradlew ':modules:repository-s3:test' --tests "org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests.testReadWithIndicesPurposeRetriesForever" -Dtests.seed=D865C8AC5D1B7543 -Dtests.locale=es-EC -Dtests.timezone=America/Yakutat -Druntime.java=20

Applicable branches:
8.13

Reproduces locally?:
Didn't try

Failure history:
Failure dashboard for org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests#testReadWithIndicesPurposeRetriesForever

Failure excerpt:

java.lang.AssertionError: 
Expected: a value greater than <210>
     but: <0> was less than <210>

  at __randomizedtesting.SeedInfo.seed([D865C8AC5D1B7543:A7E82A46500CD340]:0)
  at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
  at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:6)
  at org.elasticsearch.test.ESTestCase.assertThat(ESTestCase.java:2119)
  at org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests.testReadWithIndicesPurposeRetriesForever(S3BlobContainerRetriesTests.java:706)
  at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
  at java.lang.reflect.Method.invoke(Method.java:578)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
  at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
  at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
  at org.junit.rules.RunRules.evaluate(RunRules.java:20)
  at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
  at java.lang.Thread.run(Thread.java:1623)
@fcofdez fcofdez added :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >test-failure Triaged test failures from CI Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. labels Mar 5, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@ywangd ywangd self-assigned this Mar 6, 2024
@ywangd ywangd added low-risk An open issue or test failure that is a low risk to future releases and removed blocker labels Mar 6, 2024
ywangd added a commit to ywangd/elasticsearch that referenced this issue Mar 6, 2024
@ywangd
[Test] Ranged read should read non-empty content
dae192b 
Empty read is short-circuited without going to the blob store. In order
to test s3 blob store, ranged read should read at least one byte. This
PR ensure that.

Resolves: elastic#105958
@ywangd ywangd mentioned this issue Mar 6, 2024
Merged
@idegtiarenko
Copy link
Contributor

Another failure: https://gradle-enterprise.elastic.co/s/7tfl54htt5ag4/tests/task/:modules:repository-s3:test/details/org.elasticsearch.repositories.s3.S3BlobContainerRetriesTests/testReadWithIndicesPurposeRetriesForever?top-execution=1

I believe that reproduces locally

elasticsearchmachine pushed a commit that referenced this issue Mar 20, 2024
@ywangd
[Test] Ranged read should read non-empty content (#106000)
c30999b 
Empty read is
[short-circuited](https://github.com/elastic/elasticsearch/blob/e8039b9ecb2451752ac5377c44a6a0c662087a9f/modules/repository-s3/src/main/java/org/elasticsearch/repositories/s3/S3BlobContainer.java#L115-L116)
without going to the blob store. In order to test s3 blob store, ranged
read should read at least one byte. This PR ensures that.

Resolves: #105958
ywangd added a commit to ywangd/elasticsearch that referenced this issue Mar 20, 2024
@ywangd
[Test] Ranged read should read non-empty content (elastic#106000)
05800f2 
Empty read is
[short-circuited](https://github.com/elastic/elasticsearch/blob/e8039b9ecb2451752ac5377c44a6a0c662087a9f/modules/repository-s3/src/main/java/org/elasticsearch/repositories/s3/S3BlobContainer.java#L115-L116)
without going to the blob store. In order to test s3 blob store, ranged
read should read at least one byte. This PR ensures that.

Resolves: elastic#105958
elasticsearchmachine pushed a commit that referenced this issue Mar 20, 2024
@ywangd
[Test] Ranged read should read non-empty content (#106000) (#106525)
50c71bc 
Empty read is
[short-circuited](https://github.com/elastic/elasticsearch/blob/e8039b9ecb2451752ac5377c44a6a0c662087a9f/modules/repository-s3/src/main/java/org/elasticsearch/repositories/s3/S3BlobContainer.java#L115-L116)
without going to the blob store. In order to test s3 blob store, ranged
read should read at least one byte. This PR ensures that.

Resolves: #105958
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ywangd ywangd

Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs low-risk An open issue or test failure that is a low risk to future releases Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Test] Ranged read should read non-empty content ywangd/elasticsearch
4 participants
@fcofdez @idegtiarenko @ywangd @elasticsearchmachine