[CI] Failure in ILMDocumentationIT.testAddSnapshotLifecyclePolicy

[original-brownbear]

The following failed on 7.x:

11:09:05 org.elasticsearch.client.documentation.ILMDocumentationIT > testAddSnapshotLifecyclePolicy FAILED
11:09:05     java.lang.AssertionError: 
11:09:05     Expected: <1L>
11:09:05          but: was <2L>
11:09:05         at __randomizedtesting.SeedInfo.seed([667E1B76EEB11627:FF88531C062144A]:0)
11:09:05         at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
11:09:05         at org.junit.Assert.assertThat(Assert.java:956)
11:09:05         at org.junit.Assert.assertThat(Assert.java:923)
11:09:05         at org.elasticsearch.client.documentation.ILMDocumentationIT.testAddSnapshotLifecyclePolicy(ILMDocumentationIT.java:869)
11:09:06 REPRODUCE WITH: ./gradlew :client:rest-high-level:integTestRunner --tests "org.elasticsearch.client.documentation.ILMDocumentationIT.testAddSnapshotLifecyclePolicy" -Dtests.seed=667E1B76EEB11627 -Dtests.security.manager=true -Dtests.locale=fr-LU -Dtests.timezone=America/Lima -Dcompiler.java=12 -Druntime.java=8

Build Scan

@dakrone can you take a look?

[elasticmachine]

Pinging @elastic/es-distributed

[original-brownbear]

Another one https://gradle-enterprise.elastic.co/s/5heq24lk5ausi

[henningandersen]

Two more, also 7.x:

https://gradle-enterprise.elastic.co/s/ujxnu53ps7ms2/console-log?task=:client:rest-high-level:integTestRunner#L34
and
https://gradle-enterprise.elastic.co/s/kiaupjm4nqncu/console-log?task=:client:rest-high-level:integTestRunner

I wonder if it could be a variant of #46224 in that both cases seems to be either a delete/create or double create issue in rest tests.

[henningandersen]

The symptom here looks sufficiently close to #46091, any objections to closing this?

[dakrone]

@henningandersen it does look the same, let's close this for now and we can re-open if it occurs again now that we use ram disks for the CI.

[original-brownbear]

This happened again here https://gradle-enterprise.elastic.co/s/ssgsd3wxbxvno in 7.x

[elasticmachine]

Pinging @elastic/es-core-features

[dnhatn]

This still happens after #46881: https://gradle-enterprise.elastic.co/s/5opdtqmvz3j4i.

[DaveCTurner]

Also https://gradle-enterprise.elastic.co/s/hbt4xxlvwtrnc

[gwbrown]

This is now the same problem as #48441: Could not determine repository generation from root blobs. We likely just need to add some retries around this type of exception, or wait until the underlying issue is fixed as described at #48433 (comment).

[original-brownbear]

@gwbrown I think you'll be happier with retries and keeping the coverage for the time being. A fix (including reviews) will probably not happen in less than 2 weeks.

[gwbrown]

Thanks @original-brownbear, I was going to ping you soon to ask about the timeline on that. I'll move ahead with implementing retries as needed in these tests.

[gwbrown]

Now that #48548 has been merged and back ported, this failure should be fixed. I'm going to close this, please reopen if the failure shows up again.