Skip to content

Commit

Permalink
[scalability testing] skip unloading archives after journey (#151476)
Browse files Browse the repository at this point in the history
## Summary

Sometimes scalability testing might make Kibana not responding and it
causes after hook with unloading kbn archives to
[fail](https://buildkite.com/elastic/kibana-apis-capacity-testing/builds/241#01865418-2579-4559-bd4e-432c48a2104d):

```
2023-02-15T08:33:37.825Z proc [scalability-tests]  proc [gatling: test] Simulation org.kibanaLoadTest.simulation.generic.GenericJourney completed in 268 seconds
2023-02-15T08:38:06.749Z proc [scalability-tests]  proc [gatling: test] java.lang.reflect.InvocationTargetException
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.plugin.util.ForkMain.runMain(ForkMain.java:67)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.plugin.util.ForkMain.main(ForkMain.java:35)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] Caused by: java.lang.RuntimeException: Login request failed: org.apache.http.NoHttpResponseException: localhost:5620 failed to respond
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.getCookie(KbnClient.scala:72)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.getClientAndConnectionManager(KbnClient.scala:50)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.helpers.KbnClient.unload(KbnClient.scala:139)
2023-02-15T08:41:06.006Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$5(GenericJourney.scala:153)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$5$adapted(GenericJourney.scala:153)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$testDataLoader$2(GenericJourney.scala:47)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$testDataLoader$2$adapted(GenericJourney.scala:46)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at scala.collection.ArrayOps$.foreach$extension(ArrayOps.scala:1321)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.testDataLoader(GenericJourney.scala:46)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at org.kibanaLoadTest.simulation.generic.GenericJourney.$anonfun$new$4(GenericJourney.scala:154)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$18(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$18$adapted(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at scala.collection.immutable.List.foreach(List.scala:333)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.core.scenario.Simulation.$anonfun$params$17(Simulation.scala:176)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Runner.run(Runner.scala:62)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.start(Gatling.scala:89)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.fromArgs(Gatling.scala:51)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling$.main(Gatling.scala:39)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	at io.gatling.app.Gatling.main(Gatling.scala)
2023-02-15T08:41:06.007Z proc [scalability-tests]  proc [gatling: test] 	... 6 more
```

The journey is marked as failed though we actually got the metrics. This
PR add flag to Gatling runner command that skips running cleanup on
journey teardown.
  • Loading branch information
dmlemeshko authored Feb 22, 2023
1 parent 26bd714 commit 5c8bf9a
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions x-pack/test/scalability/runner.ts
Original file line number Diff line number Diff line change
@@ -83,6 +83,8 @@ export async function ScalabilityTestRunner(
`-Dgatling.core.outputDirectoryBaseName=${gatlingReportBaseDir}`,
'-Dgatling.simulationClass=org.kibanaLoadTest.simulation.generic.GenericJourney',
`-DjourneyPath=${scalabilityJsonPath}`,
// skip unloading kbn/es archives on journey finish since we shutdown instances anyway
`-DskipCleanupOnTeardown=true`,
],
cwd: gatlingProjectRootPath,
env: {

0 comments on commit 5c8bf9a

Please sign in to comment.