Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] XPackRestIT "transform/transforms_stats/Test get continuous transform stats" failure #52429

Closed
astefan opened this issue Feb 17, 2020 · 3 comments · Fixed by #52504
Closed

[CI] XPackRestIT "transform/transforms_stats/Test get continuous transform stats" failure #52429

astefan opened this issue Feb 17, 2020 · 3 comments · Fixed by #52504
Assignees
@hendrikmuhs
Labels
:ml/Transform Transform >test-failure Triaged test failures from CI

Comments

@astefan
Copy link
Contributor

astefan commented Feb 17, 2020

This failure was part of a longer list of failed tasks in XPackRestIT, but this one seems to have been the first failing one and looks legit. For reference, I've also created #52428. Also, it doesn't reproduce for me.

08:01:28   1> [2020-02-16T23:43:11,666][INFO ][o.e.x.t.r.XPackRestIT    ] [test] [p0=transform/transforms_stats/Test get continuous transform stats] before test
08:01:28   1> [2020-02-16T23:43:13,044][INFO ][o.e.x.t.r.XPackRestIT    ] [test] Stash dump on test failure [{
08:01:28   1>   "stash" : {
08:01:28   1>     "body" : {
08:01:28   1>       "count" : 1,
08:01:28   1>       "transforms" : [
08:01:28   1>         {
08:01:28   1>           "id" : "airline-transform-stats-continuous",
08:01:28   1>           "state" : "started",
08:01:28   1>           "node" : {
08:01:28   1>             "id" : "SMnPdQK0T-SFKbe2hgOQ6Q",
08:01:28   1>             "name" : "integTest-0",
08:01:28   1>             "ephemeral_id" : "DhvyWYLlR8qwMGK2ANFG1w",
08:01:28   1>             "transport_address" : "127.0.0.1:45379",
08:01:28   1>             "attributes" : { }
08:01:28   1>           },
08:01:28   1>           "stats" : {
08:01:28   1>             "pages_processed" : 1,
08:01:28   1>             "documents_processed" : 0,
08:01:28   1>             "documents_indexed" : 0,
08:01:28   1>             "trigger_count" : 1,
08:01:28   1>             "index_time_in_ms" : 0,
08:01:28   1>             "index_total" : 0,
08:01:28   1>             "index_failures" : 0,
08:01:28   1>             "search_time_in_ms" : 2,
08:01:28   1>             "search_total" : 1,
08:01:28   1>             "search_failures" : 0,
08:01:28   1>             "exponential_avg_checkpoint_duration_ms" : 47.0,
08:01:28   1>             "exponential_avg_documents_indexed" : 0.0,
08:01:28   1>             "exponential_avg_documents_processed" : 0.0
08:01:28   1>           },
08:01:28   1>           "checkpointing" : {
08:01:28   1>             "last" : {
08:01:28   1>               "checkpoint" : 1,
08:01:28   1>               "timestamp_millis" : 1581914592903,
08:01:28   1>               "time_upper_bound_millis" : 1581914532903
08:01:28   1>             }
08:01:28   1>           }
08:01:28   1>         }
08:01:28   1>       ]
08:01:28   1>     }
08:01:28   1>   }
08:01:28   1> }]
08:01:28   1> [2020-02-16T23:43:23,577][INFO ][o.e.x.t.r.XPackRestIT    ] [test] There are still tasks running after this test that might break subsequent tests [data_frame/transforms[c]].
08:01:28   1> [2020-02-16T23:43:23,578][INFO ][o.e.x.t.r.XPackRestIT    ] [test] [p0=transform/transforms_stats/Test get continuous transform stats] after test
08:01:28   2> REPRODUCE WITH: ./gradlew ':x-pack:plugin:integTestRunner' --tests "org.elasticsearch.xpack.test.rest.XPackRestIT.test {p0=transform/transforms_stats/Test get continuous transform stats}" -Dtests.seed=FF7502DFD4FB6063 -Dtests.security.manager=true -Dtests.locale=mt -Dtests.timezone=US/Eastern -Dcompiler.java=13 -Dtests.rest.blacklist=getting_started/10_monitor_cluster_health/*
08:01:28   2> REPRODUCE WITH: ./gradlew ':x-pack:plugin:integTestRunner' --tests "org.elasticsearch.xpack.test.rest.XPackRestIT.test {p0=transform/transforms_stats/Test get continuous transform stats}" -Dtests.seed=FF7502DFD4FB6063 -Dtests.security.manager=true -Dtests.locale=mt -Dtests.timezone=US/Eastern -Dcompiler.java=13 -Dtests.rest.blacklist=getting_started/10_monitor_cluster_health/*
08:01:28   2> java.lang.AssertionError: Failure at [transform/transforms_stats:250]: transforms.0.stats.exponential_avg_checkpoint_duration_ms didn't match expected value:
08:01:28     transforms.0.stats.exponential_avg_checkpoint_duration_ms: expected Double [0.0] but was Double [47.0]
08:01:28         at org.elasticsearch.test.rest.yaml.ESClientYamlSuiteTestCase.executeSection(ESClientYamlSuiteTestCase.java:405)
08:01:28         at org.elasticsearch.test.rest.yaml.ESClientYamlSuiteTestCase.test(ESClientYamlSuiteTestCase.java:382)
08:01:28         at jdk.internal.reflect.GeneratedMethodAccessor12.invoke(Unknown Source)
08:01:28         at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
08:01:28         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
08:01:28         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
08:01:28         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
08:01:28         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
08:01:28         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
08:01:28         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
08:01:28         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
08:01:28         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
08:01:28         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
08:01:28         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
08:01:28         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
08:01:28         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
08:01:28         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
08:01:28         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
08:01:28         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
08:01:28         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
08:01:28         at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
08:01:28         at java.base/java.lang.Thread.run(Thread.java:834)
08:01:28 
08:01:28         Caused by:
08:01:28         java.lang.AssertionError: transforms.0.stats.exponential_avg_checkpoint_duration_ms didn't match expected value:
08:01:28         transforms.0.stats.exponential_avg_checkpoint_duration_ms: expected Double [0.0] but was Double [47.0]
08:01:28             at org.elasticsearch.test.rest.yaml.section.MatchAssertion.doAssert(MatchAssertion.java:93)
08:01:28             at org.elasticsearch.test.rest.yaml.section.Assertion.execute(Assertion.java:76)
08:01:28             at org.elasticsearch.test.rest.yaml.ESClientYamlSuiteTestCase.executeSection(ESClientYamlSuiteTestCase.java:398)
08:01:28             ... 37 more

https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+matrix-java-periodic/ES_RUNTIME_JAVA=java11,nodes=general-purpose/516/console
[7.6.1] https://gradle-enterprise.elastic.co/s/dcsdwsaodnlso
[7.7.0] https://gradle-enterprise.elastic.co/s/aeqrfacqyj24u
[7.6.1] https://gradle-enterprise.elastic.co/s/vrp66sw4c6zyy
[7.7.0] https://gradle-enterprise.elastic.co/s/zpd4kfpizyq7c
https://gradle-enterprise.elastic.co/s/frzrlcgeo45j4
@astefan astefan added >test-failure Triaged test failures from CI :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data labels Feb 17, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (:Analytics/Rollup)

@iverase iverase added the :ml/Transform Transform label Feb 17, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

@hendrikmuhs
Copy link

my fault, I think this is a regression caused by #52041

@hendrikmuhs hendrikmuhs removed the :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data label Feb 18, 2020
@hendrikmuhs hendrikmuhs self-assigned this Feb 18, 2020
@hendrikmuhs hendrikmuhs mentioned this issue Feb 18, 2020
Closed
hendrikmuhs pushed a commit to hendrikmuhs/elasticsearch that referenced this issue Feb 19, 2020
do not match explicit number but only test existence for duration test
2610428 
fixes elastic#52429
@hendrikmuhs hendrikmuhs mentioned this issue Feb 19, 2020
Merged
hendrikmuhs pushed a commit that referenced this issue Feb 19, 2020
[Transform] fix XPackRestIT continuous transform stats test failure
dd3a5e1 
do not match explicit number but only test existence for duration test (#52504)

fixes #52429
hendrikmuhs pushed a commit that referenced this issue Feb 19, 2020
[Transform] fix XPackRestIT continuous transform stats test failure
4d006f0 
do not match explicit number but only test existence for duration test (#52504)

fixes #52429
sbourke pushed a commit to sbourke/elasticsearch that referenced this issue Feb 19, 2020
@sbourke
[Transform] fix XPackRestIT continuous transform stats test failure
cb5635c 
do not match explicit number but only test existence for duration test (elastic#52504)

fixes elastic#52429
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hendrikmuhs hendrikmuhs

Labels
:ml/Transform Transform >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Transform] fix XPackRestIT continuous transform stats test failure hendrikmuhs/elasticsearch
4 participants
@astefan @hendrikmuhs @elasticmachine @iverase