Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart fails #67889

Closed
valeriy42 opened this issue Jan 25, 2021 · 2 comments
Closed

[CI] RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart fails #67889

valeriy42 opened this issue Jan 25, 2021 · 2 comments
Assignees
@dimitris-athanasiou
Labels
:ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI

Comments

@valeriy42
Copy link
Contributor

Build scan:

https://gradle-enterprise.elastic.co/s/3xr6xxdizxjs2

Repro line:

./gradlew ':x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart" -Dtests.seed=8E4B8B2A38751536 -Dtests.security.manager=true -Dtests.locale=zh-Hant-TW -Dtests.timezone=Etc/GMT+4 -Druntime.java=11

Reproduces locally?:

No

Applicable branches:
master and 7.x

Failure history:
https://gradle-enterprise.elastic.co/scans/tests?search.relativeStartTime=P28D&search.timeZoneId=Europe/Berlin&tests.container=org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT&tests.sortField=FAILED&tests.test=testOutlierDetectionStopAndRestart&tests.unstableOnly=true

Failed 11 times in the past 7 days.

Failure excerpt:

org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT > testOutlierDetectionStopAndRestart FAILED
    java.lang.AssertionError: 
    Expected: <1123L>
         but: was <0L>
        at __randomizedtesting.SeedInfo.seed([8E4B8B2A38751536:B9FD866D00DE65E6]:0)
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
        at org.junit.Assert.assertThat(Assert.java:956)
        at org.junit.Assert.assertThat(Assert.java:923)
        at org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart(RunDataFrameAnalyticsIT.java:641)
REPRODUCE WITH: ./gradlew ':x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart" -Dtests.seed=8E4B8B2A38751536 -Dtests.security.manager=true -Dtests.locale=zh-Hant-TW -Dtests.timezone=Etc/GMT+4 -Druntime.java=11

Suite: Test class org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT
  1> [2021-01-25T03:35:20,066][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] before test
  1> [2021-01-25T03:35:20,069][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit]: setting up test
  1> [2021-01-25T03:35:20,073][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] version[8.0.0-SNAPSHOT], pid[494672], build[unknown/unknown/63c85ff3e846a13ae1294e99fc8ad63b9dd72d38/2021-01-25T05:48:03.186767276Z], OS[Linux/5.4.0-1034-gcp/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.2/11.0.2+7]
  1> [2021-01-25T03:35:20,073][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] JVM home [/var/lib/jenkins/.java/openjdk-11.0.2-linux]
  1> [2021-01-25T03:35:20,073][DEPRECATION][o.e.d.n.Node             ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] data_stream.dataset="deprecation.elasticsearch" data_stream.namespace="default" data_stream.type="logs" ecs.version="1.6" elasticsearch.event.category="other" key="no-jdk" message="no-jdk distributions that do not bundle a JDK are deprecated and will be removed in a future release"
  1> [2021-01-25T03:35:20,074][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] JVM arguments [-Dfile.encoding=UTF8, -Des.scripting.update.ctx_in_params=false, -Des.search.rewrite_sort=true, -Des.set.netty.runtime.available.processors=false, -Des.transport.cname_in_publish_address=true, -Dgradle.dist.lib=/var/lib/jenkins/.gradle/wrapper/dists/gradle-6.8-all/9emh0d32e025cam7aasxcw002/gradle-6.8/lib, -Dgradle.user.home=/var/lib/jenkins/.gradle, -Dgradle.worker.jar=/var/lib/jenkins/.gradle/caches/6.8/workerMain/gradle-worker.jar, -Dio.netty.noKeySetOptimization=true, -Dio.netty.noUnsafe=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Djava.awt.headless=true, -Djava.locale.providers=SPI,COMPAT, -Djna.nosys=true, -Dorg.gradle.native=false, -Dtests.artifact=native-multi-node-tests, -Dtests.cluster=[::1]:36111,127.0.0.1:37889,[::1]:37481,127.0.0.1:40071,[::1]:35937,127.0.0.1:46193, -Dtests.clustername=javaRestTest, -Dtests.gradle=true, -Dtests.logger.level=WARN, -Dtests.rest.cluster=[::1]:44923,127.0.0.1:42047,[::1]:46057,127.0.0.1:42851,[::1]:33637,127.0.0.1:41641, -Dtests.rest.load_packaged=false, -Dtests.security.manager=true, -Dtests.seed=8E4B8B2A38751536, -Dtests.task=:x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest, --illegal-access=warn, -XX:+HeapDumpOnOutOfMemoryError, -esa, -XX:HeapDumpPath=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu-18.04&&immutable/x-pack/plugin/ml/qa/native-multi-node-tests/build/heapdump, -Xms512m, -Xmx512m, -Dfile.encoding=UTF-8, -Djava.io.tmpdir=/var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu-18.04&&immutable/x-pack/plugin/ml/qa/native-multi-node-tests/build/testrun/javaRestTest/temp, -Duser.country=US, -Duser.language=en, -Duser.variant, -ea]
  1> [2021-01-25T03:35:20,074][WARN ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] version [8.0.0-SNAPSHOT] is a pre-release version of Elasticsearch and is not suitable for production
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] no modules loaded
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.index.reindex.ReindexPlugin]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.ingest.common.IngestCommonPlugin]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.test.MockHttpTransport$TestPlugin]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.transport.Netty4Plugin]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.xpack.autoscaling.Autoscaling]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.xpack.datastreams.DataStreamsPlugin]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.xpack.ilm.IndexLifecycle]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.xpack.ml.LocalStateMachineLearning]
  1> [2021-01-25T03:35:20,074][INFO ][o.e.p.PluginsService     ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] loaded plugin [org.elasticsearch.xpack.ml.integration.MlNativeIntegTestCase$MockPainlessScriptEngine$TestPlugin]
  1> [2021-01-25T03:35:20,077][INFO ][o.e.e.NodeEnvironment    ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] using [1] data paths, mounts [[/ (/dev/sda1)]], net usable_space [189.7gb], net total_space [339gb], types [ext4]
  1> [2021-01-25T03:35:20,077][INFO ][o.e.e.NodeEnvironment    ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] heap size [512mb], compressed ordinary object pointers [true]
  1> [2021-01-25T03:35:20,078][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] node name [external_19], node ID [xUnE0v__T_-m94L9_____w], cluster name [javaRestTest], roles []
  1> [2021-01-25T03:35:20,152][DEPRECATION][o.e.d.c.s.Settings       ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] data_stream.dataset="deprecation.elasticsearch" data_stream.namespace="default" data_stream.type="logs" ecs.version="1.6" elasticsearch.event.category="settings" key="xpack.security.transport.ssl.key_passphrase" message="[xpack.security.transport.ssl.key_passphrase] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version."
  1> [2021-01-25T03:35:20,182][DEPRECATION][o.e.d.c.s.Settings       ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] data_stream.dataset="deprecation.elasticsearch" data_stream.namespace="default" data_stream.type="logs" ecs.version="1.6" elasticsearch.event.category="settings" key="key_passphrase" message="[key_passphrase] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version."
  1> [2021-01-25T03:35:20,495][INFO ][o.e.d.DiscoveryModule    ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] using discovery type [zen] and seed hosts providers [settings]
  1> [2021-01-25T03:35:20,544][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] initialized
  1> [2021-01-25T03:35:20,544][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] starting ...
  1> [2021-01-25T03:35:20,549][INFO ][o.e.t.TransportService   ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] publish_address {127.0.0.1:32201}, bound_addresses {[::1]:32201}, {127.0.0.1:32201}
  1> [2021-01-25T03:35:20,676][INFO ][o.e.c.s.ClusterApplierService] [external_19] master node changed {previous [], current [{javaRestTest-0}{YrwZqUteR8WIf637OMlh5A}{qVY45LkWTPm2oTScChQk8A}{127.0.0.1}{127.0.0.1:37889}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true}]}, added {{javaRestTest-1}{aDgvWrV9RXCrqGUyVbICpg}{0MEikghpR2yszs1LlJD0Ug}{127.0.0.1}{127.0.0.1:40071}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true},{javaRestTest-2}{2X-Zvr5AQNqNojuoOkEF_Q}{pj_Rc8rGQ0Oj2F2859OvjA}{127.0.0.1}{127.0.0.1:46193}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true},{javaRestTest-0}{YrwZqUteR8WIf637OMlh5A}{qVY45LkWTPm2oTScChQk8A}{127.0.0.1}{127.0.0.1:37889}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true}}, term: 1, version: 6057, reason: ApplyCommitRequest{term=1, version=6057, sourceNode={javaRestTest-0}{YrwZqUteR8WIf637OMlh5A}{qVY45LkWTPm2oTScChQk8A}{127.0.0.1}{127.0.0.1:37889}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true}}
  1> [2021-01-25T03:35:20,680][INFO ][o.e.x.s.a.TokenService   ] [external_19] refresh keys
  1> [2021-01-25T03:35:20,866][INFO ][o.e.x.s.a.TokenService   ] [external_19] refreshed keys
  1> [2021-01-25T03:35:20,885][INFO ][o.e.l.LicenseService     ] [external_19] license [b3dade9b-e7a2-4f23-9abe-3a8fd6d5828d] mode [trial] - valid
  1> [2021-01-25T03:35:20,885][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [external_19] Active license is now [TRIAL]; Security is enabled
  1> [2021-01-25T03:35:20,885][INFO ][o.e.n.Node               ] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] started
  1> [2021-01-25T03:35:20,890][INFO ][o.e.t.ExternalTestCluster] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Setup ExternalTestCluster [javaRestTest] made of [4] nodes
  1> [2021-01-25T03:35:21,068][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit]: all set up test
  1> [2021-01-25T03:35:21,825][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:21,832][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_more_fields_than_docvalue_limit] Gathering stats for stopped task
  1> [2021-01-25T03:35:21,835][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:21,840][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_more_fields_than_docvalue_limit] Gathering stats for stopped task
  1> [2021-01-25T03:35:22,338][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,347][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,358][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,368][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,382][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,405][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,443][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,514][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,649][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:22,911][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:23,430][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:24,461][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:24,467][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_more_fields_than_docvalue_limit] Gathering stats for stopped task
  1> [2021-01-25T03:35:24,492][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] Get stats for data frame analytics [test_outlier_detection_with_more_fields_than_docvalue_limit]
  1> [2021-01-25T03:35:24,498][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_more_fields_than_docvalue_limit] Gathering stats for stopped task
  1> [2021-01-25T03:35:24,756][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit]: cleaning up after test
  1> [2021-01-25T03:35:25,047][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit]: cleaned up after test
  1> [2021-01-25T03:35:25,048][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMoreFieldsThanDocValueFieldLimit] after test
  1> [2021-01-25T03:35:25,069][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] before test
  1> [2021-01-25T03:35:25,069][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] [RunDataFrameAnalyticsIT#testModelMemoryLimitLowerThanEstimatedMemoryUsage]: setting up test
  1> [2021-01-25T03:35:25,245][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] [RunDataFrameAnalyticsIT#testModelMemoryLimitLowerThanEstimatedMemoryUsage]: all set up test
  1> [2021-01-25T03:35:26,057][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,063][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_model_memory_limit_lower_than_estimated_memory_usage] Gathering stats for stopped task
  1> [2021-01-25T03:35:26,486][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,496][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,505][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,515][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,529][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,551][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,590][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,660][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:26,795][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:27,058][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:27,576][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:28,608][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:28,659][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] Get stats for data frame analytics [test_model_memory_limit_lower_than_estimated_memory_usage]
  1> [2021-01-25T03:35:28,664][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_model_memory_limit_lower_than_estimated_memory_usage] Gathering stats for stopped task
  1> [2021-01-25T03:35:28,877][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] [RunDataFrameAnalyticsIT#testModelMemoryLimitLowerThanEstimatedMemoryUsage]: cleaning up after test
  1> [2021-01-25T03:35:29,168][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] [RunDataFrameAnalyticsIT#testModelMemoryLimitLowerThanEstimatedMemoryUsage]: cleaned up after test
  1> [2021-01-25T03:35:29,169][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testModelMemoryLimitLowerThanEstimatedMemoryUsage] after test
  1> [2021-01-25T03:35:29,190][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] before test
  1> [2021-01-25T03:35:29,190][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] [RunDataFrameAnalyticsIT#testOutlierDetectionWithCustomParams]: setting up test
  1> [2021-01-25T03:35:29,389][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] [RunDataFrameAnalyticsIT#testOutlierDetectionWithCustomParams]: all set up test
  1> [2021-01-25T03:35:30,217][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,224][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_custom_params] Gathering stats for stopped task
  1> [2021-01-25T03:35:30,226][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,232][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_custom_params] Gathering stats for stopped task
  1> [2021-01-25T03:35:30,671][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,679][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,688][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,699][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,713][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,735][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,778][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,849][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:30,983][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:31,246][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:31,765][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:31,770][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_custom_params] Gathering stats for stopped task
  1> [2021-01-25T03:35:32,801][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:32,807][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_custom_params] Gathering stats for stopped task
  1> [2021-01-25T03:35:32,820][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithCustomParams] Get stats for data frame analytics [test_outlier_detection_with_custom_params]
  1> [2021-01-25T03:35:32,826][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_custom_params] Gathering stats for stopped task
  1> [2021-01-25T03:35:33,086][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] [RunDataFrameAnalyticsIT#testOutlierDetectionWithCustomParams]: cleaning up after test
  1> [2021-01-25T03:35:33,385][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] [RunDataFrameAnalyticsIT#testOutlierDetectionWithCustomParams]: cleaned up after test
  1> [2021-01-25T03:35:33,386][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithCustomParams] after test
  1> [2021-01-25T03:35:33,415][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] before test
  1> [2021-01-25T03:35:33,415][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] [RunDataFrameAnalyticsIT#testOutlierDetectionWithPreExistingDestIndex]: setting up test
  1> [2021-01-25T03:35:33,581][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] [RunDataFrameAnalyticsIT#testOutlierDetectionWithPreExistingDestIndex]: all set up test
  1> [2021-01-25T03:35:34,386][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,392][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_pre_existing_dest_index] Gathering stats for stopped task
  1> [2021-01-25T03:35:34,394][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,400][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_pre_existing_dest_index] Gathering stats for stopped task
  1> [2021-01-25T03:35:34,852][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,860][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,869][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,879][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,893][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,916][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:34,954][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,025][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,159][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,422][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,941][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,947][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_pre_existing_dest_index] Gathering stats for stopped task
  1> [2021-01-25T03:35:35,966][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithPreExistingDestIndex] Get stats for data frame analytics [test_outlier_detection_with_pre_existing_dest_index]
  1> [2021-01-25T03:35:35,971][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_pre_existing_dest_index] Gathering stats for stopped task
  1> [2021-01-25T03:35:36,240][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] [RunDataFrameAnalyticsIT#testOutlierDetectionWithPreExistingDestIndex]: cleaning up after test
  1> [2021-01-25T03:35:36,553][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] [RunDataFrameAnalyticsIT#testOutlierDetectionWithPreExistingDestIndex]: cleaned up after test
  1> [2021-01-25T03:35:36,554][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithPreExistingDestIndex] after test
  1> [2021-01-25T03:35:36,586][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] before test
  1> [2021-01-25T03:35:36,586][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] [RunDataFrameAnalyticsIT#testOutlierDetectionWithFewDocuments]: setting up test
  1> [2021-01-25T03:35:36,751][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] [RunDataFrameAnalyticsIT#testOutlierDetectionWithFewDocuments]: all set up test
  1> [2021-01-25T03:35:37,373][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,379][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_few_docs] Gathering stats for stopped task
  1> [2021-01-25T03:35:37,380][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,385][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_few_docs] Gathering stats for stopped task
  1> [2021-01-25T03:35:37,814][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,822][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,832][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,843][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,857][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,879][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,918][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:37,989][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,123][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,386][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,906][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,911][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_few_docs] Gathering stats for stopped task
  1> [2021-01-25T03:35:38,916][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,921][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_few_docs] Gathering stats for stopped task
  1> [2021-01-25T03:35:38,939][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithFewDocuments] Get stats for data frame analytics [test_outlier_detection_with_few_docs]
  1> [2021-01-25T03:35:38,944][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_few_docs] Gathering stats for stopped task
  1> [2021-01-25T03:35:39,226][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] [RunDataFrameAnalyticsIT#testOutlierDetectionWithFewDocuments]: cleaning up after test
  1> [2021-01-25T03:35:39,511][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] [RunDataFrameAnalyticsIT#testOutlierDetectionWithFewDocuments]: cleaned up after test
  1> [2021-01-25T03:35:39,512][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithFewDocuments] after test
  1> [2021-01-25T03:35:39,543][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] before test
  1> [2021-01-25T03:35:39,543][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMultipleSourceIndices]: setting up test
  1> [2021-01-25T03:35:39,714][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMultipleSourceIndices]: all set up test
  1> [2021-01-25T03:35:40,537][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:40,543][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_multiple_source_indices] Gathering stats for stopped task
  1> [2021-01-25T03:35:40,544][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:40,550][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_multiple_source_indices] Gathering stats for stopped task
  1> [2021-01-25T03:35:41,014][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,022][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,031][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,042][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,056][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,078][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,117][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,187][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,322][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:41,584][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:42,102][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:42,108][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_multiple_source_indices] Gathering stats for stopped task
  1> [2021-01-25T03:35:42,120][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithMultipleSourceIndices] Get stats for data frame analytics [test_outlier_detection_with_multiple_source_indices]
  1> [2021-01-25T03:35:42,124][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_multiple_source_indices] Gathering stats for stopped task
  1> [2021-01-25T03:35:42,398][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMultipleSourceIndices]: cleaning up after test
  1> [2021-01-25T03:35:42,705][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] [RunDataFrameAnalyticsIT#testOutlierDetectionWithMultipleSourceIndices]: cleaned up after test
  1> [2021-01-25T03:35:42,706][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithMultipleSourceIndices] after test
  1> [2021-01-25T03:35:42,735][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] before test
  1> [2021-01-25T03:35:42,735][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] [RunDataFrameAnalyticsIT#testOutlierDetectionStopAndRestart]: setting up test
  1> [2021-01-25T03:35:42,919][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] [RunDataFrameAnalyticsIT#testOutlierDetectionStopAndRestart]: all set up test
  1> [2021-01-25T03:35:43,597][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:43,602][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_stop_and_restart] Gathering stats for stopped task
  1> [2021-01-25T03:35:44,051][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,059][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,068][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,078][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,092][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,115][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,153][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,228][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,363][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:44,626][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:45,144][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:45,277][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:45,283][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_stop_and_restart] Gathering stats for stopped task
  1> [2021-01-25T03:35:45,305][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionStopAndRestart] Get stats for data frame analytics [test_outlier_detection_stop_and_restart]
  1> [2021-01-25T03:35:45,311][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_stop_and_restart] Gathering stats for stopped task
  1> [2021-01-25T03:35:45,573][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] [RunDataFrameAnalyticsIT#testOutlierDetectionStopAndRestart]: cleaning up after test
  1> [2021-01-25T03:35:45,897][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] [RunDataFrameAnalyticsIT#testOutlierDetectionStopAndRestart]: cleaned up after test
  1> [2021-01-25T03:35:45,898][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionStopAndRestart] after test
  2> REPRODUCE WITH: ./gradlew ':x-pack:plugin:ml:qa:native-multi-node-tests:javaRestTest' --tests "org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart" -Dtests.seed=8E4B8B2A38751536 -Dtests.security.manager=true -Dtests.locale=zh-Hant-TW -Dtests.timezone=Etc/GMT+4 -Druntime.java=11
  2> java.lang.AssertionError: 
    Expected: <1123L>
         but: was <0L>
        at __randomizedtesting.SeedInfo.seed([8E4B8B2A38751536:B9FD866D00DE65E6]:0)
        at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18)
        at org.junit.Assert.assertThat(Assert.java:956)
        at org.junit.Assert.assertThat(Assert.java:923)
        at org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart(RunDataFrameAnalyticsIT.java:641)
  1> [2021-01-25T03:35:45,958][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] before test
  1> [2021-01-25T03:35:45,958][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] [RunDataFrameAnalyticsIT#testOutlierDetection_GivenIndexWithRuntimeFields]: setting up test
  1> [2021-01-25T03:35:46,142][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] [RunDataFrameAnalyticsIT#testOutlierDetection_GivenIndexWithRuntimeFields]: all set up test
  1> [2021-01-25T03:35:46,865][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:46,871][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_index_with_runtime_mappings] Gathering stats for stopped task
  1> [2021-01-25T03:35:46,873][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:46,879][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_index_with_runtime_mappings] Gathering stats for stopped task
  1> [2021-01-25T03:35:47,352][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,359][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,368][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,378][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,392][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,414][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,452][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,522][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,657][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:47,923][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:48,442][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:48,448][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_index_with_runtime_mappings] Gathering stats for stopped task
  1> [2021-01-25T03:35:48,453][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:48,457][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_index_with_runtime_mappings] Gathering stats for stopped task
  1> [2021-01-25T03:35:48,468][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetection_GivenIndexWithRuntimeFields] Get stats for data frame analytics [test_outlier_detection_with_index_with_runtime_mappings]
  1> [2021-01-25T03:35:48,473][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_index_with_runtime_mappings] Gathering stats for stopped task
  1> [2021-01-25T03:35:48,744][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] [RunDataFrameAnalyticsIT#testOutlierDetection_GivenIndexWithRuntimeFields]: cleaning up after test
  1> [2021-01-25T03:35:49,037][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] [RunDataFrameAnalyticsIT#testOutlierDetection_GivenIndexWithRuntimeFields]: cleaned up after test
  1> [2021-01-25T03:35:49,038][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetection_GivenIndexWithRuntimeFields] after test
  1> [2021-01-25T03:35:49,067][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] before test
  1> [2021-01-25T03:35:49,067][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] [RunDataFrameAnalyticsIT#testLazyAssignmentWithModelMemoryLimitTooHighForAssignment]: setting up test
  1> [2021-01-25T03:35:49,237][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] [RunDataFrameAnalyticsIT#testLazyAssignmentWithModelMemoryLimitTooHighForAssignment]: all set up test
  1> [2021-01-25T03:35:49,859][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] Get stats for data frame analytics [test_lazy_assign_model_memory_limit_too_high]
  1> [2021-01-25T03:35:49,865][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_lazy_assign_model_memory_limit_too_high] Gathering stats for stopped task
  1> [2021-01-25T03:35:50,274][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] Get stats for data frame analytics [test_lazy_assign_model_memory_limit_too_high]
  1> [2021-01-25T03:35:50,279][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_lazy_assign_model_memory_limit_too_high] Gathering stats for stopped task
  1> [2021-01-25T03:35:50,351][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] Get stats for data frame analytics [test_lazy_assign_model_memory_limit_too_high]
  1> [2021-01-25T03:35:50,356][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_lazy_assign_model_memory_limit_too_high] Gathering stats for stopped task
  1> [2021-01-25T03:35:50,576][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] [RunDataFrameAnalyticsIT#testLazyAssignmentWithModelMemoryLimitTooHighForAssignment]: cleaning up after test
  1> [2021-01-25T03:35:50,869][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] [RunDataFrameAnalyticsIT#testLazyAssignmentWithModelMemoryLimitTooHighForAssignment]: cleaned up after test
  1> [2021-01-25T03:35:50,870][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testLazyAssignmentWithModelMemoryLimitTooHighForAssignment] after test
  1> [2021-01-25T03:35:50,901][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] before test
  1> [2021-01-25T03:35:50,901][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testStopOutlierDetectionWithEnoughDocumentsToScroll]: setting up test
  1> [2021-01-25T03:35:51,071][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testStopOutlierDetectionWithEnoughDocumentsToScroll]: all set up test
  1> [2021-01-25T03:35:51,760][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testStopOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_stop_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:51,765][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_stop_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:52,695][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testStopOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_stop_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:52,700][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_stop_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:52,969][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testStopOutlierDetectionWithEnoughDocumentsToScroll]: cleaning up after test
  1> [2021-01-25T03:35:53,255][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testStopOutlierDetectionWithEnoughDocumentsToScroll]: cleaned up after test
  1> [2021-01-25T03:35:53,256][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testStopOutlierDetectionWithEnoughDocumentsToScroll] after test
  1> [2021-01-25T03:35:53,288][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] before test
  1> [2021-01-25T03:35:53,288][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testOutlierDetectionWithEnoughDocumentsToScroll]: setting up test
  1> [2021-01-25T03:35:53,477][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testOutlierDetectionWithEnoughDocumentsToScroll]: all set up test
  1> [2021-01-25T03:35:54,162][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,167][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:54,168][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,173][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:54,619][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,626][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,635][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,645][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,659][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,681][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,719][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,790][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:54,924][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:55,187][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:55,706][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:56,736][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:56,742][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:56,753][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [testOutlierDetectionWithEnoughDocumentsToScroll] Get stats for data frame analytics [test_outlier_detection_with_enough_docs_to_scroll]
  1> [2021-01-25T03:35:56,757][DEBUG][o.e.x.m.a.TransportGetDataFrameAnalyticsStatsAction] [external_19] [test_outlier_detection_with_enough_docs_to_scroll] Gathering stats for stopped task
  1> [2021-01-25T03:35:57,017][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testOutlierDetectionWithEnoughDocumentsToScroll]: cleaning up after test
  1> [2021-01-25T03:35:57,322][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] [RunDataFrameAnalyticsIT#testOutlierDetectionWithEnoughDocumentsToScroll]: cleaned up after test
  1> [2021-01-25T03:35:57,323][INFO ][o.e.x.m.i.RunDataFrameAnalyticsIT] [testOutlierDetectionWithEnoughDocumentsToScroll] after test
  1> [2021-01-25T03:35:57,323][INFO ][o.e.n.Node               ] [suite] stopping ...
  1> [2021-01-25T03:35:57,327][INFO ][o.e.c.c.Coordinator      ] [external_19] master node [{javaRestTest-0}{YrwZqUteR8WIf637OMlh5A}{qVY45LkWTPm2oTScChQk8A}{127.0.0.1}{127.0.0.1:37889}{cdhilmrstw}{testattr=test, ml.machine_memory=101266309120, ml.max_open_jobs=20, xpack.installed=true, ml.max_jvm_size=518979584, transform.node=true}] failed, restarting discovery
  1> org.elasticsearch.transport.NodeDisconnectedException: [javaRestTest-0][127.0.0.1:37889][disconnected] disconnected
  1> [2021-01-25T03:35:57,335][INFO ][o.e.n.Node               ] [suite] stopped
  1> [2021-01-25T03:35:57,335][INFO ][o.e.n.Node               ] [suite] closing ...
  1> [2021-01-25T03:35:57,340][INFO ][o.e.n.Node               ] [suite] closed
  2> NOTE: leaving temporary files on disk at: /var/lib/jenkins/workspace/elastic+elasticsearch+master+multijob-unix-compatibility/os/ubuntu-18.04&&immutable/x-pack/plugin/ml/qa/native-multi-node-tests/build/testrun/javaRestTest/temp/org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT_8E4B8B2A38751536-001
  2> NOTE: test params are: codec=Asserting(Lucene87): {type=Lucene84}, docValues:{}, maxPointsInLeafNode=1690, maxMBSortInHeap=6.909776537599106, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=zh-Hant-TW, timezone=Etc/GMT+4
  2> NOTE: Linux 5.4.0-1034-gcp amd64/Oracle Corporation 11.0.2 (64-bit)/cpus=32,threads=1,free=362512432,total=536870912
  2> NOTE: All tests run in this JVM: [AutoscalingIT, ScheduledEventsIT, DatafeedJobsRestIT, BulkFailureRetryIT, InterimResultsDeletedAfterReopeningJobIT, DataFrameAnalysisCustomFeatureIT, DeleteExpiredDataIT, SetUpgradeModeIT, OutlierDetectionWithMissingFieldsIT, CategorizationIT, DatafeedJobsIT, DatafeedWithAggsIT, DeleteJobIT, OutlierDetectionEvaluationIT, ForecastIT, AutodetectMemoryLimitIT, ClassificationIT, ModelPlotsIT, RevertModelSnapshotIT, DelayedDataDetectorIT, RunDataFrameAnalyticsIT]
WARNING: Illegal reflective access by org.mockito.cglib.core.ReflectUtils$2 (file:/var/lib/jenkins/.gradle/caches/modules-2/files-2.1/org.elasticsearch/securemock/1.2/98201d4ad5ac93f6b415ae9172d52b5e7cda490e/securemock-1.2.jar) to method java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)

Tests with failures:
 - org.elasticsearch.xpack.ml.integration.RunDataFrameAnalyticsIT.testOutlierDetectionStopAndRestart
@valeriy42 valeriy42 added >test-failure Triaged test failures from CI :ml Machine learning Team:ML Meta label for the ML team labels Jan 25, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

This was referenced Jan 25, 2021
Merged
Merged
Merged
@dimitris-athanasiou dimitris-athanasiou self-assigned this Jan 25, 2021
@dimitris-athanasiou
Copy link
Contributor

This is a duplicate of #67581

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dimitris-athanasiou dimitris-athanasiou

Labels
:ml Machine learning Team:ML Meta label for the ML team >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@valeriy42 @dimitris-athanasiou @elasticmachine