Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ILM] Surfacing policy error state #89701

Merged

Conversation

jloleysens
Copy link
Contributor

@jloleysens jloleysens commented Jan 29, 2021

Summary

Fix #87520

Adds top-level indications of ILM policy form error states for the collapsible phases.

How to test

  1. Start kibana on basic
  2. Navigate to ILM policy plugin in the management section
  3. Edit or create a new policy
  4. Activate each phase, introducing some validation error in each. Usually a negative number in force merge or replicas will do.
  5. Collapse all the phases and make sure the red alert icon is showing on all phases with validation errors and the global error callout at the bottom of the form is showing while there are any validation errors.

Screenshots

Screenshot 2021-01-28 at 14 52 07

Screenshot 2021-01-28 at 14 52 18

Checklist

Delete any items that are not applicable to this PR.

@jloleysens jloleysens added Feature:ILM v8.0.0 Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more release_note:skip Skip the PR/issue when compiling release notes v7.12.0 labels Jan 29, 2021
@jloleysens jloleysens requested a review from a team as a code owner January 29, 2021 11:06
@elasticmachine
Copy link
Contributor

Pinging @elastic/es-ui (Team:Elasticsearch UI)

@mdefazio
Copy link
Contributor

Do we want to also include an error callout at the top of the policy?

@jloleysens
Copy link
Contributor Author

@mdefazio we could, but creating elements above where a user is inputting something introduces a jump that would be better to avoid IMO. What do you think?

Copy link
Contributor

@alisonelizabeth alisonelizabeth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work @jloleysens! I think this is a great UX improvement. Code LGTM. Verified locally.

One small suggestion - I'm not sure if the toast notification is still necessary (I can't recall having one for our other forms), but maybe @mdefazio can weigh in there.

Screen Shot 2021-01-29 at 10 04 59 AM

if (!isMounted.current) {
return;
}
// This is a hack, we need to wait for the next tick to let all of the async validation complete
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it worth opening up an issue on the form lib side to consider improving this?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey Alison, that is good point!

};

test('shows phase error indicators correctly', async () => {
// This test simulates a user configuring a policy phase by phase. The flow is the following:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding these comments 👍

@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

@jloleysens
Copy link
Contributor Author

We are considering changing the implementation of how form errors are detected, in conversation with @sebelga .

@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

@jloleysens
Copy link
Contributor Author

@elasticmachine merge upstream

@jloleysens jloleysens removed the request for review from mdefazio February 2, 2021 16:00
@jloleysens
Copy link
Contributor Author

Implementation change summary:

  • Errors are listened to at the field level, instead of at the form level (bottom-up, instead of top-down). This helps isolate re-renders a bit
  • Using the new onError callback for useField [Form lib] UseField onError listener #89895

@sebelga
Copy link
Contributor

sebelga commented Feb 2, 2021

Changes with the onError handler look good to me! I find it less hacky that the setTimeout and top-bottom approach 😊

Copy link
Contributor

@alisonelizabeth alisonelizabeth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Latest changes LGTM. I like this approach better 👍 . I did not retest.

@jloleysens jloleysens merged commit 6dd6c99 into elastic:master Feb 3, 2021
jloleysens added a commit to jloleysens/kibana that referenced this pull request Feb 3, 2021
* added policy top-level callout for error state

* added form errors context. errors are sorted by their field path into phases

* added data test subject attributes and prevent setErrors from getting called if component is not mounted

* update copy

* refactored errors context and optimised setting of context value. Also added test for various form error notifications across the collapsed phases

* add test for non-phase specific policy validation error

* Remove unused import

* refactor how errors are listened to, use the new "onError" callback

Co-authored-by: Kibana Machine <[email protected]>
@jloleysens jloleysens deleted the ilm/surfacing-policy-error-state branch February 3, 2021 11:17
jloleysens added a commit that referenced this pull request Feb 3, 2021
* added policy top-level callout for error state

* added form errors context. errors are sorted by their field path into phases

* added data test subject attributes and prevent setErrors from getting called if component is not mounted

* update copy

* refactored errors context and optimised setting of context value. Also added test for various form error notifications across the collapsed phases

* add test for non-phase specific policy validation error

* Remove unused import

* refactor how errors are listened to, use the new "onError" callback

Co-authored-by: Kibana Machine <[email protected]>

Co-authored-by: Kibana Machine <[email protected]>
@kibanamachine
Copy link
Contributor

kibanamachine commented Feb 9, 2021

💔 Build Failed

Failed CI Steps


Test Failures

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/ml/data_frame_analytics/feature_importance·ts.machine learning data frame analytics total feature importance panel and decision path popover binary classification job should display the feature importance decision path in the data grid

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: machine learning
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: 
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> "before all" hook
[00:00:00]               │ debg creating role ft_ml_source
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_ml_source]
[00:00:00]               │ debg creating role ft_ml_source_readonly
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_ml_source_readonly]
[00:00:00]               │ debg creating role ft_ml_dest
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_ml_dest]
[00:00:00]               │ debg creating role ft_ml_dest_readonly
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_ml_dest_readonly]
[00:00:00]               │ debg creating role ft_ml_ui_extras
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_ml_ui_extras]
[00:00:00]               │ debg creating role ft_default_space_ml_all
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_default_space_ml_all]
[00:00:00]               │ debg creating role ft_default_space1_ml_all
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_default_space1_ml_all]
[00:00:00]               │ debg creating role ft_all_spaces_ml_all
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_all_spaces_ml_all]
[00:00:00]               │ debg creating role ft_default_space_ml_read
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_default_space_ml_read]
[00:00:00]               │ debg creating role ft_default_space1_ml_read
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_default_space1_ml_read]
[00:00:00]               │ debg creating role ft_all_spaces_ml_read
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_all_spaces_ml_read]
[00:00:00]               │ debg creating role ft_default_space_ml_none
[00:00:00]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added role [ft_default_space_ml_none]
[00:00:00]               │ debg creating user ft_ml_poweruser
[00:00:00]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_poweruser]
[00:00:00]               │ debg created user ft_ml_poweruser
[00:00:00]               │ debg creating user ft_ml_poweruser_spaces
[00:00:00]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_poweruser_spaces]
[00:00:00]               │ debg created user ft_ml_poweruser_spaces
[00:00:00]               │ debg creating user ft_ml_poweruser_space1
[00:00:00]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_poweruser_space1]
[00:00:00]               │ debg created user ft_ml_poweruser_space1
[00:00:00]               │ debg creating user ft_ml_poweruser_all_spaces
[00:00:00]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_poweruser_all_spaces]
[00:00:00]               │ debg created user ft_ml_poweruser_all_spaces
[00:00:00]               │ debg creating user ft_ml_viewer
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_viewer]
[00:00:01]               │ debg created user ft_ml_viewer
[00:00:01]               │ debg creating user ft_ml_viewer_spaces
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_viewer_spaces]
[00:00:01]               │ debg created user ft_ml_viewer_spaces
[00:00:01]               │ debg creating user ft_ml_viewer_space1
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_viewer_space1]
[00:00:01]               │ debg created user ft_ml_viewer_space1
[00:00:01]               │ debg creating user ft_ml_viewer_all_spaces
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_viewer_all_spaces]
[00:00:01]               │ debg created user ft_ml_viewer_all_spaces
[00:00:01]               │ debg creating user ft_ml_unauthorized
[00:00:01]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ds-ilm-history-5-2021.02.09-000001] creating index, cause [initialize_data_stream], templates [ilm-history], shards [1]/[0]
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_unauthorized]
[00:00:01]               │ info [o.e.c.m.MetadataCreateDataStreamService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding data stream [ilm-history-5] with write index [.ds-ilm-history-5-2021.02.09-000001] and backing indices []
[00:00:01]               │ debg created user ft_ml_unauthorized
[00:00:01]               │ debg creating user ft_ml_unauthorized_spaces
[00:00:01]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ds-ilm-history-5-2021.02.09-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ilm-history-ilm-policy]
[00:00:01]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.ds-ilm-history-5-2021.02.09-000001][0]]])." previous.health="YELLOW" reason="shards started [[.ds-ilm-history-5-2021.02.09-000001][0]]"
[00:00:01]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ds-ilm-history-5-2021.02.09-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ilm-history-ilm-policy]
[00:00:01]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] added user [ft_ml_unauthorized_spaces]
[00:00:01]               │ debg created user ft_ml_unauthorized_spaces
[00:44:23]             └-: data frame analytics
[00:44:23]               └-> "before all" hook
[00:47:39]               └-: total feature importance panel and decision path popover
[00:47:39]                 └-> "before all" hook
[00:47:39]                 └-> "before all" hook
[00:47:39]                   │ debg applying update to kibana config: {"dateFormat:tz":"UTC"}
[00:47:40]                   │ debg SecurityPage.forceLogout
[00:47:40]                   │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=100
[00:47:40]                   │ debg --- retry.tryForTime error: .login-form is not displayed
[00:47:40]                   │ debg Redirecting to /logout to force the logout
[00:47:41]                   │ debg Waiting on the login form to appear
[00:47:41]                   │ debg Waiting for Login Page to appear.
[00:47:41]                   │ debg Waiting up to 100000ms for login page...
[00:47:41]                   │ debg browser[INFO] http://localhost:61111/logout?_t=1612882219187 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:47:41]                   │
[00:47:41]                   │ debg browser[INFO] http://localhost:61111/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:47:41]                   │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:47:43]                   │ debg browser[INFO] http://localhost:61111/login?msg=LOGGED_OUT 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:47:43]                   │
[00:47:43]                   │ debg browser[INFO] http://localhost:61111/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:47:43]                   │ debg --- retry.tryForTime error: .login-form is not displayed
[00:47:43]                   │ERROR browser[SEVERE] http://localhost:61111/internal/spaces/_active_space - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:47:44]                   │ERROR browser[SEVERE] http://localhost:61111/internal/security/me - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:47:44]                   │ debg browser[INFO] http://localhost:61111/40079/bundles/core/core.entry.js 12:159380 "Detected an unhandled Promise rejection.
[00:47:44]                   │      Error: Unauthorized"
[00:47:44]                   │ERROR browser[SEVERE] http://localhost:61111/40079/bundles/core/core.entry.js 5:3002 
[00:47:44]                   │ERROR browser[SEVERE] http://localhost:61111/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:47:44]                   │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:47:44]                   │ debg TestSubjects.exists(loginForm)
[00:47:44]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:47:44]                   │ debg Waiting for Login Form to appear.
[00:47:44]                   │ debg Waiting up to 100000ms for login form...
[00:47:44]                   │ debg TestSubjects.exists(loginForm)
[00:47:44]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:47:44]                   │ debg TestSubjects.setValue(loginUsername, ft_ml_poweruser)
[00:47:44]                   │ debg TestSubjects.click(loginUsername)
[00:47:44]                   │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:47:44]                   │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:47:44]                   │ debg TestSubjects.setValue(loginPassword, mlp001)
[00:47:44]                   │ debg TestSubjects.click(loginPassword)
[00:47:44]                   │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:47:44]                   │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:47:44]                   │ debg TestSubjects.click(loginSubmit)
[00:47:44]                   │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:47:44]                   │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:47:45]                   │ debg Waiting for login result, expected: chrome.
[00:47:45]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"] .app-wrapper:not(.hidden-chrome)') with timeout=20000
[00:47:45]                   │ proc [kibana]   log   [14:50:23.336] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:47:47]                   │ debg browser[INFO] http://localhost:61111/app/home 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:47:47]                   │
[00:47:47]                   │ debg browser[INFO] http://localhost:61111/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:47:47]                   │ debg Finished login process currentUrl = http://localhost:61111/app/home#/
[00:47:47]                   │ debg Waiting up to 20000ms for logout button visible...
[00:47:47]                   │ debg TestSubjects.exists(userMenuButton)
[00:47:47]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenuButton"]') with timeout=2500
[00:47:47]                   │ debg TestSubjects.exists(userMenu)
[00:47:47]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=2500
[00:47:49]                   │ debg --- retry.tryForTime error: [data-test-subj="userMenu"] is not displayed
[00:47:50]                   │ debg TestSubjects.click(userMenuButton)
[00:47:50]                   │ debg Find.clickByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:47:50]                   │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:47:50]                   │ debg TestSubjects.exists(userMenu)
[00:47:50]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=120000
[00:47:50]                   │ debg TestSubjects.exists(userMenu > logoutLink)
[00:47:50]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"] [data-test-subj="logoutLink"]') with timeout=2500
[00:47:50]                   │ info [ml/ihp_outlier] Loading "mappings.json"
[00:47:50]                   │ info [ml/ihp_outlier] Loading "data.json.gz"
[00:47:50]                   │ info [ml/ihp_outlier] Skipped restore for existing index "ft_ihp_outlier"
[00:47:50]                   │ debg Searching for 'index-pattern' with title 'ft_ihp_outlier'...
[00:47:50]                   │ debg  > Found 'a512b510-6adf-11eb-aa93-af9bc8cd0de1'
[00:47:50]                   │ debg Index pattern with title 'ft_ihp_outlier' already exists. Nothing to create.
[00:47:50]                   │ debg Creating data frame analytic job with id 'ihp_fi_binary_1612879357706' ...
[00:47:50]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-config] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:47:50]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-config]
[00:47:50]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-annotations-6] creating index, cause [api], templates [], shards [1]/[1]
[00:47:50]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-annotations-6]
[00:47:50]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-notifications-000001] creating index, cause [auto(bulk api)], templates [.ml-notifications-000001], shards [1]/[1]
[00:47:50]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-notifications-000001]
[00:47:51]                   │ debg Waiting up to 5000ms for 'ihp_fi_binary_1612879357706' to exist...
[00:47:51]                   │ debg Fetching data frame analytics job 'ihp_fi_binary_1612879357706'...
[00:47:51]                   │ debg > DFA job fetched.
[00:47:51]                   │ debg > DFA job created.
[00:47:51]                   │ debg Starting data frame analytics job 'ihp_fi_binary_1612879357706'...
[00:47:51]                   │ info [o.e.x.m.a.TransportStartDataFrameAnalyticsAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Starting data frame analytics from state [stopped]
[00:47:51]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-inference-000003] creating index, cause [api], templates [], shards [1]/[1]
[00:47:51]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-inference-000003]
[00:47:51]                   │ info [o.e.x.c.m.u.MlIndexAndAlias] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] About to create first concrete index [.ml-state-000001] with alias [.ml-state-write]
[00:47:51]                   │ debg > DFA job started.
[00:47:51]                   │ debg Waiting up to 60000ms for 'ihp_fi_binary_1612879357706' to have training_docs_count > 0...
[00:47:51]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:51]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-state-000001] creating index, cause [api], templates [.ml-state], shards [1]/[1]
[00:47:51]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-state-000001]
[00:47:51]                   │ debg > DFA job stats fetched.
[00:47:51]                   │ debg --- retry.waitForWithTimeout error: expected data frame analytics job 'ihp_fi_binary_1612879357706' to have training_docs_count > 0 (got 0)
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-state-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ml-size-based-ilm-policy]
[00:47:51]                   │ info [o.e.x.c.m.u.MlIndexAndAlias] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] About to create first concrete index [.ml-stats-000001] with alias [.ml-stats-write]
[00:47:51]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.ml-stats-000001] creating index, cause [api], templates [.ml-stats], shards [1]/[1]
[00:47:51]                   │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updating number_of_replicas to [0] for indices [.ml-stats-000001]
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-state-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ml-size-based-ilm-policy]
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-stats-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ml-size-based-ilm-policy]
[00:47:51]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Creating destination index [user-ihp_fi_binary_1612879357706]
[00:47:51]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [user-ihp_fi_binary_1612879357706] creating index, cause [api], templates [], shards [1]/[1]
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-state-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ml-size-based-ilm-policy]
[00:47:51]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Started reindexing
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-stats-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ml-size-based-ilm-policy]
[00:47:51]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.ml-stats-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ml-size-based-ilm-policy]
[00:47:52]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:52]                   │ debg > DFA job stats fetched.
[00:47:52]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:52]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Started loading data
[00:47:52]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Started analyzing
[00:47:52]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Waiting for result processor to complete
[00:47:52]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:52]                   │ debg > DFA job stats fetched.
[00:47:52]                   │ debg Waiting up to 120000ms for analytics state to be stopped...
[00:47:52]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:52]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:52]                   │ debg > DFA job stats fetched.
[00:47:52]                   │ debg --- retry.waitForWithTimeout error: expected analytics state to be stopped but got started
[00:47:53]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:53]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:53]                   │ debg > DFA job stats fetched.
[00:47:53]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:53]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:53]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:53]                   │ debg > DFA job stats fetched.
[00:47:53]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:54]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:54]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:54]                   │ debg > DFA job stats fetched.
[00:47:54]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:54]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:54]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:54]                   │ debg > DFA job stats fetched.
[00:47:54]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:55]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:55]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:55]                   │ debg > DFA job stats fetched.
[00:47:55]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:55]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:55]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:55]                   │ debg > DFA job stats fetched.
[00:47:55]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:56]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:56]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:56]                   │ debg > DFA job stats fetched.
[00:47:56]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:56]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:56]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:56]                   │ debg > DFA job stats fetched.
[00:47:56]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:57]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:57]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:57]                   │ debg > DFA job stats fetched.
[00:47:57]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:57]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:57]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:57]                   │ debg > DFA job stats fetched.
[00:47:57]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:58]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:58]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:58]                   │ debg > DFA job stats fetched.
[00:47:58]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:58]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:58]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:58]                   │ debg > DFA job stats fetched.
[00:47:58]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:59]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] [data_frame_analyzer/263419] [CBoostedTreeImpl.cc@245] Hyperparameter selection failed: exiting loop early
[00:47:59]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:59]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:59]                   │ debg > DFA job stats fetched.
[00:47:59]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:59]                   │ info [o.e.x.m.d.p.ChunkedTrainedModelPersister] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] finished storing trained model with id [ihp_fi_binary_1612879357706-1612882237944]
[00:47:59]                   │ info [o.e.x.m.d.p.AnalyticsResultProcessor] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Started writing results
[00:47:59]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:47:59]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:47:59]                   │ debg > DFA job stats fetched.
[00:47:59]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:47:59]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Result processor has completed
[00:47:59]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Closing process
[00:47:59]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] [data_frame_analyzer/263419] [Main.cc@241] [{"name":"E_DFTPMEstimatedPeakMemoryUsage","description":"The upfront estimate of the peak memory training the predictive model would use","value":6040636}
[00:47:59]                   │      ,{"name":"E_DFTPMPeakMemoryUsage","description":"The peak memory training the predictive model used","value":225175}
[00:47:59]                   │      ,{"name":"E_DFTPMTimeToTrain","description":"The time it took to train the predictive model","value":6873}
[00:47:59]                   │      ,{"name":"E_DFTPMTrainedForestNumberTrees","description":"The total number of trees in the trained forest","value":42}
[00:47:59]                   │      ]
[00:47:59]                   │ info [o.e.x.m.p.AbstractNativeProcess] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] State output finished
[00:47:59]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Closed process
[00:47:59]                   │ info [o.e.x.m.d.i.InferenceRunner] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Started inference on test data against model [ihp_fi_binary_1612879357706-1612882237944]
[00:48:00]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:48:00]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:48:00]                   │ debg > DFA job stats fetched.
[00:48:00]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:00]                   │ info [o.e.x.m.d.DataFrameAnalyticsManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_binary_1612879357706] Marking task completed
[00:48:00]                   │ debg Fetching analytics state for job ihp_fi_binary_1612879357706
[00:48:00]                   │ debg Fetching data frame analytics job stats for job ihp_fi_binary_1612879357706...
[00:48:00]                   │ debg > DFA job stats fetched.
[00:48:00]                   │ info [ml/ihp_outlier] Loading "mappings.json"
[00:48:00]                   │ info [ml/ihp_outlier] Loading "data.json.gz"
[00:48:00]                   │ info [ml/ihp_outlier] Skipped restore for existing index "ft_ihp_outlier"
[00:48:00]                   │ debg Searching for 'index-pattern' with title 'ft_ihp_outlier'...
[00:48:00]                   │ debg  > Found 'a512b510-6adf-11eb-aa93-af9bc8cd0de1'
[00:48:00]                   │ debg Index pattern with title 'ft_ihp_outlier' already exists. Nothing to create.
[00:48:00]                   │ debg Creating data frame analytic job with id 'ihp_fi_multi_1612879357706' ...
[00:48:01]                   │ debg Waiting up to 5000ms for 'ihp_fi_multi_1612879357706' to exist...
[00:48:01]                   │ debg Fetching data frame analytics job 'ihp_fi_multi_1612879357706'...
[00:48:01]                   │ debg > DFA job fetched.
[00:48:01]                   │ debg > DFA job created.
[00:48:01]                   │ debg Starting data frame analytics job 'ihp_fi_multi_1612879357706'...
[00:48:01]                   │ info [o.e.x.m.a.TransportStartDataFrameAnalyticsAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Starting data frame analytics from state [stopped]
[00:48:01]                   │ debg > DFA job started.
[00:48:01]                   │ debg Waiting up to 60000ms for 'ihp_fi_multi_1612879357706' to have training_docs_count > 0...
[00:48:01]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:01]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Creating destination index [user-ihp_fi_multi_1612879357706]
[00:48:01]                   │ debg > DFA job stats fetched.
[00:48:01]                   │ debg --- retry.waitForWithTimeout error: expected data frame analytics job 'ihp_fi_multi_1612879357706' to have training_docs_count > 0 (got 0)
[00:48:01]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [user-ihp_fi_multi_1612879357706] creating index, cause [api], templates [], shards [1]/[1]
[00:48:01]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Started reindexing
[00:48:02]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:02]                   │ debg > DFA job stats fetched.
[00:48:02]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:02]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Started loading data
[00:48:02]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Started analyzing
[00:48:02]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Waiting for result processor to complete
[00:48:02]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:02]                   │ debg > DFA job stats fetched.
[00:48:02]                   │ debg Waiting up to 120000ms for analytics state to be stopped...
[00:48:02]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:02]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:02]                   │ debg > DFA job stats fetched.
[00:48:02]                   │ debg --- retry.waitForWithTimeout error: expected analytics state to be stopped but got started
[00:48:03]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:03]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:03]                   │ debg > DFA job stats fetched.
[00:48:03]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:03]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:03]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:03]                   │ debg > DFA job stats fetched.
[00:48:03]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:04]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:04]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:04]                   │ debg > DFA job stats fetched.
[00:48:04]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:04]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:04]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:04]                   │ debg > DFA job stats fetched.
[00:48:04]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:05]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:05]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:05]                   │ debg > DFA job stats fetched.
[00:48:05]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:05]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:05]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:05]                   │ debg > DFA job stats fetched.
[00:48:05]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:06]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:06]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:06]                   │ debg > DFA job stats fetched.
[00:48:06]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:06]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:06]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:06]                   │ debg > DFA job stats fetched.
[00:48:06]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:07]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:07]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:07]                   │ debg > DFA job stats fetched.
[00:48:07]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:07]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:07]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:07]                   │ debg > DFA job stats fetched.
[00:48:07]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:08]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:08]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:08]                   │ debg > DFA job stats fetched.
[00:48:08]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:08]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:08]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:08]                   │ debg > DFA job stats fetched.
[00:48:08]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:09]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:09]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:09]                   │ debg > DFA job stats fetched.
[00:48:09]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:09]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:09]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:09]                   │ debg > DFA job stats fetched.
[00:48:09]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:10]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:10]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:10]                   │ debg > DFA job stats fetched.
[00:48:10]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:10]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:10]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:10]                   │ debg > DFA job stats fetched.
[00:48:10]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:11]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:11]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:11]                   │ debg > DFA job stats fetched.
[00:48:11]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:11]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:11]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:11]                   │ debg > DFA job stats fetched.
[00:48:11]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:12]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:12]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:12]                   │ debg > DFA job stats fetched.
[00:48:12]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:12]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:12]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:12]                   │ debg > DFA job stats fetched.
[00:48:12]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:13]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:13]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:13]                   │ debg > DFA job stats fetched.
[00:48:13]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:13]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:13]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:13]                   │ debg > DFA job stats fetched.
[00:48:13]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:14]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:14]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:14]                   │ debg > DFA job stats fetched.
[00:48:14]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:14]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:14]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:14]                   │ debg > DFA job stats fetched.
[00:48:14]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:15]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:15]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:15]                   │ debg > DFA job stats fetched.
[00:48:15]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:15]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:15]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:15]                   │ debg > DFA job stats fetched.
[00:48:15]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:16]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:16]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:16]                   │ debg > DFA job stats fetched.
[00:48:16]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:16]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:16]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:16]                   │ debg > DFA job stats fetched.
[00:48:16]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:17]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:17]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:17]                   │ debg > DFA job stats fetched.
[00:48:17]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:17]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:17]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:17]                   │ debg > DFA job stats fetched.
[00:48:17]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:18]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:18]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:18]                   │ debg > DFA job stats fetched.
[00:48:18]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:19]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:19]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:19]                   │ debg > DFA job stats fetched.
[00:48:19]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:19]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:19]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:19]                   │ debg > DFA job stats fetched.
[00:48:19]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:20]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:20]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:20]                   │ debg > DFA job stats fetched.
[00:48:20]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:20]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:20]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:20]                   │ debg > DFA job stats fetched.
[00:48:20]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:21]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:21]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:21]                   │ debg > DFA job stats fetched.
[00:48:21]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:21]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:21]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:21]                   │ debg > DFA job stats fetched.
[00:48:21]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:22]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:22]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:22]                   │ debg > DFA job stats fetched.
[00:48:22]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:22]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:22]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:22]                   │ debg > DFA job stats fetched.
[00:48:22]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:23]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:23]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:23]                   │ debg > DFA job stats fetched.
[00:48:23]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:23]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:23]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:23]                   │ debg > DFA job stats fetched.
[00:48:23]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:24]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:24]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:24]                   │ debg > DFA job stats fetched.
[00:48:24]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:24]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:24]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:24]                   │ debg > DFA job stats fetched.
[00:48:24]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:25]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:25]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:25]                   │ debg > DFA job stats fetched.
[00:48:25]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:25]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:25]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:25]                   │ debg > DFA job stats fetched.
[00:48:25]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:25]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] [data_frame_analyzer/263923] [CBoostedTreeImpl.cc@245] Hyperparameter selection failed: exiting loop early
[00:48:26]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:26]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:26]                   │ debg > DFA job stats fetched.
[00:48:26]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:26]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:26]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:26]                   │ debg > DFA job stats fetched.
[00:48:26]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:26]                   │ info [o.e.x.m.d.p.ChunkedTrainedModelPersister] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] finished storing trained model with id [ihp_fi_multi_1612879357706-1612882265125]
[00:48:26]                   │ info [o.e.x.m.d.p.AnalyticsResultProcessor] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Started writing results
[00:48:27]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Result processor has completed
[00:48:27]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Closing process
[00:48:27]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] [data_frame_analyzer/263923] [Main.cc@241] [{"name":"E_DFTPMEstimatedPeakMemoryUsage","description":"The upfront estimate of the peak memory training the predictive model would use","value":9613500}
[00:48:27]                   │      ,{"name":"E_DFTPMPeakMemoryUsage","description":"The peak memory training the predictive model used","value":1390210}
[00:48:27]                   │      ,{"name":"E_DFTPMTimeToTrain","description":"The time it took to train the predictive model","value":23746}
[00:48:27]                   │      ,{"name":"E_DFTPMTrainedForestNumberTrees","description":"The total number of trees in the trained forest","value":57}
[00:48:27]                   │      ]
[00:48:27]                   │ info [o.e.x.m.p.AbstractNativeProcess] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] State output finished
[00:48:27]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Closed process
[00:48:27]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:27]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:27]                   │ info [o.e.x.m.d.i.InferenceRunner] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Started inference on test data against model [ihp_fi_multi_1612879357706-1612882265125]
[00:48:27]                   │ debg > DFA job stats fetched.
[00:48:27]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:27]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:27]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:27]                   │ debg > DFA job stats fetched.
[00:48:27]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:28]                   │ info [o.e.x.m.d.DataFrameAnalyticsManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [ihp_fi_multi_1612879357706] Marking task completed
[00:48:28]                   │ debg Fetching analytics state for job ihp_fi_multi_1612879357706
[00:48:28]                   │ debg Fetching data frame analytics job stats for job ihp_fi_multi_1612879357706...
[00:48:28]                   │ debg > DFA job stats fetched.
[00:48:28]                   │ info [ml/egs_regression] Loading "mappings.json"
[00:48:28]                   │ info [ml/egs_regression] Loading "data.json.gz"
[00:48:28]                   │ info [ml/egs_regression] Skipped restore for existing index "ft_egs_regression"
[00:48:28]                   │ debg Searching for 'index-pattern' with title 'ft_egs_regression'...
[00:48:28]                   │ debg  > Found 'ca442250-6ae5-11eb-aa93-af9bc8cd0de1'
[00:48:28]                   │ debg Index pattern with title 'ft_egs_regression' already exists. Nothing to create.
[00:48:28]                   │ debg Creating data frame analytic job with id 'egs_fi_reg_1612879357706' ...
[00:48:29]                   │ debg Waiting up to 5000ms for 'egs_fi_reg_1612879357706' to exist...
[00:48:29]                   │ debg Fetching data frame analytics job 'egs_fi_reg_1612879357706'...
[00:48:29]                   │ debg > DFA job fetched.
[00:48:29]                   │ debg > DFA job created.
[00:48:29]                   │ debg Starting data frame analytics job 'egs_fi_reg_1612879357706'...
[00:48:29]                   │ info [o.e.x.m.a.TransportStartDataFrameAnalyticsAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Starting data frame analytics from state [stopped]
[00:48:29]                   │ debg > DFA job started.
[00:48:29]                   │ debg Waiting up to 60000ms for 'egs_fi_reg_1612879357706' to have training_docs_count > 0...
[00:48:29]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:29]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Creating destination index [user-egs_fi_reg_1612879357706]
[00:48:29]                   │ debg > DFA job stats fetched.
[00:48:29]                   │ debg --- retry.waitForWithTimeout error: expected data frame analytics job 'egs_fi_reg_1612879357706' to have training_docs_count > 0 (got 0)
[00:48:29]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [user-egs_fi_reg_1612879357706] creating index, cause [api], templates [], shards [1]/[1]
[00:48:29]                   │ info [o.e.x.m.d.s.ReindexingStep] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Started reindexing
[00:48:30]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:30]                   │ debg > DFA job stats fetched.
[00:48:30]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:30]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Started loading data
[00:48:30]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Started analyzing
[00:48:30]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Waiting for result processor to complete
[00:48:30]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:30]                   │ debg > DFA job stats fetched.
[00:48:30]                   │ debg Waiting up to 120000ms for analytics state to be stopped...
[00:48:30]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:30]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:30]                   │ debg > DFA job stats fetched.
[00:48:30]                   │ debg --- retry.waitForWithTimeout error: expected analytics state to be stopped but got started
[00:48:31]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:31]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:31]                   │ debg > DFA job stats fetched.
[00:48:31]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:31]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:31]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:31]                   │ debg > DFA job stats fetched.
[00:48:31]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:32]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:32]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:32]                   │ debg > DFA job stats fetched.
[00:48:32]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:32]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:32]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:32]                   │ debg > DFA job stats fetched.
[00:48:32]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:33]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:33]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:33]                   │ debg > DFA job stats fetched.
[00:48:33]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:33]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:33]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:33]                   │ debg > DFA job stats fetched.
[00:48:33]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:34]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:34]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:34]                   │ debg > DFA job stats fetched.
[00:48:34]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:34]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:34]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:34]                   │ debg > DFA job stats fetched.
[00:48:34]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:35]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:35]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:35]                   │ debg > DFA job stats fetched.
[00:48:35]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:35]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:35]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:35]                   │ debg > DFA job stats fetched.
[00:48:35]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:36]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:36]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:36]                   │ debg > DFA job stats fetched.
[00:48:36]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:36]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:36]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:36]                   │ debg > DFA job stats fetched.
[00:48:36]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:37]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:37]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:37]                   │ debg > DFA job stats fetched.
[00:48:37]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:37]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:37]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:37]                   │ debg > DFA job stats fetched.
[00:48:37]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:38]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:38]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:38]                   │ debg > DFA job stats fetched.
[00:48:38]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:38]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:38]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:38]                   │ debg > DFA job stats fetched.
[00:48:38]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:39]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:39]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:39]                   │ debg > DFA job stats fetched.
[00:48:39]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:39]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:39]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:39]                   │ debg > DFA job stats fetched.
[00:48:39]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:40]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:40]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:40]                   │ debg > DFA job stats fetched.
[00:48:40]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:40]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:40]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:40]                   │ debg > DFA job stats fetched.
[00:48:40]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:41]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:41]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:41]                   │ debg > DFA job stats fetched.
[00:48:41]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:41]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:41]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:41]                   │ debg > DFA job stats fetched.
[00:48:41]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:42]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:42]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:42]                   │ debg > DFA job stats fetched.
[00:48:42]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:43]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:43]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:43]                   │ debg > DFA job stats fetched.
[00:48:43]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:43]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:43]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:43]                   │ debg > DFA job stats fetched.
[00:48:43]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:44]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:44]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:44]                   │ debg > DFA job stats fetched.
[00:48:44]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:44]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:44]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:44]                   │ debg > DFA job stats fetched.
[00:48:44]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:45]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:45]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:45]                   │ debg > DFA job stats fetched.
[00:48:45]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:45]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:45]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:45]                   │ debg > DFA job stats fetched.
[00:48:45]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:46]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:46]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:46]                   │ debg > DFA job stats fetched.
[00:48:46]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:46]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:46]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:46]                   │ debg > DFA job stats fetched.
[00:48:46]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:47]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:47]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:47]                   │ debg > DFA job stats fetched.
[00:48:47]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:47]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:47]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:47]                   │ debg > DFA job stats fetched.
[00:48:47]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:48]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:48]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:48]                   │ debg > DFA job stats fetched.
[00:48:48]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:48]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:48]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:48]                   │ debg > DFA job stats fetched.
[00:48:48]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:49]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:49]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:49]                   │ debg > DFA job stats fetched.
[00:48:49]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:49]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:49]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:49]                   │ debg > DFA job stats fetched.
[00:48:49]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:50]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:50]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:50]                   │ debg > DFA job stats fetched.
[00:48:50]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:50]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:50]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:50]                   │ debg > DFA job stats fetched.
[00:48:50]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:51]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:51]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:51]                   │ debg > DFA job stats fetched.
[00:48:51]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:51]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:51]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:51]                   │ debg > DFA job stats fetched.
[00:48:51]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:52]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:52]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:52]                   │ debg > DFA job stats fetched.
[00:48:52]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:52]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:52]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:52]                   │ debg > DFA job stats fetched.
[00:48:52]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:53]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:53]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:53]                   │ debg > DFA job stats fetched.
[00:48:53]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:53]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:53]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:53]                   │ debg > DFA job stats fetched.
[00:48:53]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:54]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:54]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:54]                   │ debg > DFA job stats fetched.
[00:48:54]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:54]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:54]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:54]                   │ debg > DFA job stats fetched.
[00:48:54]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:55]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:55]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:55]                   │ debg > DFA job stats fetched.
[00:48:55]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:55]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:55]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:55]                   │ debg > DFA job stats fetched.
[00:48:55]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:56]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:56]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:56]                   │ debg > DFA job stats fetched.
[00:48:56]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:56]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:56]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:56]                   │ debg > DFA job stats fetched.
[00:48:56]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:57]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:57]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:57]                   │ debg > DFA job stats fetched.
[00:48:57]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:57]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:57]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:57]                   │ debg > DFA job stats fetched.
[00:48:57]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:58]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:58]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:58]                   │ debg > DFA job stats fetched.
[00:48:58]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:58]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:58]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:58]                   │ debg > DFA job stats fetched.
[00:48:58]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:59]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:59]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:59]                   │ debg > DFA job stats fetched.
[00:48:59]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:48:59]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:48:59]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:48:59]                   │ debg > DFA job stats fetched.
[00:48:59]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:00]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:00]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:00]                   │ debg > DFA job stats fetched.
[00:49:00]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:00]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:00]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:00]                   │ debg > DFA job stats fetched.
[00:49:00]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:01]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:01]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:01]                   │ debg > DFA job stats fetched.
[00:49:01]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:01]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:01]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:01]                   │ debg > DFA job stats fetched.
[00:49:01]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:02]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:02]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:02]                   │ debg > DFA job stats fetched.
[00:49:02]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:02]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:02]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:02]                   │ debg > DFA job stats fetched.
[00:49:02]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:03]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:03]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:03]                   │ debg > DFA job stats fetched.
[00:49:03]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:03]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:03]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:03]                   │ debg > DFA job stats fetched.
[00:49:03]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:04]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] [data_frame_analyzer/265847] [CBoostedTreeImpl.cc@245] Hyperparameter selection failed: exiting loop early
[00:49:04]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:04]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:04]                   │ debg > DFA job stats fetched.
[00:49:04]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:04]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:04]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:04]                   │ debg > DFA job stats fetched.
[00:49:04]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:05]                   │ info [o.e.x.m.d.p.ChunkedTrainedModelPersister] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] finished storing trained model with id [egs_fi_reg_1612879357706-1612882303545]
[00:49:05]                   │ info [o.e.x.m.d.p.AnalyticsResultProcessor] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Started writing results
[00:49:05]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:05]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:05]                   │ debg > DFA job stats fetched.
[00:49:05]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:05]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Result processor has completed
[00:49:05]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Closing process
[00:49:05]                   │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] [data_frame_analyzer/265847] [Main.cc@241] [{"name":"E_DFTPMEstimatedPeakMemoryUsage","description":"The upfront estimate of the peak memory training the predictive model would use","value":7582544}
[00:49:05]                   │      ,{"name":"E_DFTPMPeakMemoryUsage","description":"The peak memory training the predictive model used","value":7668138}
[00:49:05]                   │      ,{"name":"E_DFTPMTimeToTrain","description":"The time it took to train the predictive model","value":34211}
[00:49:05]                   │      ,{"name":"E_DFTPMTrainedForestNumberTrees","description":"The total number of trees in the trained forest","value":224}
[00:49:05]                   │      ]
[00:49:05]                   │ info [o.e.x.m.p.AbstractNativeProcess] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] State output finished
[00:49:05]                   │ info [o.e.x.m.d.p.AnalyticsProcessManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Closed process
[00:49:05]                   │ info [o.e.x.m.d.i.InferenceRunner] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Started inference on test data against model [egs_fi_reg_1612879357706-1612882303545]
[00:49:05]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:05]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:05]                   │ debg > DFA job stats fetched.
[00:49:05]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:06]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:06]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:06]                   │ debg > DFA job stats fetched.
[00:49:06]                   │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:49:06]                   │ info [o.e.x.m.d.DataFrameAnalyticsManager] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [egs_fi_reg_1612879357706] Marking task completed
[00:49:06]                   │ debg Fetching analytics state for job egs_fi_reg_1612879357706
[00:49:06]                   │ debg Fetching data frame analytics job stats for job egs_fi_reg_1612879357706...
[00:49:06]                   │ debg > DFA job stats fetched.
[00:49:06]                 └-: binary classification job
[00:49:06]                   └-> "before all" hook
[00:49:06]                   └-> "before all" hook
[00:49:06]                     │ debg navigating to ml url: http://localhost:61111/app/ml
[00:49:06]                     │ debg navigate to: http://localhost:61111/app/ml
[00:49:07]                     │ debg browser[INFO] http://localhost:61111/app/ml?_t=1612882305246 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:49:07]                     │
[00:49:07]                     │ debg browser[INFO] http://localhost:61111/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:49:07]                     │ debg ... sleep(700) start
[00:49:07]                     │ debg ... sleep(700) end
[00:49:07]                     │ debg returned from get, calling refresh
[00:49:08]                     │ debg browser[INFO] http://localhost:61111/app/ml?_t=1612882305246 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:49:08]                     │
[00:49:08]                     │ debg browser[INFO] http://localhost:61111/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:49:08]                     │ debg currentUrl = http://localhost:61111/app/ml
[00:49:08]                     │          appUrl = http://localhost:61111/app/ml
[00:49:08]                     │ debg TestSubjects.find(kibanaChrome)
[00:49:08]                     │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:49:09]                     │ debg ... sleep(501) start
[00:49:09]                     │ debg ... sleep(501) end
[00:49:09]                     │ debg in navigateTo url = http://localhost:61111/app/ml/overview
[00:49:09]                     │ debg --- retry.try error: URL changed, waiting for it to settle
[00:49:10]                     │ debg ... sleep(501) start
[00:49:10]                     │ debg ... sleep(501) end
[00:49:10]                     │ debg in navigateTo url = http://localhost:61111/app/ml/overview
[00:49:10]                     │ debg TestSubjects.exists(statusPageContainer)
[00:49:10]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:49:13]                     │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:49:13]                     │ debg TestSubjects.exists(mlApp)
[00:49:13]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlApp"]') with timeout=2000
[00:49:13]                     │ debg TestSubjects.click(~mlMainTab & ~dataFrameAnalytics)
[00:49:13]                     │ debg Find.clickByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="dataFrameAnalytics"]') with timeout=10000
[00:49:13]                     │ debg Find.findByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="dataFrameAnalytics"]') with timeout=10000
[00:49:14]                     │ debg TestSubjects.exists(~mlMainTab & ~dataFrameAnalytics & ~selected)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="mlMainTab"][data-test-subj~="dataFrameAnalytics"][data-test-subj~="selected"]') with timeout=120000
[00:49:14]                     │ debg TestSubjects.exists(mlPageDataFrameAnalytics)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageDataFrameAnalytics"]') with timeout=120000
[00:49:14]                     │ debg TestSubjects.exists(~mlAnalyticsTable)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="mlAnalyticsTable"]') with timeout=60000
[00:49:14]                     │ debg TestSubjects.exists(mlAnalyticsTable loaded)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlAnalyticsTable loaded"]') with timeout=30000
[00:49:14]                     │ debg TestSubjects.exists(~mlAnalyticsTable > ~row-ihp_fi_binary_1612879357706 > mlAnalyticsJobViewButton)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj~="mlAnalyticsTable"] [data-test-subj~="row-ihp_fi_binary_1612879357706"] [data-test-subj="mlAnalyticsJobViewButton"]') with timeout=120000
[00:49:14]                     │ debg TestSubjects.click(~mlAnalyticsTable > ~row-ihp_fi_binary_1612879357706 > mlAnalyticsJobViewButton)
[00:49:14]                     │ debg Find.clickByCssSelector('[data-test-subj~="mlAnalyticsTable"] [data-test-subj~="row-ihp_fi_binary_1612879357706"] [data-test-subj="mlAnalyticsJobViewButton"]') with timeout=10000
[00:49:14]                     │ debg Find.findByCssSelector('[data-test-subj~="mlAnalyticsTable"] [data-test-subj~="row-ihp_fi_binary_1612879357706"] [data-test-subj="mlAnalyticsJobViewButton"]') with timeout=10000
[00:49:14]                     │ debg TestSubjects.exists(mlPageDataFrameAnalyticsExploration)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlPageDataFrameAnalyticsExploration"]') with timeout=20000
[00:49:14]                   └-> should display the total feature importance in the results view
[00:49:14]                     └-> "before each" hook: global before each
[00:49:14]                     │ debg TestSubjects.exists(mlDFExpandableSection-FeatureImportanceSummary)
[00:49:14]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlDFExpandableSection-FeatureImportanceSummary"]') with timeout=120000
[00:49:16]                     │ debg TestSubjects.exists(mlTotalFeatureImportanceChart)
[00:49:16]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlTotalFeatureImportanceChart"]') with timeout=5000
[00:49:17]                     └- ✓ pass  (2.8s) "machine learning  data frame analytics total feature importance panel and decision path popover binary classification job should display the total feature importance in the results view"
[00:49:17]                   └-> should display the feature importance decision path in the data grid
[00:49:17]                     └-> "before each" hook: global before each
[00:49:17]                     │ debg TestSubjects.exists(mlExplorationDataGrid loaded)
[00:49:17]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlExplorationDataGrid loaded"]') with timeout=5000
[00:49:17]                     │ debg TestSubjects.findAll(mlExplorationDataGrid loaded > dataGridRow)
[00:49:17]                     │ debg Find.allByCssSelector('[data-test-subj="mlExplorationDataGrid loaded"] [data-test-subj="dataGridRow"]') with timeout=10000
[00:49:18]                     │ debg TestSubjects.findAll(mlExplorationDataGrid loaded > dataGridRow)
[00:49:18]                     │ debg Find.allByCssSelector('[data-test-subj="mlExplorationDataGrid loaded"] [data-test-subj="dataGridRow"]') with timeout=10000
[00:49:18]                     │ debg TestSubjects.find(mlExplorationDataGrid loaded > dataGridRow)
[00:49:18]                     │ debg Find.findByCssSelector('[data-test-subj="mlExplorationDataGrid loaded"] [data-test-subj="dataGridRow"]') with timeout=10000
[00:49:18]                     │ debg TestSubjects.exists(mlDFADecisionPathPopover)
[00:49:18]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="mlDFADecisionPathPopover"]') with timeout=120000
[00:49:21]                     │ debg --- retry.tryForTime error: [data-test-subj="mlDFADecisionPathPopover"] is not displayed
[00:49:24]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:27]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:30]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:33]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:36]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:39]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:42]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:45]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:48]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:51]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:54]                     │ debg --- retry.tryForTime failed again with the same message...
[00:49:57]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:00]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:04]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:07]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:10]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:13]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:16]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:19]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:22]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:25]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:28]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:31]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:34]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:37]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:40]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:43]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:46]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:49]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:52]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:55]                     │ debg --- retry.tryForTime failed again with the same message...
[00:50:58]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:01]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:04]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:07]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:10]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:14]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:17]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:20]                     │ debg --- retry.tryForTime failed again with the same message...
[00:51:20]                     │ info Taking screenshot "/dev/shm/workspace/parallel/11/kibana/x-pack/test/functional/screenshots/failure/machine learning  data frame analytics total feature importance panel and decision path popover binary classification job should display the feature importance decision path in the data grid.png"
[00:51:20]                     │ info Current URL is: http://localhost:61111/app/ml/data_frame_analytics/exploration?_g=(ml%3A(analysisType%3Aclassification%2CjobId%3Aihp_fi_binary_1612879357706))
[00:51:20]                     │ info Saving page source to: /dev/shm/workspace/parallel/11/kibana/x-pack/test/functional/failure_debug/html/machine learning  data frame analytics total feature importance panel and decision path popover binary classification job should display the feature importance decision path in the data grid.html
[00:51:20]                     └- ✖ fail: machine learning  data frame analytics total feature importance panel and decision path popover binary classification job should display the feature importance decision path in the data grid
[00:51:20]                     │      Error: expected testSubject(mlDFADecisionPathPopover) to exist
[00:51:20]                     │       at TestSubjects.existOrFail (/dev/shm/workspace/parallel/11/kibana/test/functional/services/common/test_subjects.ts:51:15)
[00:51:20]                     │       at Object.openFeatureImportanceDecisionPathPopover (test/functional/services/ml/data_frame_analytics_results.ts:98:7)
[00:51:20]                     │       at Context.<anonymous> (test/functional/apps/ml/data_frame_analytics/feature_importance.ts:204:11)
[00:51:20]                     │       at Object.apply (/dev/shm/workspace/parallel/11/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:51:20]                     │ 
[00:51:20]                     │ 

Stack Trace

Error: expected testSubject(mlDFADecisionPathPopover) to exist
    at TestSubjects.existOrFail (/dev/shm/workspace/parallel/11/kibana/test/functional/services/common/test_subjects.ts:51:15)
    at Object.openFeatureImportanceDecisionPathPopover (test/functional/services/ml/data_frame_analytics_results.ts:98:7)
    at Context.<anonymous> (test/functional/apps/ml/data_frame_analytics/feature_importance.ts:204:11)
    at Object.apply (/dev/shm/workspace/parallel/11/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

Kibana Pipeline / general / X-Pack Detection Engine API Integration Tests.x-pack/test/detection_engine_api_integration/security_and_spaces/tests/delete_signals_migrations·ts.detection engine api security and spaces enabled deleting signals migrations rejects the request if the user does not have sufficient privileges

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: detection engine api security and spaces enabled
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: 
[00:00:00]             └-> "before all" hook
[00:17:02]             └-: deleting signals migrations
[00:17:02]               └-> "before all" hook
[00:17:02]               └-> returns the deleted migration SavedObjects
[00:17:02]                 └-> "before each" hook: global before each
[00:17:02]                 └-> "before each" hook
[00:17:02]                   │ info [o.e.x.i.a.TransportPutLifecycleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding index lifecycle policy [.siem-signals-default]
[00:17:02]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding template [.siem-signals-default] for index patterns [.siem-signals-default-*]
[00:17:02]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-000001] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:02]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [signals/outdated_signals_index] Loading "mappings.json"
[00:17:03]                   │ info [signals/outdated_signals_index] Loading "data.json"
[00:17:03]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [signals/outdated_signals_index] Created index ".siem-signals-default-outdated"
[00:17:03]                   │ debg [signals/outdated_signals_index] ".siem-signals-default-outdated" settings {"index":{"lifecycle":{"indexing_complete":true}}}
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [signals/outdated_signals_index] Indexed 1 docs into ".siem-signals-default-outdated"
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated-r000014] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:03]                   │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] 204831 finished with response BulkByScrollResponse[took=10.4ms,timed_out=false,sliceId=null,updated=0,created=1,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:17:03]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:05]                 └- ✓ pass  (997ms) "detection engine api security and spaces enabled  deleting signals migrations returns the deleted migration SavedObjects"
[00:17:05]               └-> "after each" hook
[00:17:05]                 │ info [signals/outdated_signals_index] Unloading indices from "mappings.json"
[00:17:05]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated/VRm5l97ATMmE5pHfSdS7PA] deleting index
[00:17:05]                 │ info [signals/outdated_signals_index] Deleted existing index ".siem-signals-default-outdated"
[00:17:05]                 │ info [signals/outdated_signals_index] Unloading indices from "data.json"
[00:17:05]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated-r000014/ghpiEMEXSVelz5sRyxQ27g] deleting index
[00:17:05]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-000001/917h3cwDTEOX4Tj9n0oHwA] deleting index
[00:17:06]                 │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] removing template [.siem-signals-default]
[00:17:06]               └-> marks the original index for deletion by applying our cleanup policy
[00:17:06]                 └-> "before each" hook: global before each
[00:17:06]                 └-> "before each" hook
[00:17:06]                   │ info [o.e.x.i.a.TransportPutLifecycleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding index lifecycle policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding template [.siem-signals-default] for index patterns [.siem-signals-default-*]
[00:17:06]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-000001] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [signals/outdated_signals_index] Loading "mappings.json"
[00:17:06]                   │ info [signals/outdated_signals_index] Loading "data.json"
[00:17:06]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [signals/outdated_signals_index] Created index ".siem-signals-default-outdated"
[00:17:06]                   │ debg [signals/outdated_signals_index] ".siem-signals-default-outdated" settings {"index":{"lifecycle":{"indexing_complete":true}}}
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [signals/outdated_signals_index] Indexed 1 docs into ".siem-signals-default-outdated"
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated-r000014] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:06]                   │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] 205017 finished with response BulkByScrollResponse[took=12.8ms,timed_out=false,sliceId=null,updated=0,created=1,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:17:06]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:08]                 └- ✓ pass  (1.0s) "detection engine api security and spaces enabled  deleting signals migrations marks the original index for deletion by applying our cleanup policy"
[00:17:08]               └-> "after each" hook
[00:17:08]                 │ info [signals/outdated_signals_index] Unloading indices from "mappings.json"
[00:17:08]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated/2kqBhK_ARoyC9XWxV0fPiA] deleting index
[00:17:08]                 │ info [signals/outdated_signals_index] Deleted existing index ".siem-signals-default-outdated"
[00:17:08]                 │ info [signals/outdated_signals_index] Unloading indices from "data.json"
[00:17:08]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-000001/i7vUuUcESdeWnr-5wOoSzw] deleting index
[00:17:08]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated-r000014/rnGfqllaRgKMCvyIizh9qw] deleting index
[00:17:09]                 │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] removing template [.siem-signals-default]
[00:17:09]               └-> rejects the request if the user does not have sufficient privileges
[00:17:09]                 └-> "before each" hook: global before each
[00:17:09]                 └-> "before each" hook
[00:17:09]                   │ info [o.e.x.i.a.TransportPutLifecycleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding index lifecycle policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.c.m.MetadataIndexTemplateService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] adding template [.siem-signals-default] for index patterns [.siem-signals-default-*]
[00:17:09]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-000001] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [signals/outdated_signals_index] Loading "mappings.json"
[00:17:09]                   │ info [signals/outdated_signals_index] Loading "data.json"
[00:17:09]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [signals/outdated_signals_index] Created index ".siem-signals-default-outdated"
[00:17:09]                   │ debg [signals/outdated_signals_index] ".siem-signals-default-outdated" settings {"index":{"lifecycle":{"indexing_complete":true}}}
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [signals/outdated_signals_index] Indexed 1 docs into ".siem-signals-default-outdated"
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] [.siem-signals-default-outdated-r000014] creating index, cause [api], templates [.siem-signals-default], shards [1]/[1]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [.siem-signals-default]
[00:17:09]                   │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] 205210 finished with response BulkByScrollResponse[took=10.9ms,timed_out=false,sliceId=null,updated=0,created=1,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:17:09]                   │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] moving index [.siem-signals-default-outdated-r000014] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [.siem-signals-default]
[00:17:10]                 │ debg creating role t1_analyst
[00:17:10]                 │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updated role [t1_analyst]
[00:17:10]                 │ debg creating user t1_analyst
[00:17:11]                 │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-18-tests-xxl-1612877324657432379] updated user [t1_analyst]
[00:17:11]                 │ debg created user t1_analyst
[00:17:11]                 └- ✖ fail: detection engine api security and spaces enabled  deleting signals migrations rejects the request if the user does not have sufficient privileges
[00:17:11]                 │       Error: expected { message: 'security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the index privileges [manage,all]',
[00:17:11]                 │   status_code: 403 } to sort of equal { message: 'security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the privileges [manage,all]',
[00:17:11]                 │   status_code: 403 }
[00:17:11]                 │       + expected - actual
[00:17:11]                 │ 
[00:17:11]                 │        {
[00:17:11]                 │       -  "message": "security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the index privileges [manage,all]"
[00:17:11]                 │       +  "message": "security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the privileges [manage,all]"
[00:17:11]                 │          "status_code": 403
[00:17:11]                 │        }
[00:17:11]                 │       
[00:17:11]                 │       at Assertion.assert (/dev/shm/workspace/parallel/17/kibana/packages/kbn-expect/expect.js:100:11)
[00:17:11]                 │       at Assertion.eql (/dev/shm/workspace/parallel/17/kibana/packages/kbn-expect/expect.js:244:8)
[00:17:11]                 │       at Context.<anonymous> (test/detection_engine_api_integration/security_and_spaces/tests/delete_signals_migrations.ts:118:41)
[00:17:11]                 │       at Object.apply (/dev/shm/workspace/parallel/17/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:17:11]                 │ 
[00:17:11]                 │ 

Stack Trace

Error: expected { message: 'security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the index privileges [manage,all]',
  status_code: 403 } to sort of equal { message: 'security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the privileges [manage,all]',
  status_code: 403 }
    at Assertion.assert (/dev/shm/workspace/parallel/17/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/17/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/detection_engine_api_integration/security_and_spaces/tests/delete_signals_migrations.ts:118:41)
    at Object.apply (/dev/shm/workspace/parallel/17/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: '{\n' +
    '  "message": "security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the index privileges [manage,all]"\n' +
    '  "status_code": 403\n' +
    '}',
  expected: '{\n' +
    '  "message": "security_exception: action [indices:admin/settings/update] is unauthorized for user [t1_analyst] on indices [], this action is granted by the privileges [manage,all]"\n' +
    '  "status_code": 403\n' +
    '}',
  showDiff: true
}

Kibana Pipeline / general / X-Pack API Integration Tests.x-pack/test/api_integration/apis/management/index_management/indices·js.apis management index management indices list should list all the indices with the expected properties and data enrichers

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 9 times on tracked branches: https://github.com/elastic/kibana/issues/64473

[00:00:00]       │
[00:00:00]         └-: apis
[00:00:00]           └-> "before all" hook
[00:04:31]           └-: management
[00:04:31]             └-> "before all" hook
[00:04:49]             └-: index management
[00:04:49]               └-> "before all" hook
[00:04:49]               └-: indices
[00:04:49]                 └-> "before all" hook
[00:04:51]                 └-: list
[00:04:51]                   └-> "before all" hook
[00:04:51]                   └-> should list all the indices with the expected properties and data enrichers
[00:04:51]                     └-> "before each" hook: global before each
[00:04:51]                     └- ✖ fail: apis management index management indices list should list all the indices with the expected properties and data enrichers
[00:04:51]                     │       Error: expected [ 'aliases',
[00:04:51]                     │   'data_stream',
[00:04:51]                     │   'documents',
[00:04:51]                     │   'health',
[00:04:51]                     │   'hidden',
[00:04:51]                     │   'ilm',
[00:04:51]                     │   'isFollowerIndex',
[00:04:51]                     │   'isFrozen',
[00:04:51]                     │   'isRollupIndex',
[00:04:51]                     │   'name',
[00:04:51]                     │   'primary',
[00:04:51]                     │   'replica',
[00:04:51]                     │   'size',
[00:04:51]                     │   'status',
[00:04:51]                     │   'uuid' ] to sort of equal [ 'aliases',
[00:04:51]                     │   'documents',
[00:04:51]                     │   'health',
[00:04:51]                     │   'hidden',
[00:04:51]                     │   'ilm',
[00:04:51]                     │   'isFollowerIndex',
[00:04:51]                     │   'isFrozen',
[00:04:51]                     │   'isRollupIndex',
[00:04:51]                     │   'name',
[00:04:51]                     │   'primary',
[00:04:51]                     │   'replica',
[00:04:51]                     │   'size',
[00:04:51]                     │   'status',
[00:04:51]                     │   'uuid' ]
[00:04:51]                     │       + expected - actual
[00:04:51]                     │ 
[00:04:51]                     │        [
[00:04:51]                     │          "aliases"
[00:04:51]                     │       -  "data_stream"
[00:04:51]                     │          "documents"
[00:04:51]                     │          "health"
[00:04:51]                     │          "hidden"
[00:04:51]                     │          "ilm"
[00:04:51]                     │       
[00:04:51]                     │       at Assertion.assert (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:100:11)
[00:04:51]                     │       at Assertion.eql (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:244:8)
[00:04:51]                     │       at Context.<anonymous> (test/api_integration/apis/management/index_management/indices.js:206:39)
[00:04:51]                     │       at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:04:51]                     │ 
[00:04:51]                     │ 

Stack Trace

Error: expected [ 'aliases',
  'data_stream',
  'documents',
  'health',
  'hidden',
  'ilm',
  'isFollowerIndex',
  'isFrozen',
  'isRollupIndex',
  'name',
  'primary',
  'replica',
  'size',
  'status',
  'uuid' ] to sort of equal [ 'aliases',
  'documents',
  'health',
  'hidden',
  'ilm',
  'isFollowerIndex',
  'isFrozen',
  'isRollupIndex',
  'name',
  'primary',
  'replica',
  'size',
  'status',
  'uuid' ]
    at Assertion.assert (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/api_integration/apis/management/index_management/indices.js:206:39)
    at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: '[\n' +
    '  "aliases"\n' +
    '  "data_stream"\n' +
    '  "documents"\n' +
    '  "health"\n' +
    '  "hidden"\n' +
    '  "ilm"\n' +
    '  "isFollowerIndex"\n' +
    '  "isFrozen"\n' +
    '  "isRollupIndex"\n' +
    '  "name"\n' +
    '  "primary"\n' +
    '  "replica"\n' +
    '  "size"\n' +
    '  "status"\n' +
    '  "uuid"\n' +
    ']',
  expected: '[\n' +
    '  "aliases"\n' +
    '  "documents"\n' +
    '  "health"\n' +
    '  "hidden"\n' +
    '  "ilm"\n' +
    '  "isFollowerIndex"\n' +
    '  "isFrozen"\n' +
    '  "isRollupIndex"\n' +
    '  "name"\n' +
    '  "primary"\n' +
    '  "replica"\n' +
    '  "size"\n' +
    '  "status"\n' +
    '  "uuid"\n' +
    ']',
  showDiff: true
}

and 1 more failures, only showing the first 3.

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
indexLifecycleManagement 173 177 +4

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
indexLifecycleManagement 228.1KB 231.9KB +3.8KB

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:ILM release_note:skip Skip the PR/issue when compiling release notes Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more v7.12.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[ILM] Improve form error notification
6 participants