Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/lens/existing_fields·ts - apis Lens existing_fields apis "before all" hook in "existing_fields apis" #97387

Closed
kibanamachine opened this issue Apr 17, 2021 · 23 comments · Fixed by #97876
Closed

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/lens/existing_fields·ts - apis Lens existing_fields apis "before all" hook in "existing_fields apis" #97387

kibanamachine opened this issue Apr 17, 2021 · 23 comments · Fixed by #97876
Assignees
@flash1293
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Operations Team label for Operations Team Team:Visualizations Visualization editors, elastic-charts and infrastructure v8.0.0

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Apr 17, 2021 •
edited
Loading

A test failed on a tracked branch

ConnectionError: connect ECONNREFUSED 127.0.0.1:6152
    at ClientRequest.onError (/dev/shm/workspace/parallel/5/kibana/node_modules/@elastic/elasticsearch/lib/Connection.js:115:16)
    at Socket.socketErrorListener (_http_client.js:469:9)
    at emitErrorNT (internal/streams/destroy.js:106:8)
    at emitErrorCloseNT (internal/streams/destroy.js:74:3)
    at processTicksAndRejections (internal/process/task_queues.js:80:21) {
  meta: {
    body: null,
    statusCode: null,
    headers: null,
    meta: {
      context: null,
      request: [Object],
      name: 'elasticsearch-js',
      connection: [Object],
      attempts: 3,
      aborted: false
    }
  }
}

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Apr 17, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@botelastic botelastic bot added the needs-team Issues missing a team label label Apr 17, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@mistic mistic added the Team:Visualizations Visualization editors, elastic-charts and infrastructure label Apr 17, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-app (Team:KibanaApp)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Apr 17, 2021
mistic added a commit that referenced this issue Apr 17, 2021
@mistic
skip flaky suite (#97387)
a89b756
mistic added a commit that referenced this issue Apr 17, 2021
@mistic
skip flaky suite (#97387)
fb4568a
@mistic
Copy link
Member

mistic commented Apr 17, 2021

This test keeps failing and looks flaky. Skipping for now.

master/8.0: a89b756
7.x/7.13: fb4568a

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@flash1293
Copy link
Contributor

@mistic This error message doesn’t look like there’s something wrong with the test itself - it looks like Elasticsearch or Kibana is not available and refuses connections. The specific thing failing is esarchiver. Could the @elastic/kibana-operations team take a look at this? I’m unsure how to approach the problem.

@flash1293 flash1293 added the Team:Operations Team label for Operations Team label Apr 17, 2021
jloleysens added a commit to jloleysens/kibana that referenced this issue Apr 19, 2021
@jloleysens
Merge branch 'master' of github.com:elastic/kibana into watcher/migra…
87d64a4 
…te-legacy-es-client

* 'master' of github.com:elastic/kibana: (102 commits)
  [Exploratory view] integerate page views to exploratory view (elastic#97258)
  Fix typo in license_api_guard README name and import http server mocks from public interface (elastic#97334)
  Avoid mutating KQL query when validating it (elastic#97081)
  Add description as title on tag badge (elastic#97109)
  Remove legacy ES client usages in `home` and `xpack_legacy` (elastic#97359)
  [Fleet] Finer-grained error information from install/upgrade API (elastic#95649)
  Rule registry bundle size (elastic#97251)
  [Partial Results] Move other bucket into Search Source (elastic#96384)
  [Dashboard] Makes lens default editor for creating new panels (elastic#96181)
  skip flaky suite (elastic#97387)
  [Asset Management] Agent picker follow up (elastic#97357)
  skip flaky suite (elastic#97382)
  [Security Solutions] Fixes flake with cypress tests (elastic#97329)
  skip flaky suite (elastic#97355)
  Skip test to try and stabilize master
  minimize number of so fild asserted in tests. it creates flakines when implementation details change (elastic#97374)
  [Search Sessions] Client side search cache (elastic#92439)
  [SavedObjects] Add aggregations support (elastic#96292)
  [Reporting] Remove legacy elasticsearch client usage from the reporting plugin (elastic#97184)
  [kbnClient] fix basePath handling and export reponse type (elastic#97277)
  ...

# Conflicts:
#	x-pack/plugins/watcher/server/lib/license_pre_routing_factory/license_pre_routing_factory.ts
#	x-pack/plugins/watcher/server/plugin.ts
#	x-pack/plugins/watcher/server/routes/api/indices/register_get_route.ts
#	x-pack/plugins/watcher/server/routes/api/license/register_refresh_route.ts
#	x-pack/plugins/watcher/server/routes/api/register_list_fields_route.ts
#	x-pack/plugins/watcher/server/routes/api/register_load_history_route.ts
#	x-pack/plugins/watcher/server/routes/api/settings/register_load_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/action/register_acknowledge_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_activate_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_deactivate_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_delete_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_execute_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_history_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_load_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_save_route.ts
#	x-pack/plugins/watcher/server/routes/api/watch/register_visualize_route.ts
#	x-pack/plugins/watcher/server/routes/api/watches/register_delete_route.ts
#	x-pack/plugins/watcher/server/routes/api/watches/register_list_route.ts
#	x-pack/plugins/watcher/server/shared_imports.ts
#	x-pack/plugins/watcher/server/types.ts
@mistic
Copy link
Member

mistic commented Apr 19, 2021

@flash1293 We're still trying to understand what happened here. I've skipped that block of tests to unblock the CI 😃

@flash1293
Copy link
Contributor

Found something interesting in the logs:

[00:07:15] │ info [o.e.m.j.JvmGcMonitorService] [kibana-ci-immutable-centos-tests-xxl-1618671748595445320] [gc][462] overhead, spent [379ms] collecting in the last [1s]
[00:07:15] │ info java.lang.OutOfMemoryError: Java heap space
[00:07:15] │ Dumping heap to data/java_pid128925.hprof ...

Seems like this test is overwhelming Elasticsearch and it crashes.

This test doesn't load anything expensive:

kibana/x-pack/test/api_integration/apis/lens/existing_fields.ts

Line 166 in a89b756

await esArchiver.loadIfNeeded('logstash_functional');

Maybe we have to grant more memory to ES?

@flash1293 flash1293 self-assigned this Apr 19, 2021
@flash1293 flash1293 mentioned this issue Apr 19, 2021
Closed
@flash1293
Copy link
Contributor

Other instances of this:
#97395
#97392
#97390
#97388

spalger added a commit to spalger/kibana that referenced this issue Apr 21, 2021
@spalger
Revert "skip flaky suite (elastic#97387)"
e8fd659 
This reverts commit a89b756.
@spalger spalger mentioned this issue Apr 21, 2021
Merged
spalger added a commit that referenced this issue Apr 22, 2021
@spalger @kibanamachine
Revert skips added while triaging ES OOMs (#97876)
6bb2893 
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355f.

* upload heap dumps when they are created

Co-authored-by: spalger <[email protected]>
Co-authored-by: Kibana Machine <[email protected]>
kibanamachine added a commit to kibanamachine/kibana that referenced this issue Apr 22, 2021
@spalger @kibanamachine
Revert skips added while triaging ES OOMs (elastic#97876)
d5999e1 
* Revert "skip flaky suite (elastic#97382)"

This reverts commit e321f57.

* Revert "skip flaky suite (elastic#97387)"

This reverts commit a89b756.

* Revert "Skip test to try and stabilize master" (elastic#97378)

This reverts commit 194355f.

* upload heap dumps when they are created

Co-authored-by: spalger <[email protected]>
Co-authored-by: Kibana Machine <[email protected]>
kibanamachine added a commit to kibanamachine/kibana that referenced this issue Apr 22, 2021
@spalger @kibanamachine
Revert skips added while triaging ES OOMs (elastic#97876)
2fb0d8d 
* Revert "skip flaky suite (elastic#97382)"

This reverts commit e321f57.

* Revert "skip flaky suite (elastic#97387)"

This reverts commit a89b756.

* Revert "Skip test to try and stabilize master" (elastic#97378)

This reverts commit 194355f.

* upload heap dumps when they are created

Co-authored-by: spalger <[email protected]>
Co-authored-by: Kibana Machine <[email protected]>
kibanamachine added a commit that referenced this issue Apr 22, 2021
@kibanamachine @spalger
Revert skips added while triaging ES OOMs (#97876) (#98066)
84046ed 
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355f.

* upload heap dumps when they are created

Co-authored-by: spalger <[email protected]>
Co-authored-by: Kibana Machine <[email protected]>

Co-authored-by: Spencer <[email protected]>
Co-authored-by: spalger <[email protected]>
kibanamachine added a commit that referenced this issue Apr 22, 2021
@kibanamachine @spalger
Revert skips added while triaging ES OOMs (#97876) (#98067)
08c9152 
* Revert "skip flaky suite (#97382)"

This reverts commit e321f57.

* Revert "skip flaky suite (#97387)"

This reverts commit a89b756.

* Revert "Skip test to try and stabilize master" (#97378)

This reverts commit 194355f.

* upload heap dumps when they are created

Co-authored-by: spalger <[email protected]>
Co-authored-by: Kibana Machine <[email protected]>

Co-authored-by: Spencer <[email protected]>
Co-authored-by: spalger <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@flash1293 flash1293

Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test skipped-test Team:Operations Team label for Operations Team Team:Visualizations Visualization editors, elastic-charts and infrastructure v8.0.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Revert skips added while triaging ES OOMs spalger/kibana
4 participants
@flash1293 @mistic @elasticmachine @kibanamachine