Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/advanced_settings/feature_controls/advanced_settings_spaces·ts - Advanced Settings spaces feature controls space with Advanced Settings disabled redirects to management home #57413

Closed
kibanamachine opened this issue Feb 12, 2020 · 10 comments · Fixed by #57715 or #73823
Assignees
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test Feature:Kibana Management Feature label for Data Views, Advanced Setting, Saved Object management pages Feature:Security/Spaces Platform Security - Spaces feature skipped-test Team:Visualizations Visualization editors, elastic-charts and infrastructure test_xpack_functional test

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Feb 12, 2020

A test failed on a tracked branch

Error: expected testSubject(managementHome) to exist
    at TestSubjects.existOrFail (/dev/shm/workspace/kibana/test/functional/services/test_subjects.ts:60:15)

First failure: Jenkins Build

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Feb 12, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-test-triage (failed-test)

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@myasonik myasonik added Feature:Kibana Management Feature label for Data Views, Advanced Setting, Saved Object management pages Feature:Security/Spaces Platform Security - Spaces feature Team:Visualizations Visualization editors, elastic-charts and infrastructure test test_xpack_functional labels Feb 14, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-app (Team:KibanaApp)

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

spalger added a commit that referenced this issue Mar 31, 2020
spalger added a commit that referenced this issue Mar 31, 2020
(cherry picked from commit a7bebba)
@spalger
Copy link
Contributor

spalger commented Mar 31, 2020

This has failed 7 builds in the last week

image

Skipped

master: a7bebba
7.x/7.8: 12f6b73

@dej611
Copy link
Contributor

dej611 commented Jul 23, 2020

Cannot reproduce on the flaky test runner: https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/644/

@spalger
Copy link
Contributor

spalger commented Jul 23, 2020

The skip was a while ago, and the failure that finally triggered the skip was in 7.8. It's possible that this was fixed in a newer version but try cherry-picking dej611@c126365 to 7.8 and running that in the flaky test runner. The fix might not have made it back to 7.8. Alternatively, a PR with nothing but removing the skip that has 300-400 successful flaky test executions would be more than enough "evidence" that the test is no longer flaky.

@dej611 dej611 self-assigned this Jul 27, 2020
@dej611
Copy link
Contributor

dej611 commented Jul 29, 2020

Flaky test runner batches:

🎉

Note: I had to filter out other (non-functional) X-Pack Group: 2 suites to make it run for 100 executions, in order to reduce the amount of work.
The skip has been removed and all the functional tests have run for 300 times.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker failed-test A test failure on a tracked branch, potentially flaky-test Feature:Kibana Management Feature label for Data Views, Advanced Setting, Saved Object management pages Feature:Security/Spaces Platform Security - Spaces feature skipped-test Team:Visualizations Visualization editors, elastic-charts and infrastructure test_xpack_functional test
Projects
None yet
5 participants