Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/index_management/index_template_wizard·ts - Index Management app Index template wizard Mappings step clearing up the Numeric subtype dropdown doesn't break the page #159403

Closed
kibanamachine opened this issue Jun 9, 2023 · 7 comments · Fixed by #160128 or #161243
Assignees
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jun 9, 2023

A test failed on a tracked branch

Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="addFieldButton"])
Wait timed out after 10004ms
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-020c47d26e68bf92/elastic/kibana-on-merge/kibana/node_modules/selenium-webdriver/lib/webdriver.js:929:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.try (retry.ts:31:12)
    at Proxy.clickByCssSelector (find.ts:407:5)
    at TestSubjects.click (test_subjects.ts:164:5)
    at Context.<anonymous> (index_template_wizard.ts:128:9)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - main

@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jun 9, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Jun 9, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@davismcphee davismcphee added Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more and removed needs-team Issues missing a team label labels Jun 14, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/platform-deployment-management (Team:Deployment Management)

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Jun 15, 2023
@mistic
Copy link
Member

mistic commented Jun 15, 2023

Skipped.

main: ee56461

@alisonelizabeth
Copy link
Contributor

I verified manually the the UI is working as expected. It looks like this test is fairly new and added via #158912. @ElenaStoeva when you have time, can you take a look?

@ElenaStoeva
Copy link
Contributor

I ran the flaky test runner (https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2433) and, out of 50 runs, the test failed 3 times so it seems that it is indeed flaky.

From the artefacts and the logs of the failed tests, it seems the test cannot navigate the "Add field" button because it's still on the previous step of the index template wizard (it's on the "Index settings" step while it should already be at the "Mappings" step). I imagine that this is because the page hasn't loaded so I plan to try adding checks on each step of the wizard to make sure we are on the right page before proceeding to the next one.

ElenaStoeva added a commit that referenced this issue Jun 22, 2023
Fixes #159403

## Summary

The recently added functional test for the index template wizard in
Index Management (added with
#158912) seems to be flaky. It
fails when trying to navigate the "Add field" button on the "Mappings
step" because it's still on the previous step of the index template
wizard (the "Index settings" step). This PR adds checks on each step of
the wizard to make sure that it is on the right page before proceeding
to the next one.

Flaky test runner results:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2436

Co-authored-by: Kibana Machine <[email protected]>
@ElenaStoeva ElenaStoeva reopened this Jun 30, 2023
ElenaStoeva added a commit that referenced this issue Jul 5, 2023
Fix #159403
Fix #159524

This PR unskips the flaky tests that were fixed in
#160128 but the `skip()` call was
mistakenly left out.

The flaky test runner passed all 100 runs:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2557
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Kibana Management Dev Tools, Index Management, Upgrade Assistant, ILM, Ingest Node Pipelines, and more
Projects
None yet
6 participants