Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack Accessibility Tests.x-pack/test/accessibility/apps/spaces·ts - Kibana spaces page meets a11y validations a11y test for manage spaces page #96625

Closed
kibanamachine opened this issue Apr 8, 2021 · 12 comments
Closed

Failing test: X-Pack Accessibility Tests.x-pack/test/accessibility/apps/spaces·ts - Kibana spaces page meets a11y validations a11y test for manage spaces page #96625

kibanamachine opened this issue Apr 8, 2021 · 12 comments
Assignees
@bhavyarm
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more!

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Apr 8, 2021 •
edited
Loading

A test failed on a tracked branch

Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="manageSpaces"])
Wait timed out after 10055ms
    at /dev/shm/workspace/parallel/4/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at onFailure (/dev/shm/workspace/parallel/4/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/4/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at Retry.try (/dev/shm/workspace/parallel/4/kibana/test/common/services/retry/retry.ts:32:14)
    at Proxy.clickByCssSelector (/dev/shm/workspace/parallel/4/kibana/test/functional/services/common/find.ts:420:7)
    at TestSubjects.click (/dev/shm/workspace/parallel/4/kibana/test/functional/services/common/test_subjects.ts:109:7)
    at SpaceSelectorPage.clickManageSpaces (test/functional/page_objects/space_selector_page.ts:55:7)
    at Context.<anonymous> (test/accessibility/apps/spaces.ts:38:7)
    at Object.apply (/dev/shm/workspace/parallel/4/kibana/node_modules/@kbn/test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Apr 8, 2021
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@botelastic botelastic bot added the needs-team Issues missing a team label label Apr 8, 2021
jbudz added a commit that referenced this issue Apr 8, 2021
@jbudz
skip a11y spaces tests. #77933, #96625
869fd93
jbudz added a commit that referenced this issue Apr 8, 2021
@jbudz
skip a11y spaces tests. #77933, #96625
fc9e799
jbudz added a commit that referenced this issue Apr 8, 2021
@jbudz
skip a11y spaces tests. #77933, #96625
596ec35
@jbudz jbudz added the Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more! label Apr 8, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-security (Team:Security)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Apr 8, 2021
@jbudz
Copy link
Member

jbudz commented Apr 8, 2021

There were cascading failures once we started skipping, so these skip the suite:

main: 869fd93
7.x: fc9e799
7.12: 596ec35

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

1 similar comment
@kibanamachine
Copy link
Contributor Author

New failure: Jenkins Build

@bhavyarm bhavyarm self-assigned this Apr 12, 2021
@bhavyarm bhavyarm mentioned this issue Apr 14, 2021
Merged
@bhavyarm
Copy link
Contributor

closed by #97190

@kibanamachine kibanamachine reopened this Dec 14, 2021
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@jportner
Copy link
Contributor

Different failure this time:

[00:01:46]         └-> a11y test for manage spaces page
[00:01:46]           └-> "before each" hook: global before each for "a11y test for manage spaces page"
[00:01:46]           │ debg TestSubjects.click(manageSpaces)
[00:01:46]           │ debg Find.clickByCssSelector('[data-test-subj="manageSpaces"]') with timeout=10000
[00:01:46]           │ debg Find.findByCssSelector('[data-test-subj="manageSpaces"]') with timeout=10000
[00:01:46]           │ debg isGlobalLoadingIndicatorVisible
[00:01:46]           │ debg TestSubjects.exists(globalLoadingIndicator)
[00:01:46]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:01:46]           │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:01:46]           │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:01:46]           │ debg TestSubjects.find(globalToastList)
[00:01:46]           │ debg Find.findByCssSelector('[data-test-subj="globalToastList"]') with timeout=10000
[00:01:56]           │ debg Waiting up to 20000ms for Manage spaces page visible...
[00:01:56]           │ debg TestSubjects.exists(createSpace)
[00:01:56]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:01:59]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:00]           │ debg TestSubjects.exists(createSpace)
[00:02:00]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:02:03]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:04]           │ debg TestSubjects.exists(createSpace)
[00:02:04]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:02:06]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:07]           │ debg TestSubjects.exists(createSpace)
[00:02:07]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:02:10]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:11]           │ debg TestSubjects.exists(createSpace)
[00:02:11]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:02:13]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:14]           │ debg TestSubjects.exists(createSpace)
[00:02:14]           │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="createSpace"]') with timeout=2500
[00:02:17]           │ debg --- retry.tryForTime error: [data-test-subj="createSpace"] is not displayed
[00:02:18]           │ info Taking screenshot "/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/x-pack/test/functional/screenshots/failure/Kibana spaces page meets a11y validations a11y test for manage spaces page.png"
[00:02:18]           │ info Current URL is: http://localhost:6101/app/home#/
[00:02:18]           │ info Saving page source to: /opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/x-pack/test/functional/failure_debug/html/Kibana spaces page meets a11y validations a11y test for manage spaces page.html
[00:02:18]           └- ✖ fail: Kibana spaces page meets a11y validations a11y test for manage spaces page
[00:02:18]           │      Error: timed out waiting for Manage spaces page visible
[00:02:18]           │       at onFailure (/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/test/common/services/retry/retry_for_truthy.ts:39:13)
[00:02:18]           │       at retryForSuccess (/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/test/common/services/retry/retry_for_success.ts:59:13)
[00:02:18]           │       at retryForTruthy (/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/test/common/services/retry/retry_for_truthy.ts:27:3)
[00:02:18]           │       at RetryService.waitFor (/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/test/common/services/retry/retry.ts:59:5)
[00:02:18]           │       at Context.<anonymous> (test/accessibility/apps/spaces.ts:40:7)
[00:02:18]           │       at Object.apply (/opt/local-ssd/buildkite/builds/kb-n2-4-6f8c4a0cc2dd5643/elastic/kibana-hourly/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)

Screenshot:
image

Not really sure what's happening here but it looks like it could be a transient failure. I'll close for now and we can investigate further if it gets reopened.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bhavyarm bhavyarm

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Security Team focused on: Auth, Users, Roles, Spaces, Audit Logging, and more!
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@jbudz @jportner @bhavyarm @elasticmachine @kibanamachine