Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/uptime/feature_controls/uptime_security·ts - Uptime app with real-world data feature controls security no uptime privileges "before all" hook for "doesn't show uptime navlink" #104249

Closed
kibanamachine opened this issue Jul 2, 2021 · 16 comments · Fixed by #141586
Closed

Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/uptime/feature_controls/uptime_security·ts - Uptime app with real-world data feature controls security no uptime privileges "before all" hook for "doesn't show uptime navlink" #104249

kibanamachine opened this issue Jul 2, 2021 · 16 comments · Fixed by #141586
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Jul 2, 2021 •
edited
Loading

A test failed on a tracked branch

Error: timed out waiting for logout button visible -- last error: Error: retry.try timeout: Error: expected testSubject(userMenu) to exist
    at TestSubjects.existOrFail (/dev/shm/workspace/parallel/17/kibana/test/functional/services/common/test_subjects.ts:45:13)
    at /dev/shm/workspace/parallel/17/kibana/x-pack/test/functional/services/user_menu.js:48:9
    at runAttempt (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at RetryService.try (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry.ts:31:12)
    at UserMenu._ensureMenuOpen (test/functional/services/user_menu.js:46:7)
    at UserMenu.logoutLinkExists (test/functional/services/user_menu.js:28:7)
    at /dev/shm/workspace/parallel/17/kibana/x-pack/test/functional/page_objects/security_page.ts:232:19
    at runAttempt (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at retryForTruthy (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_truthy.ts:27:3)
    at RetryService.waitFor (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry.ts:59:5)
    at SecurityPageObject.login (test/functional/page_objects/security_page.ts:230:5)
    at Context.<anonymous> (test/functional/apps/uptime/feature_controls/uptime_security.ts:159:9)
    at Object.apply (/dev/shm/workspace/parallel/17/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
    at onFailure (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at RetryService.try (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry.ts:31:12)
    at UserMenu._ensureMenuOpen (test/functional/services/user_menu.js:46:7)
    at UserMenu.logoutLinkExists (test/functional/services/user_menu.js:28:7)
    at /dev/shm/workspace/parallel/17/kibana/x-pack/test/functional/page_objects/security_page.ts:232:19
    at runAttempt (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at retryForTruthy (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_truthy.ts:27:3)
    at RetryService.waitFor (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry.ts:59:5)
    at SecurityPageObject.login (test/functional/page_objects/security_page.ts:230:5)
    at Context.<anonymous> (test/functional/apps/uptime/feature_controls/uptime_security.ts:159:9)
    at Object.apply (/dev/shm/workspace/parallel/17/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
    at onFailure (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_truthy.ts:39:13)
    at retryForSuccess (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at retryForTruthy (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry_for_truthy.ts:27:3)
    at RetryService.waitFor (/dev/shm/workspace/parallel/17/kibana/test/common/services/retry/retry.ts:59:5)
    at SecurityPageObject.login (test/functional/page_objects/security_page.ts:230:5)
    at Context.<anonymous> (test/functional/apps/uptime/feature_controls/uptime_security.ts:159:9)
    at Object.apply (/dev/shm/workspace/parallel/17/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)

First failure: Jenkins Build
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Jul 2, 2021
@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 2, 2021
@mistic mistic added the Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability label Jul 2, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/uptime (Team:uptime)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Jul 2, 2021
@shahzad31
Copy link
Contributor

looks like one off failure , also it's coming out of common page object security , uptime is just using login/logout feature from that.

@zube zube bot added [zube]: Done and removed [zube]: Ready labels Sep 8, 2021
@kibanamachine kibanamachine reopened this Oct 22, 2021
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - master

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 7.16

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@dominiqueclarke
Copy link
Contributor

We run PageObjects.security.login before these to ensure that we can login as a permission restricted user. That helper is timing out. We may need help from the security team to further debug.

Unless this becomes flaky enough to skip, I'd say we're okay to move this to 8.0.0 as it has not be skipped yet and the failure appears to be due to a helper timing out. @paulb-elastic

@pheyos
Copy link
Member

pheyos commented Nov 25, 2021

This flakiness has potentially been fixed with #119607 (same failure message, but could still be a different failure), might be worth checking.

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.0

mistic added a commit that referenced this issue Dec 13, 2021
@mistic
skip flaky suite (#104249)
30786a6
mistic added a commit that referenced this issue Dec 13, 2021
@mistic
skip flaky suite (#104249)
8a2f610
@mistic
Copy link
Member

mistic commented Dec 13, 2021 •
edited
Loading

This test keeps failing and looks flaky. Skipping for now.

main/8.1: 30786a6
8.0: 8a2f610
7.16: e2dd4c0

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 7.16

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 7.16

mistic added a commit that referenced this issue Dec 16, 2021
@mistic
skip flaky suite (#104249)
e2dd4c0
TinLe pushed a commit to TinLe/kibana that referenced this issue Dec 22, 2021
@mistic @TinLe
skip flaky suite (elastic#104249)
3911672
@lucasfcosta lucasfcosta self-assigned this Apr 11, 2022
@shahzad31 shahzad31 self-assigned this Sep 23, 2022
@shahzad31 shahzad31 mentioned this issue Sep 23, 2022
Merged
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine kibanamachine reopened this Nov 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Uptime - DEPRECATED Synthetics & RUM sub-team of Application Observability
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Unskip uptime feature control test shahzad31/kibana
8 participants
@pheyos @shahzad31 @mistic @lucasfcosta @dominiqueclarke @elasticmachine @kibanamachine @paulb-elastic