Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Serverless Observability Functional Tests.x-pack/test_serverless/functional/test_suites/common/home_page·ts - serverless common UI home page has project header #165386

Closed
kibanamachine opened this issue Aug 31, 2023 · 35 comments · Fixed by #167497
Closed

Failing test: Serverless Observability Functional Tests.x-pack/test_serverless/functional/test_suites/common/home_page·ts - serverless common UI home page has project header #165386

kibanamachine opened this issue Aug 31, 2023 · 35 comments · Fixed by #167497
Assignees
@Dosant
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:QA Team label for QA Team Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience)

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Aug 31, 2023 •
edited
Loading

A test failed on a tracked branch

Error: retry.tryForTime timeout: Error: retry.tryForTime timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"] nav:not(.ng-hide))
Wait timed out after 61178ms
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-d74ee144bef4cd60/elastic/kibana-serverless/kibana/node_modules/selenium-webdriver/lib/webdriver.js:929:17
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.try (retry.ts:31:12)
    at common_page.ts:265:21
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:68:21)
    at RetryService.tryForTime (retry.ts:22:12)
    at CommonPageObject.navigateToApp (common_page.ts:264:5)
    at svl_common_navigation.ts:21:9
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:68:21)
    at RetryService.tryForTime (retry.ts:22:12)
    at Object.navigateToKibanaHome (svl_common_navigation.ts:20:7)
    at Context.<anonymous> (home_page.ts:16:7)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.tryForTime (retry.ts:22:12)
    at CommonPageObject.navigateToApp (common_page.ts:264:5)
    at svl_common_navigation.ts:21:9
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:68:21)
    at RetryService.tryForTime (retry.ts:22:12)
    at Object.navigateToKibanaHome (svl_common_navigation.ts:20:7)
    at Context.<anonymous> (home_page.ts:16:7)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:59:13)
    at RetryService.tryForTime (retry.ts:22:12)
    at Object.navigateToKibanaHome (svl_common_navigation.ts:20:7)
    at Context.<anonymous> (home_page.ts:16:7)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Aug 31, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Aug 31, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@jbudz
Copy link
Member

jbudz commented Sep 1, 2023

/skip

@kibanamachine
Copy link
Contributor Author

Skipped

main: 15ab284

kibanamachine added a commit that referenced this issue Sep 1, 2023
@kibanamachine
skip failing test suite (#165386)
15ab284
@jbudz jbudz added Team:QA Team label for QA Team Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience) labels Sep 1, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-qa (Team:QA)

@elasticmachine
Copy link
Contributor

Pinging @elastic/appex-sharedux (Team:SharedUX)

@botelastic botelastic bot removed the needs-team Issues missing a team label label Sep 1, 2023
sphilipse pushed a commit to sphilipse/kibana that referenced this issue Sep 4, 2023
@kibanamachine @sphilipse
skip failing test suite (elastic#165386)
504c3d9
@Dosant
Copy link
Contributor

Dosant commented Sep 4, 2023

@elastic/kibana-qa, this was a timeout failure during login in the first test in a suite.

image

I assume the fix needs to be done not to the test itself, but to the underlying navigateToApp helper or waiting for serverless kibana to be ready.

I saw this pr #165522, am I right to assume that it should also help with this failure?

@Dosant Dosant self-assigned this Sep 4, 2023
@dmlemeshko
Copy link
Member

I saw this pr #165522, am I right to assume that it should also help with this failure?

I hope so.

Dosant added a commit that referenced this issue Sep 6, 2023
@Dosant
unskip
86a757e 
fix #165386
@Dosant Dosant mentioned this issue Sep 6, 2023
Closed
@Dosant
Copy link
Contributor

Dosant commented Sep 6, 2023

Looks like the #165522 didn't help, still the same login screen loading error #165829 (comment)

@sebelga sebelga mentioned this issue Sep 7, 2023
Merged
1 task
@Dosant Dosant mentioned this issue Sep 13, 2023
Closed
@Dosant Dosant mentioned this issue Sep 26, 2023
Open
@dmlemeshko dmlemeshko mentioned this issue Sep 28, 2023
Merged
dmlemeshko added a commit that referenced this issue Sep 29, 2023
@dmlemeshko
[ftr] unskip serverless functional tests (#167497)
97c7d7d 
I hope the change made in #166936 allow us to unskip these tests

closes #165763
closes #165386
closes #165414
closes #166448 
closes #165943 
closes #166461
closes #166551

Flaky-test-runner:
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3242

Quick stability check of re-enabled tests:
-
x-pack/test_serverless/functional/test_suites/common/examples/search_examples/partial_results_example.ts
100/100
-
x-pack/test_serverless/functional/test_suites/common/examples/unified_field_list_examples/existing_fields.ts
100/100 failures
- x-pack/test_serverless/functional/test_suites/common/home_page.ts
100/100
-
x-pack/test_serverless/functional/test_suites/common/index_management/create_enrich_policy.ts
99/100
-
x-pack/test_serverless/functional/test_suites/observability/cases/configure.ts
49/50
-
x-pack/test_serverless/functional/test_suites/observability/observability_log_explorer/app.ts
49/50
-
x-pack/test_serverless/functional/test_suites/observability/observability_log_explorer/filter_controls.ts
49/50
-
x-pack/test_serverless/functional/test_suites/security/ftr/cases/configure.ts
49/50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Dosant Dosant

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:QA Team label for QA Team Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience)
Projects
None yet
Milestone
No milestone
5 participants
@jbudz @Dosant @dmlemeshko @elasticmachine @kibanamachine