Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Firefox XPack UI Functional Tests.x-pack/test/functional/apps/infra/home_page·ts - InfraOps App Metrics UI Home page alerts flyouts should open and close inventory alert flyout #157711

Closed
kibanamachine opened this issue May 15, 2023 · 19 comments · Fixed by #160503, #162896 or #163919
Closed

Failing test: Firefox XPack UI Functional Tests.x-pack/test/functional/apps/infra/home_page·ts - InfraOps App Metrics UI Home page alerts flyouts should open and close inventory alert flyout #157711

kibanamachine opened this issue May 15, 2023 · 19 comments · Fixed by #160503, #162896 or #163919
Assignees
@crespocarlos
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented May 15, 2023 •
edited
Loading

A test failed on a tracked branch

TimeoutError: The element [data-test-subj="inventory-alerts-create-rule"] was still present when it should have disappeared.
Wait timed out after 11629ms
    at /var/lib/buildkite-agent/builds/kb-n2-4-spot-97d4245b8e27ff03/elastic/kibana-on-merge/kibana/node_modules/selenium-webdriver/lib/webdriver.js:929:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5) {
  remoteStacktrace: ''
}

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label May 15, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label May 15, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.8

@mistic mistic added the Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services label May 15, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/infra-monitoring-ui (Team:Infra Monitoring UI)

@botelastic botelastic bot removed the needs-team Issues missing a team label label May 15, 2023
mistic added a commit that referenced this issue May 15, 2023
@mistic
skip flaky suite (#157711)
f847eab
mistic added a commit that referenced this issue May 15, 2023
@mistic
skip flaky suite (#157711)
e627f64
@mistic
Copy link
Member

mistic commented May 15, 2023

Skipped.

main: f847eab
8.8: e627f64

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.8

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - 8.8

jasonrhodes pushed a commit that referenced this issue May 17, 2023
@mistic @jasonrhodes
skip flaky suite (#157711)
d033213
@jennypavlova jennypavlova mentioned this issue Jun 26, 2023
Merged
jennypavlova added a commit that referenced this issue Jun 27, 2023
@jennypavlova
Infra flaky test fixes (#160503)
7e7cf0f 
Closes #157711 and closes #157740
## Summary

This PR fixes the mentioned flaky tests together with the fix done in
#160407
@kibanamachine kibanamachine reopened this Jun 30, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

Skipped

main: f4e9cd1

kibanamachine added a commit that referenced this issue Jul 11, 2023
@kibanamachine
skip failing test suite (#157711)
f4e9cd1
@jennypavlova jennypavlova self-assigned this Aug 1, 2023
@jennypavlova jennypavlova mentioned this issue Aug 2, 2023
Merged
jennypavlova added a commit that referenced this issue Aug 2, 2023
@jennypavlova
[Infra UI] Add timeout to fix flaky tests (#162896)
446f894 
Closes #157711
Closes #157740

## Summary

Fixes for the flaky tests: I ran the tests 200 and after that 50 times
and with the fix they are not flaky anymore. The fix was setting a
timeout because the element was still present when the test checked for
it.
@kibanamachine kibanamachine reopened this Aug 15, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Aug 15, 2023
@mistic
skip flaky suite (#157711)
fd3df5e
@mistic
Copy link
Member

mistic commented Aug 15, 2023

Skipped.

main: fd3df5e

@neptunian neptunian mentioned this issue Aug 15, 2023
Merged
crespocarlos added a commit that referenced this issue Aug 16, 2023
@crespocarlos @kibanamachine
[Infra UI] Unskip alerts flyout test (#163919)
d1240d3 
closes [#157712](#157712)
closes [#157767](#157767)
closes [#157711](#157711)

## Summary

Unskips "alerts flyouts" test. What cause the test to fail was possibly
solved by #162896


### How to test

```
yarn test:ftr:server --config x-pack/test/functional/apps/infra/config.ts     
```
```
node scripts/functional_test_runner --config=x-pack/test/functional/apps/infra/config.ts --include x-pack/test/functional/apps/infra/home_page.ts  
```

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888

---------

Co-authored-by: Kibana Machine <[email protected]>
hop-dev pushed a commit to hop-dev/kibana that referenced this issue Aug 16, 2023
@crespocarlos @kibanamachine @hop-dev
[Infra UI] Unskip alerts flyout test (elastic#163919)
f3040f2 
closes [elastic#157712](elastic#157712)
closes [elastic#157767](elastic#157767)
closes [elastic#157711](elastic#157711)

## Summary

Unskips "alerts flyouts" test. What cause the test to fail was possibly
solved by elastic#162896


### How to test

```
yarn test:ftr:server --config x-pack/test/functional/apps/infra/config.ts     
```
```
node scripts/functional_test_runner --config=x-pack/test/functional/apps/infra/config.ts --include x-pack/test/functional/apps/infra/home_page.ts  
```

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888

---------

Co-authored-by: Kibana Machine <[email protected]>
bryce-b pushed a commit that referenced this issue Aug 22, 2023
@mistic @bryce-b
skip flaky suite (#157711)
1822283
bryce-b pushed a commit that referenced this issue Aug 22, 2023
@crespocarlos @kibanamachine @bryce-b
[Infra UI] Unskip alerts flyout test (#163919)
a22b2b4 
closes [#157712](#157712)
closes [#157767](#157767)
closes [#157711](#157711)

## Summary

Unskips "alerts flyouts" test. What cause the test to fail was possibly
solved by #162896


### How to test

```
yarn test:ftr:server --config x-pack/test/functional/apps/infra/config.ts     
```
```
node scripts/functional_test_runner --config=x-pack/test/functional/apps/infra/config.ts --include x-pack/test/functional/apps/infra/home_page.ts  
```

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888

---------

Co-authored-by: Kibana Machine <[email protected]>
crespocarlos added a commit to crespocarlos/kibana that referenced this issue Sep 4, 2023
@crespocarlos
[Infra UI] Unskip alerts flyout test (elastic#163919)
29368cc 
closes [elastic#157712](elastic#157712)
closes [elastic#157767](elastic#157767)
closes [elastic#157711](elastic#157711)

## Summary

Unskips "alerts flyouts" test. What cause the test to fail was possibly
solved by elastic#162896

### How to test

```
yarn test:ftr:server --config x-pack/test/functional/apps/infra/config.ts
```
```
node scripts/functional_test_runner --config=x-pack/test/functional/apps/infra/config.ts --include x-pack/test/functional/apps/infra/home_page.ts
```

https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888

---------

Co-authored-by: Kibana Machine <[email protected]>
(cherry picked from commit d1240d3)

# Conflicts:
#	x-pack/test/functional/page_objects/infra_home_page.ts
crespocarlos added a commit that referenced this issue Sep 5, 2023
@crespocarlos
[7.17] [Infra UI] Unskip alerts flyout test (#163919) (#165607)
52757ec 
closes [#157767](#157767)

# Backport

This will backport the following commits from `main` to `7.17`:
- [[Infra UI] Unskip alerts flyout test
(#163919)](#163919)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Carlos
Crespo","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-08-16T12:13:22Z","message":"[Infra
UI] Unskip alerts flyout test (#163919)\n\ncloses
[#157712](https://github.com/elastic/kibana/issues/157712)\r\ncloses
[#157767](https://github.com/elastic/kibana/issues/157767)\r\ncloses
[#157711](https://github.com/elastic/kibana/issues/157711)\r\n\r\n##
Summary\r\n\r\nUnskips \"alerts flyouts\" test. What cause the test to
fail was possibly\r\nsolved by
https://github.com/elastic/kibana/pull/162896\r\n\r\n\r\n### How to
test\r\n\r\n```\r\nyarn test:ftr:server --config
x-pack/test/functional/apps/infra/config.ts \r\n```\r\n```\r\nnode
scripts/functional_test_runner
--config=x-pack/test/functional/apps/infra/config.ts --include
x-pack/test/functional/apps/infra/home_page.ts
\r\n```\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"d1240d332502605657bf4a2b01f92f599557deab","branchLabelMapping":{"^v8.10.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["Feature:Metrics
UI","Team:Infra Monitoring
UI","release_note:skip","backport:skip","v8.10.0","v8.11.0"],"number":163919,"url":"https://github.com/elastic/kibana/pull/163919","mergeCommit":{"message":"[Infra
UI] Unskip alerts flyout test (#163919)\n\ncloses
[#157712](https://github.com/elastic/kibana/issues/157712)\r\ncloses
[#157767](https://github.com/elastic/kibana/issues/157767)\r\ncloses
[#157711](https://github.com/elastic/kibana/issues/157711)\r\n\r\n##
Summary\r\n\r\nUnskips \"alerts flyouts\" test. What cause the test to
fail was possibly\r\nsolved by
https://github.com/elastic/kibana/pull/162896\r\n\r\n\r\n### How to
test\r\n\r\n```\r\nyarn test:ftr:server --config
x-pack/test/functional/apps/infra/config.ts \r\n```\r\n```\r\nnode
scripts/functional_test_runner
--config=x-pack/test/functional/apps/infra/config.ts --include
x-pack/test/functional/apps/infra/home_page.ts
\r\n```\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"d1240d332502605657bf4a2b01f92f599557deab"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.10.0","labelRegex":"^v8.10.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/163919","number":163919,"mergeCommit":{"message":"[Infra
UI] Unskip alerts flyout test (#163919)\n\ncloses
[#157712](https://github.com/elastic/kibana/issues/157712)\r\ncloses
[#157767](https://github.com/elastic/kibana/issues/157767)\r\ncloses
[#157711](https://github.com/elastic/kibana/issues/157711)\r\n\r\n##
Summary\r\n\r\nUnskips \"alerts flyouts\" test. What cause the test to
fail was possibly\r\nsolved by
https://github.com/elastic/kibana/pull/162896\r\n\r\n\r\n### How to
test\r\n\r\n```\r\nyarn test:ftr:server --config
x-pack/test/functional/apps/infra/config.ts \r\n```\r\n```\r\nnode
scripts/functional_test_runner
--config=x-pack/test/functional/apps/infra/config.ts --include
x-pack/test/functional/apps/infra/home_page.ts
\r\n```\r\n\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/2888\r\n\r\n---------\r\n\r\nCo-authored-by:
Kibana Machine
<[email protected]>","sha":"d1240d332502605657bf4a2b01f92f599557deab"}},{"branch":"8.11","label":"v8.11.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@crespocarlos crespocarlos

Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services
Projects
None yet
Milestone
No milestone
6 participants
@crespocarlos @jbudz @mistic @jennypavlova @elasticmachine @kibanamachine