Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix flaky alert flapping test #198013

Merged
merged 4 commits into from
Oct 30, 2024
Merged

Fix flaky alert flapping test #198013

merged 4 commits into from
Oct 30, 2024

Conversation

mikecote
Copy link
Contributor

@mikecote mikecote commented Oct 28, 2024

Resolves #195573

In this PR, I'm un-skipping the alerts as data flapping tests. The flaky test runners weren't able to reproduce the flakiness. I believe it's because we needed to wait longer after changing the flapping settings for the cache to clear. This is already done in https://github.com/elastic/kibana/pull/197070/files#diff-3d57bae0b495bddd934b87ca29e2f43fa21bab9bf304b5d359d7e230284415c0 but it was merged after the test was skipped.

Flaky test runners:

@mikecote mikecote added Feature:Alerting release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) v9.0.0 backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) v8.17.0 labels Oct 28, 2024
@mikecote mikecote self-assigned this Oct 28, 2024
@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7286

[✅] x-pack/test/alerting_api_integration/spaces_only/tests/alerting/group4/config.ts: 100/100 tests passed.

see run history

@kibanamachine
Copy link
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#7306

[✅] x-pack/test/alerting_api_integration/spaces_only/tests/alerting/group4/config.ts: 200/200 tests passed.

see run history

@mikecote mikecote marked this pull request as ready for review October 30, 2024 16:00
@mikecote mikecote requested a review from a team as a code owner October 30, 2024 16:00
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

Copy link
Member

@pmuellr pmuellr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@mikecote mikecote enabled auto-merge (squash) October 30, 2024 16:07
@mikecote mikecote merged commit 0a93f3c into elastic:main Oct 30, 2024
21 of 22 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11598700281

@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

cc @mikecote

@kibanamachine
Copy link
Contributor

💔 All backports failed

Status Branch Result
8.x Cherrypick failed because the selected commit (0a93f3c) is empty. Did you already backport this commit?

Manual backport

To create the backport manually run:

node scripts/backport --pr 198013

Questions ?

Please refer to the Backport tool documentation

@mikecote
Copy link
Contributor Author

Looks like test was already unskipped in 8.x via #197062 (race condition between skipping test done in #195573 and that PR merging to unskip it again). Will add backport:skip as things are good now.

@mikecote mikecote added backport:skip This commit does not require backporting and removed backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) v8.17.0 labels Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting Feature:Alerting release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) v9.0.0
Projects
None yet
4 participants