Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Lens] Make Formula functional tests less flaky #112428

Merged
merged 4 commits into from
Sep 20, 2021

Conversation

dej611
Copy link
Contributor

@dej611 dej611 commented Sep 16, 2021

Summary

Fixes (again) #102183

Adding some waiting time after the typing fixed the flaky behaviour - the editor schedules a text replacement as async task and sometimes it takes a bit longer than usual.

Here I've ran the lens formula suite with 100 agents: https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/1902/

Checklist

Delete any items that are not applicable to this PR.

@dej611 dej611 added Team:Visualizations Visualization editors, elastic-charts and infrastructure v8.0.0 release_note:skip Skip the PR/issue when compiling release notes Feature:Lens auto-backport Deprecated - use backport:version if exact versions are needed v7.16.0 labels Sep 16, 2021
@dej611 dej611 requested a review from a team as a code owner September 16, 2021 14:48
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-vis-editors (Team:VisEditors)

@jbudz
Copy link
Member

jbudz commented Sep 16, 2021

Can we backport to 7.14+? Here's a recent failure:
https://buildkite.com/elastic/kibana-elasticsearch-snapshot-verify/builds/119#_

@dej611
Copy link
Contributor Author

dej611 commented Sep 20, 2021

@elasticmachine merge upstream

@dej611
Copy link
Contributor Author

dej611 commented Sep 20, 2021

Can we backport to 7.14+? Here's a recent failure:
buildkite.com/elastic/kibana-elasticsearch-snapshot-verify/builds/119#_

I see no harm in that. What do you think @stratoula @flash1293 ?

@stratoula
Copy link
Contributor

Yes it is fine. For functional tests fixes it is safe to backport them in previous versions

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@dej611
Copy link
Contributor Author

dej611 commented Sep 20, 2021

Changed labels to enable backports to 7.14+

Copy link
Contributor

@mbondyra mbondyra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code lgtm, not sure if it will help avoiding flakiness completely, but definitely will not harm anything!

@dej611 dej611 merged commit 298de06 into elastic:master Sep 20, 2021
@dej611 dej611 deleted the fix/102183-3 branch September 20, 2021 13:56
kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Sep 20, 2021
kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Sep 20, 2021
kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Sep 20, 2021
@kibanamachine
Copy link
Contributor

💚 Backport successful

Status Branch Result
7.x
7.14
7.15

The backport PRs will be merged automatically after passing CI.

kibanamachine added a commit that referenced this pull request Sep 20, 2021
kibanamachine added a commit that referenced this pull request Sep 20, 2021
kibanamachine added a commit that referenced this pull request Sep 20, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed Feature:Lens release_note:skip Skip the PR/issue when compiling release notes Team:Visualizations Visualization editors, elastic-charts and infrastructure v7.14.2 v7.15.1 v7.16.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants