Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] Fix flaky test for multiline diff algorithm #201019

Merged

Conversation

banderror
Copy link
Contributor

@banderror banderror commented Nov 20, 2024

Fixes: #201014
Related to: #199388

Summary

This PR increases the threshold (time limit) value for the test by 2x from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness on CI.

@banderror banderror added test release_note:skip Skip the PR/issue when compiling release notes v9.0.0 Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Detection Rule Management Security Detection Rule Management Team Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area backport:version Backport to applied version labels v8.17.0 v8.16.1 labels Nov 20, 2024
@banderror banderror self-assigned this Nov 20, 2024
@banderror banderror requested a review from a team as a code owner November 20, 2024 18:12
@banderror banderror requested a review from xcrzx November 20, 2024 18:12
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

@banderror banderror requested review from dplumlee and removed request for xcrzx November 20, 2024 18:13
@banderror banderror enabled auto-merge (squash) November 20, 2024 18:21
Copy link
Contributor

@dplumlee dplumlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the quick fix @banderror!

@dplumlee
Copy link
Contributor

@elasticmachine merge upstream

@banderror banderror merged commit c9e7820 into elastic:main Nov 20, 2024
43 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.16, 8.x

https://github.com/elastic/kibana/actions/runs/11941814637

@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

cc @banderror

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 20, 2024
…tic#201019)

**Fixes: elastic#201014
**Related to:** elastic#199388

## Summary

This PR increases the threshold (time limit) value for the test by 2x
from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness
on CI.

(cherry picked from commit c9e7820)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 20, 2024
…tic#201019)

**Fixes: elastic#201014
**Related to:** elastic#199388

## Summary

This PR increases the threshold (time limit) value for the test by 2x
from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness
on CI.

(cherry picked from commit c9e7820)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.16
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Nov 20, 2024
…#201019) (#201044)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[Security Solution] Fix flaky test for multiline diff algorithm
(#201019)](#201019)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-20T21:12:02Z","message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.17.0","v8.16.1"],"title":"[Security
Solution] Fix flaky test for multiline diff
algorithm","number":201019,"url":"https://github.com/elastic/kibana/pull/201019","mergeCommit":{"message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/201019","number":201019,"mergeCommit":{"message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Georgii Gorbachev <[email protected]>
@banderror banderror deleted the fix-test-for-multiline-diff-algorithm branch November 21, 2024 12:18
TattdCodeMonkey pushed a commit to TattdCodeMonkey/kibana that referenced this pull request Nov 21, 2024
…tic#201019)

**Fixes: elastic#201014
**Related to:** elastic#199388

## Summary

This PR increases the threshold (time limit) value for the test by 2x
from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness
on CI.
kibanamachine added a commit that referenced this pull request Nov 22, 2024
#201019) (#201043)

# Backport

This will backport the following commits from `main` to `8.16`:
- [[Security Solution] Fix flaky test for multiline diff algorithm
(#201019)](#201019)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Georgii
Gorbachev","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-20T21:12:02Z","message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.17.0","v8.16.1"],"title":"[Security
Solution] Fix flaky test for multiline diff
algorithm","number":201019,"url":"https://github.com/elastic/kibana/pull/201019","mergeCommit":{"message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c"}},"sourceBranch":"main","suggestedTargetBranches":["8.x","8.16"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/201019","number":201019,"mergeCommit":{"message":"[Security
Solution] Fix flaky test for multiline diff algorithm
(#201019)\n\n**Fixes:
https://github.com/elastic/kibana/issues/201014**\r\n**Related to:**
https://github.com/elastic/kibana/pull/199388\r\n\r\n##
Summary\r\n\r\nThis PR increases the threshold (time limit) value for
the test by 2x\r\nfrom 500 ms to 1000 ms. Hope it should be enough to
eliminate flakiness\r\non
CI.","sha":"c9e782030a768da471616d626096eb325e12c38c"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.16","label":"v8.16.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Georgii Gorbachev <[email protected]>
Co-authored-by: Elastic Machine <[email protected]>
paulinashakirova pushed a commit to paulinashakirova/kibana that referenced this pull request Nov 26, 2024
…tic#201019)

**Fixes: elastic#201014
**Related to:** elastic#199388

## Summary

This PR increases the threshold (time limit) value for the test by 2x
from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness
on CI.
CAWilson94 pushed a commit to CAWilson94/kibana that referenced this pull request Dec 12, 2024
…tic#201019)

**Fixes: elastic#201014
**Related to:** elastic#199388

## Summary

This PR increases the threshold (time limit) value for the test by 2x
from 500 ms to 1000 ms. Hope it should be enough to eliminate flakiness
on CI.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:version Backport to applied version labels Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area release_note:skip Skip the PR/issue when compiling release notes Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. test v8.16.1 v8.16.2 v8.17.0 v9.0.0
Projects
None yet
4 participants