Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments·cy·ts - Enrichment Custom query rule from new risk scores Should has enrichment fields from legacy risk Should has enrichment fields from legacy risk #169154

Closed
kibanamachine opened this issue Oct 17, 2023 · 12 comments
Closed

Failing test: Security Solution Cypress.x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments·cy·ts - Enrichment Custom query rule from new risk scores Should has enrichment fields from legacy risk Should has enrichment fields from legacy risk #169154

kibanamachine opened this issue Oct 17, 2023 · 12 comments
Assignees
@rylnd @nkhristinin
Labels
8.13 candidate EA Sprint 1 (2023.11.6 - 2023.11.19) failed-test A test failure on a tracked branch, potentially flaky-test legit-flake Test was triaged and marked as an actual flake. Team:Entity Analytics Security Entity Analytics Team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented Oct 17, 2023 •
edited
Loading

A test failed on a tracked branch

AssertionError: Timed out retrying after 150000ms: Expected not to find content: 'Original host risk level' within the element: <div.euiFlexGroup.StyledEuiFlexGroup-sc-1az7ye2-2.chTqHU.css-1a15qtm-euiFlexGroup-responsive-none-flexStart-center-row> but continuously found it.
    at Context.eval (webpack:///./e2e/entity_analytics/enrichments.cy.ts:129:69)

First failure: CI Build - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label Oct 17, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Oct 17, 2023
@kibanamachine kibanamachine added the Team:Detection Engine Security Solution Detection Engine Area label Oct 17, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Oct 17, 2023
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@jpdjere jpdjere mentioned this issue Oct 17, 2023
Closed
mistic added a commit that referenced this issue Oct 17, 2023
@mistic
skip flaky suite (#169154)
7f9afeb
@mistic
Copy link
Member

mistic commented Oct 17, 2023 •
edited
Loading

Skipped.

main: 019f82b

@jpdjere jpdjere mentioned this issue Oct 18, 2023
Merged
hop-dev pushed a commit to hop-dev/kibana that referenced this issue Oct 18, 2023
@mistic @hop-dev
skip flaky suite (elastic#169154)
d4d66b8
@jpdjere jpdjere added the legit-flake Test was triaged and marked as an actual flake. label Oct 19, 2023
@jpdjere
Copy link
Contributor

jpdjere commented Oct 19, 2023

Detected as legit flake in #169209

Flaky test runner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Oct 19, 2023
@mistic
skip flaky suite (#169154)
751bf21
@rylnd rylnd self-assigned this Oct 24, 2023
jpdjere added a commit that referenced this issue Oct 24, 2023
@jpdjere
[Security Solution] Enable Serverless for entity_analytics Cypress …
12975a5 
…tests (#169209)

## Summary

Running flaky test runner for
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics`

## Changes

-
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments.cy.ts`
**unskipped whole test suite in favour of failing test -> `Custom Query
rule - from legacy risk scores`** (see below) **also enabled on
Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/entity_analytics_management_page.cy.ts`
**enabled on Serverless**

## Related failing-test issues

1. #169154
**Marked as legit-flake and assigned to
@elastic/security-detection-engine**

### Flaky test runner link

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

jpdjere added a commit to jpdjere/kibana that referenced this issue Oct 24, 2023
@jpdjere
[Security Solution] Enable Serverless for entity_analytics Cypress …
b8e1c40 
…tests (elastic#169209)

Running flaky test runner for
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics`

-
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments.cy.ts`
**unskipped whole test suite in favour of failing test -> `Custom Query
rule - from legacy risk scores`** (see below) **also enabled on
Serverless**
-
`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/entity_analytics_management_page.cy.ts`
**enabled on Serverless**

1. elastic#169154
**Marked as legit-flake and assigned to
@elastic/security-detection-engine**

-
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575

(cherry picked from commit 12975a5)
jpdjere referenced this issue Oct 24, 2023
@jpdjere
[8.11] [Security Solution] Enable Serverless for entity_analytics C…
702e8b4 
…ypress tests (#169209) (#169682)

# Backport

This will backport the following commits from `main` to `8.11`:
- [[Security Solution] Enable Serverless for `entity_analytics` Cypress
tests (#169209)](#169209)

<!--- Backport version: 8.9.8 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Juan Pablo
Djeredjian","email":"[email protected]"},"sourceCommit":{"committedDate":"2023-10-24T08:26:15Z","message":"[Security
Solution] Enable Serverless for `entity_analytics` Cypress tests
(#169209)\n\n## Summary\r\n\r\nRunning flaky test runner
for\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments.cy.ts`\r\n**unskipped
whole test suite in favour of failing test -> `Custom Query\r\nrule -
from legacy risk scores`** (see below) **also enabled
on\r\nServerless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/entity_analytics_management_page.cy.ts`\r\n**enabled
on Serverless**\r\n\r\n## Related failing-test issues\r\n\r\n1.
https://github.com/elastic/kibana/issues/169154\r\n**Marked as
legit-flake and assigned
to\r\n@elastic/security-detection-engine**\r\n\r\n### Flaky test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575","sha":"12975a5a0c6846d5cdbecc73beceba0346cd866b","branchLabelMapping":{"^v8.12.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:skip","Team:Detections
and Resp","Team:Detection
Engine","v8.12.0"],"number":169209,"url":"https://github.com/elastic/kibana/pull/169209","mergeCommit":{"message":"[Security
Solution] Enable Serverless for `entity_analytics` Cypress tests
(#169209)\n\n## Summary\r\n\r\nRunning flaky test runner
for\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments.cy.ts`\r\n**unskipped
whole test suite in favour of failing test -> `Custom Query\r\nrule -
from legacy risk scores`** (see below) **also enabled
on\r\nServerless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/entity_analytics_management_page.cy.ts`\r\n**enabled
on Serverless**\r\n\r\n## Related failing-test issues\r\n\r\n1.
https://github.com/elastic/kibana/issues/169154\r\n**Marked as
legit-flake and assigned
to\r\n@elastic/security-detection-engine**\r\n\r\n### Flaky test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575","sha":"12975a5a0c6846d5cdbecc73beceba0346cd866b"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v8.12.0","labelRegex":"^v8.12.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/169209","number":169209,"mergeCommit":{"message":"[Security
Solution] Enable Serverless for `entity_analytics` Cypress tests
(#169209)\n\n## Summary\r\n\r\nRunning flaky test runner
for\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics`\r\n\r\n##
Changes\r\n\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/enrichments.cy.ts`\r\n**unskipped
whole test suite in favour of failing test -> `Custom Query\r\nrule -
from legacy risk scores`** (see below) **also enabled
on\r\nServerless**\r\n-\r\n`x-pack/test/security_solution_cypress/cypress/e2e/entity_analytics/entity_analytics_management_page.cy.ts`\r\n**enabled
on Serverless**\r\n\r\n## Related failing-test issues\r\n\r\n1.
https://github.com/elastic/kibana/issues/169154\r\n**Marked as
legit-flake and assigned
to\r\n@elastic/security-detection-engine**\r\n\r\n### Flaky test runner
link\r\n\r\n-\r\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/3575","sha":"12975a5a0c6846d5cdbecc73beceba0346cd866b"}}]}]
BACKPORT-->
@rylnd rylnd mentioned this issue Oct 24, 2023
Draft
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

mistic added a commit that referenced this issue Oct 30, 2023
@mistic
skip flaky suite (#169154)
019f82b
@jpdjere jpdjere mentioned this issue Nov 6, 2023
Closed
@yctercero yctercero mentioned this issue Nov 15, 2023
Closed
@jpdjere jpdjere removed their assignment Nov 16, 2023
@yctercero yctercero removed the Team:Detection Engine Security Solution Detection Engine Area label Nov 20, 2023
@yctercero yctercero removed their assignment Nov 20, 2023
@rylnd
Copy link
Contributor

rylnd commented Nov 22, 2023

This comment contains a summary of where these test fixes are at, and that PR has a play-by-play of the things I tried as part of my investigation. When @nkhristinin and I have time we'll circle back on this.

@rylnd
Copy link
Contributor

rylnd commented Dec 22, 2023

New PR from @nkhristinin : #171983

@rylnd rylnd mentioned this issue Jan 5, 2024
Merged
@kibanamachine
Copy link
Contributor Author

New failure: CI Build - main

@nkhristinin
Copy link
Contributor

Let's close this issue for now since there were no errors for 2 weeks, we can open it again if there are new errors

@rylnd rylnd mentioned this issue Feb 23, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@rylnd rylnd

@nkhristinin nkhristinin

Labels
8.13 candidate EA Sprint 1 (2023.11.6 - 2023.11.19) failed-test A test failure on a tracked branch, potentially flaky-test legit-flake Test was triaged and marked as an actual flake. Team:Entity Analytics Security Entity Analytics Team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@rylnd @mistic @jpdjere @nkhristinin @yctercero @kibanamachine @jaredburgettelastic