Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Tests][Detection Engine] Track status of FTR/Cypress tests for detection engine #171366

Open
yctercero opened this issue Nov 15, 2023 · 0 comments
Open

[Tests][Detection Engine] Track status of FTR/Cypress tests for detection engine #171366

yctercero opened this issue Nov 15, 2023 · 0 comments
Assignees
@yctercero
Labels
consider-next Team:Detection Engine Security Solution Detection Engine Area test test-coverage issues & PRs for improving code test coverage

Comments

@yctercero
Copy link
Contributor

yctercero commented Nov 15, 2023 •
edited
Loading

Summary

As a follow up to this ticket - using the wonderful table @jpdjere created to track skipped tests for detection engine. Removed from the table any tests that were marked as running in both environments successfully. Any tests that are currently skipped, need to be fixed and unskipped. If a test should not run in either environment, ensure proper tags are applied.

Tracking failed or flakey tests for Detection Engine.

Folder Issue ESS Serverless Comments
/detection_alerts/assignments/assignments_serverless_complete.cy.ts #172557 NA ❌
/detection_alerts/assignments/assignments_serverless_essentials.cy.ts #172520 NA ❌
/detection_alerts/callouts/alerts_index_outdated_callout.cy.ts ✅ ❌ Has @skipInServerless tag
/detection_alerts/callouts/missing_privileges_callout.cy.ts ✅ ✅ /❌ Has @brokenInServerlessQA tag
/detection_alerts/enrichments/alert_threat_enrichments.cy.ts #161539 ✅ ✅ /❌ Has @brokenInServerlessQA tag
/detection_alerts/status/alert_status.cy.ts #169091 ❌ ❌
/exceptions/alerts_table_flow/rule_exceptions/auto_populate_with_alert_data.cy.ts #161539, #163967 ❌ ❌
/exceptions/alerts_table_flow/rule_exceptions/closing_all_matching_alerts.cy.ts #161539, #163967 ✅ ❌ Has @skipInServerless tag
/exceptions/alerts_table_flow/endpoint_exceptions.cy.ts #161539, #163967 ❌ ❌
/exceptions/entry/flyout_validation.cy.ts #154994 ❌ ❌
/exceptions/entry/use_value_list.cy.ts #171252 ❌ ❌
/exceptions/rule_details_flow/add_edit_exception.cy.ts #161539 ❌ ❌
/exceptions/shared_exception_lists_management/shared_exception_list_page/import_lists.cy.ts ✅ ❌ Has @skipInServerless tag
/exceptions/shared_exception_lists_management/shared_exception_list_page/read_only.cy.ts #161539 ✅ ❌
/overview/cti_link_panel.cy.ts #165709 ❌ ❌
/rule_actions/rule_actions.cy.ts #161539 ✅ ❌ Has @brokenInServerless tag
/rule_creation/custom_saved_query_rule.cy.ts #161539 ✅ ❌ Has @brokenInServerless tag
/rule_creation/indicator_match_rule.cy.ts #161539 ✅ ❌ Has @brokenInServerless tag
/rule_creation/machine_learning_rule.cy.ts ✅ ❌ Has @brokenInServerless tag
/rule_edit/custom_query_rule.cy.ts ✅ ✅ /❌ Has @brokenInServerlessQA tag
/sourcerer/sourcerer_permissions.cy.ts ✅ ❌ Has @brokenInServerless tag
/sourcerer/sourcerer_timeline.cy.ts ✅ ❌ Has @brokenInServerless tag
value_lists/permissions.cy.ts ✅ ❌ Has @skipInServerless tag
@yctercero yctercero self-assigned this Nov 15, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Nov 15, 2023
@yctercero yctercero added test test-coverage issues & PRs for improving code test coverage Team:Detection Engine Security Solution Detection Engine Area consider-next and removed needs-team Issues missing a team label labels Nov 15, 2023
@yctercero yctercero mentioned this issue Nov 15, 2023
Closed
@vitaliidm vitaliidm mentioned this issue Jan 11, 2024
Merged
vitaliidm added a commit that referenced this issue Jan 15, 2024
@vitaliidm
[Security Solution][Detection Engine] fixes broken tests in serverles…
9762fa3 
…s for IM and saved query rules (#174580)

## Summary

- unskips tests for Serverless for IM and saved query rule
- addresses #171366
- Flaky tests runner(x100):
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/4837
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yctercero yctercero

Labels
consider-next Team:Detection Engine Security Solution Detection Engine Area test test-coverage issues & PRs for improving code test coverage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@yctercero