Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Explain Log Rate Spikes: Additional functional tests with artificial logs dataset #145763

Merged
merged 5 commits into from
Nov 22, 2022

Conversation

walterra
Copy link
Contributor

@walterra walterra commented Nov 18, 2022

Summary

Follow up to #145699.
Part of #142456.

Additional functional tests with artificial logs dataset.

This generates an artificial logs dataset with the purpose of asserting the case where grouping needs to identify 2 non-overlapping groups. The primary use case of the test is to track possible regressions related to when trying to improve frequent_items aggregation settings and the custom grouping code.

I plan to use the same approach for additional tests on the API integration side. Once I do this follow up I'll look into how some code that was duplicated for this PR can be consolidated.

aiops-functional-test-0001

Checklist

@walterra walterra self-assigned this Nov 18, 2022
@walterra walterra mentioned this pull request Nov 18, 2022
12 tasks
@walterra walterra added :ml release_note:skip Skip the PR/issue when compiling release notes Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis v8.6.0 v8.7.0 labels Nov 21, 2022
@walterra walterra marked this pull request as ready for review November 21, 2022 10:12
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

Copy link
Member

@pheyos pheyos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@walterra
Copy link
Contributor Author

walterra commented Nov 21, 2022

Running flaky test runner: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/1584

✅ 50 runs passed!

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

Unknown metric groups

ESLint disabled in files

id before after diff
osquery 1 2 +1

ESLint disabled line counts

id before after diff
enterpriseSearch 19 21 +2
fleet 59 65 +6
osquery 109 115 +6
securitySolution 442 448 +6
total +20

Total ESLint disabled count

id before after diff
enterpriseSearch 20 22 +2
fleet 67 73 +6
osquery 110 117 +7
securitySolution 519 525 +6
total +21

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @walterra

Copy link
Member

@pheyos pheyos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Latest changes LGTM

Copy link
Contributor

@alvarezmelissa87 alvarezmelissa87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ⚡

@walterra walterra merged commit c45f556 into elastic:main Nov 22, 2022
@walterra walterra deleted the ml-aiops-dataset-2 branch November 22, 2022 17:28
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 22, 2022
…cial logs dataset (elastic#145763)

Additional functional tests with artificial logs dataset.

This generates an artificial logs dataset with the purpose of asserting
the case where grouping needs to identify 2 non-overlapping groups. The
primary use case of the test is to track possible regressions related to
when trying to improve `frequent_items` aggregation settings and the
custom grouping code.

(cherry picked from commit c45f556)
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.6

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Nov 22, 2022
…artificial logs dataset (#145763) (#146038)

# Backport

This will backport the following commits from `main` to `8.6`:
- [[ML] Explain Log Rate Spikes: Additional functional tests with
artificial logs dataset
(#145763)](#145763)

<!--- Backport version: 8.9.7 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Walter
Rafelsberger","email":"[email protected]"},"sourceCommit":{"committedDate":"2022-11-22T17:28:54Z","message":"[ML]
Explain Log Rate Spikes: Additional functional tests with artificial
logs dataset (#145763)\n\nAdditional functional tests with artificial
logs dataset.\r\n\r\nThis generates an artificial logs dataset with the
purpose of asserting\r\nthe case where grouping needs to identify 2
non-overlapping groups. The\r\nprimary use case of the test is to track
possible regressions related to\r\nwhen trying to improve
`frequent_items` aggregation settings and the\r\ncustom grouping
code.","sha":"c45f55660584381d385e11817d4285e3e24eb546","branchLabelMapping":{"^v8.7.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","release_note:skip","Feature:ML/AIOps","v8.6.0","v8.7.0"],"number":145763,"url":"https://github.com/elastic/kibana/pull/145763","mergeCommit":{"message":"[ML]
Explain Log Rate Spikes: Additional functional tests with artificial
logs dataset (#145763)\n\nAdditional functional tests with artificial
logs dataset.\r\n\r\nThis generates an artificial logs dataset with the
purpose of asserting\r\nthe case where grouping needs to identify 2
non-overlapping groups. The\r\nprimary use case of the test is to track
possible regressions related to\r\nwhen trying to improve
`frequent_items` aggregation settings and the\r\ncustom grouping
code.","sha":"c45f55660584381d385e11817d4285e3e24eb546"}},"sourceBranch":"main","suggestedTargetBranches":["8.6"],"targetPullRequestStates":[{"branch":"8.6","label":"v8.6.0","labelRegex":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v8.7.0","labelRegex":"^v8.7.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/145763","number":145763,"mergeCommit":{"message":"[ML]
Explain Log Rate Spikes: Additional functional tests with artificial
logs dataset (#145763)\n\nAdditional functional tests with artificial
logs dataset.\r\n\r\nThis generates an artificial logs dataset with the
purpose of asserting\r\nthe case where grouping needs to identify 2
non-overlapping groups. The\r\nprimary use case of the test is to track
possible regressions related to\r\nwhen trying to improve
`frequent_items` aggregation settings and the\r\ncustom grouping
code.","sha":"c45f55660584381d385e11817d4285e3e24eb546"}}]}] BACKPORT-->

Co-authored-by: Walter Rafelsberger <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis :ml release_note:skip Skip the PR/issue when compiling release notes v8.6.0 v8.7.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants