Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] AIOps: Log Rate Analysis embeddable #192167

Closed

Conversation

walterra
Copy link
Contributor

@walterra walterra commented Sep 5, 2024

Summary

image
  • Let's users create a Log Rate Analysis panel using the "Add Panel" button when editing dashboards.
  • Retains functionality of links in results table to Discover and Pattern Analysis. 41b4337
  • Create Logs AIOps section in Add Panel menu.
  • Brushes not working with multiple panels fixed in 75ca4ca. The reason was the DualBrush component used hard coded html ids.
  • Panel now updates when data view is changed in options flyout, fixed in 2b58567.
  • When the user selects a data view without time field, we now show the same warning as used for pattern analysis and the apply button gets disabled, fixed in a01975d.
  • Pass on and use global search/filters to embeddable. 2c24dbd
  • Moving labels 26cd1a5
  • No results after time range update 632b711

Checklist

Delete any items that are not applicable to this PR.

@walterra walterra self-assigned this Sep 5, 2024
@walterra walterra force-pushed the ml-aiops-log-rate-analysis-embeddable branch from f036bf6 to e8ff186 Compare September 11, 2024 15:05
@walterra walterra force-pushed the ml-aiops-log-rate-analysis-embeddable branch 5 times, most recently from bed0540 to 07fdd72 Compare October 2, 2024 13:28
@walterra walterra force-pushed the ml-aiops-log-rate-analysis-embeddable branch from c2c775a to 93055db Compare October 7, 2024 13:53
@kibana-ci
Copy link
Collaborator

kibana-ci commented Oct 7, 2024

💔 Build Failed

Failed CI Steps

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
aiops 611 627 +16
ml 2041 2042 +1
total +17

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
aiops 552.7KB 577.4KB +24.7KB
dataVisualizer 726.5KB 726.5KB -23.0B
discover 820.0KB 820.0KB +16.0B
infra 1.6MB 1.6MB +5.0B
ml 4.6MB 4.6MB +758.0B
observability 467.6KB 467.6KB +8.0B
slo 855.4KB 855.4KB +5.0B
total +25.4KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
aiops 8.1KB 8.4KB +335.0B
Unknown metric groups

API count

id before after diff
aiops 73 72 -1

async chunk count

id before after diff
aiops 32 36 +4

ESLint disabled line counts

id before after diff
@kbn/aiops-log-rate-analysis 0 2 +2
aiops 38 39 +1
total +3

Total ESLint disabled count

id before after diff
@kbn/aiops-log-rate-analysis 0 2 +2
aiops 38 39 +1
total +3

History

  • 💛 Build #238858 was flaky c2c775af4df87cc366275fcc3880d823bd2cf61c
  • 💔 Build #238797 failed 07fdd724e9d10ccaa49ea34d9de635a806f31868
  • 💔 Build #238114 failed cdb685a98c803e196c131e9533d61d5c6da4d0a0
  • 💔 Build #238101 failed b05a4c04fc7cfba6f7c1cae64fd385544612951f
  • 💔 Build #238080 failed f62416eea10ff67ee11fbc34f272f19f2f5b8e34

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @walterra

@walterra walterra force-pushed the ml-aiops-log-rate-analysis-embeddable branch 2 times, most recently from d99a585 to 18a1cda Compare October 9, 2024 14:26
@walterra walterra added :ml v9.0.0 v8.16.0 Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis release_note:enhancement labels Oct 10, 2024
@walterra walterra marked this pull request as ready for review October 10, 2024 07:43
@walterra walterra requested a review from a team as a code owner October 10, 2024 07:43
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@peteharverson
Copy link
Contributor

As discussed offline, I'm seeing some odd effects when I try to add more than 1 log rate analysis embeddable panel to the same dashboard. Brush selection doesn't seem to work on the second panel.

@jgowdyelastic
Copy link
Member

I'm seeing an issue where changing the data view doesn't appear to be affecting the visualization. The chart doesn't change.

2024-10-10.10-18-09.2024-10-10.10_19_24.mp4

@walterra walterra added the backport:version Backport to applied version labels label Oct 10, 2024
@peteharverson
Copy link
Contributor

I'm finding that the labels for the brushes are moving as the panel contents is scrolled:

Screenshot 2024-10-10 at 10 35 13

@peteharverson
Copy link
Contributor

As discussed offline, I saw a regression regarding time range changes, where I started getting no results after moving the deviation to a different range and then back again. See if you can reproduce. Doesn't seem to happen on main:

Screen.Recording.2024-10-10.at.10.44.39.mov

@walterra
Copy link
Contributor Author

walterra commented Oct 10, 2024

Fixes done:

  • Brushes not working with multiple panels fixed in 75ca4ca. The reason was the DualBrush component used hard coded html ids.
  • Panel now updates when data view is changed in options flyout, fixed in 2b58567.
  • When the user selects a data view without time field, we now show the same warning as used for pattern analysis and the apply button gets disabled, fixed in a01975d.

@walterra walterra requested review from a team as code owners October 25, 2024 16:24
@walterra walterra requested a review from rylnd October 25, 2024 16:24
Copy link

❌ Author of the following commits did not sign a Contributor Agreement:
, , , , , , 7dd66b3, , , , ,

Please, read and sign the above mentioned agreement if you want to contribute to this project

@walterra
Copy link
Contributor Author

walterra commented Oct 25, 2024

sorry for the noise, pushed a wrong update.

@walterra walterra closed this Oct 25, 2024
@elasticmachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
aiops 584 636 +52

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
aiops 552.6KB 590.0KB +37.4KB
dataVisualizer 616.0KB 616.0KB -23.0B
ml 4.5MB 4.5MB +31.0B
transform 478.0KB 478.0KB +9.0B
total +37.4KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
aiops 7.9KB 8.4KB +438.0B
Unknown metric groups

async chunk count

id before after diff
aiops 30 34 +4

ESLint disabled line counts

id before after diff
@kbn/aiops-log-rate-analysis 0 2 +2
aiops 38 40 +2
total +4

Total ESLint disabled count

id before after diff
@kbn/aiops-log-rate-analysis 0 2 +2
aiops 38 40 +2
total +4

History

cc @walterra

@walterra walterra deleted the ml-aiops-log-rate-analysis-embeddable branch October 30, 2024 12:11
walterra added a commit that referenced this pull request Nov 5, 2024
## Summary

Follow up to #192167 (rebase/push gone wrong)

<img width="1920" alt="image"
src="https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a">

- [x] Let's users create a Log Rate Analysis panel using the "Add Panel"
button when editing dashboards.
- [x] Retains functionality of links in results table to Discover and
Pattern Analysis.
[41b4337](41b4337)
- [x] Create `Logs AIOps` section in Add Panel menu.
- [x] Brushes not working with multiple panels fixed in
[75ca4ca](75ca4ca).
The reason was the `DualBrush` component used hard coded html ids.
- [x] Panel now updates when data view is changed in options flyout,
fixed in
[2b58567](2b58567).
- [x] When the user selects a data view without time field, we now show
the same warning as used for pattern analysis and the apply button gets
disabled, fixed in
[a01975d](a01975d).
- [x] Pass on and use global search/filters to embeddable.
[2c24dbd](2c24dbd)
- [x] Moving labels
[26cd1a5](26cd1a5)
- [x] No results after time range update
[632b711](632b711)

### Checklist

Delete any items that are not applicable to this PR.

- [x] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Nov 5, 2024
## Summary

Follow up to elastic#192167 (rebase/push gone wrong)

<img width="1920" alt="image"
src="https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a">

- [x] Let's users create a Log Rate Analysis panel using the "Add Panel"
button when editing dashboards.
- [x] Retains functionality of links in results table to Discover and
Pattern Analysis.
[41b4337](elastic@41b4337)
- [x] Create `Logs AIOps` section in Add Panel menu.
- [x] Brushes not working with multiple panels fixed in
[75ca4ca](elastic@75ca4ca).
The reason was the `DualBrush` component used hard coded html ids.
- [x] Panel now updates when data view is changed in options flyout,
fixed in
[2b58567](elastic@2b58567).
- [x] When the user selects a data view without time field, we now show
the same warning as used for pattern analysis and the apply button gets
disabled, fixed in
[a01975d](elastic@a01975d).
- [x] Pass on and use global search/filters to embeddable.
[2c24dbd](elastic@2c24dbd)
- [x] Moving labels
[26cd1a5](elastic@26cd1a5)
- [x] No results after time range update
[632b711](elastic@632b711)

### Checklist

Delete any items that are not applicable to this PR.

- [x] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)

(cherry picked from commit 6b77e05)
kibanamachine added a commit that referenced this pull request Nov 5, 2024
# Backport

This will backport the following commits from `main` to `8.x`:
- [[ML] AIOps: Log Rate Analysis embeddable
(#197943)](#197943)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Walter
Rafelsberger","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-11-05T14:48:45Z","message":"[ML]
AIOps: Log Rate Analysis embeddable (#197943)\n\n##
Summary\r\n\r\nFollow up to #192167 (rebase/push gone wrong)\r\n\r\n<img
width=\"1920\"
alt=\"image\"\r\nsrc=\"https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a\">\r\n\r\n-
[x] Let's users create a Log Rate Analysis panel using the \"Add
Panel\"\r\nbutton when editing dashboards.\r\n- [x] Retains
functionality of links in results table to Discover and\r\nPattern
Analysis.\r\n[41b4337](https://github.com/elastic/kibana/pull/192167/commits/41b4337f9ac15103c6b151c94cfb6b7f944aeb89)\r\n-
[x] Create `Logs AIOps` section in Add Panel menu.\r\n- [x] Brushes not
working with multiple panels fixed
in\r\n[75ca4ca](https://github.com/elastic/kibana/pull/192167/commits/75ca4cac37abda94ae7fb9d5132283e1def0b85e).\r\nThe
reason was the `DualBrush` component used hard coded html ids.\r\n- [x]
Panel now updates when data view is changed in options flyout,\r\nfixed
in\r\n[2b58567](https://github.com/elastic/kibana/pull/192167/commits/2b5856777151d3ccc5e882c895704008e575aaff).\r\n-
[x] When the user selects a data view without time field, we now
show\r\nthe same warning as used for pattern analysis and the apply
button gets\r\ndisabled, fixed
in\r\n[a01975d](https://github.com/elastic/kibana/pull/192167/commits/a01975dba7b5218ea0f094ebc5cb74cd8670131a).\r\n-
[x] Pass on and use global search/filters to
embeddable.\r\n[2c24dbd](https://github.com/elastic/kibana/pull/192167/commits/2c24dbd116ef4ae19ff58796b2c5fc4f61a86234)\r\n-
[x] Moving
labels\r\n[26cd1a5](https://github.com/elastic/kibana/pull/192167/commits/26cd1a53dfbbea34094cd840eb885a78f29d8de6)\r\n-
[x] No results after time range
update\r\n[632b711](https://github.com/elastic/kibana/pull/192167/commits/632b711ca1de77d113192649f56c5b18ae453f86)\r\n\r\n###
Checklist\r\n\r\nDelete any items that are not applicable to this
PR.\r\n\r\n- [x] Any text added follows [EUI's
writing\r\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\r\nsentence case text and includes
[i18n\r\nsupport](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)\r\n-
[x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] This was
checked for breaking API changes and was
[labeled\r\nappropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)","sha":"6b77e05586524892dc42c34d0b5b2a561cebc0ae","branchLabelMapping":{"^v9.0.0$":"main","^v8.17.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":[":ml","v9.0.0","release_note:feature","Feature:ML/AIOps","backport:version","v8.17.0"],"title":"[ML]
AIOps: Log Rate Analysis
embeddable","number":197943,"url":"https://github.com/elastic/kibana/pull/197943","mergeCommit":{"message":"[ML]
AIOps: Log Rate Analysis embeddable (#197943)\n\n##
Summary\r\n\r\nFollow up to #192167 (rebase/push gone wrong)\r\n\r\n<img
width=\"1920\"
alt=\"image\"\r\nsrc=\"https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a\">\r\n\r\n-
[x] Let's users create a Log Rate Analysis panel using the \"Add
Panel\"\r\nbutton when editing dashboards.\r\n- [x] Retains
functionality of links in results table to Discover and\r\nPattern
Analysis.\r\n[41b4337](https://github.com/elastic/kibana/pull/192167/commits/41b4337f9ac15103c6b151c94cfb6b7f944aeb89)\r\n-
[x] Create `Logs AIOps` section in Add Panel menu.\r\n- [x] Brushes not
working with multiple panels fixed
in\r\n[75ca4ca](https://github.com/elastic/kibana/pull/192167/commits/75ca4cac37abda94ae7fb9d5132283e1def0b85e).\r\nThe
reason was the `DualBrush` component used hard coded html ids.\r\n- [x]
Panel now updates when data view is changed in options flyout,\r\nfixed
in\r\n[2b58567](https://github.com/elastic/kibana/pull/192167/commits/2b5856777151d3ccc5e882c895704008e575aaff).\r\n-
[x] When the user selects a data view without time field, we now
show\r\nthe same warning as used for pattern analysis and the apply
button gets\r\ndisabled, fixed
in\r\n[a01975d](https://github.com/elastic/kibana/pull/192167/commits/a01975dba7b5218ea0f094ebc5cb74cd8670131a).\r\n-
[x] Pass on and use global search/filters to
embeddable.\r\n[2c24dbd](https://github.com/elastic/kibana/pull/192167/commits/2c24dbd116ef4ae19ff58796b2c5fc4f61a86234)\r\n-
[x] Moving
labels\r\n[26cd1a5](https://github.com/elastic/kibana/pull/192167/commits/26cd1a53dfbbea34094cd840eb885a78f29d8de6)\r\n-
[x] No results after time range
update\r\n[632b711](https://github.com/elastic/kibana/pull/192167/commits/632b711ca1de77d113192649f56c5b18ae453f86)\r\n\r\n###
Checklist\r\n\r\nDelete any items that are not applicable to this
PR.\r\n\r\n- [x] Any text added follows [EUI's
writing\r\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\r\nsentence case text and includes
[i18n\r\nsupport](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)\r\n-
[x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] This was
checked for breaking API changes and was
[labeled\r\nappropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)","sha":"6b77e05586524892dc42c34d0b5b2a561cebc0ae"}},"sourceBranch":"main","suggestedTargetBranches":["8.x"],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/197943","number":197943,"mergeCommit":{"message":"[ML]
AIOps: Log Rate Analysis embeddable (#197943)\n\n##
Summary\r\n\r\nFollow up to #192167 (rebase/push gone wrong)\r\n\r\n<img
width=\"1920\"
alt=\"image\"\r\nsrc=\"https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a\">\r\n\r\n-
[x] Let's users create a Log Rate Analysis panel using the \"Add
Panel\"\r\nbutton when editing dashboards.\r\n- [x] Retains
functionality of links in results table to Discover and\r\nPattern
Analysis.\r\n[41b4337](https://github.com/elastic/kibana/pull/192167/commits/41b4337f9ac15103c6b151c94cfb6b7f944aeb89)\r\n-
[x] Create `Logs AIOps` section in Add Panel menu.\r\n- [x] Brushes not
working with multiple panels fixed
in\r\n[75ca4ca](https://github.com/elastic/kibana/pull/192167/commits/75ca4cac37abda94ae7fb9d5132283e1def0b85e).\r\nThe
reason was the `DualBrush` component used hard coded html ids.\r\n- [x]
Panel now updates when data view is changed in options flyout,\r\nfixed
in\r\n[2b58567](https://github.com/elastic/kibana/pull/192167/commits/2b5856777151d3ccc5e882c895704008e575aaff).\r\n-
[x] When the user selects a data view without time field, we now
show\r\nthe same warning as used for pattern analysis and the apply
button gets\r\ndisabled, fixed
in\r\n[a01975d](https://github.com/elastic/kibana/pull/192167/commits/a01975dba7b5218ea0f094ebc5cb74cd8670131a).\r\n-
[x] Pass on and use global search/filters to
embeddable.\r\n[2c24dbd](https://github.com/elastic/kibana/pull/192167/commits/2c24dbd116ef4ae19ff58796b2c5fc4f61a86234)\r\n-
[x] Moving
labels\r\n[26cd1a5](https://github.com/elastic/kibana/pull/192167/commits/26cd1a53dfbbea34094cd840eb885a78f29d8de6)\r\n-
[x] No results after time range
update\r\n[632b711](https://github.com/elastic/kibana/pull/192167/commits/632b711ca1de77d113192649f56c5b18ae453f86)\r\n\r\n###
Checklist\r\n\r\nDelete any items that are not applicable to this
PR.\r\n\r\n- [x] Any text added follows [EUI's
writing\r\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\r\nsentence case text and includes
[i18n\r\nsupport](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)\r\n-
[x] [Unit or
functional\r\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\r\nwere
updated or added to match the most common scenarios\r\n- [x] This was
checked for breaking API changes and was
[labeled\r\nappropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)","sha":"6b77e05586524892dc42c34d0b5b2a561cebc0ae"}},{"branch":"8.x","label":"v8.17.0","branchLabelMappingKey":"^v8.17.0$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Walter Rafelsberger <[email protected]>
mgadewoll pushed a commit to mgadewoll/kibana that referenced this pull request Nov 7, 2024
## Summary

Follow up to elastic#192167 (rebase/push gone wrong)

<img width="1920" alt="image"
src="https://github.com/user-attachments/assets/0ee12b65-0bff-4a02-805d-adab1be2a52a">

- [x] Let's users create a Log Rate Analysis panel using the "Add Panel"
button when editing dashboards.
- [x] Retains functionality of links in results table to Discover and
Pattern Analysis.
[41b4337](elastic@41b4337)
- [x] Create `Logs AIOps` section in Add Panel menu.
- [x] Brushes not working with multiple panels fixed in
[75ca4ca](elastic@75ca4ca).
The reason was the `DualBrush` component used hard coded html ids.
- [x] Panel now updates when data view is changed in options flyout,
fixed in
[2b58567](elastic@2b58567).
- [x] When the user selects a data view without time field, we now show
the same warning as used for pattern analysis and the apply button gets
disabled, fixed in
[a01975d](elastic@a01975d).
- [x] Pass on and use global search/filters to embeddable.
[2c24dbd](elastic@2c24dbd)
- [x] Moving labels
[26cd1a5](elastic@26cd1a5)
- [x] No results after time range update
[632b711](elastic@632b711)

### Checklist

Delete any items that are not applicable to this PR.

- [x] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/packages/kbn-i18n/README.md)
- [x] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [x] This was checked for breaking API changes and was [labeled
appropriately](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:version Backport to applied version labels Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis :ml release_note:feature Makes this part of the condensed release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.