Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Adds grok highlighting to the file data visualizer #175913

Conversation

jgowdyelastic
Copy link
Member

@jgowdyelastic jgowdyelastic commented Jan 30, 2024

Adds grokpattern highlighting to the file data visualizer for semi-structured text files.
The first 5 lines of the file are displayed with inline highlighting. Hovering the mouse over displays a tooltip with the field name and type.

image

If for whatever reason the highlighting fails, we switch back to the raw text.

@szabosteve and @peteharverson I'm not 100% happy with the labels on the tabs, Highlighted text and Raw text. So suggestions are welcome.

Relates to elastic/elasticsearch#104394

@jgowdyelastic
Copy link
Member Author

/ci

@jgowdyelastic
Copy link
Member Author

/ci

@jgowdyelastic
Copy link
Member Author

/ci

@jgowdyelastic
Copy link
Member Author

/ci

@jgowdyelastic
Copy link
Member Author

/ci

@jgowdyelastic
Copy link
Member Author

/ci

@peteharverson peteharverson changed the title [ML] File data visualizer grok highighting [ML] File data visualizer grok highlighting Feb 6, 2024
@peteharverson peteharverson changed the title [ML] File data visualizer grok highlighting [ML] Adds grok highlighting to the file data visualizer grok Feb 6, 2024
@peteharverson peteharverson changed the title [ML] Adds grok highlighting to the file data visualizer grok [ML] Adds grok highlighting to the file data visualizer Feb 6, 2024
Copy link
Contributor

@szabosteve szabosteve left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left an alternative solution for the label strings. It would be interesting to know your opinions as naming is tricky. Thanks in advance! @jgowdyelastic, @peteharverson

Copy link
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tested with a variety of different logs, and LGTM.

@qn895
Copy link
Member

qn895 commented Feb 7, 2024

LGTM, left a note about test data that was commented out.

@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
dataVisualizer 613 617 +4

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
dataVisualizer 646.1KB 650.0KB +4.0KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
dataVisualizer 23.2KB 23.3KB +140.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @jgowdyelastic

@jgowdyelastic jgowdyelastic merged commit 0bca3c0 into elastic:main Feb 8, 2024
17 checks passed
@kibanamachine kibanamachine added the backport:skip This commit does not require backporting label Feb 8, 2024
@jgowdyelastic jgowdyelastic deleted the file-data-visualizer-grok-highlighting branch February 8, 2024 09:22
fkanout pushed a commit to fkanout/kibana that referenced this pull request Feb 8, 2024
Adds grokpattern highlighting to the file data visualizer for
semi-structured text files.
The first 5 lines of the file are displayed with inline highlighting.
Hovering the mouse over displays a tooltip with the field name and type.


![image](https://github.com/elastic/kibana/assets/22172091/7b50aeca-0255-4413-93ef-e44976e798f4)


If for whatever reason the highlighting fails, we switch back to the raw
text.

@szabosteve and @peteharverson I'm not 100% happy with the labels on the
tabs, `Highlighted text` and `Raw text`. So suggestions are welcome.



Relates to elastic/elasticsearch#104394

---------

Co-authored-by: kibanamachine <[email protected]>
Co-authored-by: István Zoltán Szabó <[email protected]>
CoenWarmer pushed a commit to CoenWarmer/kibana that referenced this pull request Feb 15, 2024
Adds grokpattern highlighting to the file data visualizer for
semi-structured text files.
The first 5 lines of the file are displayed with inline highlighting.
Hovering the mouse over displays a tooltip with the field name and type.


![image](https://github.com/elastic/kibana/assets/22172091/7b50aeca-0255-4413-93ef-e44976e798f4)


If for whatever reason the highlighting fails, we switch back to the raw
text.

@szabosteve and @peteharverson I'm not 100% happy with the labels on the
tabs, `Highlighted text` and `Raw text`. So suggestions are welcome.



Relates to elastic/elasticsearch#104394

---------

Co-authored-by: kibanamachine <[email protected]>
Co-authored-by: István Zoltán Szabó <[email protected]>
fkanout pushed a commit to fkanout/kibana that referenced this pull request Mar 4, 2024
Adds grokpattern highlighting to the file data visualizer for
semi-structured text files.
The first 5 lines of the file are displayed with inline highlighting.
Hovering the mouse over displays a tooltip with the field name and type.


![image](https://github.com/elastic/kibana/assets/22172091/7b50aeca-0255-4413-93ef-e44976e798f4)


If for whatever reason the highlighting fails, we switch back to the raw
text.

@szabosteve and @peteharverson I'm not 100% happy with the labels on the
tabs, `Highlighted text` and `Raw text`. So suggestions are welcome.



Relates to elastic/elasticsearch#104394

---------

Co-authored-by: kibanamachine <[email protected]>
Co-authored-by: István Zoltán Szabó <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting Feature:File and Index Data Viz ML file and index data visualizer :ml release_note:enhancement v8.13.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants