Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Metrics UI / Logs UI] Remove field filtering in Source API call #58553

Merged
merged 3 commits into from
Feb 26, 2020

Conversation

simianhacker
Copy link
Member

@simianhacker simianhacker commented Feb 25, 2020

Summary

This PR fixes a performance issue with the Metrics UI on slow or large clusters. This removes the code used to filter down the fields to just the active Metricbeat/Filebeat modules. On larger clusters this query can take up to 40-70 seconds to complete making the UI essentially unusable. This change will affect ALL the field selection dropdown throughout the Metrics and Logs UI. After this PR the user will see EVERY field listed in the Metricbeat and Filebeat mappings.

Checklist

Delete any items that are not applicable to this PR.

Possible Related Issues

Logs UI GraphQL data source request takes 40 seconds #58166
Metrics App and Metrics Inventory taking very long time to load #58551

@sorantis @roncohen

@simianhacker simianhacker added release_note:fix Feature:Metrics UI Metrics UI feature v8.0.0 Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services v7.7.0 v7.6.1 labels Feb 25, 2020
@simianhacker simianhacker requested a review from a team as a code owner February 25, 2020 23:01
@elasticmachine
Copy link
Contributor

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

Copy link
Member

@weltenwort weltenwort left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👀 Reviewing on behalf of @elastic/logs-metrics-ui...

Copy link
Member

@weltenwort weltenwort left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM aside from the compiler warnings. There's a noticeable speedup when loading the sources.

);
const dataSets = buckets.map(bucket => bucket.key.dataset);
const modules = dataSets.reduce((acc, dataset) => {
const module = first(dataset.split(/\./));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The compiler complains about these lodash functions still being imported after the removal of their usage.

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@simianhacker simianhacker merged commit 0764380 into elastic:master Feb 26, 2020
simianhacker added a commit to simianhacker/kibana that referenced this pull request Feb 26, 2020
…stic#58553)

* [Metrics UI / Logs UI] Remove field filtering in Source API call.

* Fixing type_check issues
simianhacker added a commit to simianhacker/kibana that referenced this pull request Feb 26, 2020
…stic#58553)

* [Metrics UI / Logs UI] Remove field filtering in Source API call.

* Fixing type_check issues
simianhacker added a commit that referenced this pull request Feb 26, 2020
) (#58615)

* [Metrics UI / Logs UI] Remove field filtering in Source API call.

* Fixing type_check issues
simianhacker added a commit that referenced this pull request Feb 26, 2020
) (#58616)

* [Metrics UI / Logs UI] Remove field filtering in Source API call.

* Fixing type_check issues
@simianhacker simianhacker deleted the remove-field-filtering branch April 17, 2024 15:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:Metrics UI Metrics UI feature release_note:fix Team:Infra Monitoring UI - DEPRECATED DEPRECATED - Label for the Infra Monitoring UI team. Use Team:obs-ux-infra_services v7.6.1 v7.7.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants