Discover tab available fields list top five value pop up percentage resolution is too low

[bturner1273]

Description of the issue

Kibana discover tab available fields list seemingly has an issue that when a field is clicked to show 'Top Five Values' if one of the values greatly outweighs the others i.e. we have 9999 equal values and one outlier the common value will be the only one displayed in the 'Top Five Values' menu with a display of 100%. The other doesn't display as .01% and is left out. The only way to view it is to explicitly filter out the top value.

Proposed solution

Make the discover field list look more like Lens, by using aggregations to determine the top values.

[elasticmachine]

Pinging @elastic/kibana-app (Team:KibanaApp)

[wylieconlon]

This is not a bug, but I agree that we should consider changing it.

Currently Discover only looks at 500 documents, so the values you see are based on the 500 documents loaded.

Lens has taken a different approach with our field list, which is trying to represent percentages more globally.

We should probably change the calculation to be more global, like Lens.

[timroes]

Closing this in favor of #41108 and ... another issue I am not able to find again. We have an issue that index patterns should provide the API for field stats, but I can't find that issue right now. If someone comes across it please feel free to link it here.