Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Range support for Auto-interval Date Histogram #45299

Closed
not-napoleon opened this issue Aug 7, 2019 · 2 comments
Closed

Range support for Auto-interval Date Histogram #45299

not-napoleon opened this issue Aug 7, 2019 · 2 comments
Labels
:Analytics/Aggregations Aggregations Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@not-napoleon
Copy link
Member

This is a discussion issue for how and if we should add Range Field support to the Auto-interval Date Histogram aggregation. There are some edge cases with auto bucketing that don't come up in fixed width buckets.

Consider the case of many narrow (sub-hour) ranges and one wide (many days) interval. If we look at a single day and ask for ~20 buckets, we might expect to see one or three hour wide buckets. But if the wide range intersects the queried date, we might instead end up with day buckets.

We discussed this on 2019-08-07 and had a few thoughts on how to handle this:

  • Outlier detection could remove wide ranges when calculating the interval, but factor them in when counting documents. This could happen in the reduce phase, maybe?
  • We could achieve a similar effect by limiting the aggregation to a contains query, which would exclude ranges spanning beyond the queried time.

Leaving this open for further discussion.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo

@rjernst rjernst added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label May 4, 2020
@not-napoleon
Copy link
Member Author

Closing, we don't feel a need for this feature at this time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/Aggregations Aggregations Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Development

No branches or pull requests

3 participants