Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perform evaluation in multiple steps when necessary #53295

Merged
merged 3 commits into from
Mar 11, 2020

Conversation

przemekwitek
Copy link
Contributor

@przemekwitek przemekwitek commented Mar 9, 2020

This PR performs evaluation aggregations in batches when performing a single request would cause too_many_buckets_exception.

It takes into account the search.max_buckets setting. The setting is passed to all the metrics using Settings object so the interface of EvaluationMetric::aggs method had to be extended.

For the default value of search.max_buckets setting (10000) there will be more than 100 sequential steps making the _evaluate request somewhat slow. But for now I think it's better to provide slow response rather than no response at all.

@przemekwitek przemekwitek force-pushed the fix_evaluation_bug branch 4 times, most recently from 1ab682c to baff92b Compare March 11, 2020 07:05
@przemekwitek przemekwitek marked this pull request as ready for review March 11, 2020 07:52
@przemekwitek przemekwitek added :ml Machine learning >bug v7.7.0 v8.0.0 and removed WIP labels Mar 11, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@przemekwitek
Copy link
Contributor Author

run elasticsearch-ci/default-distro
run elasticsearch-ci/bwc

@przemekwitek
Copy link
Contributor Author

run elasticsearch-ci/bwc

Copy link
Contributor

@droberts195 droberts195 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants