Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[8.9] Change downsample threadpool size. (#97714) #97764

Merged
merged 1 commit into from
Jul 18, 2023
Merged

[8.9] Change downsample threadpool size. (#97714) #97764

merged 1 commit into from
Jul 18, 2023

Conversation

martijnvg
Copy link
Member

Backports the following commits to 8.9:

@martijnvg
Change downsample threadpool size. (elastic#97714)
e5f7aad 
Changed the downsample threadpool size to one eight of the allocated processors. Downsampling is a cpu intensive operation (search + heavy aggregation that rolls up documents) and could overwhelm a node. On top of this the downsample operation also delegates to force merge api, which has a threadpool that is also bounded to one eight of the allocated processors.

Relates to elastic#97141
@martijnvg martijnvg added :StorageEngine/Downsampling Downsampling (replacement for rollups) - Turn fine-grained time-based data into coarser-grained data >non-issue auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) labels Jul 18, 2023
@elasticsearchmachine elasticsearchmachine mentioned this pull request Jul 18, 2023
Merged
@elasticsearchmachine elasticsearchmachine merged commit ff03c34 into elastic:8.9 Jul 18, 2023
@martijnvg martijnvg deleted the backport/8.9/pr-97714 branch July 18, 2023 19:34
@rjernst rjernst added v8.9.0 and removed v8.9.1 labels Jul 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) backport >non-issue :StorageEngine/Downsampling Downsampling (replacement for rollups) - Turn fine-grained time-based data into coarser-grained data Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v8.9.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@martijnvg @rjernst @elasticsearchmachine