Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Filter Unneeded SnapshotInfo Instances Early in TransportGetSnapshotsAction (#78032) #79321

Merged
merged 1 commit into from
Oct 17, 2021

Conversation

original-brownbear
Copy link
Member

Better to filter as early as possible to release the memory asap and not even fetch things we don't need to fetch to begin with.
There's still a bunch of spots remaining where similar optimizations can be added quickly before we implement the system index for the remaining searching/fetching that we can't easily exclude up-front.
This already gives vastly improved performance for many requests though for obvious reasons.

backport of #78032

…Action (elastic#78032)

Better to filter as early as possible to release the memory asap and not even fetch things we don't need to fetch to begin with.
There's still a bunch of spots remaining where similar optimizations can be added quickly before we implement the system index for the remaining searching/fetching that we can't easily exclude up-front.
This already gives vastly improved performance for many requests though for obvious reasons.
@original-brownbear original-brownbear added >non-issue :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Oct 17, 2021
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Oct 17, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@original-brownbear original-brownbear merged commit 284a352 into elastic:7.x Oct 17, 2021
@original-brownbear original-brownbear deleted the 78032-7.x branch October 17, 2021 18:28
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Oct 18, 2021
Same as elastic#79321 but for SLM policies. Enhances RepositoryData accordingly
to enable the optimization.
original-brownbear added a commit that referenced this pull request Oct 19, 2021
Same as #79321 but for SLM policies. Enhances RepositoryData accordingly
to enable the optimization.
original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Oct 19, 2021
Same as elastic#79321 but for SLM policies. Enhances RepositoryData accordingly
to enable the optimization.
original-brownbear added a commit that referenced this pull request Oct 19, 2021
Same as #79321 but for SLM policies. Enhances RepositoryData accordingly
to enable the optimization.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport :Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >enhancement Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants