Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RemoteRoutingTable] Reduce number of remote download call for Indices Routing #15125

Closed
shailendra0811 opened this issue Aug 6, 2024 · 0 comments · Fixed by #14684
Closed
Labels
enhancement Enhancement or improvement to existing feature or request ShardManagement:Resiliency untriaged

Comments

@shailendra0811
Copy link
Contributor

shailendra0811 commented Aug 6, 2024

Is your feature request related to a problem? Please describe

In the event of a node drop, read calls to indices files would be proportional to number of index changed multiplied by number of nodes in the cluster. We need to reduce the number of downloads required for node drop scenarios.

Describe the solution you'd like

To reduce the number of indices file downloads required to construct the updated routing table, we will upload/download a new routing table diff file. This file will store the incremental differences between the previous routing table and the new routing table. This approach will reduce the number of reads to 1 per node in the cluster during node drop scenarios.

Related component

ShardManagement:Resiliency

Describe alternatives you've considered

No response

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request ShardManagement:Resiliency untriaged
Projects
Status: ✅ Done
Development

Successfully merging a pull request may close this issue.

2 participants