Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autoscaling reactive storage decider (#65520) #66236

Conversation

henningandersen
Copy link
Contributor

Backport of #65520

The reactive storage decider will request additional capacity
proportional to the size of shards that are either:

  • unassigned and unable to be allocated with only reason being storage
    on a node
  • shards that cannot remain where they are with only reason being
    storage and cannot be allocated anywhere else
  • shards that cannot remain where they are and cannot be allocated
    on any node and at least one node has storage as the only reason for
    unable to allocate.

The reactive storage decider does not try to look into the future, thus
at the time the reactive decider asks to scale up, the cluster is
already in a need for more storage.

The reactive storage decider will request additional capacity
proportional to the size of shards that are either:
* unassigned and unable to be allocated with only reason being storage
on a node
* shards that cannot remain where they are with only reason being
storage and cannot be allocated anywhere else
* shards that cannot remain where they are and cannot be allocated
on any node and at least one node has storage as the only reason for
unable to allocate.

The reactive storage decider does not try to look into the future, thus
at the time the reactive decider asks to scale up, the cluster is
already in a need for more storage.
@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Dec 13, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@henningandersen henningandersen merged commit 2a44a5f into elastic:7.x Dec 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport :Distributed Coordination/Autoscaling >non-issue Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.11.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants