Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deprecated support for delaying state recovery pending master nodes #53646

Merged
merged 3 commits into from
Mar 18, 2020

Conversation

ShawnLi1014
Copy link
Contributor

As mentioned in issue #51806, we now have the option to delay state recovery until a certain number of master-eligible nodes have joined, but this seems unnecessary: we require a majority of master-eligible nodes for state recovery, but there is no advantage in waiting for more.
This pull request deprecated the following settings in GatewayService.java

  • gateway.expected_nodes
  • gateway.expected_master_nodes
  • gateway.recover_after_nodes
  • gateway.recover_after_master_nodes

@DaveCTurner DaveCTurner self-requested a review March 17, 2020 10:33
@DaveCTurner DaveCTurner added the :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) label Mar 17, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (:Distributed/Allocation)

Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggested an alternative way to note that these are deprecated in the docs, but the code changes look good.

docs/reference/modules/gateway.asciidoc Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Outdated Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Outdated Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Outdated Show resolved Hide resolved
docs/reference/modules/gateway.asciidoc Outdated Show resolved Hide resolved
@DaveCTurner
Copy link
Contributor

@elasticmachine test this please

@DaveCTurner
Copy link
Contributor

@elasticmachine update branch

@DaveCTurner
Copy link
Contributor

@elasticmachine test this please

@DaveCTurner
Copy link
Contributor

@elasticmachine test this please

Copy link
Contributor

@DaveCTurner DaveCTurner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks @ShawnLi1014. Do you plan to open a follow-up to remove these settings?

@DaveCTurner DaveCTurner merged commit fe5092a into elastic:master Mar 18, 2020
DaveCTurner pushed a commit that referenced this pull request Mar 18, 2020
It is useful to be able to delay state recovery until enough data nodes have
joined the cluster, since this gives the shard allocator a decent opportunity
to re-use as much existing data as possible. However we also have the option to
delay state recovery until a certain number of master-eligible nodes have
joined, and this is unnecessary: we require a majority of master-eligible nodes
for state recovery, and there is no advantage in waiting for more.

This commit deprecates the unnecessary settings in preparation for their
removal.

Relates #51806
@ShawnLi1014
Copy link
Contributor Author

LGTM thanks @ShawnLi1014. Do you plan to open a follow-up to remove these settings?

Thank you, and yes I am working on it

@mfussenegger mfussenegger mentioned this pull request Mar 25, 2020
37 tasks
DaveCTurner added a commit to DaveCTurner/elasticsearch that referenced this pull request Jan 26, 2021
The `gateway.recover_after_nodes` setting is one of the lucky few that
gets a mention in the default `elasticsearch.yml` config file. This
setting was deprecated in favour of `gateway.recover_after_data_nodes`
in elastic#53646, but neither of these settings is really important enough to
warrant a place in the default config so this commit removes it.
DaveCTurner added a commit that referenced this pull request Jan 28, 2021
The `gateway.recover_after_nodes` setting is one of the lucky few that
gets a mention in the default `elasticsearch.yml` config file. This
setting was deprecated in favour of `gateway.recover_after_data_nodes`
in #53646, but neither of these settings is really important enough to
warrant a place in the default config so this commit removes it.
DaveCTurner added a commit that referenced this pull request Jan 28, 2021
The `gateway.recover_after_nodes` setting is one of the lucky few that
gets a mention in the default `elasticsearch.yml` config file. This
setting was deprecated in favour of `gateway.recover_after_data_nodes`
in #53646, but neither of these settings is really important enough to
warrant a place in the default config so this commit removes it.
jrodewig added a commit that referenced this pull request Sep 16, 2021
We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77951)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77952)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77953)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77958)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77954)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77956)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77955)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
elasticsearchmachine pushed a commit that referenced this pull request Sep 16, 2021
…) (#77957)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
jrodewig added a commit that referenced this pull request Sep 16, 2021
…) (#77959)

We deprecated the following settings in 7.7 with PR #53646:

* `gateway.expected_nodes`
* `gateway.expected_master_nodes`
* `gateway.recover_after_nodes`
* `gateway.recover_after_master_nodes`

However, we didn't add a related item to the 7.7 deprecation docs. This adds the
missing item.

Relates to #53845.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>deprecation :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) v7.7.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants