Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(Doc+) How to resolve shards >50GB #111254

Merged
merged 2 commits into from
Jul 25, 2024

Conversation

stefnestor
Copy link
Contributor

👋 howdy, team! Expands Aim for shards of up to 200M documents, or with sizes between 10GB and 50GB to include resolution steps if you find yourself out of bounds.

Calls out can do Split/Reindex but Restore/Clone would be insufficient, which comes up frequently for Support.

@stefnestor stefnestor added >enhancement >docs General docs changes :Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) Team:Distributed Meta label for distributed team (obsolete) Team:Docs Meta label for docs team labels Jul 24, 2024
Copy link
Contributor

Documentation preview:

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-docs (Team:Docs)

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@elasticsearchmachine elasticsearchmachine added v8.16.0 external-contributor Pull request authored by a developer outside the Elasticsearch team labels Jul 24, 2024
Co-authored-by: Ievgen Degtiarenko <[email protected]>
@stefnestor stefnestor merged commit a7470c0 into elastic:main Jul 25, 2024
5 checks passed
@stefnestor stefnestor deleted the stef_shards50GBresolve branch July 25, 2024 14:29
@elasticsearchmachine
Copy link
Collaborator

💚 Backport successful

Status Branch Result
8.14
8.15

stefnestor added a commit to stefnestor/elasticsearch that referenced this pull request Jul 25, 2024
* (Doc+) How to resolve shards >50GB

---------

Co-authored-by: Ievgen Degtiarenko <[email protected]>
stefnestor added a commit to stefnestor/elasticsearch that referenced this pull request Jul 25, 2024
* (Doc+) How to resolve shards >50GB

---------

Co-authored-by: Ievgen Degtiarenko <[email protected]>
elasticsearchmachine pushed a commit that referenced this pull request Jul 25, 2024
* (Doc+) How to resolve shards >50GB

---------

Co-authored-by: Ievgen Degtiarenko <[email protected]>
stefnestor added a commit that referenced this pull request Oct 16, 2024
👋 howdy, team (cc: @anniegale9538 )! 

Playing forward #111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.
stefnestor added a commit that referenced this pull request Oct 16, 2024
* (Doc+) link video for resolving shards too large

👋 howdy, team (cc: @anniegale9538 )!  Playing forward #111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.

---------

Co-authored-by: Liam Thompson <[email protected]>
leemthompo pushed a commit that referenced this pull request Oct 16, 2024
* (Doc+) link video for resolving shards too large

👋 howdy, team (cc: @anniegale9538 )!  Playing forward #111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.

---------

Co-authored-by: Liam Thompson <[email protected]>
(cherry picked from commit c76fd00)
elasticsearchmachine pushed a commit that referenced this pull request Oct 16, 2024
* (Doc+) link video for resolving shards too large

👋 howdy, team (cc: @anniegale9538 )!  Playing forward #111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.

---------

Co-authored-by: Liam Thompson <[email protected]>
(cherry picked from commit c76fd00)

Co-authored-by: Stef Nestor <[email protected]>
georgewallace pushed a commit to georgewallace/elasticsearch that referenced this pull request Oct 25, 2024
* (Doc+) link video for resolving shards too large

👋 howdy, team (cc: @anniegale9538 )!  Playing forward elastic#111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.

---------

Co-authored-by: Liam Thompson <[email protected]>
jfreden pushed a commit to jfreden/elasticsearch that referenced this pull request Nov 4, 2024
* (Doc+) link video for resolving shards too large

👋 howdy, team (cc: @anniegale9538 )!  Playing forward elastic#111254, [this video](https://www.youtube.com/watch?v=sHyNYnwbYro) demonstrates an example resolving shards too large via reindex under [this section](https://www.elastic.co/guide/en/elasticsearch/reference/master/size-your-shards.html#shard-size-recommendation) as it's a top support ask.

---------

Co-authored-by: Liam Thompson <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Allocation All issues relating to the decision making around placing a shard (both master logic & on the nodes) >docs General docs changes >enhancement external-contributor Pull request authored by a developer outside the Elasticsearch team Team:Distributed Meta label for distributed team (obsolete) Team:Docs Meta label for docs team v8.14.0 v8.15.0 v8.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants