Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add warning for read-write indices in force merge documentation #28843

Closed
ppf2 opened this issue Feb 27, 2018 · 6 comments
Closed

Add warning for read-write indices in force merge documentation #28843

ppf2 opened this issue Feb 27, 2018 · 6 comments
Labels
:Data Management/Indices APIs APIs to create and manage indices and templates >docs General docs changes

Comments

@ppf2
Copy link
Member

ppf2 commented Feb 27, 2018

Running force merge against a read-write index (an index that can still have read/write activity post force-merge) can cause very large segments to be produced (>5Gb per segment), and the merge policy will never consider it for merging again until it has 75% of deleted docs. This can cause very large segments to remain in the shards.

This is not currently documented (https://www.elastic.co/guide/en/elasticsearch/reference/6.2/indices-forcemerge.html). Would like to see a warning message added to the above page to specify force merge as an API call to use only against read-only indices.

@ppf2 ppf2 added the >docs General docs changes label Feb 27, 2018
@javanna javanna added the help wanted adoptme label Mar 1, 2018
@mueedc-zz
Copy link

I'd be happy to give this a shot if no one else has claimed it

@javanna
Copy link
Member

javanna commented Mar 1, 2018

go for it @mueedc , looking forward to your PR ;)

@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-infra

@eloj
Copy link

eloj commented Mar 9, 2019

I know this is an old:ish issue, but the warning text merged seems misleading, at least to relatively inexperienced users like myself.

I immediately assumed that I should set index.blocks.read_only (or .read_only_allow_delete) to make the index read-only before issuing a force merge, but this then results in a 403 when trying to merge.

It was explained to me on twitter that the actual meaning is that there should be no concurrent writes, not that the index should be set to read-only.

Please consider if the warning can be rewritten to be clearer. Thank you.

@laf-rge
Copy link

laf-rge commented Apr 28, 2019

I know this is an old:ish issue, but the warning text merged seems misleading, at least to relatively inexperienced users like myself.

I immediately assumed that I should set index.blocks.read_only (or .read_only_allow_delete) to make the index read-only before issuing a force merge, but this then results in a 403 when trying to merge.

It was explained to me on twitter that the actual meaning is that there should be no concurrent writes, not that the index should be set to read-only.

Please consider if the warning can be rewritten to be clearer. Thank you.

I just did the same thing.

@DaveCTurner
Copy link
Contributor

Thanks for the comments @laf-rge and @eloj, I opened #41624 to discuss fixes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Data Management/Indices APIs APIs to create and manage indices and templates >docs General docs changes
Projects
None yet
Development

No branches or pull requests

8 participants