Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deduplicate mappings in persisted cluster state #87126

Conversation

DaveCTurner
Copy link
Contributor

WIP

@DaveCTurner DaveCTurner added WIP :Distributed Coordination/Cluster Coordination Cluster formation and cluster state publication, including cluster membership and fault detection. v8.4.0 labels May 25, 2022
@DaveCTurner
Copy link
Contributor Author

We discussed this recently and decided that Joe is going to move this forwards.

joegallo added 18 commits June 28, 2022 15:23
to reflect specifically that there's no action required for an index, specifically
There's no tracking of 'mappings changed' because we're storing things
by hash, so mappings are removed and/or added but we can't see
'changes' as a reified thing.
The behavior of writeIncrementalStateAndCommit relies on the
previousState that we pass in actually being a correct representation
of the on-disk state -- this test did not respect that. Rather, it did
clusterState->newClusterState twice in a row, so now we inject a
null->clusterState between the two so that everything works right.

Also we're doing more writes now, so I bumped the 14 constant to 16.
@joegallo
Copy link
Contributor

Closing in favor of #88479

@joegallo joegallo closed this Jul 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Cluster Coordination Cluster formation and cluster state publication, including cluster membership and fault detection. v8.4.0 WIP
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants