State sync support #5803
Closed
State sync support #5803
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
erikgrinaker
added a commit
to tendermint/tendermint
that referenced
this pull request
Apr 29, 2020
Adds the ABCI interface for [state sync](#828) as outlined in [ADR-053](https://github.com/tendermint/tendermint/blob/master/docs/architecture/adr-053-state-sync-prototype.md), and bumps ABCIVersion to `0.17.0`. The interface adds a new ABCI connection which Tendermint can use to query and load snapshots from the app (for serving snapshots to other nodes), and to offer and apply snapshots to the app (for state syncing a local node from peers). Split out from the original PR in #4645, state sync reactor will be submitted as a separate PR. The interface is implemented by the Cosmos SDK in cosmos/cosmos-sdk#5803.
erikgrinaker
added a commit
to tendermint/tendermint
that referenced
this pull request
Apr 29, 2020
Fixes #828. Adds state sync, as outlined in [ADR-053](https://github.com/tendermint/tendermint/blob/master/docs/architecture/adr-053-state-sync-prototype.md). See related PRs in Cosmos SDK (cosmos/cosmos-sdk#5803) and Gaia (cosmos/gaia#327). This is split out of the previous PR #4645, and branched off of the ABCI interface in #4704. * Adds a new P2P reactor which exchanges snapshots with peers, and bootstraps an empty local node from remote snapshots when requested. * Adds a new configuration section `[statesync]` that enables state sync and configures the light client. Also enables `statesync:info` logging by default. * Integrates state sync into node startup. Does not support the v2 blockchain reactor, since it needs some reorganization to defer startup.
13 tasks
tac0turtle
pushed a commit
to tendermint/tendermint
that referenced
this pull request
Apr 29, 2020
Adds the ABCI interface for [state sync](#828) as outlined in [ADR-053](https://github.com/tendermint/tendermint/blob/master/docs/architecture/adr-053-state-sync-prototype.md), and bumps ABCIVersion to `0.17.0`. The interface adds a new ABCI connection which Tendermint can use to query and load snapshots from the app (for serving snapshots to other nodes), and to offer and apply snapshots to the app (for state syncing a local node from peers). Split out from the original PR in #4645, state sync reactor will be submitted as a separate PR. The interface is implemented by the Cosmos SDK in cosmos/cosmos-sdk#5803.
tac0turtle
pushed a commit
to tendermint/tendermint
that referenced
this pull request
Apr 29, 2020
Fixes #828. Adds state sync, as outlined in [ADR-053](https://github.com/tendermint/tendermint/blob/master/docs/architecture/adr-053-state-sync-prototype.md). See related PRs in Cosmos SDK (cosmos/cosmos-sdk#5803) and Gaia (cosmos/gaia#327). This is split out of the previous PR #4645, and branched off of the ABCI interface in #4704. * Adds a new P2P reactor which exchanges snapshots with peers, and bootstraps an empty local node from remote snapshots when requested. * Adds a new configuration section `[statesync]` that enables state sync and configures the light client. Also enables `statesync:info` logging by default. * Integrates state sync into node startup. Does not support the v2 blockchain reactor, since it needs some reorganization to defer startup.
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
|
leave it open |
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
|
I've ported this to the latest SDK+Tendermint target in the |
16 tasks
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
25 tasks
|
Superseded by #7166. |
NexZhu
pushed a commit
to daotl/go-acei
that referenced
this pull request
Oct 27, 2021
Adds the ABCI interface for [state sync](tendermint/tendermint#828) as outlined in [ADR-053](https://github.com/tendermint/tendermint/blob/master/docs/architecture/adr-053-state-sync-prototype.md), and bumps ABCIVersion to `0.17.0`. The interface adds a new ABCI connection which Tendermint can use to query and load snapshots from the app (for serving snapshots to other nodes), and to offer and apply snapshots to the app (for state syncing a local node from peers). Split out from the original PR in #4645, state sync reactor will be submitted as a separate PR. The interface is implemented by the Cosmos SDK in cosmos/cosmos-sdk#5803.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Fixes #5689, fixes #5690. Adds support for taking, restoring, and serving snapshots for state sync, as outlined in ADR-053 and the ABCI reference.
rootmulti.Storenow implements a newsnapshots.Snapshotterinterface, which can take and restore binary state snapshots at a given height. Snapshots are built as follows:rootmulti.Storeiterates over alliavl.Storestores, and for each one emits a delimited ProtobufSnapshotStoreItemmessage with store metadataFor each
iavl.Store, exportiavl.ExportNodenodes viaExport()at the given height and emit a delimited ProtobufSnapshotIAVLItemmessage for each nodeThe delimited Protobuf message stream is zlib-compressed
The zlib-compressed stream is chunked naïvely into 10 MB chunks
snapshots.Storestores snapshot metadata in a separate database and chunks in a filesystem directoryBaseApptakes asynchronous snapshots afterCommit()in regular height intervals given by the config optionstate-sync.snapshot-interval(default 0, i.e. disabled). It also prunes old snapshots, and keeps the most recent snapshots given by the optionstate-sync.snapshot-keep-recent(default 2).BaseAppimplements the upcoming state sync ABCI interface from Tendermint, for fetching and applying state snapshots.SimApphas been updated to enable and initialize state sync snapshots.