Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make ledgers rsync-able, readable at arbitrary leader serialization states #698

Closed
rob-solana opened this issue Jul 19, 2018 · 2 comments
Closed

Comments

@rob-solana
Copy link
Contributor

If a validator reads directly from a leader's ledger file/output or starts from a leader's ledger that was snapshot'd while the leader was appending, the deserialization may fail on the last, partial Entry serialization.

There are choices to be made:

  • leaders can advertise snapshots from which validators can safely rsync or read directly
  • validators can tolerate failed deserialization, partial tails, and catchup via repair window

It'd be ok if both of the above were employed.

@sakridge
Copy link
Member

Atomic FS writes maybe something to look at.

@mvines mvines added this to the The Future! milestone Sep 5, 2018
@rob-solana
Copy link
Contributor Author

isn't relevant anymore, ledger_recover() covers the case

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants