Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Draft][CX-CLEANUP] - DA Integrated Storage #2784

Closed
wants to merge 4 commits into from
Closed

Conversation

jparr721
Copy link
Contributor

Closes #2621

We want to integrate a persistent storage interface within HotShot to enable the application to manage data storage effectively. This feature aims to address potential data storage issues (e.g., full disk space) that can prevent nodes from storing DA blobs or VID shares.

This PR:

  1. Creates BlockStorage Trait
  2. Initializes BlockStorage in HotShot's init
  3. Add Storage Operations on DA Proposals
    • If this fails, do not vote on the proposal and exit the event handler.
  4. Add Storage Operations on DA Proposals VID Shares
    • If this fails, do not vote on the VID disperse, otherwise, use the old logic to vote.
  5. Refactor In-memory Payload/VID Stores:
    • Remove in-memory storage for payloads and VID shares from HotShot. This involves removing the self.consensus.write().await.vid_shares.insert(view, disperse.clone()); call from the code for VID disperse events.

This code also implements a number of changes to introduce a TestBlockStorage type for use in the various testing components.

This PR does not:

Key places to review:

@jparr721 jparr721 changed the title [Draft][[CX-CLEANUP] - DA Integrated Storage [Draft][CX-CLEANUP] - DA Integrated Storage Mar 15, 2024
@@ -59,7 +59,7 @@ futures = "0.3.30"
# TODO generic-array should not be a direct dependency
# https://github.com/EspressoSystems/HotShot/issues/1850
generic-array = { version = "0.14.7", features = ["serde"] }
hotshot-types = { git = "https://github.com/EspressoSystems/hotshot-types", tag = "0.1.4" }
hotshot-types = { git = "https://github.com/EspressoSystems/hotshot-types", branch = "jparr721/issue-2621" }
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jparr721 jparr721 marked this pull request as ready for review March 15, 2024 15:58
@jparr721 jparr721 requested review from shenkeyao, bfish713, jbearer and elliedavidson and removed request for bfish713, lukaszrzasik and elliedavidson March 15, 2024 16:10
@jparr721 jparr721 closed this Mar 18, 2024
@jparr721 jparr721 deleted the jparr721/issue-2621 branch March 18, 2024 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CX-CLEANUP] - DA Integrated Storage
1 participant