EIP4844 Feature Completion Checklist

[terencechain]

This issue tracks the remaining tasks for completing the EIP4844 feature on Deneb. The following tasks have already been accomplished:

• State transition implementation is up to spec. Latest spec tests passed
• Validator signing blobs and broadcasting blobs to individual gossip net are working
• DB pruning for blobs is working
• Most of current spec'ed beacon API endpoints are implemented and tested
• Blob gossip is working
• Blob by range syncing is working
• Blob by root syncing is working
• A node can sync from Genesis to post Deneb on the block with blobs
• Prysmctl tool to request blobs by range

The following tasks are remaining:

• Implement backfilling for blocks and blobs
• Implement builder path for Deneb blind block and blind blobs
  • update builder client handling Update getHeader and submitBlindedBlock to support blobs (EIP-4844) ethereum/builder-specs#61
• Implement a better heuristic approach to request missing blob
• Implement blob storage separation. Users can choose to store blobs in other file systems if they wish to
• Add and optimize sidecar KZG proof checks
• Handle the edge case where the finalized epoch is older than the data retention epoch
• Clean up the initial sync code. Perhaps using this excellent opportunity to rewrite the majority of the initial sync code
• Test thoroughly and refine the user experience
• Update Beacon API endpoints:
  • getStateV2 json
  • getStateV2 ssz
  • getBlockV2 json
  • getBlockV2 ssz
  • getBlindedBlock json
  • getBlindedBlock ssz
  • publishBlock json
  • publishBlock ssz
  • publishBlockV2 json
  • publishBlockV2 ssz
  • publishBlindedBlock json
  • publishBlindedBlock ssz
  • publishBlindedBlockV2 json
  • publishBlindedBlockV2 ssz
  • produceBlindedBlock json
  • produceBlindedBlock ssz
  • produceBlockV2 json
  • produceBlockV2 ssz
  • produceBlockV3 json Add block v3 endpoint. ethereum/beacon-APIs#339
  • produceBlockV3 ssz
  • getBlobs json
  • getBlobs ssz
• add Web3signer support for Deneb blocks
• add Web3signer support for signed blobs
• update validator rest api calls to support deneb:
  • getBlock
  • streamBlock
  • submitBlock
  • submitBlindedBlock
• E2E for Deneb