Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DNM] PIBD Task / Issue Tracker #3695

Merged
merged 22 commits into from
Oct 18, 2022
Merged

[DNM] PIBD Task / Issue Tracker #3695

merged 22 commits into from
Oct 18, 2022

Commits on Jan 12, 2022

  1. [PIBD_IMPL] Introduce PIBD state into sync workflow (#3685)

    * experimental addition of pibd download state for testnet only
    
    * fixes to bitmap number of segments calculation + conversion of bitmap accumulator to bitmap
    
    * attempt to call a test message
    
    * add p2p methods for receiving bitmap segment and applying to desegmenter associated with chain
    
    * fixes to state sync
    yeastplume authored Jan 12, 2022
    Configuration menu
    Copy the full SHA
    89730b7 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2022

  1. Configuration menu
    Copy the full SHA
    009a02e View commit details
    Browse the repository at this point in the history

Commits on Jan 20, 2022

  1. [PIBD_IMPL] PIBD Desegmenter State (#3688)

    * add functions to desegmenter to report next desired segments, begin to add state to determine which segments have been requested
    
    * add segmentidentifier type to id requested segments uniquely
    
    * make a call on where to keep track of which PIBD segments have been requested
    
    * move segmenttype definition, add functions to manipulate peer segment list
    
    * remove desegmenter state enum
    
    * change chain desegmenter function to provide rwlock
    
    * trace, warning cleanup
    
    * udpate to test compliation
    yeastplume authored Jan 20, 2022
    Configuration menu
    Copy the full SHA
    41a86b4 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2022

  1. [PIBD_IMPL] Bitmap accumulator reconstruction + TxHashset set reconst…

    …ruction (#3689)
    
    * application of received bitmap segments to local accumulator
    
    * add all required elements to send/receive output segment requests and responses
    
    * testing of output sync
    
    * add special cases to pmmr segment request
    yeastplume authored Jan 25, 2022
    Configuration menu
    Copy the full SHA
    436bacf View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2022

  1. [PIBD_IMPL] PMMR Reassembly from Segments (#3690)

    * update pibd copy test to use new desgmenter structure
    
    * begin reconstruction of output pmmr
    
    * clean up hash/leaf insertion logic
    
    * push pruned subtree appears to be working, now also calculates left hand hashes correctly
    
    * factor out ordering of segment/hash order array
    
    * refactor for pmmr application code
    
    * test of chain copy appears to be working
    
    * add rangeproof functions to desegmenter
    
    * add kernel functions, attempt refactor
    
    * small test cleanup, reconstruction of live chain working in manual copy test
    yeastplume authored Jan 28, 2022
    Configuration menu
    Copy the full SHA
    24202f0 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2022

  1. [PIBD_IMPL] PIBD tree sync via network and kill/resume functionality (#…

    …3691)
    
    * add functions to determing latest verifiable block height for the given pibd state
    
    * attempting to allow for pibd to resume after killing process
    
    * fix to ensure prune list is properly flushed during pibd sync
    
    * removal of unneeded code
    
    * ignore test for now (fix before full merge)
    yeastplume authored Feb 8, 2022
    Configuration menu
    Copy the full SHA
    169e106 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2022

  1. [PIBD_IMPL] Finalize PIBD download and move state to chain validation (

    …#3692)
    
    * investigations as to why a slight rewind is needed on startup during PIBD
    
    * move validation code into desegmenter validation thread (for now)
    
    * ensure genesis entries in pmmrs are removed if they're removed in the first segment
    
    * validation all working except for verifying kernel sums
    
    * remove unneeded pmmr rollbacks on resume now root cause was found
    
    * updates to remove unpruned leaves from leaf set when rebuilding pmmr
    
    * remove + 1 to segment traversal iter length
    yeastplume authored Feb 15, 2022
    Configuration menu
    Copy the full SHA
    3ea233d View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2022

  1. [PIBD_IMPL] PIBD Stats + Retry on validation errors (#3694)

    * start to add stats and reset chain state after errors detected
    
    * add functions to reset prune list when resetting chain pibd state
    
    * debug statement
    
    * remove test function
    yeastplume authored Feb 17, 2022
    Configuration menu
    Copy the full SHA
    5630cf2 View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2022

  1. [PIBD_IMPL] Update number of simultaneous peer requests for segments (#…

    …3696)
    
    * cleanup of segment request list
    
    * allow for more simultaneous requests during state sync
    
    * up number of simultaneous peer requests for segments
    yeastplume authored Feb 24, 2022
    Configuration menu
    Copy the full SHA
    bf48e52 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2022

  1. [PIBD_IMPL] Thread simplification + More TUI Updates + Stop State Pro…

    …pagation (#3698)
    
    * change pibd stat display to show progress as a percentage of downloaded leaves
    
    * attempt some inline rp validation
    
    * propagate shutdown state through kernel validation
    
    * change validation loop timing
    
    * simplify validator threading
    
    * add more detailed tracking of kernel history validation to tui, allow stop state during
    
    * adding more stop state + tui progress indication
    
    * remove progressive validate
    
    * test fix
    yeastplume authored Mar 1, 2022
    Configuration menu
    Copy the full SHA
    21b1ac5 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2022

  1. Configuration menu
    Copy the full SHA
    b08a6dd View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2022

  1. Configuration menu
    Copy the full SHA
    09d6f41 View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2022

  1. Configuration menu
    Copy the full SHA
    50450ba View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2022

  1. [PIBD_IMPL] Catch-Up functionality + Fixes based on testing (#3702)

    * ensure desegmenter attempts to apply correct block after a resumte
    
    * ensure txhashset's committed implementation takes into account output bitmap for summing purposes
    
    * remove check to de-apply outputs during segment application
    
    * return removal of spent outputs during pibd
    
    * remove unneeded status
    
    * remove uneeded change to rewind function
    yeastplume authored Mar 30, 2022
    Configuration menu
    Copy the full SHA
    6a7b66b View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2022

  1. Configuration menu
    Copy the full SHA
    eda31ab View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2022

  1. Configuration menu
    Copy the full SHA
    aa2a2a9 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2022

  1. [PIBD_IMPL] BitmapAccumulator Serialization Fix (#3705)

    * fix for writing / calculating incorrect length for negative indices
    
    * update capabilities with new version of PIBD hist
    
    * remove incorrect comment
    
    * fix capabilities flag, trace output
    
    * test fix
    yeastplume authored Apr 20, 2022
    Configuration menu
    Copy the full SHA
    5efd70a View commit details
    Browse the repository at this point in the history

Commits on May 16, 2022

  1. Merge DNSSeed scope changes into pibd impl branch (#3708)

    * update Cargo.lock for next release
    
    * visibility scope tweaks to aid seed test utilities (#3707)
    yeastplume authored May 16, 2022
    Configuration menu
    Copy the full SHA
    41f3aaf View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2022

  1. Configuration menu
    Copy the full SHA
    a441b78 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2022

  1. Configuration menu
    Copy the full SHA
    e13c9d1 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2022

  1. Configuration menu
    Copy the full SHA
    6412fd1 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2022

  1. Configuration menu
    Copy the full SHA
    3524b70 View commit details
    Browse the repository at this point in the history