Skip to content
This repository has been archived by the owner on Nov 6, 2020. It is now read-only.

Snapshot creation and restoration #1679

Merged
merged 88 commits into from
Aug 5, 2016
Merged

Snapshot creation and restoration #1679

merged 88 commits into from
Aug 5, 2016

Commits on Jul 12, 2016

  1. to_rlp takes self by-reference

    @rphmeier
    rphmeier committed Jul 12, 2016
    Configuration menu
    Copy the full SHA
    317a3bf View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2016

  1. clean up some derefs

    @rphmeier
    rphmeier committed Jul 13, 2016
    Configuration menu
    Copy the full SHA
    575de78 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into pv64

    @rphmeier
    rphmeier committed Jul 13, 2016
    Configuration menu
    Copy the full SHA
    aec9c9e View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2016

  1. Merge branch 'master' into pv64

    @rphmeier
    rphmeier committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    0ebd69a View commit details
    Browse the repository at this point in the history

  2. out-of-order insertion for blockchain

    @rphmeier
    rphmeier committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    a0f9759 View commit details
    Browse the repository at this point in the history

  3. implement block rebuilder without verification

    @rphmeier
    rphmeier committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    02d052d View commit details
    Browse the repository at this point in the history

  4. group block chunk header into struct

    @rphmeier
    rphmeier committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    e8f7c4f View commit details
    Browse the repository at this point in the history

  5. block rebuilder does verification

    @rphmeier
    rphmeier committed Jul 14, 2016
    Configuration menu
    Copy the full SHA
    9f96512 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2016

  1. integrate snapshot service with client service; flesh out implementat… 

    …ion more
    @rphmeier
    rphmeier committed Jul 15, 2016
    Configuration menu
    Copy the full SHA
    a8da992 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2016

  1. initial implementation of snapshot service

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    7b3b494 View commit details
    Browse the repository at this point in the history

  2. remove snapshottaker trait

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    51fc3d3 View commit details
    Browse the repository at this point in the history

  3. snapshot writer trait with packed and loose implementations

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    b77d8e2 View commit details
    Browse the repository at this point in the history

  4. write chunks using "snapshotwriter" in service

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    910b77f View commit details
    Browse the repository at this point in the history

  5. have snapshot taking use snapshotwriter

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    039decc View commit details
    Browse the repository at this point in the history

  6. implement snapshot readers

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    2c68467 View commit details
    Browse the repository at this point in the history

  7. back up client dbs when replacing

    @rphmeier
    rphmeier committed Jul 16, 2016
    Configuration menu
    Copy the full SHA
    dbc15c3 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2016

  1. use snapshot reader in snapshot service

    @rphmeier
    rphmeier committed Jul 17, 2016
    Configuration menu
    Copy the full SHA
    f3ad832 View commit details
    Browse the repository at this point in the history

  2. describe offset format

    @rphmeier
    rphmeier committed Jul 17, 2016
    Configuration menu
    Copy the full SHA
    b588feb View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2016

  1. use new get_db_path in parity, allow some errors in service

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    4ecf7b9 View commit details
    Browse the repository at this point in the history

  2. merge with master

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    fea41ad View commit details
    Browse the repository at this point in the history

  3. merge with master

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    5ea7324 View commit details
    Browse the repository at this point in the history

  4. blockchain formatting

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    13852b9 View commit details
    Browse the repository at this point in the history

  5. implement parity snapshot

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    257b8d3 View commit details
    Browse the repository at this point in the history

  6. implement snapshot restore

    @rphmeier
    rphmeier committed Jul 18, 2016
    Configuration menu
    Copy the full SHA
    1573acd View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2016

  1. force blocks to be submitted in order

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    edf75dc View commit details
    Browse the repository at this point in the history

  2. fix bug loading block hashes in packed reader

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    d7a1f6e View commit details
    Browse the repository at this point in the history

  3. fix seal field loading

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    de0236b View commit details
    Browse the repository at this point in the history

  4. fix uncle hash computation

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    9ca9d0d View commit details
    Browse the repository at this point in the history

  5. fix a few bugs

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    0bebec3 View commit details
    Browse the repository at this point in the history

  6. store genesis state in db. reverse block chunk order in packed writer

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    5c67073 View commit details
    Browse the repository at this point in the history

  7. merge with master

    @rphmeier
    rphmeier committed Jul 19, 2016
    Configuration menu
    Copy the full SHA
    4187c54 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2016

  1. allow out-of-order import for blocks

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    0ec4da7 View commit details
    Browse the repository at this point in the history

  2. bring restoration types together

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    a119416 View commit details
    Browse the repository at this point in the history

  3. only snapshot the last 30000 blocks

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    d756943 View commit details
    Browse the repository at this point in the history

  4. merge with master

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    8cf8ea9 View commit details
    Browse the repository at this point in the history

  5. restore into overlaydb instead of journaldb

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    df0f566 View commit details
    Browse the repository at this point in the history

  6. commit version to database

    @rphmeier
    rphmeier committed Jul 20, 2016
    Configuration menu
    Copy the full SHA
    3468cfa View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2016

  1. use memorydbs and commit directly

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    207e38a View commit details
    Browse the repository at this point in the history

  2. fix trie test compilation

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    f6ca5ff View commit details
    Browse the repository at this point in the history

  3. fix failing tests

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    1e573fb View commit details
    Browse the repository at this point in the history

  4. sha3_null_rlp, not H256::zero

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    456c122 View commit details
    Browse the repository at this point in the history

  5. move overlaydb to ref_overlaydb, add new overlaydb without on-disk rc

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    504a5ac View commit details
    Browse the repository at this point in the history

  6. port archivedb to new overlaydb

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    b04c065 View commit details
    Browse the repository at this point in the history

  7. add deletion mode tests for overlaydb

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    3e8dbb4 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'overlaydb' into pv64

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    b58806d View commit details
    Browse the repository at this point in the history

  9. use new overlaydb, check state root at end

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    f155fa4 View commit details
    Browse the repository at this point in the history

  10. share chain info between state and block snapshotting

    @rphmeier
    rphmeier committed Jul 21, 2016
    Configuration menu
    Copy the full SHA
    4bdbeb5 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2016

  1. create blocks snapshot using blockchain directly

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    200a2af View commit details
    Browse the repository at this point in the history

  2. allow snapshot from arbitrary block, remove panickers from snapshot c… 

    …reation
    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    2878a39 View commit details
    Browse the repository at this point in the history

  3. begin test framework

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    944f13a View commit details
    Browse the repository at this point in the history

  4. blockchain chunking test

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    80dab3c View commit details
    Browse the repository at this point in the history

  5. implement stateproducer::tick

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    04ccbdf View commit details
    Browse the repository at this point in the history

  6. state snapshot test

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    53ef687 View commit details
    Browse the repository at this point in the history

  7. create block and state chunks concurrently, better restoration informant

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    eeb143f View commit details
    Browse the repository at this point in the history

  8. fix tests

    @rphmeier
    rphmeier committed Jul 22, 2016
    Configuration menu
    Copy the full SHA
    2784d83 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2016

  1. add deletion mode tests for overlaydb

    @rphmeier
    rphmeier committed Jul 23, 2016
    Configuration menu
    Copy the full SHA
    fd566ff View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2016

  1. address comments

    @rphmeier
    rphmeier committed Jul 26, 2016
    Configuration menu
    Copy the full SHA
    22ed490 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2016

  1. merge with master

    @rphmeier
    rphmeier committed Jul 27, 2016
    Configuration menu
    Copy the full SHA
    64275fa View commit details
    Browse the repository at this point in the history

  2. more tests

    @rphmeier
    rphmeier committed Jul 27, 2016
    Configuration menu
    Copy the full SHA
    472c9c6 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2016

  1. Merge branch 'overlaydb_no_archive' of https://github.com/rphmeier/pa… 

    …rity into rphmeier-overlaydb_no_archive
    @gavofyork
    gavofyork committed Jul 28, 2016
    Configuration menu
    Copy the full SHA
    3b8c4da View commit details
    Browse the repository at this point in the history

  2. Fix up tests.

    @gavofyork
    gavofyork committed Jul 28, 2016
    Configuration menu
    Copy the full SHA
    200a063 View commit details
    Browse the repository at this point in the history

  3. remove a few printlns

    @rphmeier
    rphmeier committed Jul 28, 2016
    Configuration menu
    Copy the full SHA
    c880ab6 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2016

  1. merge with master

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    80bf077 View commit details
    Browse the repository at this point in the history

  2. add a little more documentation to commit

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    b8d6986 View commit details
    Browse the repository at this point in the history

  3. fix tests

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    1339ed6 View commit details
    Browse the repository at this point in the history

  4. merge with master, break everything!

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    8967db7 View commit details
    Browse the repository at this point in the history

  5. get latest overlaydb

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    0037aeb View commit details
    Browse the repository at this point in the history

  6. fix ref_overlaydb test names

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    d1d1727 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'overlaydb_no_archive' into pv64

    @rphmeier
    rphmeier committed Jul 30, 2016
    Configuration menu
    Copy the full SHA
    70bcf86 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2016

  1. snapshot command skeleton

    @rphmeier
    rphmeier committed Jul 31, 2016
    Configuration menu
    Copy the full SHA
    3520fa7 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2016

  1. revert ref_overlaydb renaming

    @rphmeier
    rphmeier committed Aug 2, 2016
    Configuration menu
    Copy the full SHA
    49d52e1 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2016

  1. reimplement snapshot commands

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    72d8352 View commit details
    Browse the repository at this point in the history

  2. fix many errors

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    6368917 View commit details
    Browse the repository at this point in the history

  3. everything but inject

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    82a58c0 View commit details
    Browse the repository at this point in the history

  4. merge with master

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    01835c5 View commit details
    Browse the repository at this point in the history

  5. get ethcore compiling

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    ae45db8 View commit details
    Browse the repository at this point in the history

  6. get snapshot tests passing again

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    758107e View commit details
    Browse the repository at this point in the history

  7. instrument snapshot commands again

    @rphmeier
    rphmeier committed Aug 3, 2016
    Configuration menu
    Copy the full SHA
    917d1f3 View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2016

  1. fix fallout from other changes, mark snapshots as experimental

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    64ea9d1 View commit details
    Browse the repository at this point in the history

  2. merge with master

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    90aa435 View commit details
    Browse the repository at this point in the history

  3. optimize injection patterns

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    19612ec View commit details
    Browse the repository at this point in the history

  4. do two injections

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    d36d5a8 View commit details
    Browse the repository at this point in the history

  5. fix up tests

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    d48e262 View commit details
    Browse the repository at this point in the history

  6. take snapshots from 1000 blocks efore

    @rphmeier
    rphmeier committed Aug 4, 2016
    Configuration menu
    Copy the full SHA
    2802734 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2016

  1. address minor comments

    @rphmeier
    rphmeier committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    30ea380 View commit details
    Browse the repository at this point in the history

  2. merge with master

    @rphmeier
    rphmeier committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    96ef106 View commit details
    Browse the repository at this point in the history

  3. fix a few io crate related errors

    @rphmeier
    rphmeier committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    ad02931 View commit details
    Browse the repository at this point in the history

  4. clarify names about total difficulty 

    [ci skip]
    @rphmeier
    rphmeier committed Aug 5, 2016
    Configuration menu
    Copy the full SHA
    57d4014 View commit details
    Browse the repository at this point in the history