Code

Add tool for database conversion#2061

Code

Merged

tsahee merged 75 commits intomasterOffchainLabs/nitro:masterfrom db-conversionOffchainLabs/nitro:db-conversionCopy head branch name to clipboardAug 17, 2024

+1,089-76

Commits

Commits on Dec 28, 2023

• add dbconv draft

  magicxyyz

  committed
  b6ae081

  Copy full SHA for b6ae081

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  291214b

  Copy full SHA for 291214b

• make lint happy

  magicxyyz

  committed
  a52d9ac

  Copy full SHA for a52d9ac

• add database conversion system test draft

  magicxyyz

  committed
  67922b5

  Copy full SHA for 67922b5

• improve db conversion test

  magicxyyz

  committed
  5f61bc3

  Copy full SHA for 5f61bc3

Commits on Dec 30, 2023

• use start key instead of prefix, add main draft

  magicxyyz

  committed
  689e653

  Copy full SHA for 689e653

Commits on Jan 3, 2024

• fix middle key lookup

  magicxyyz

  committed
  83a22e1

  Copy full SHA for 83a22e1

• fix lint

  magicxyyz

  committed
  a1ea3ae

  Copy full SHA for a1ea3ae

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  0868fa2

  Copy full SHA for 0868fa2

Commits on Jan 4, 2024

• add initial progress reporting

  magicxyyz

  committed
  d14a201

  Copy full SHA for d14a201

• remove debug log from stats

  magicxyyz

  committed
  dd4ec96

  Copy full SHA for dd4ec96

• fix forking, add more stats

  magicxyyz

  committed
  c81e6c8

  Copy full SHA for c81e6c8

• add verification option

  magicxyyz

  committed
  97ea9b7

  Copy full SHA for 97ea9b7

• reformat progress string, add log-level option

  magicxyyz

  committed
  1e7041e

  Copy full SHA for 1e7041e

• add compaction option

  magicxyyz

  committed
  c735874

  Copy full SHA for c735874

• clean ':' from log

  magicxyyz

  committed
  83f1f57

  Copy full SHA for 83f1f57

Commits on Jan 5, 2024

• stop progress printing during compaction

  magicxyyz

  committed
  31e5b8c

  Copy full SHA for 31e5b8c

Commits on Jan 8, 2024

• change unit of entries per second

  magicxyyz

  committed
  e779fe7

  Copy full SHA for e779fe7

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  d7f5360

  Copy full SHA for d7f5360

• shorten dbconv test

  magicxyyz

  committed
  bc41c66

  Copy full SHA for bc41c66

Commits on Jan 10, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  62c86a5

  Copy full SHA for 62c86a5

• add dbconv to Makefile

  magicxyyz

  committed
  39a5311

  Copy full SHA for 39a5311

Commits on Jan 11, 2024

• add dbconv to docker

  magicxyyz

  committed
  dd33ae2

  Copy full SHA for dd33ae2

Commits on Apr 2, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  c82675a

  Copy full SHA for c82675a

Commits on Apr 5, 2024

• cmd/dbconv: add metrics

  magicxyyz

  committed
  48f5c84

  Copy full SHA for 48f5c84

Commits on Apr 22, 2024

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  7cb6417

  Copy full SHA for 7cb6417

Commits on Apr 23, 2024

• Merge remote-tracking branch 'origin/pebble-extra-options' into db-conversion

  magicxyyz

  committed
  59bdbfc

  Copy full SHA for 59bdbfc

Commits on Apr 24, 2024

• dbconv: add pebble config options

  magicxyyz

  committed
  c3b4a19

  Copy full SHA for c3b4a19

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  c3c6aff

  Copy full SHA for c3c6aff

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  7e6e2d1

  Copy full SHA for 7e6e2d1

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  0062b76

  Copy full SHA for 0062b76

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  9daf165

  Copy full SHA for 9daf165

• Merge branch 'pebble-extra-options' into db-conversion

  magicxyyz

  committed
  d7dfdb8

  Copy full SHA for d7dfdb8

Commits on Apr 26, 2024

• Merge remote-tracking branch 'origin/pebble-extra-options' into db-conversion

  magicxyyz

  committed
  073c40e

  Copy full SHA for 073c40e

Commits on Jun 3, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  b213597

  Copy full SHA for b213597

Commits on Jun 4, 2024

• cmd/dbconv: remove multithreading option, update pebble extra options usage

  magicxyyz

  committed
  fc98de6

  Copy full SHA for fc98de6

• system_tests: update db_conversion_test

  magicxyyz

  committed
  d7f5ea9

  Copy full SHA for d7f5ea9

• cmd/dbconv: format numbers in progress message

  magicxyyz

  committed
  5eac1d4

  Copy full SHA for 5eac1d4

Commits on Jun 5, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  88e8221

  Copy full SHA for 88e8221

Commits on Jun 6, 2024

• scripts: add initial version of convert-databases.bash

  magicxyyz

  committed
  e308cf6

  Copy full SHA for e308cf6

Commits on Jun 11, 2024

• scripts: improve convert-database script

  magicxyyz

  committed
  8657e51

  Copy full SHA for 8657e51

• cmd/dbconv: return 1 on error from main binary

  magicxyyz

  committed
  09d0371

  Copy full SHA for 09d0371

• scripts: add --help flag to convert-databases.bash

  magicxyyz

  committed
  c47ee34

  Copy full SHA for c47ee34

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  bc8b85d

  Copy full SHA for bc8b85d

• scripts: add extra flags check in convert-databases.bash

  magicxyyz

  committed
  25ab55d

  Copy full SHA for 25ab55d

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  897a33e

  Copy full SHA for 897a33e

Commits on Jun 21, 2024

• Update cmd/dbconv/dbconv/config.go

  Show description for 7f9f7ef
  

  magicxyyz

  and

  diegoximenes

  authored
  7f9f7ef

  Copy full SHA for 7f9f7ef

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  6595a44

  Copy full SHA for 6595a44

• dbconv: address review comments

  Show description for cfb1393
  magicxyyz

  committed
  cfb1393

  Copy full SHA for cfb1393

Commits on Jun 25, 2024

• refactor convert-databases script

  magicxyyz

  committed
  6a22f1d

  Copy full SHA for 6a22f1d

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  a2d3507

  Copy full SHA for a2d3507

• retab convert-databases script

  magicxyyz

  committed
  dc24202

  Copy full SHA for dc24202

Commits on Jun 28, 2024

• pass default config to DBConfigAddOptions

  magicxyyz

  committed
  bc3d784

  Copy full SHA for bc3d784

• dbconv/stats: rename AddBytes/AddEntries to LogBytes/LogEntries

  magicxyyz

  committed
  37a826e

  Copy full SHA for 37a826e

Commits on Jul 1, 2024

• remove dst dirs when conversion fails

  magicxyyz

  committed
  0ca882a

  Copy full SHA for 0ca882a

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  a5ebac9

  Copy full SHA for a5ebac9

• clean up conver-databases script

  magicxyyz

  committed
  1d69881

  Copy full SHA for 1d69881

Commits on Jul 3, 2024

• add unfinished convertion canary key

  magicxyyz

  committed
  7527848

  Copy full SHA for 7527848

Commits on Jul 25, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  77eb4da

  Copy full SHA for 77eb4da

Commits on Aug 7, 2024

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  8422e35

  Copy full SHA for 8422e35

• enable archive mode for HashScheme only in db conversion system test

  magicxyyz

  committed
  21f2ee4

  Copy full SHA for 21f2ee4

Commits on Aug 13, 2024

• check for canary key when initializing databases

  magicxyyz

  committed
  7895656

  Copy full SHA for 7895656

• fix db_conversion_test for PathScheme

  magicxyyz

  committed
  8ec8389

  Copy full SHA for 8ec8389

• convert-databases: by default on conversion failure remove only unfinished database

  magicxyyz

  committed
  ee7cba8

  Copy full SHA for ee7cba8

• Merge branch 'master' into db-conversion

  magicxyyz

  committed
  6a9e8ff

  Copy full SHA for 6a9e8ff

Commits on Aug 14, 2024

• fix NodeBuilder.RestartL2Node - use l2StackConfig from builder

  magicxyyz

  committed
  4ebfd7a

  Copy full SHA for 4ebfd7a

• add extra checks to db conversion system test

  magicxyyz

  committed
  b0484c5

  Copy full SHA for b0484c5

• move UnfinishedConversionCheck to dbutil package

  magicxyyz

  committed
  53c448f

  Copy full SHA for 53c448f

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  4d79dfc

  Copy full SHA for 4d79dfc

Commits on Aug 15, 2024

• convert-databases.bash: fix handling directories containing spaces

  magicxyyz

  committed
  5b61070

  Copy full SHA for 5b61070

• remove comment

  magicxyyz

  committed
  3fdab93

  Copy full SHA for 3fdab93

• copy convert-databases script to docker

  magicxyyz

  committed
  a78fb97

  Copy full SHA for a78fb97

• Merge branch 'master' into db-conversion

  magicxyyz

  authored
  44f0e18

  Copy full SHA for 44f0e18

Commits on Aug 16, 2024

• fix RestartL2Node - pass initMessage to createL2BlockChainWithStackConfig

  magicxyyz

  committed
  bc8803a

  Copy full SHA for bc8803a

• Merge branch 'master' into db-conversion

  tsahee

  authored
  93aaaef

  Copy full SHA for 93aaaef