Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support migration of data to databases other than leveldb #696

Closed
4 tasks done
derekadams opened this issue Mar 1, 2022 · 0 comments · Fixed by #604
Closed
4 tasks done

Support migration of data to databases other than leveldb #696

derekadams opened this issue Mar 1, 2022 · 0 comments · Fixed by #604
Assignees
Milestone

Comments

@derekadams
Copy link
Contributor

Summary

The current configuration for provenanced primarily supports leveldb which is starting to show performance issues at scale. Add support for migrating existing leveldb data to other databases supported by Cosmos/Tendermint (e.g. rocksdb, badgerdb) so that we can properly test performance characteristics across database backends.

Problem Definition

What problems may be addressed by introducing this feature?
Issues with slow node start-up/catch-up times as well as general processing performance.

What benefits does the Provenance Network stand to gain by including this feature?
Better experience for node operators, faster recovery when bootstrapping from quicksync, and generally improved performance.

Proposal

Create a new binary that sits on top of the tm-db database libraries which allows database information to be migrated from one type to another.


For Admin Use

  • Not duplicate issue
  • Appropriate labels applied
  • Appropriate contributors tagged
  • Contributor assigned/self-assigned
@derekadams derekadams self-assigned this Mar 1, 2022
@iramiller iramiller added this to the v1.9.0 milestone Mar 1, 2022
@iramiller iramiller moved this from Todo to In Progress in Provenance Core Protocol Team Mar 1, 2022
@dwedul-figure dwedul-figure self-assigned this Mar 2, 2022
@iramiller iramiller modified the milestones: v1.10.0, v.1.9.0 Apr 11, 2022
Repository owner moved this from In Progress to Done in Provenance Core Protocol Team Apr 21, 2022
@iramiller iramiller moved this from Done to Archive in Provenance Core Protocol Team May 3, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging a pull request may close this issue.

3 participants