Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(storage): Refactor improving performance and atomicity. #8

Merged
merged 4 commits into from
Feb 14, 2024

Commits on Feb 1, 2024

  1. fix(storage): Refactor improving performance and atomicity.

    Overview:
    This commit overhauls the Storage layer to set the foundation for a high-performance filtering system based on bitmap indexing. The refactoring introduces a more efficient data handling model and resolves critical issues that affected stability and performance.
    
    Key Changes:
    - Introduced the concept of 'WriteBatch' in the Storage interface to support efficient data operations.
    - Removed the DB interface to eliminate excessive abstraction, making difficult the implementation of database-specific optimizations.
    - Fixed the handling of byte arrays in Pebble's closer method to prevent data corruption. The Storage layer now ensures that data is parsed correctly before the Get operation is closed, eliminating the risk of random failures.
    - Implemented batching for data writting from remote nodes, enhancing data consistency and speed.
    - Restructured Mock objects into an internal package, restricting access to internals and eliminating the need for specific build tags.
    
    Signed-off-by: Antonio Navarro Perez <[email protected]>
    ajnavarro committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    81c1266 View commit details
    Browse the repository at this point in the history
  2. Make linter happy

    Signed-off-by: Antonio Navarro Perez <[email protected]>
    ajnavarro committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    928fe17 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. Add requested changes

    Signed-off-by: Antonio Navarro Perez <[email protected]>
    ajnavarro committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    1a82f41 View commit details
    Browse the repository at this point in the history
  2. Make linter happy

    Signed-off-by: Antonio Navarro Perez <[email protected]>
    ajnavarro committed Feb 14, 2024
    Configuration menu
    Copy the full SHA
    c71a29e View commit details
    Browse the repository at this point in the history