Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cli tools to decode wal segment #1567

Closed
jiacai2050 opened this issue Sep 14, 2024 · 2 comments
Closed

Cli tools to decode wal segment #1567

jiacai2050 opened this issue Sep 14, 2024 · 2 comments
Assignees
@zealchen
Labels
A-WAL Area: Write ahead log layer contributor friendly Good for contribution

Comments

@jiacai2050
Copy link
Contributor

Describe This Problem

I'm excited to share that we've successfully implemented a local Write-Ahead Log (WAL) following the completion of #1566. While we haven't conducted extensive performance benchmarking yet, our initial tests suggest that our implementation is performing comparably to the one based on RocksDB. This marks a significant milestone in our project's development, and we're looking forward to further optimizing and testing this new feature.

Proposal

In order to trouble shoot WAL issues, we need a cli tool to decode wal segment, to include at least following infos:

  • segment version
  • min/max seq of each table

Additional Context

No response
@jiacai2050 jiacai2050 added contributor friendly Good for contribution A-WAL Area: Write ahead log layer labels Sep 14, 2024
@zealchen
Copy link
Contributor

Nice. Let me handle this one.

@jiacai2050
Copy link
Contributor Author

jiacai2050 commented Oct 28, 2024 •
edited
Loading

Thanks, you can add another file here https://github.com/apache/horaedb/tree/main/src/tools/src/bin

@zealchen zealchen mentioned this issue Oct 30, 2024
Merged
jiacai2050 pushed a commit that referenced this issue Nov 1, 2024
@zealchen
feat: add a cli tool to read wal meta information (#1584)
4cbe82c 
## Rationale
#1567 

## Detailed Changes
A cli tool to decode wal segment.

## Test Plan
Manual test

<img width="935" alt="image"
src="https://github.com/user-attachments/assets/a9a88ca8-74a9-41f7-b338-9ea642ea27be">


<img width="1053" alt="image"
src="https://github.com/user-attachments/assets/e9d80981-9940-43ac-9c36-546b7dd77b5f">
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zealchen zealchen

Labels
A-WAL Area: Write ahead log layer contributor friendly Good for contribution
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jiacai2050 @zealchen