- Sponsor
-
Notifications
You must be signed in to change notification settings - Fork 11
Comparing changes
Open a pull request
base repository: khonsulabs/okaywal
base: main
head repository: spaceandtimelabs/okaywal
compare: main
- 15 commits
- 7 files changed
- 3 contributors
Commits on Aug 1, 2023
-
Add the ability to checkpoint-on-commit and to wait for a given entry…
… to be checkpointed This adds two abilities to okaywal: - The ability to tell it to perform a checkpoint right after commiting an entry. This allows to control when the checkpointing code should run. - The ability to wait for a certain entry_id to be checkpointed, with a timeout.
David Alves committedAug 1, 2023 Configuration menu - View commit details
-
Copy full SHA for 2729070 - Browse repository at this point
Copy the full SHA 2729070View commit details -
Merge pull request #1 from spaceandtimelabs/dralves-checkpointing
Add the ability to checkpoint-on-commit and to wait for a given entry to be checkpointed
Configuration menu - View commit details
-
Copy full SHA for 00a1339 - Browse repository at this point
Copy the full SHA 00a1339View commit details
Commits on Aug 11, 2023
-
Cleanup: Added some logging and prevented checkpointing threads from …
…quitting
David Alves committedAug 11, 2023 Configuration menu - View commit details
-
Copy full SHA for 0ac9343 - Browse repository at this point
Copy the full SHA 0ac9343View commit details -
Merge pull request #2 from spaceandtimelabs/dralves-no-quitting
Cleanup: Added some logging and prevented checkpointing threads from quitting
Configuration menu - View commit details
-
Copy full SHA for 909783f - Browse repository at this point
Copy the full SHA 909783fView commit details
Commits on Aug 16, 2023
-
Change the checkpointing logic to reuse reclaim
Checkpointing depends on the file being switched before the checkpointing is started but that was never happening because reclaim would only occur when the file was full (and not when the file was forced to roll over). This fixes that by embedding the checkpointing logic in the pre-existing roll-over logic.
David Alves committedAug 16, 2023 Configuration menu - View commit details
-
Copy full SHA for f4b9ccd - Browse repository at this point
Copy the full SHA f4b9ccdView commit details -
Merge pull request #3 from spaceandtimelabs/dralves-fix-cp
Change the checkpointing logic to reuse reclaim
Configuration menu - View commit details
-
Copy full SHA for 82f2da2 - Browse repository at this point
Copy the full SHA 82f2da2View commit details
Commits on Aug 22, 2023
-
Allow to obtain the number of pending checkpoints
This is a measure of backpressure: if the number of checkpoints pendings increases too much it means we're falling behind. This also make it so that we panic!() when a checkpoint fails. It's important to fail here because most of the time we don't know how to recover from a checkpoint having failed.
David Alves committedAug 22, 2023 Configuration menu - View commit details
-
Copy full SHA for 578f797 - Browse repository at this point
Copy the full SHA 578f797View commit details -
Merge pull request #4 from spaceandtimelabs/dralves-len
Allow to obtain the number of pending checkpoints
Configuration menu - View commit details
-
Copy full SHA for f526ba3 - Browse repository at this point
Copy the full SHA f526ba3View commit details
Commits on Dec 21, 2023
-
Add a hard quota for disk usage in percent
This adds a hard disk quota for disk usage in percent, after which: - New entries will be rejected - Activating new files will fail The default quota is 95%.
David Alves committedDec 21, 2023 Configuration menu - View commit details
-
Copy full SHA for b4570ec - Browse repository at this point
Copy the full SHA b4570ecView commit details
Commits on Jan 2, 2024
-
Merge pull request #6 from spaceandtimelabs/max_quota
Add a hard quota for disk usage in percent
Configuration menu - View commit details
-
Copy full SHA for f132251 - Browse repository at this point
Copy the full SHA f132251View commit details
Commits on Jan 11, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f241ae3 - Browse repository at this point
Copy the full SHA f241ae3View commit details -
Merge pull request #7 from spaceandtimelabs/fix_disk_quota_check
fix disk space check logic
Configuration menu - View commit details
-
Copy full SHA for 0c42d33 - Browse repository at this point
Copy the full SHA 0c42d33View commit details
Commits on Feb 5, 2024
-
No more panics on errors & allow to inspect whether the checkpointing…
… thread is running (#8) This adds a couple of things, one is to stop the checkpoiting thread from panicking and instead allow it to just return the error. This will help in debugging cases where there are many checkpointing threads. The second one is to add a method that allows to inspect whether the checkpointing thread is running.
Configuration menu - View commit details
-
Copy full SHA for f0ab33a - Browse repository at this point
Copy the full SHA f0ab33aView commit details
Commits on Feb 22, 2024
-
Make
new
in SegmentReader public so that we can read segments outsi……de of okaywal (#9)
Configuration menu - View commit details
-
Copy full SHA for 0bc962b - Browse repository at this point
Copy the full SHA 0bc962bView commit details
Commits on Mar 12, 2024
-
Truncate files on startup (#5)
When the checkpoint thread fails, we accumulate a lot of files but the startup process doesn't trim them. This adds a max_inactive_files configuration and enforces it on startup. TODO: Finish unit test Co-authored-by: David Alves <david.alves@dfinity.org>
Configuration menu - View commit details
-
Copy full SHA for 09db7a9 - Browse repository at this point
Copy the full SHA 09db7a9View commit details
There are no files selected for viewing