-
Notifications
You must be signed in to change notification settings - Fork 144
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Store analysis to embedded K-V store #118
Comments
i can do tests with large datasets. |
This is an awesome tool, thanks so much! This db feature would be very useful for periodic scans of very large servers. duc is great for this, but it's way slower to scan than gdu on my server (as expected, based on your excellent benchmark data!). Once the scan is complete though, duc is much snappier to open/explore the result (stored in a Tokyocabinet database) than gdu (stored in a JSON), again, as expected. This may also enable #150 - allowing users to view partially scanned dir trees if the scan aborts or is stopped. Restarting a scan from an aborted/stopped scan would also be amazing, but maybe tricky to do. I would also find it useful to be able to merge/join two databases. Sometimes I find that the best way to reduce resource usage and scan time is to just take |
First implementation released in https://github.com/dundee/gdu/releases/tag/v5.26.0 |
Add a possibility to store the analysis into some fast embedded key-value store instead of memory. E.g. BadgerDB. The analysis would be of course slower a lot but it will use very little memory and the result could be opened again very fast.
The text was updated successfully, but these errors were encountered: