Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use memory-mapped files in the data service #533

Open
rbs-jacob opened this issue Dec 12, 2024 · 0 comments
Open

Use memory-mapped files in the data service #533

rbs-jacob opened this issue Dec 12, 2024 · 0 comments

Comments

@rbs-jacob
Copy link
Member

What is the use case for the feature?

OFRAK currently stores all data in-memory. This can be prohibitive for analyzing very large (>16GB) files, especially on memory-constrained systems.

How would you implement this feature?

Either modify the existing data service, or make an alternative implementation ascribing to the same interface. Instead of storing data as bytes objects, use memory-mapped files via Python's standard library mmap module.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant