-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Ability to iterate over rows? #42
Comments
Hi! I created PoC, but:
|
Due to limitation of pyo3 we can't add truly iterating over rust iterator (see PyO3/pyo3#1085). So, I added iterating over rust range #43 (after calamine read whole sheet in memory), this can decrease memory allocation in some cases (see benchmark). |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
(I'm ignorant about how the underlying rust code works so maybe this is not feasible),
Would it be possible to add support for iterating over rows in a sheet without loading all of them into memory (similar to
iter_rows
thatopenpyxl
has)?Dealing with some larger files and while the compute performance is amazing, I end up allocating loads of memory (400+ MB for 80mb file, using
iter_rows
fromopenpyxl
helps bring this down to 40mb, but it takes 5-6x longer so obviously I'd prefer to use this package).The text was updated successfully, but these errors were encountered: