-
Notifications
You must be signed in to change notification settings - Fork 784
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable column_page_reader read specific row ranges record #1792
Comments
I would recommend the approach I described #1791 (review) critically, a page does not know what constitutes a row. This highly non-trivial logic is handled in RecordReader, which will therefore need to drive the interpretation of any row-based filtering. |
Thanks ❤️ |
* Stub API for parquet record skipping * Update parquet/src/arrow/record_reader/mod.rs Co-authored-by: Yang Jiang <[email protected]> * Remove empty google.protobuf.rs * Replace todo with nyi_err * Update doc comment Co-authored-by: Yang Jiang <[email protected]>
I was just wondering what the status and ETA of this item is. I see maybe there is a non-public partial implementation already in the code. What's left to do for this? Thanks! |
I intend to polish up the remaining bits and pieces in time for the next release - #2382 |
That's fantastic! Thanks for all you do. |
* Make filter APIs public (#1792) * Update parquet/src/arrow/arrow_reader/mod.rs Co-authored-by: Liang-Chi Hsieh <[email protected]> Co-authored-by: Liang-Chi Hsieh <[email protected]>
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and why for this feature, in addition to the what)
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: