You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In terms of testing, I think the easiest thing to do would be to follow the model of the existing tests for Utf8/Binary columns and pass the schema_force_view_types config flag
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge?
Part of #11752
While working to enable StringView in #12092 I found that the columns when read as
StringView
andBinaryView
do not take advantage of Bloom filters.Specifically this code doesn't handle StringView
datafusion/datafusion/core/src/datasource/physical_plan/parquet/row_group_filter.rs
Lines 267 to 272 in a08f923
Describe the solution you'd like
Support applying parquet bloom filters to StringView columns
Describe alternatives you've considered
Basically:
StringViewArray
by default from Parquet #12092In terms of testing, I think the easiest thing to do would be to follow the model of the existing tests for Utf8/Binary columns and pass the
schema_force_view_types
config flagAdditional context
No response
The text was updated successfully, but these errors were encountered: