-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
remix nested columns #14014
Merged
Merged
remix nested columns #14014
Commits on Apr 2, 2023
-
changes: * introduce ColumnFormat to separate physical storage format from logical type. ColumnFormat is now used instead of ColumnCapabilities to get column handlers for segment creation * introduce new 'standard type' indexer, merger, and family of serializers, which is the next logical iteration of the nested column stuff. Essentially this is an automatic type column indexer that produces the most appropriate column for the given inputs, making either STRING, ARRAY<STRING>, LONG, ARRAY<LONG>, DOUBLE, ARRAY<DOUBLE>, or COMPLEX<json>. * revert NestedDataColumnIndexer, NestedDataColumnMerger, NestedDataColumnSerializer to their version pre apache#13803 behavior (v4) for backwards compatibility * fix a bug in RoaringBitmapSerdeFactory if anything actually ever wrote out an empty bitmap using toBytes and then later tried to read it (the nerve!)
Configuration menu - View commit details
-
Copy full SHA for 2f93beb - Browse repository at this point
Copy the full SHA 2f93bebView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4ab840d - Browse repository at this point
Copy the full SHA 4ab840dView commit details -
Configuration menu - View commit details
-
Copy full SHA for f616bf1 - Browse repository at this point
Copy the full SHA f616bf1View commit details
Commits on Apr 3, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 07ee921 - Browse repository at this point
Copy the full SHA 07ee921View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5ba43c0 - Browse repository at this point
Copy the full SHA 5ba43c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 26e1b56 - Browse repository at this point
Copy the full SHA 26e1b56View commit details -
Configuration menu - View commit details
-
Copy full SHA for d139402 - Browse repository at this point
Copy the full SHA d139402View commit details -
Configuration menu - View commit details
-
Copy full SHA for aa9f7ab - Browse repository at this point
Copy the full SHA aa9f7abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d1c99b - Browse repository at this point
Copy the full SHA 2d1c99bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0c62eb3 - Browse repository at this point
Copy the full SHA 0c62eb3View commit details -
Configuration menu - View commit details
-
Copy full SHA for fa401e2 - Browse repository at this point
Copy the full SHA fa401e2View commit details
Commits on Apr 4, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 16dfe66 - Browse repository at this point
Copy the full SHA 16dfe66View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8e182e1 - Browse repository at this point
Copy the full SHA 8e182e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 69b6512 - Browse repository at this point
Copy the full SHA 69b6512View commit details -
Configuration menu - View commit details
-
Copy full SHA for 211965c - Browse repository at this point
Copy the full SHA 211965cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8b6441d - Browse repository at this point
Copy the full SHA 8b6441dView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.