Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remix nested columns #14014

Merged
merged 16 commits into from
Apr 5, 2023
Merged

Commits on Apr 2, 2023

  1. remix nested columns

    changes:
    * introduce ColumnFormat to separate physical storage format from logical type. ColumnFormat is now used instead of ColumnCapabilities to get column handlers for segment creation
    * introduce new 'standard type' indexer, merger, and family of serializers, which is the next logical iteration of the nested column stuff. Essentially this is an automatic type column indexer that produces the most appropriate column for the given inputs, making either STRING, ARRAY<STRING>, LONG, ARRAY<LONG>, DOUBLE, ARRAY<DOUBLE>, or COMPLEX<json>.
    * revert NestedDataColumnIndexer, NestedDataColumnMerger, NestedDataColumnSerializer to their version pre apache#13803 behavior (v4) for backwards compatibility
    * fix a bug in RoaringBitmapSerdeFactory if anything actually ever wrote out an empty bitmap using toBytes and then later tried to read it (the nerve!)
    clintropolis committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    2f93beb View commit details
    Browse the repository at this point in the history
  2. fix npe and style

    clintropolis committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    4ab840d View commit details
    Browse the repository at this point in the history
  3. more test, fix bugs

    clintropolis committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    f616bf1 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. fix array bug

    clintropolis committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    07ee921 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5ba43c0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    26e1b56 View commit details
    Browse the repository at this point in the history
  4. oops

    clintropolis committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    d139402 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    aa9f7ab View commit details
    Browse the repository at this point in the history
  6. adjust some stuff

    clintropolis committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    2d1c99b View commit details
    Browse the repository at this point in the history
  7. cleanup

    clintropolis committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    0c62eb3 View commit details
    Browse the repository at this point in the history
  8. hella renaming

    clintropolis committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    fa401e2 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. fix stuff

    clintropolis committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    16dfe66 View commit details
    Browse the repository at this point in the history
  2. adjust the stuff

    clintropolis committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    8e182e1 View commit details
    Browse the repository at this point in the history
  3. add javadoc back, fix

    clintropolis committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    69b6512 View commit details
    Browse the repository at this point in the history
  4. inspections

    clintropolis committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    211965c View commit details
    Browse the repository at this point in the history
  5. missed inspections

    clintropolis committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    8b6441d View commit details
    Browse the repository at this point in the history