Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix timestamp with timezone mapping in iceberg type converter #23534

Draft
wants to merge 45 commits into
base: master
Choose a base branch
from
Draft

Fix timestamp with timezone mapping in iceberg type converter #23534

wants to merge 45 commits into from

Commits on Nov 25, 2024

  1. Fix timestamp with timezone mapping in iceberg type converter

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    e9789ac View commit details
    Browse the repository at this point in the history

  2. remove verify type supported

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    fb2bdea View commit details
    Browse the repository at this point in the history

  3. test progress

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    b6122ed View commit details
    Browse the repository at this point in the history

  4. more test progress

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    2539eda View commit details
    Browse the repository at this point in the history

  5. add paritioning to test cases

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    3dc2db9 View commit details
    Browse the repository at this point in the history

  6. add filtering, not working

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ec21e70 View commit details
    Browse the repository at this point in the history

  7. trying things

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    95fa0fe View commit details
    Browse the repository at this point in the history

  8. static import createIcebergQueryRunner

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    90d70e6 View commit details
    Browse the repository at this point in the history

  9. header

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    55669ad View commit details
    Browse the repository at this point in the history

  10. checkstyle

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    2b1ea37 View commit details
    Browse the repository at this point in the history

  11. add static import

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    67e0f68 View commit details
    Browse the repository at this point in the history

  12. toy with tests

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    101eca6 View commit details
    Browse the repository at this point in the history

  13. add time stamp with time zone case to getIcebergLiteral

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    90d2641 View commit details
    Browse the repository at this point in the history

  14. stop packing timestamp with timezone in parquet reader

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    2260933 View commit details
    Browse the repository at this point in the history

  15. parameterize test with query runner

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    dd6ded5 View commit details
    Browse the repository at this point in the history

  16. add to test

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    d5e47a2 View commit details
    Browse the repository at this point in the history

  17. update

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    053f180 View commit details
    Browse the repository at this point in the history

  18. fix iceberg distributed smoke test base

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    233651d View commit details
    Browse the repository at this point in the history

  19. outline new timestamp with tz parquet writer logic

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    9ddb17c View commit details
    Browse the repository at this point in the history

  20. add unpacking to expression converter

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ac40cc7 View commit details
    Browse the repository at this point in the history

  21. pack value with zone utc in plain values decoder for batch reader

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    95ca6cd View commit details
    Browse the repository at this point in the history

  22. add readNextWithTimezone method to decoder interface/implementations

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    14e8909 View commit details
    Browse the repository at this point in the history

  23. pull timestamp batch readers out of generated sources

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    a20d4ec View commit details
    Browse the repository at this point in the history

  24. add timezone logic to batch readers, tests passing

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    f3cd0fe View commit details
    Browse the repository at this point in the history

  25. checkstyle

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    989a048 View commit details
    Browse the repository at this point in the history

  26. use stateful approach to decode with timestamp logic

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    3765ce2 View commit details
    Browse the repository at this point in the history

  27. checkstyle

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    61aa9ee View commit details
    Browse the repository at this point in the history

  28. add withTimezone to constructors

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    9d82cf8 View commit details
    Browse the repository at this point in the history

  29. make constructor used setter for withTimezone

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    fe8d2ee View commit details
    Browse the repository at this point in the history

  30. remove setWithTimezone method

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    7ec5853 View commit details
    Browse the repository at this point in the history

  31. set packing function in constructor of RLE class

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    0f4cb2c View commit details
    Browse the repository at this point in the history

  32. remove unused import

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    3fd542e View commit details
    Browse the repository at this point in the history

  33. add functional interface to other decoder implementations

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    6ec4b13 View commit details
    Browse the repository at this point in the history

  34. checkstyle

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    392ddbc View commit details
    Browse the repository at this point in the history

  35. eliminate branching in hot loop for value writer

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ac53703 View commit details
    Browse the repository at this point in the history

  36. add timestamp with timezone type mapping to iceberg connector docs

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    ea8d84a View commit details
    Browse the repository at this point in the history

  37. set value to pack function in packed values decoder

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    04788ff View commit details
    Browse the repository at this point in the history

  38. clean value writer code

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    0093fcc View commit details
    Browse the repository at this point in the history

  39. rm isWithTimezone method from interface

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    d9f223a View commit details
    Browse the repository at this point in the history

  40. added withTimezone arg to all decoders

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    6e859be View commit details
    Browse the repository at this point in the history

  41. fix decoder casts

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    adde43f View commit details
    Browse the repository at this point in the history

  42. saved

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    d7473ec View commit details
    Browse the repository at this point in the history

  43. changes

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    2b70909 View commit details
    Browse the repository at this point in the history

  44. remove debug logs in nested batch reader, confirmed not the problem

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    b6c5cce View commit details
    Browse the repository at this point in the history

  45. remove use of packing function from plain decoder

    @auden-woolfson
    auden-woolfson committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    e2f6634 View commit details
    Browse the repository at this point in the history