Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Avoid reading Iceberg delete files when not needed #13395

Merged
merged 2 commits into from
Aug 8, 2022
Merged

Avoid reading Iceberg delete files when not needed #13395

merged 2 commits into from
Aug 8, 2022

Commits on Aug 3, 2022

  1. Avoid reading Iceberg delete files when not needed 

    Parqet only.

Skip reading the delete files associated with a data file if the deletes are
not relevant. This can happen when the statistics from the data file already
show the split can be skipped. Additionally, this can happen when the line
numbers read by the split are known and can be used to filter positional
deletes.
    @alexjo2144
    alexjo2144 committed Aug 3, 2022
    Configuration menu
    Copy the full SHA
    6df8a8b View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2022

  1. empty

    @alexjo2144
    alexjo2144 committed Aug 4, 2022
    Configuration menu
    Copy the full SHA
    77bc71e View commit details
    Browse the repository at this point in the history