You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It would be useful to be able to choose which columns may be used for file skipping so that min/max values are not stored for unused columns.
Use Case
In our use case, we have some large string columns that are never used for file skipping, and keeping min/max values for those results in unnecessarily large delta log files.
Related Issue(s)
Delta log files get unnecessarily big.
The text was updated successfully, but these errors were encountered:
Description
It would be useful to be able to choose which columns may be used for file skipping so that min/max values are not stored for unused columns.
Use Case
In our use case, we have some large string columns that are never used for file skipping, and keeping min/max values for those results in unnecessarily large delta log files.
Related Issue(s)
Delta log files get unnecessarily big.
The text was updated successfully, but these errors were encountered: