You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A deltatable is hosted in an Azure DataLake. When trying to read the data via a SQL query performed in a Synapse workspace, an error is raised due to certain fields in the checkpoint file.
The problematic fields are those whose values are "null".
Solution
The solution is not to show fields with a 'null' value in the checkpoint json.
To achieve this, optional fields in the Checkpoint struct must not be serialized if they are null or None.
The text was updated successfully, but these errors were encountered:
Environment
Delta-rs version: 0.12.0
Environment:
Bug
A deltatable is hosted in an Azure DataLake. When trying to read the data via a SQL query performed in a Synapse workspace, an error is raised due to certain fields in the checkpoint file.
The problematic fields are those whose values are "null".
Solution
The solution is not to show fields with a 'null' value in the checkpoint json.
To achieve this, optional fields in the Checkpoint struct must not be serialized if they are null or None.
The text was updated successfully, but these errors were encountered: