You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently cleanup time is set to 7 days - in cases where issues rise and many runs get stopped a lot of tables can accumulate. Setting a low value will result in deleting the table before it finished the run (in case of long running commands - such as ingesting a whole container)
A nice enhancement would be to periodically increase this value for extra hours. As long as the driver is running and havent finished processing the current DF it would increase the tables auto delete and retention policies.
The text was updated successfully, but these errors were encountered:
Currently cleanup time is set to 7 days - in cases where issues rise and many runs get stopped a lot of tables can accumulate. Setting a low value will result in deleting the table before it finished the run (in case of long running commands - such as ingesting a whole container)
A nice enhancement would be to periodically increase this value for extra hours. As long as the driver is running and havent finished processing the current DF it would increase the tables auto delete and retention policies.
The text was updated successfully, but these errors were encountered: