Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

automatically clean up temporary tables from failed syncs #4059

Closed
jrhizor opened this issue Jun 11, 2021 · 1 comment
Closed

automatically clean up temporary tables from failed syncs #4059

jrhizor opened this issue Jun 11, 2021 · 1 comment
Labels
area/connectors Connector related issues autoteam team/extensibility type/enhancement New feature or request

Comments

@jrhizor
Copy link
Contributor

jrhizor commented Jun 11, 2021

If a destination fails, a bunch of _airbyte_<some number, not ‘raw’> temporary tables exist and are never cleaned up. See https://airbytehq.slack.com/archives/C019WJFR1JT/p1623378865339700 for an example of someone manually cleaning these up.

We should clean these up automatically. I imagine this should happen within the connectors. Maybe if the timestamp for the temporary run is > a certain threshold?
@jrhizor jrhizor added type/enhancement New feature or request area/connectors Connector related issues labels Jun 11, 2021
@jrhizor jrhizor changed the title automatically clean up airbyte temporary tables from failed syncs automatically clean up temporary tables from failed syncs Jun 11, 2021
@marcosmarxm
Copy link
Member

This is a duplicate of #7011

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area/connectors Connector related issues autoteam team/extensibility type/enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@bleonard @jrhizor @marcosmarxm