Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Liquid Clustering configuration in adapter #399

Closed
ammarchalifah opened this issue Jul 28, 2023 · 0 comments · Fixed by #398
Closed

Liquid Clustering configuration in adapter #399

ammarchalifah opened this issue Jul 28, 2023 · 0 comments · Fixed by #398
Labels
enhancement New feature or request

Comments

@ammarchalifah
Copy link
Contributor

Describe the feature

Recently Databricks launched a new feature called Liquid Clustering, where table is not partitioned on physical file level (such as Hive-styled partition), but on a logical level based on cluster keys. For more explanation, read the blog here.

The feature request is to enable liquid clustering via dbt-databricks, by adjusting the DDL to also include cluster keys if liquid_clustered_by config is supplied.

Describe alternatives you've considered

Additional context

Who will this benefit?

Databricks customer who wish to use Liquid Clustering & dbt.

Are you interested in contributing this feature?

Yes, I'm working on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants