v1.7.2

What's Changed

• 140 optionality for non-historized-link foreign hashkeys by @filcov in #274
• Snowflake: improve handling of the various timestamp formats in ghost records by @tkiehn in #279
• FIX:databricks/postgres/redshift: replace unsupported timestamp_sub- and dateadd-functions by @tkiehn in #280

New Contributors

• @filcov made their first contribution in #274

Full Changelog: v1.7.1...v1.7.2

Hotfix v1.7.1

What's Changed

• Add the datatypes Array and Variant to Snowflake ghost records by @tkiehn in #278

Full Changelog: v1.7.0...v1.7.1

v1.7.0 - Oracle Support

What's New

• Full support for Oracle

What's Changed

• Update README to include Databricks by @tkirschke in #273
• Add Oracle Support by @tkiehn in #275

Contributors

• @tderk
• @thoffmann-sf
• @tkiehn

Full Changelog: v1.6.0...v1.7.0

v1.6.0 - Databricks Support

What's new?

• Full support for Databricks, developed by @rfernandezlamuno & @filcov

What's Changed

• update fabric stage and rec_track_sat to use string_default_dtype() by @tkiehn in #270
• Added code explanation for workflow files. by @DamianHinz in #271
• Release databricks adapter by @tkiehn in #272

Full Changelog: v1.5.0...v1.6.0

v1.5.0

What's Changed

• run count instead of full scan for rec-trac-sats by @tkiehn in #267

What's New

Release fabric adapter by @tkiehn & @bvenedik-scalefree in #265

Contributions

• @tkiehn
• @bvenedik-scalefree

Full Changelog: v1.4.2...v1.5.0

v1.4.2

Bugfixes

• fix redshift/postgres beginning_of_all_times unknown ghost record values by @tkiehn in #260
  Starting with v1.4.0 the unknown values of ghost records for timestamp datatypes on redshift and postgres were created using the beginning_of_all_times_date-variable instead of the beginning_of_all_times-variable.
  The resulting timestamp-values then have 00:00:00 as time instead of 00:00:01. This could lead to the unknown records not being properly filtered out in downstream macros which rely on the beginning_of_all_times-variable.

• fix redshift stage compilation error when no hashed columns are provided by @tkiehn in #259

Other Changes

• Add CAST as timestamp_default_dtype to postgres__string_to_timestamp by @tkiehn in #257
• 36 update label triggered workflow by @DamianHinz in #256
• Changing Google BigQuery to AWS Redshift by @MatheHostel in #255
• delete unused macros by @tkiehn in #252

Full Changelog: v1.4.1...v1.4.2

v1.4.1

Important Changes

The default values for numeric ghost have been changed.

Before they were 0 for the unknown values und -1 for error values. Now they are -1 for unknown values and -2 for error values.
If you want to change these values there are new global variables to adjust these values:
datavault4dbt.unknown_value__numeric and datavault4dbt.error_value__numeric.

All changes

• Update stage.sql, add default ldts value by @tkiehn in #243
• fix hub key renaming if there are different namings for bk and hkey by @tkiehn in #242
• Escaping Data for Data Types BOOLEAN / SUPER / GEOMETRY in Hash-Function by @MatheHostel in #240
• Add possibility to switch of ghost records in the staging macro by @tkiehn in #192
• Cleanup by @tkiehn in #248
• Add macros for global beginning and end of all times dates by @tkiehn in #249
• only create ghost records when it is not an incremental run by @tkiehn in #250
• Change ghost record numeric defaults and add ghost record numeric values variables by @tkiehn in #251

New Contributors

• @MatheHostel made their first contribution in #240

Full Changelog: v1.4.0...v1.4.1

v1.4.0

Important Changes

What's new?

All adapters

• Global variables for rsrc_default_dtype, timestamp_default_dtype, stg_default_dtype, and derived_column_default_dtype are now adapter specific
• Adapter specific column escaping
• Enforcing default datatype of ldts: The load date timestamp column is explicitly cast to the specified timestamp_default_dtype

PostgreSQL

• Usage of adapter specific end_of_all_times

What's changed?

Snowflake

• Huge improvements in column name escaping, to support all kinds of column names

PostgreSQL

• Default Hash Datatype set to VARCHAR(32) instead of STRING
• Broader support of Datatypes in Ghost Record generation
• Improvement of incremental loading for NH_Links
• Fix hash macro parameters #207
• Fix ref_sat_v0 and sat_v0 macro parameters #206
• Fix control_snap_v0 macro parameters #205

Redshift

• Default Hash Datatype set to VARCHAR(32) instead of STRING
• Broader support of Datatypes in Ghost Record generation #204
• Improvement of incremental loading for NH_Links
• Usage of DATEADD() instead of TIMESTAMPSUB() in PIT #155
• CROSS JOIN instead of FULL OUTER JOIN in ref_table
• Fix hash macro parameters #207
• Fix ref_sat_v0 and sat_v0 macro parameters #206
• Fix control_snap_v0 macro parameters #205

Synapse

• Align the snapshot control tables v0 and v1 with the other adapters

Bugfixes

All adapters

• Usage of dbt.type_timestamp() instead of just type_timestamp()

Postgres

• Timestamp format for Postgres changed to YYYY-MM-DD HH24:MI:SS
• Fixed Interval issues in Control_Snap_v1
• Added option for disable_hwm and source_is_single_batch to sat_v0 to align with other adapters

Redshift:

• string_to_timestamp now outputs the datatype that is set as value timestamp_default_dtype

Snowflake

• Fixed issue with multi-source hubs which had different business key names

Google BigQuery

• Fixed issue with duplicate column names when using an input column as rsrc or ldts
• Fixed uniqueness issue for Multi Source reference hubs

Synapse

• Fixed issue with multi-source hubs and links
• Fixed unnecessary quoting in PIT for the pit_type
• Remove unnecessary subquery inside the ref_table

Exasol

• Fixed Issues with Multi Active Hashing
• Fixed several issues with column escaping
• Added disable_hwm parameter to various RDV models, to align with other adapters

v1.3.3

What's Changed

• deleted comments and changed schemas back to generic placeholders by @polat-deniz in #179
• Fixed combination of derived cols and prejoins in Snowflake by @tkirschke in #183
• Removed double comma for Multi Active Hashkey calculation by @tkirschke in #184
• Add parameters to postgres macros by @tkiehn in #186

Full Changelog: v1.3.2...v1.3.3

v1.3.2

What's Changed

• Delete logs directory by @polat-deniz in #169
• Added CAST() to fix hash_datatype length issue with Snowflake by @migma-ciklum in #174
• Change global var hash datatype to string by @tkiehn in #175
• change copy_rsrc_ldts_input_columns to false by @tkiehn in #176
• Various fixes for v1 Satellites by @tkirschke in #178

New Contributors

• @migma-ciklum made their first contribution in #174

Full Changelog: v1.3.1...v1.3.2