v1.1.0
Pre-release
Pre-release
v1.1.0
New Features
- Reference Data: By adding new macros for Reference Hubs, Reference Satellites, and Reference Tables, datavault4dbt finally supports your reference data!
- Prejoining now supports other dbt Models: Instead of prejoining only with dbt sources, it now also supports other dbt models!
- Prejoin over multiple columns: The JOIN condition of a Prejoin can now be based on multiple attributes!
- Multi-Source entities can be loaded from different columns of the same source: Thanks to a changed metadata structure, multi-source entities can now be loaded out of different columns coming from the same source, as many times as you want it! Check this new wiki page for more details!
- Optional High-Water-Mark for Single-Source entities: When an entity is loaded only from one source, a High-Water-Mark is now enabled automatically without any additional config required! Thus, this can be disabled per model via a new parameter "disable_hwm".
- Performance Boost for NH-Links: Once you trust the staging data of a Non-Historized Link, you can now disable the de-duplication within the NH-Link laoding script to boost its performance!
- Deduplication in NH-Satellites: An optional QUALIFY statement is now added to NH-Satellites to support multi-batch processing. It can be disabled with a new parameter similar to NH-Links!
- v1 Satellites can exclude the payload: It is now possible to configure v1 Satellites to not again include the payload of the v0 Satellite!
Changes
- The hash method (based on the global variable hash) is now based on a new macro, similar to the macros of beginning_of_all_times and end_of_all_times.
Disclaimer
- All Changes and new Features are untested on Exasol! Due to licensing problems we were not able to test the Exasol Adapter macros, but this does not affect the other adapters!