Introduce Toggle to Run on Test Data

Happy Friday the 13th! 🐈‍⬛

This release addresses issue #19 and introduces the ability to run the package on test data exclusively (by default, test data is excluded by the package).

See the README for details on how to toggle this with the using_livemode variable.

Thanks and kudos to @leinemann for contributing this solution!

dbt 0.20.0 Compatibility

🎉 dbt 0.20.0 Compatibility 🎉

🚨 This is a breaking change! 🚨 dbt v0.20.0 or greater is required for this release. If you are not ready to upgrade, consider using a previous release of this package.

Additional considerations when upgrading to this package:

• This package utilizes the latest v0.7.x release of the dbt-labls/dbt_utils package. If your project also utilizes a version of the fishtown-analytics/dbt_utils package then you will receive a duplicate package error. If this is the case you will need to consider upgrading your other packages to be compatible with this update or use a previous release of this package.
• Similar to the above point, all previous Fivetran dbt packages utilize the fishtown-analytics/dbt_utils package and you will need to upgrade all Fivetran dbt packages to the latest dbt 0.20.0 compatibility releases in order for your packages to run without package conflicts.

Fivetran Utils Dependency Update

🚧 Fivetran Utils Dependency Update 🚧

This release includes the following non-breaking changes:

• Update to the packages.yml to reference the recently released Fivetran Utils package. This is a necessary update to ensure this package is compatible with previous dbt releases before dbt v0.20.0 updates take place.

Remove test and deleted customer records

This release includes the following non-breaking changes:

• Addition of a filter to the stg_stripe__customer_tmp model to filter our deleted and test customers from the final staging model. PR #12

Bug Fix

This release addresses bug outlined in issue #9

• plan_interval in stg_stripe__plan for BigQuery removed actual data by hardcoding "interval" rather than the actual values.

Bug Fixes and Enhancements

🚨 This update introduces breaking changes: Output models are renamed to include a double underscore between the source name and the table name. For example, stg_stripe_customer.sql is now stg_stripe__customer.sql. Additionally, this release introduces custom schemas to output staging models into a respective <target.schema>+_stg_stripe schema. Refer to the ReadMe for more details. 🚨

The release also:

• Introduces CircleCI testing
• BigQuery compatibility bug fixes
• Minor documentation updates

dbt 0.19.0 Compatibility

This release introduces compatibility with dbt version 0.19.0. There are no known breaking changes.

dbt 0.18.0 Compatibility

Updates package to be compatible with dbt 0.18.0. This is a breaking change!
🚨 dbt v0.18.0 or greater is required for this release. If you are not ready to upgrade, consider using a previous release of this package

Additionally, this release:

• Updates dbt_utils dependency so to align with other Fivetran packages

Initial Release

This is the initial release of this package.

This package is designed enrich your Fivetran data by doing the following:

• Add descriptions to tables and columns that are synced using Fivetran
• Add freshness tests to source data
• Add column-level testing where applicable. For example, all primary keys are tested for uniqueness and non-null values.
• Model staging tables, which will be used in our transform package

Currently the package supports Redshift, BigQuery and Snowflake.