Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stripe updates #59

Merged
merged 133 commits into from
Jan 31, 2023
Merged

Stripe updates #59

merged 133 commits into from
Jan 31, 2023

Conversation

fivetran-reneeli
Copy link
Contributor

@fivetran-reneeli fivetran-reneeli commented Nov 23, 2022

Are you a current Fivetran customer?

Internal

What change(s) does this PR introduce?

Q4 Stripe updates

  • Add new columns to existing models
  • Add new models for other source tables customers are using - pricing and account
  • Add updates relating to the stripe price table replacing the plan table for new customers
  • add remaining standardization updates

Did you update the CHANGELOG?

  • Yes

Does this PR introduce a breaking change?

  • Yes (please provide breaking change details below.)
  • No (please provide an explanation as to how the change is non-breaking below.)
    Will need a full refresh to have all the new columns/ tables

Did you update the dbt_project.yml files with the version upgrade (please leverage standard semantic versioning)? (In both your main project and integration_tests)

  • Yes

Is this PR in response to a previously created Bug or Feature Request

  • Yes, Issue/Feature [link bug/feature number here]
  • No

How did you test the PR changes?

  • BuildKite
  • Local (please provide additional testing details below)

Select which warehouse(s) were used to test the PR

  • BigQuery
  • Redshift
  • Snowflake
  • Postgres
  • Databricks
  • Other (provide details below)

Provide an emoji that best describes your current mood

💃

Feedback

We are so excited you decided to contribute to the Fivetran community dbt package! We continue to work to improve the packages and would greatly appreciate your feedback on our existing dbt packages or what you'd like to see next.

Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli we are getting close! Please see my comments below and let me know if you want to discuss any in more detail. Specifically let me know if you want to chat about the consolidation of the stg_stripe__pricing model.

Additionally, there were two or so comments from my previous review that were missed. Please look through the previous comments above for any unresolved ones to still be addressed.

README.md Outdated Show resolved Hide resolved
models/tmp/stg_stripe__pricing_tmp.sql Outdated Show resolved Hide resolved
models/stg_stripe__pricing.sql Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
Copy link
Contributor Author

@fivetran-reneeli fivetran-reneeli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding comments

CHANGELOG.md Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
dbt_project.yml Outdated Show resolved Hide resolved
dbt_project.yml Outdated Show resolved Hide resolved
models/stg_stripe.yml Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
models/stg_stripe__pricing.sql Outdated Show resolved Hide resolved
models/tmp/stg_stripe__pricing_tmp.sql Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli I think this is the absolute final review with only a few suggestions and change requests. This shouldn't take too long to update. Let me know once the changes are applied and I can approve this PR.

Additionally, once you make these changes be sure to regen the docs for this package one last time. We will then be good to go!

CHANGELOG.md Outdated Show resolved Hide resolved
CHANGELOG.md Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
CHANGELOG.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@fivetran-reneeli fivetran-reneeli changed the base branch from feature/stripe-updates-q4-2022 to main January 30, 2023 15:48
Copy link
Contributor

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-reneeli thanks for working through all my comments and addressing the requested updates!

I have two small comments regarding the README and CHANGELOG; however, they are relatively small and shouldn't need a re-review. As such, I am approving this PR. Thanks for all your hard work!

@@ -129,7 +163,7 @@ Alternatively, if you only have strings in your JSON object, the metadata variab

```yml
vars:
stripe__plan_metadata: ['the', 'list', 'of', 'property', 'fields'] # Note: this is case-SENSITIVE and must match the casing of the property as it appears in the JSON
stripe__subscription_metadata: ['the', 'list', 'of', 'property', 'fields'] # Note: this is case-SENSITIVE and must match the casing of the property as it appears in the JSON
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The above note needs to reference the stripe__subscription_metadata variable instead of the old stripe__plan_metadata variable.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated!

stripe__plan_metadata:
- name: rename
- alias: renamed_field
stripe__price_plan_metadata: ## Used for both Price and Plan sources
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My apologies for not catching this, but we will need to update the CHANGELOG that this variable was renamed. Actually, it looks like we didn't include any of the metadata variables in the previous -> new variable names. Can you add those there.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-joemarkiewicz it looks like the other metadata variables were already prefixed with stripe, so I don't think they were renamed?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah good catch. Thanks for calling that out. If that is the case then we can just call out the price_plan change.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yup -- added that

  • stripe__plan_metadata variable has been renamed to stripe__price_plan_metadata

@fivetran-reneeli fivetran-reneeli merged commit b5b8423 into main Jan 31, 2023
@fivetran-reneeli fivetran-reneeli deleted the stripe_updates branch January 31, 2023 03:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status:in_review Currently in review type:enhancement New functionality or enhancement update_type:models Primary focus requires model updates
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants