Merge pull request #7 from fivetran/MagicBot/integation-test-webhooks-14

Package Updater Testing PR

.buildkite/scripts/run_models.sh

@@ -18,4 +18,5 @@ cd integration_tests
 dbt deps
 dbt seed --target "$db" --full-refresh
 dbt run --target "$db" --full-refresh
-dbt test --target "$db"
+dbt test --target "$db"
+dbt run-operation fivetran_utils.drop_schemas_automation --target "$db"

.github/PULL_REQUEST_TEMPLATE/maintainer_pull_request_template.md

@@ -0,0 +1,51 @@
+## PR Overview
+**This PR will address the following Issue/Feature:**
+
+**This PR will result in the following new package version:**
+<!--- Please add details around your decision for breaking vs non-breaking version upgrade. If this is a breaking change, were backwards-compatible options explored? -->
+
+**Please detail what change(s) this PR introduces and any additional information that should be known during the review of this PR:**
+
+## PR Checklist
+### Basic Validation
+Please acknowledge that you have successfully performed the following commands locally:
+- [ ] dbt compile
+- [ ] dbt run –full-refresh
+- [ ] dbt run
+- [ ] dbt test
+- [ ] dbt run –vars (if applicable)
+
+Before marking this PR as "ready for review" the following have been applied:
+- [ ] The appropriate issue has been linked and tagged
+- [ ] You are assigned to the corresponding issue and this PR
+- [ ] BuildKite integration tests are passing
+
+### Detailed Validation
+Please acknowledge that the following validation checks have been performed prior to marking this PR as "ready for review":
+- [ ] You have validated these changes and assure this PR will address the respective Issue/Feature.
+- [ ] You are reasonably confident these changes will not impact any other components of this package or any dependent packages.
+- [ ] You have provided details below around the validation steps performed to gain confidence in these changes.
+<!--- Provide the steps you took to validate your changes below. -->
+
+### Standard Updates
+Please acknowledge that your PR contains the following standard updates:
+- Package versioning has been appropriately indexed in the following locations:
+    - [ ] indexed within dbt_project.yml
+    - [ ] indexed within integration_tests/dbt_project.yml
+- [ ] CHANGELOG has individual entries for each respective change in this PR
+    <!--- If there is a parallel upstream change, remember to reference the corresponding CHANGELOG as an individual entry.  -->
+- [ ] README updates have been applied (if applicable)
+    <!--- Remember to check the following README locations for common updates. →
+        <!--- Suggested install range (needed for breaking changes) →
+        <!--- Dependency matrix is appropriately updated (if applicable) →
+        <!--- New variable documentation (if applicable) -->
+- [ ] DECISIONLOG updates have been updated (if applicable)
+- [ ] Appropriate yml documentation has been added (if applicable)
+
+### dbt Docs
+Please acknowledge that after the above were all completed the below were applied to your branch:
+- [ ] docs were regenerated (unless this PR does not include any code or yml updates)
+
+### If you had to summarize this PR in an emoji, which would it be?
+<!--- For a complete list of markdown compatible emojis check our this git repo (https://gist.github.com/rxaviers/7360908)  --> 
+:dancer:

.github/pull_request_template.md

@@ -1,52 +1,33 @@
-**Are you a current Fivetran customer?** 
-<!--- Please tell us your name, title and company -->
+**Please provide your name and company**
 
-**What change(s) does this PR introduce?** 
-<!--- Describe what changes your PR introduces to the package and how to leverage this new feature. -->
+**Link the issue/feature request which this PR is meant to address**
+<!--- If an issue was not created, please create one first so we may discuss the PR prior to opening one. -->
 
-**Did you update the CHANGELOG?** 
+**Detail what changes this PR introduces and how this addresses the issue/feature request linked above.**
+
+**How did you validate the changes introduced within this PR?**
+
+**Which warehouse did you use to develop these changes?**
+
+**Did you update the CHANGELOG?**
 <!--- Please update the new package version’s CHANGELOG entry detailing the changes included in this PR. -->
 <!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
 - [ ] Yes
 
-**Does this PR introduce a breaking change?**
-<!--- Does this PR introduce changes that will cause current package users' jobs to fail or require a `--full-refresh`? -->
-<!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
-- [ ] Yes (please provide breaking change details below.)
-- [ ] No  (please provide an explanation as to how the change is non-breaking below.)
-
-**Did you update the dbt_project.yml files with the version upgrade (please leverage standard semantic versioning)? (In both your main project and integration_tests)** 
+**Did you update the dbt_project.yml files with the version upgrade (please leverage standard semantic versioning)? (In both your main project and integration_tests)**
 <!--- The dbt_project.yml and the integration_tests/dbt_project.yml files contain the version number. Be sure to upgrade it accordingly -->
 <!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
 - [ ] Yes
 
-**Is this PR in response to a previously created Bug or Feature Request**
-<!--- If an Issue was created it is helpful to track the progress by linking it in the PR. -->
-<!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
-- [ ] Yes, Issue/Feature [link bug/feature number here]
-- [ ] No 
-
-**How did you test the PR changes?** 
-<!--- Proof of testing is required in order for the PR to be approved. -->
-<!--- To check a box, remove the space and insert an x in the box (eg. [x] Buildkite). --> 
-<!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
-- [ ] Buildkite <!--- Buildkite testing is only applicable to Fivetran employees. --> 
-- [ ] Local (please provide additional testing details below)
-
-**Select which warehouse(s) were used to test the PR**
-<!--- To check a warehouse remove the space and insert an x in the box (eg. [x] Bigquery). --> 
-<!--- To select a checkbox you simply need to add an "x" with no spaces between the brackets (eg. [x] Yes). -->
-- [ ] BigQuery
-- [ ] Redshift
-- [ ] Snowflake
-- [ ] Postgres
-- [ ] Databricks
-- [ ] Other (provide details below)
-
 **Provide an emoji that best describes your current mood**
 <!--- For a complete list of markdown compatible emojis check our this git repo (https://gist.github.com/rxaviers/7360908)  --> 
 :dancer:
 
 **Feedback**
 
 We are so excited you decided to contribute to the Fivetran community dbt package! We continue to work to improve the packages and would greatly appreciate your [feedback](https://www.surveymonkey.com/r/DQ7K7WW) on our existing dbt packages or what you'd like to see next.
+
+**PR Template** 
+- [Community Pull Request Template](?expand=1&template=pull_request_template.md) (default)
+
+- [Maintainer Pull Request Template](?expand=1&template=maintainer_pull_request_template.md) (to be used by maintainers)

CHANGELOG.md

@@ -1,3 +1,22 @@
+# dbt_instagram_business v0.2.1
+[PR #9](https://github.com/fivetran/dbt_instagram_business/pull/9) includes the following updates.
+
+## Feature Updates
+- Addition of the following fields and accompanying documentation to the `instagram_business__posts` model:
+    - `reel_comments`
+    - `reel_likes`
+    - `reel_plays`
+    - `reel_reach`
+    - `reel_shares`
+    - `reel_total_interactions`
+
+## Under the Hood
+- Incorporated the new `fivetran_utils.drop_schemas_automation` macro into the end of each Buildkite integration test job.
+- Updated the pull request [templates](/.github).
+
+## Contributors
+- [@IbraFal](https://github.com/IbraFal) ([PR #9](https://github.com/fivetran/dbt_instagram_business/pull/9))
+
 # dbt_instagram_business v0.2.0
 
 ## 🚨 Breaking Changes 🚨:

dbt_project.yml

@@ -1,5 +1,5 @@
 name: 'instagram_business'
-version: '0.2.0'
+version: '0.2.1'
 config-version: 2
 require-dbt-version: [">=1.3.0", "<2.0.0"]
 vars:

integration_tests/dbt_project.yml

@@ -1,5 +1,5 @@
 name: 'instagram_business_integration_tests'
-version: '0.2.0'
+version: '0.2.1'
 profile: 'integration_tests'
 config-version: 2
 vars:

integration_tests/seeds/instagram_business_media_insights_data.csv

@@ -1,6 +1,6 @@
-_fivetran_id,_fivetran_synced,carousel_album_engagement,carousel_album_impressions,carousel_album_reach,carousel_album_saved,carousel_album_video_views,comment_count,id,like_count,story_exits,story_impressions,story_reach,story_replies,story_taps_back,story_taps_forward,video_photo_engagement,video_photo_impressions,video_photo_reach,video_photo_saved,video_views
-HHKa3JBGx1RRxWfgqqMXC6ewgc4=,2021-10-27T14:22:01.906,,,,,,1,17875951606801054,3,,,,,,,4,56,43,0,
-zzVHxeqeogmAzEWFVvBrhOwm5w0=,2021-10-27T14:22:01.901,,,,,,1,17846746730324230,7,,,,,,,8,79,57,0,
-E3Z4FOw/J3joWUdHoLL1FXIGrXE=,2021-10-27T14:22:01.904,,,,,,0,17912811451468757,5,,,,,,,5,96,60,0,54
-3SGiNeVHbYUzwaX/VLXQArKHOl0=,2021-10-27T14:22:01.896,,,,,,0,17927058817426962,10,,,,,,,10,68,53,0,47
-15mSp2H5q1GUJYqTXy8Z2ln+3eY=,2021-10-27T14:22:01.899,4,68,47,0,0,0,17866678285999550,4,,,,,,,,,,0,0
+_fivetran_id,_fivetran_synced,carousel_album_engagement,carousel_album_impressions,carousel_album_reach,carousel_album_saved,carousel_album_video_views,comment_count,id,like_count,story_exits,story_impressions,story_reach,story_replies,story_taps_back,story_taps_forward,video_photo_engagement,video_photo_impressions,video_photo_reach,video_photo_saved,video_views,reel_comments,reel_likes,reel_plays,reel_reach,reel_shares,reel_total_interactions
+HHKa3JBGx1RRxWfgqqMXC6ewgc4=,2021-10-27T14:22:01.906,,,,,,1,17875951606801054,3,,,,,,,4,56,43,0,,1,2,3,4,5,6
+zzVHxeqeogmAzEWFVvBrhOwm5w0=,2021-10-27T14:22:01.901,,,,,,1,17846746730324230,7,,,,,,,8,79,57,0,,1,2,3,4,5,6
+E3Z4FOw/J3joWUdHoLL1FXIGrXE=,2021-10-27T14:22:01.904,,,,,,0,17912811451468757,5,,,,,,,5,96,60,0,54,1,2,3,4,5,6
+3SGiNeVHbYUzwaX/VLXQArKHOl0=,2021-10-27T14:22:01.896,,,,,,0,17927058817426962,10,,,,,,,10,68,53,0,47,1,2,3,4,5,6
+15mSp2H5q1GUJYqTXy8Z2ln+3eY=,2021-10-27T14:22:01.899,4,68,47,0,0,0,17866678285999550,4,,,,,,,,,,0,0,1,2,3,4,5,6

models/instagram_business.yml

@@ -73,5 +73,17 @@ models:
         description: Total number of unique Instagram accounts that have saved the video IG Media object.
       - name: video_views
         description: Total number of times the video IG Media object has been viewed.
+      - name: reel_comments
+        description: Total number of comments on the reel IG Media object.
+      - name: reel_likes
+        description: Total number of likes on the reel IG Media object.
+      - name: reel_plays
+        description: Total number of times the reel IG Media object has been played.
+      - name: reel_reach
+        description: Total number of unique Instagram accounts that have seen the reel IG Media object.
+      - name: reel_shares
+        description: Total number of times the reel IG Media object has been shared.
+      - name: reel_total_interactions
+        description: Total number of interactions the reel IG Media object had.
       - name: source_relation
-        description: The source of the record, if the unioning functionality is being used.
+        description: The source of the record, if the unioning functionality is being used.

models/instagram_business__posts.sql

@@ -50,6 +50,12 @@ with media_history as (
         media_insights.video_photo_reach,
         media_insights.video_photo_saved,
         media_insights.video_views,
+        media_insights.reel_comments,
+        media_insights.reel_likes,
+        media_insights.reel_plays,
+        media_insights.reel_reach,
+        media_insights.reel_shares,
+        media_insights.reel_total_interactions,
         media_history.source_relation
     from media_history
     left join media_insights
@@ -62,4 +68,4 @@ with media_history as (
 )
 
 select *
-from joined
+from joined