Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Integration: Snowflake #7043

Merged
merged 77 commits into from
Sep 16, 2020
Merged

New Integration: Snowflake #7043

merged 77 commits into from
Sep 16, 2020

Conversation

ChristineTChen
Copy link
Contributor

@ChristineTChen ChristineTChen commented Jul 1, 2020

What does this PR do?

Motivation

Additional Notes

Review checklist (to be filled by reviewers)

  • Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
  • PR title must be written as a CHANGELOG entry (see why)
  • Files changes must correspond to the primary purpose of the PR as described in the title (small unrelated changes should have their own PR)
  • PR must have changelog/ and integration/ labels attached

@codecov
Copy link

codecov bot commented Jul 24, 2020

Codecov Report

Merging #7043 into master will increase coverage by 2.57%.
The diff coverage is 91.20%.

Impacted Files Coverage Δ
snowflake/datadog_checks/snowflake/check.py 76.19% <76.19%> (ø)
snowflake/datadog_checks/snowflake/config.py 86.66% <86.66%> (ø)
snowflake/tests/conftest.py 88.88% <88.88%> (ø)
snowflake/tests/test_unit.py 94.11% <94.11%> (ø)
snowflake/datadog_checks/snowflake/__about__.py 100.00% <100.00%> (ø)
snowflake/datadog_checks/snowflake/__init__.py 100.00% <100.00%> (ø)
snowflake/datadog_checks/snowflake/queries.py 100.00% <100.00%> (ø)
snowflake/tests/test_snowflake.py 100.00% <100.00%> (ø)
datadog_checks_dev/datadog_checks/dev/__about__.py
..._fargate/datadog_checks/ecs_fargate/ecs_fargate.py
... and 883 more

snowflake/assets/configuration/spec.yaml Show resolved Hide resolved
snowflake/assets/configuration/spec.yaml Outdated Show resolved Hide resolved
snowflake/assets/configuration/spec.yaml Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/check.py Show resolved Hide resolved
Copy link
Member

@mgarabed mgarabed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🏅 Very clean and well-organized code!

snowflake/assets/configuration/spec.yaml Outdated Show resolved Hide resolved
Copy link
Contributor

@ofek ofek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great!

type: string
example: <OCSP_RESPONSE_CACHE_FILENAME>
- name: metric_groups
required: true
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since there is a default:

Suggested change
required: true

WDYT?

snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/datadog_checks/snowflake/queries.py Outdated Show resolved Hide resolved
snowflake/requirements-dev.txt Outdated Show resolved Hide resolved
ChristineTChen and others added 14 commits September 11, 2020 11:55
sarina-dd
sarina-dd previously approved these changes Sep 14, 2020
Copy link
Contributor

@sarina-dd sarina-dd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs approved 👍

mgarabed
mgarabed previously approved these changes Sep 15, 2020
@ofek ofek merged commit a1b1bc2 into master Sep 16, 2020
@ofek ofek deleted the cc/snowflake branch September 16, 2020 17:29
github-actions bot pushed a commit that referenced this pull request Sep 16, 2020
* Add snowflake intg

* Add dep

* Add auth options

* Validate config options

* set config options

* Set up connection obj

* Add storage usage query

* use dd_check_run fixture

* Add execute query

* Add metric usage query

* Add warehouse credit usage

* Collect metadata version

* Add mocked test

* Add test for metering metrics

* override min collection interval

* Update

* Override min_collect_interval

* add metrics

* Update last ts

* Add test coverage

* Add login metrics

* Add warehouse load metrics
:

* fix CI

* Pin deps

* Add metrics to metadata

* Add query history metrics

* Get parts from last ts

* initial min collection interval

* set default for min collect

* Add query history metrics

* pin dep to 2.1.3

* Ensure queries convert start_time column to UTC

* Fix style

* Increase latency timestamp to 3 hours

* remove last ts concept and collect metrics by day

* Update manifest

* Add sc

* Add readme

* Remove conversion and use local time

* Add metric groups

* Use check_name constant in tests

* Test metric group config

* Test queries

* Clean up

* Update billing metrics

* Fix style

* remove format string from log line

* Add test for version metadata

* Add data transfer metrics

* Add auto recluster metrics

* Add table storage metrics

* Add pipe metrics

* Add replication metrics

* Add custom queries

* Fix tests

* Update readme

* Add rec mon

* Update with feedback

* Add missing option

* Update snowflake/requirements-dev.txt

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Update snowflake/datadog_checks/snowflake/queries.py

Co-authored-by: Ofek Lev <[email protected]>

* Make db and schema customizable

* Retry connection if closed

* clean up

Co-authored-by: Ofek Lev <[email protected]> a1b1bc2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants