Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update AWS Cloudwatch mappings #14653

Closed
wants to merge 2 commits into from

Conversation

exekias
Copy link
Contributor

@exekias exekias commented Nov 20, 2019

AWS cloudwatch metrics were being reported under aws.metrics, but the
mapping definitions in fields.yml were expecting these under
aws.cloudwatch.metrics.

This change fixes that and refactors how metrics are handled when used
together with Lightweight modules. Metrics should now include the
metricset name in the path, example:

For cloudwatch metricset, metrics look like:

aws.cloudwatch.metrics.CPUUtilization.p10
aws.cloudwatch.dimensions.InstanceId

While when used from a lightweight module it produces:

aws.ebs.metrics.BurstBalance.avg
aws.dimensions.VolumeId

I kept dimensions together as sometimes these can be used for
correlation, so having them under the same field helps.

TODO:

  • Update ELB metricset
  • Update dashboards

AWS cloudwatch metrics were being reported under `aws.metrics`, but the
mapping definitions in `fields.yml` were expecting these under
`aws.cloudwatch.metrics`.

This change fixes that and refactors how metrics are handled when used
together with Lightweight modules. Metrics should now include the
metricset name in the path, example:

For cloudwatch metricset, metrics look like:

```
aws.cloudwatch.metrics.CPUUtilization.p10
aws.cloudwatch.dimensions.InstanceId
```

While when used from a lightweight module it produces:

```
aws.ebs.metrics.BurstBalance.avg
aws.cloudwatch.dimensions.VolumeId
```

I kept dimensions together as sometimes these can be used for
correlation, so having them under the same field helps.
@exekias exekias added in progress Pull request is currently in progress. discuss Issue needs further discussion. labels Nov 20, 2019
@exekias exekias requested a review from a team as a code owner November 20, 2019 16:05
@exekias
Copy link
Contributor Author

exekias commented Nov 20, 2019

I've played with this while thinking on #14662, would love to hear opinions here

@exekias
Copy link
Contributor Author

exekias commented Nov 20, 2019

cc @kaiyan-sheng @sorantis

@kaiyan-sheng
Copy link
Contributor

Thanks @exekias for starting this! One thing I'm concerned about is the inconsistency of ebs/cloudwatch in light module use case:

aws.ebs.metrics.BurstBalance.avg
aws.cloudwatch.dimensions.VolumeId

metrics and dimensions are both concepts from AWS Cloudwatch. It makes sense with metrics from cloudwatch metricset but for light modules, will this difference be confusing a bit?

@exekias
Copy link
Contributor Author

exekias commented Nov 21, 2019

Sorry you are right, I actually changed them to aws.dimensions, but wrote the incorrect path in the description. I have updated it. WDYT?

@kaiyan-sheng
Copy link
Contributor

Sorry you are right, I actually changed them to aws.dimensions, but wrote the incorrect path in the description. I have updated it. WDYT?

Thanks! I'm good with aws.dimensions.VolumeId!

Copy link
Contributor

@kaiyan-sheng kaiyan-sheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM besides changelog and needs to run mage fmt update.

@exekias
Copy link
Contributor Author

exekias commented Jan 7, 2020

closing in favor of #15245

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking change discuss Issue needs further discussion. in progress Pull request is currently in progress.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants