Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AWS] Add dimensions to firewall, transit gateway and vpn data streams #6339

Merged
merged 11 commits into from
Jun 5, 2023
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "1.36.9"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: in #6365 we bumped minor version, here only patch one
why the difference? :)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

1.37 changes were not related to TSDB, that is why I bumped to 1.38 in that PR. Unlike here, since 1.36.8 was a change to add dimensions.

changes:
- description: Add dimension fields to firewall, transit gateway and vpn data streams.
type: enhancement
link: https://github.com/elastic/integrations/pull/6339
- version: "1.36.8"
changes:
- description: Add dimension fields to usage, dynamoDB and ELB data streams.
Expand Down
5 changes: 5 additions & 0 deletions packages/aws/data_stream/firewall_metrics/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
name: cloud
- external: ecs
name: cloud.account.id
dimension: true
- external: ecs
name: cloud.account.name
- external: ecs
Expand All @@ -14,6 +15,7 @@
name: cloud.provider
- external: ecs
name: cloud.region
dimension: true
- external: ecs
name: ecs.version
- external: ecs
Expand Down Expand Up @@ -60,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
4 changes: 4 additions & 0 deletions packages/aws/data_stream/firewall_metrics/fields/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,19 @@
fields:
- name: AvailabilityZone
type: keyword
dimension: true
description: Availability Zone in the Region where the Network Firewall firewall is active.
- name: CustomAction
type: keyword
dimension: true
description: Dimension for a publish metrics custom action that you defined. You can define this for a rule action in a stateless rule group or for a stateless default action in a firewall policy.
- name: Engine
type: keyword
dimension: true
description: Rules engine that processed the packet. The value for this is either Stateful or Stateless.
- name: FirewallName
type: keyword
dimension: true
description: Name that you specified for the Network Firewall firewall.
- name: cloudwatch
type: group
Expand Down
5 changes: 5 additions & 0 deletions packages/aws/data_stream/transitgateway/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
name: cloud
- external: ecs
name: cloud.account.id
dimension: true
- external: ecs
name: cloud.account.name
- external: ecs
Expand All @@ -18,6 +19,7 @@
name: cloud.provider
- external: ecs
name: cloud.region
dimension: true
- external: ecs
name: ecs.version
- external: ecs
Expand Down Expand Up @@ -60,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
2 changes: 2 additions & 0 deletions packages/aws/data_stream/transitgateway/fields/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,11 @@
type: group
fields:
- name: TransitGateway
dimension: true
type: keyword
description: Filters the metric data by transit gateway.
- name: TransitGatewayAttachment
dimension: true
type: keyword
description: Filters the metric data by transit gateway attachment.
- name: transitgateway
Expand Down
5 changes: 5 additions & 0 deletions packages/aws/data_stream/vpn/fields/ecs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@
name: cloud
- external: ecs
name: cloud.account.id
dimension: true
- external: ecs
name: cloud.account.name
- external: ecs
Expand All @@ -18,6 +19,7 @@
name: cloud.provider
- external: ecs
name: cloud.region
dimension: true
- external: ecs
name: ecs.version
- external: ecs
Expand Down Expand Up @@ -60,3 +62,6 @@
name: container.labels
- external: ecs
name: container.name
- name: agent.id
external: ecs
dimension: true
2 changes: 2 additions & 0 deletions packages/aws/data_stream/vpn/fields/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,9 +21,11 @@
fields:
- name: VpnId
type: keyword
dimension: true
description: Filters the metric data by the Site-to-Site VPN connection ID.
- name: TunnelIpAddress
type: keyword
dimension: true
description: Filters the metric data by the IP address of the tunnel for the virtual private gateway.
- name: cloudwatch
type: group
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/firewall.md
Original file line number Diff line number Diff line change
Expand Up @@ -413,6 +413,7 @@ An example event for `firewall` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.\* | Metric dimensions. | object |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/transitgateway.md
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,7 @@ An example event for `transitgateway` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.\* | Metric dimensions. | object |
| aws.dimensions.TransitGateway | Filters the metric data by transit gateway. | keyword |
Expand Down
1 change: 1 addition & 0 deletions packages/aws/docs/vpn.md
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,7 @@ An example event for `vpn` looks as following:
| Field | Description | Type |
|---|---|---|
| @timestamp | Event timestamp. | date |
| agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |
| aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object |
| aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |
| aws.dimensions.\* | Metric dimensions. | object |
Expand Down
2 changes: 1 addition & 1 deletion packages/aws/manifest.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
format_version: 1.0.0
name: aws
title: AWS
version: 1.36.8
version: 1.36.9
license: basic
description: Collect logs and metrics from Amazon Web Services with Elastic Agent.
type: integration
Expand Down