Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws.securityhub_findings: Improve support for CDR #11158

Merged
merged 37 commits into from
Oct 30, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
36732d3
Add CSPM fields - 1
kcreddy Sep 17, 2024
a94baae
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Sep 17, 2024
93dd726
reformat
kcreddy Sep 17, 2024
c2c58ff
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub-2
kcreddy Sep 17, 2024
364c668
reformat
kcreddy Sep 17, 2024
0d6a54b
Add more ECS fields
kcreddy Sep 20, 2024
866e8c9
Consider multiple resources
kcreddy Sep 20, 2024
849e444
Split single and multiple resource logic. Add multiple resources test.
kcreddy Sep 23, 2024
a73b971
Add tags and update comments
kcreddy Sep 23, 2024
4c0472b
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub-2
kcreddy Sep 23, 2024
549ea69
Add visualization to findings dashboard
kcreddy Sep 23, 2024
09a3e99
update typeMigrationVersion on kibana searches
kcreddy Sep 23, 2024
f898ffc
Address PR comments.
kcreddy Sep 24, 2024
0d43327
Address PR comments-1
kcreddy Sep 25, 2024
0897d24
Add PR comment-2
kcreddy Sep 25, 2024
69603d5
Address PR comments-3. Use constant_keyword
kcreddy Sep 26, 2024
a806320
Address PR comments-4. Separate res.Details != null condition block a…
kcreddy Sep 26, 2024
f6b7cea
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Sep 30, 2024
fe69984
Merge branch 'cspm-aws_securityhub' of https://github.com/kcreddy/int…
kcreddy Sep 30, 2024
e04489a
fix HEAD
kcreddy Sep 30, 2024
a914bcf
ecs fields sorted.
kcreddy Sep 30, 2024
6d9d901
Address Pr comments-5. Remove unused fields from mapping.
kcreddy Oct 2, 2024
603643a
Add misconfiguration_latest transform
kcreddy Oct 7, 2024
be802d8
Address PR comment. Update transform retention to 90d.
kcreddy Oct 11, 2024
6b31c8a
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 11, 2024
6ae7527
Address PR comments. Updated rule fields to keyword.
kcreddy Oct 15, 2024
63fdd87
update readme
kcreddy Oct 15, 2024
d349bec
Remove references from pipeline tests
kcreddy Oct 15, 2024
b26ac6b
Merge branch 'main' of https://github.com/elastic/integrations into c…
kcreddy Oct 15, 2024
1d92a8f
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 15, 2024
451cae9
update fields to ecs
kcreddy Oct 28, 2024
0dfc25d
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 28, 2024
0e44091
address pr comments.
kcreddy Oct 29, 2024
d861580
fix static test
kcreddy Oct 30, 2024
a0a7e23
update/fix readme
kcreddy Oct 30, 2024
1080998
address pr comments
kcreddy Oct 30, 2024
aafe9a9
address pr comments. Remove unnecessary `ignore_empty_value` option
kcreddy Oct 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
- name: cloud
title: Cloud
group: 2
description: Fields related to the cloud or infrastructure the events are coming from.
footnote: 'Examples: If Metricbeat is running on an EC2 host and fetches data from its host, the cloud info contains the data about this machine. If Metricbeat runs on a remote machine outside the cloud and fetches data from a service running in the cloud, the field contains cloud data from the machine the service is running on.'
type: group
fields:
- name: image.id
type: keyword
description: Image ID for the cloud instance.
- name: host
title: Host
group: 2
description: 'A host is defined as a general computing instance.

ECS host.* fields should be populated with details about the host on which the event happened, or from which the measurement was taken. Host types include hardware, virtual machines, Docker containers, and Kubernetes nodes.'
type: group
fields:
- name: containerized
type: boolean
description: >
If the host is a container.

- name: os.build
type: keyword
example: "18D109"
description: >
OS build information.

- name: os.codename
type: keyword
example: "stretch"
description: >
OS codename, if any.

- name: input.type
type: keyword
description: Input type
- name: log.offset
type: long
description: Log offset
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
- name: data_stream.type
type: constant_keyword
description: Data stream type.
- name: data_stream.dataset
type: constant_keyword
description: Data stream dataset.
- name: data_stream.namespace
type: keyword
description: Data stream namespace.
- name: event.module
type: constant_keyword
description: Event module.
value: aws
- name: '@timestamp'
type: date
description: Event timestamp.
Original file line number Diff line number Diff line change
@@ -0,0 +1,159 @@
# Define ECS constant fields as constant_keyword
- name: cloud.provider
type: constant_keyword
- name: event.kind
type: constant_keyword
- name: observer.vendor
type: constant_keyword

# Define ECS fields for transform
- name: cloud.account.id
external: ecs
- name: cloud.availability_zone
external: ecs
- name: cloud.instance.id
external: ecs
- name: cloud.instance.name
external: ecs
- name: cloud.machine.type
external: ecs
- name: cloud.project.id
external: ecs
- name: cloud.region
external: ecs
- name: cloud.service.name
external: ecs
- name: destination.domain
external: ecs
- name: destination.ip
external: ecs
- name: destination.port
external: ecs
- name: ecs.version
external: ecs
- name: event.action
external: ecs
- name: event.agent_id_status
external: ecs
- name: event.category
external: ecs
- name: event.created
external: ecs
- name: event.dataset
external: ecs
- name: event.id
external: ecs
- name: event.ingested
external: ecs
- name: event.original
external: ecs
- name: event.outcome
external: ecs
- name: event.severity
external: ecs
- name: event.type
external: ecs
- name: host.id
external: ecs
- name: host.ip
external: ecs
- name: host.name
external: ecs
- name: network.direction
external: ecs
- name: network.protocol
external: ecs
- name: orchestrator.cluster.id
external: ecs
- name: orchestrator.cluster.name
external: ecs
- name: orchestrator.cluster.version
external: ecs
- name: orchestrator.cluster.url
external: ecs
- name: orchestrator.resource.id
external: ecs
- name: orchestrator.resource.name
external: ecs
- name: orchestrator.resource.type
external: ecs
- name: organization.name
external: ecs
- name: process.end
external: ecs
- name: process.executable
external: ecs
- name: process.name
external: ecs
- name: process.parent.pid
external: ecs
- name: process.pid
external: ecs
- name: process.start
external: ecs
- name: rule.ruleset
external: ecs
- name: related.hash
external: ecs
- name: related.hosts
external: ecs
- name: related.ip
external: ecs
- name: related.user
external: ecs
- name: source.domain
external: ecs
- name: source.ip
external: ecs
- name: source.mac
external: ecs
- name: source.port
external: ecs
- name: tags
external: ecs
- name: threat.indicator.last_seen
external: ecs
- name: threat.indicator.type
external: ecs
- name: threat.enrichments
external: ecs
- name: url.domain
external: ecs
- name: url.extension
external: ecs
- name: url.fragment
external: ecs
- name: url.full
external: ecs
- name: url.original
external: ecs
- name: url.password
external: ecs
- name: url.path
external: ecs
- name: url.port
external: ecs
- name: url.query
external: ecs
- name: url.registered_domain
external: ecs
- name: url.scheme
external: ecs
- name: url.subdomain
external: ecs
- name: url.top_level_domain
external: ecs
- name: url.username
external: ecs
- name: user.id
external: ecs
- name: user.name
external: ecs
- name: vulnerability.id
external: ecs
- name: vulnerability.reference
external: ecs
- name: vulnerability.scanner.vendor
external: ecs
- name: vulnerability.id
kcreddy marked this conversation as resolved.
Show resolved Hide resolved
external: ecs
Loading