Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws.securityhub_findings: Improve support for CDR #11158

Merged
merged 37 commits into from
Oct 30, 2024
Merged
Show file tree
Hide file tree
Changes from 21 commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
36732d3
Add CSPM fields - 1
kcreddy Sep 17, 2024
a94baae
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Sep 17, 2024
93dd726
reformat
kcreddy Sep 17, 2024
c2c58ff
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub-2
kcreddy Sep 17, 2024
364c668
reformat
kcreddy Sep 17, 2024
0d6a54b
Add more ECS fields
kcreddy Sep 20, 2024
866e8c9
Consider multiple resources
kcreddy Sep 20, 2024
849e444
Split single and multiple resource logic. Add multiple resources test.
kcreddy Sep 23, 2024
a73b971
Add tags and update comments
kcreddy Sep 23, 2024
4c0472b
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub-2
kcreddy Sep 23, 2024
549ea69
Add visualization to findings dashboard
kcreddy Sep 23, 2024
09a3e99
update typeMigrationVersion on kibana searches
kcreddy Sep 23, 2024
f898ffc
Address PR comments.
kcreddy Sep 24, 2024
0d43327
Address PR comments-1
kcreddy Sep 25, 2024
0897d24
Add PR comment-2
kcreddy Sep 25, 2024
69603d5
Address PR comments-3. Use constant_keyword
kcreddy Sep 26, 2024
a806320
Address PR comments-4. Separate res.Details != null condition block a…
kcreddy Sep 26, 2024
f6b7cea
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Sep 30, 2024
fe69984
Merge branch 'cspm-aws_securityhub' of https://github.com/kcreddy/int…
kcreddy Sep 30, 2024
e04489a
fix HEAD
kcreddy Sep 30, 2024
a914bcf
ecs fields sorted.
kcreddy Sep 30, 2024
6d9d901
Address Pr comments-5. Remove unused fields from mapping.
kcreddy Oct 2, 2024
603643a
Add misconfiguration_latest transform
kcreddy Oct 7, 2024
be802d8
Address PR comment. Update transform retention to 90d.
kcreddy Oct 11, 2024
6b31c8a
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 11, 2024
6ae7527
Address PR comments. Updated rule fields to keyword.
kcreddy Oct 15, 2024
63fdd87
update readme
kcreddy Oct 15, 2024
d349bec
Remove references from pipeline tests
kcreddy Oct 15, 2024
b26ac6b
Merge branch 'main' of https://github.com/elastic/integrations into c…
kcreddy Oct 15, 2024
1d92a8f
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 15, 2024
451cae9
update fields to ecs
kcreddy Oct 28, 2024
0dfc25d
Merge remote-tracking branch 'upstream/main' into cspm-aws_securityhub
kcreddy Oct 28, 2024
0e44091
address pr comments.
kcreddy Oct 29, 2024
d861580
fix static test
kcreddy Oct 30, 2024
a0a7e23
update/fix readme
kcreddy Oct 30, 2024
1080998
address pr comments
kcreddy Oct 30, 2024
aafe9a9
address pr comments. Remove unnecessary `ignore_empty_value` option
kcreddy Oct 30, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions packages/aws/changelog.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
# newer versions go on top
- version: "2.26.0"
changes:
- description: Improve support for CDR in securityhub_findings data stream.
kcreddy marked this conversation as resolved.
Show resolved Hide resolved
type: enhancement
link: https://github.com/elastic/integrations/pull/11158
- version: "2.25.0-preview01"
changes:
- description: Add related.entity field.
Expand Down

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
- name: cloud.provider
type: constant_keyword
- name: event.kind
type: constant_keyword
- name: observer.vendor
type: constant_keyword
Original file line number Diff line number Diff line change
Expand Up @@ -271,6 +271,9 @@
- name: compliance
type: group
fields:
- name: security_control_id
type: keyword
description: Unique identifier of a control across standards.
- name: related_requirements
type: keyword
description: For a control, the industry or regulatory framework requirements that are related to the control.
Expand All @@ -289,6 +292,9 @@
- name: confidence
type: long
description: A finding's confidence. Confidence is defined as the likelihood that a finding accurately identifies the behavior or issue that it was intended to identify.
- name: processed_at
type: date
description: Indicates when AWS Security Hub received a finding and begins to process it.
- name: created_at
type: date
description: Indicates when the security-findings provider created the potential security issue that a finding captured.
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
- name: resource
type: group
fields:
- name: id
type: keyword
- name: name
type: keyword
- name: type
type: keyword
- name: sub_type
kcreddy marked this conversation as resolved.
Show resolved Hide resolved
type: keyword
16 changes: 16 additions & 0 deletions packages/aws/data_stream/securityhub_findings/fields/result.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
- name: result
type: group
fields:
- name: evaluation
type: keyword
- name: evidence
kcreddy marked this conversation as resolved.
Show resolved Hide resolved
type: group
fields:
- name: current_value
type: text
- name: expected_value
type: text
- name: configuration_path
type: text
- name: cloud_configuration_link
type: text
17 changes: 17 additions & 0 deletions packages/aws/data_stream/securityhub_findings/fields/rule.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
- name: rule
type: group
fields:
- name: uuid
kcreddy marked this conversation as resolved.
Show resolved Hide resolved
type: keyword
- name: id
type: keyword
- name: name
type: keyword
- name: description
type: text
- name: remediation
type: text
- name: references
type: text
- name: reference
type: text
21 changes: 21 additions & 0 deletions packages/aws/docs/securityhub.md
Original file line number Diff line number Diff line change
Expand Up @@ -526,6 +526,7 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
| aws.securityhub_findings.aws_account_id | The Amazon Web Services account ID that a finding is generated in. | keyword |
| aws.securityhub_findings.company.name | The name of the company for the product that generated the finding. | keyword |
| aws.securityhub_findings.compliance.related_requirements | For a control, the industry or regulatory framework requirements that are related to the control. | keyword |
| aws.securityhub_findings.compliance.security_control_id | Unique identifier of a control across standards. | keyword |
| aws.securityhub_findings.compliance.status | The result of a standards check. | keyword |
| aws.securityhub_findings.compliance.status_reasons.description | The corresponding description for the status reason code. | keyword |
| aws.securityhub_findings.compliance.status_reasons.reason_code | A code that represents a reason for the control status. | keyword |
Expand Down Expand Up @@ -590,6 +591,7 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
| aws.securityhub_findings.process.path | The path to the process executable. | keyword |
| aws.securityhub_findings.process.pid | The process ID. | long |
| aws.securityhub_findings.process.terminated_at | Indicates when the process was terminated. | date |
| aws.securityhub_findings.processed_at | Indicates when AWS Security Hub received a finding and begins to process it. | date |
| aws.securityhub_findings.product.arn | The ARN generated by Security Hub that uniquely identifies a product that generates findings. This can be the ARN for a third-party product that is integrated with Security Hub, or the ARN for a custom integration. | keyword |
| aws.securityhub_findings.product.fields | A data type where security-findings providers can include additional solution-specific details that aren't part of the defined AwsSecurityFinding format. | flattened |
| aws.securityhub_findings.product.name | The name of the product that generated the finding. | keyword |
Expand Down Expand Up @@ -651,15 +653,34 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
| aws.securityhub_findings.workflow.state | The workflow state of a finding. | keyword |
| aws.securityhub_findings.workflow.status | The status of the investigation into the finding. | keyword |
| cloud.image.id | Image ID for the cloud instance. | keyword |
| cloud.provider | | constant_keyword |
| data_stream.dataset | Data stream dataset. | constant_keyword |
| data_stream.namespace | Data stream namespace. | constant_keyword |
| data_stream.type | Data stream type. | constant_keyword |
| event.kind | | constant_keyword |
| event.module | Event module. | constant_keyword |
| host.containerized | If the host is a container. | boolean |
| host.os.build | OS build information. | keyword |
| host.os.codename | OS codename, if any. | keyword |
| input.type | Input type | keyword |
| log.offset | Log offset | long |
| observer.vendor | | constant_keyword |
| resource.id | | keyword |
| resource.name | | keyword |
| resource.sub_type | | keyword |
| resource.type | | keyword |
| result.evaluation | | keyword |
| result.evidence.cloud_configuration_link | | text |
| result.evidence.configuration_path | | text |
| result.evidence.current_value | | text |
| result.evidence.expected_value | | text |
| rule.description | | text |
| rule.id | | keyword |
| rule.name | | keyword |
| rule.reference | | text |
| rule.references | | text |
| rule.remediation | | text |
| rule.uuid | | keyword |
| url.user_info | | keyword |


Expand Down
Loading