Skip to content

Commit

Permalink
Allow host.* fields to be disabled in Suricata module (elastic#19107)
Browse files Browse the repository at this point in the history
If `forwarded` as configured as a tag (e.g. `var.tags: [forwarded]`) for the Suricata module then Filebeat will not add `host` fields to events. This is for use cases where Suricata is analyzing forwarded data (like from a network tap or mirror port).

Relates: elastic#13920
  • Loading branch information
andrewkroh authored and melchiormoulin committed Oct 14, 2020
1 parent a176fba commit 8c27325
Show file tree
Hide file tree
Showing 5 changed files with 15 additions and 3 deletions.
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d
* iptables {pull}18756[18756]
* Checkpoint {pull}18754[18754]
* Netflow {pull}19087[19087]
* Suricata {pull}19107[19107] (`forwarded` tag is not included by default)
- Preserve case of http.request.method. ECS prior to 1.6 specified normalizing to lowercase, which lost information. Affects filesets: apache/access, elasticsearch/audit, iis/access, iis/error, nginx/access, nginx/ingress_controller, aws/elb, suricata/eve, zeek/http. {issue}18154[18154] {pull}18359[18359]
- Adds check on `<no value>` config option value for the azure input `resource_manager_endpoint`. {pull}18890[18890]
- Okta module now requires objects instead of JSON strings for the `http_headers`, `http_request_body`, `pagination`, `rate_limit`, and `ssl` variables. {pull}18953[18953]
Expand Down
6 changes: 6 additions & 0 deletions filebeat/docs/modules/suricata.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,12 @@ include::../include/config-option-intro.asciidoc[]

include::../include/var-paths.asciidoc[]

*`var.tags`*::

A list of tags to include in events. Including `forwarded` indicates that the
events did not originate on this host and causes `host.name` to not be added to
events. Defaults to `[suricata]`.

[float]
=== Example dashboard

Expand Down
6 changes: 6 additions & 0 deletions x-pack/filebeat/module/suricata/_meta/docs.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,12 @@ include::../include/config-option-intro.asciidoc[]

include::../include/var-paths.asciidoc[]

*`var.tags`*::

A list of tags to include in events. Including `forwarded` indicates that the
events did not originate on this host and causes `host.name` to not be added to
events. Defaults to `[suricata]`.

[float]
=== Example dashboard

Expand Down
3 changes: 2 additions & 1 deletion x-pack/filebeat/module/suricata/eve/config/eve.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,8 @@ paths:
- {{$path}}
{{ end }}
exclude_files: [".gz$"]
tags: {{.tags}}
tags: {{.tags | tojson}}
publisher_pipeline.disable_host: {{ inList .tags "forwarded" }}

processors:
- rename:
Expand Down
2 changes: 0 additions & 2 deletions x-pack/filebeat/module/suricata/eve/manifest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,8 +13,6 @@ var:
- name: community_id
default: true

# - name: nested_ecs
# default: false
ingest_pipeline: ingest/pipeline.yml
input: config/eve.yml

Expand Down

0 comments on commit 8c27325

Please sign in to comment.