Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add setting to configure the source mode of a data stream #419

Merged
merged 4 commits into from
Sep 21, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions spec/changelog.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,9 @@
- description: Document and validate `object_type` and `object_type_mapping_type`.
type: enhancement
link: https://github.com/elastic/package-spec/pull/417
- description: Add setting to configure the source mode of a data stream
type: enhancement
link: https://github.com/elastic/package-spec/issues/340
- version: 1.18.0
changes:
- description: Update Go runtime to 1.19.1.
Expand Down
14 changes: 14 additions & 0 deletions spec/integration/data_stream/manifest.spec.yml
Original file line number Diff line number Diff line change
Expand Up @@ -222,5 +222,19 @@ spec:
type: array
items:
type: string
source_mode:
description: |-
Source mode to use. This configures how the document source (`_source`) is stored
for this data stream.
If configured as `default`, this mode is not configured and it uses Elasticsearch defaults.
jsoriano marked this conversation as resolved.
Show resolved Hide resolved
If configured as `synthetic`, it doesn't store the source, but tries to rebuild it
from the indexed fields when queried.
If no configured, users may override the setting from Fleet UI.
jsoriano marked this conversation as resolved.
Show resolved Hide resolved
type: string
enum:
- "default"
- "synthetic"
examples:
- "synthetic"
required:
- title
2 changes: 2 additions & 0 deletions test/packages/good/data_stream/k8s_data_stream/manifest.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,3 +12,5 @@ streams:
default: /server-status
title: Nginx access logs
description: Collect Nginx access logs
elasticsearch:
source_mode: "default"
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ streams:
default: 10s

elasticsearch:
source_mode: "synthetic"
index_mode: "time_series"
index_template:
settings:
Expand Down