Skip to content

Commit

Permalink
Clarifies that Data Prepper select_entries processor does not remove …
Browse files Browse the repository at this point in the history
…events (#6917)

* Adds some clarity to the Data Prepper select_entries processor documentation that events are not dropped.

Signed-off-by: David Venable <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
  • Loading branch information
dlvenable and Naarcha-AWS authored Apr 19, 2024
1 parent b8211a4 commit 8b71973
Showing 1 changed file with 3 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,8 @@ nav_order: 59

# select_entries

The `select_entries` processor selects entries from a Data Prepper event. Only the selected entries will remain in the event, and all other entries will be removed from the event.
The `select_entries` processor selects entries from a Data Prepper event.
Only the selected entries remain in the processed event and while all other entries are removed. However, the processor does not remove any events from the Data Prepper pipeline.

## Configuration

Expand All @@ -17,7 +18,7 @@ You can configure the `select_entries` processor using the following options.
| Option | Required | Description |
| :--- | :--- | :--- |
| `include_keys` | Yes | A list of keys to be selected from an event. |
| `select_when` | No | A [conditional expression](https://opensearch.org/docs/latest/data-prepper/pipelines/expression-syntax/), such as `/some-key == "test"'`, that will be evaluated to determine whether the processor will be run on the event. |
| `select_when` | No | A [conditional expression](https://opensearch.org/docs/latest/data-prepper/pipelines/expression-syntax/), such as `/some-key == "test"'`, that will be evaluated to determine whether the processor will be run on the event. If the condition is not met, then the event continues through the pipeline unmodified with all the original fields present. |

## Usage

Expand Down

0 comments on commit 8b71973

Please sign in to comment.