Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

http adding endpoint to ingest data with #8067

Merged
merged 10 commits into from
Sep 13, 2024
Merged

http adding endpoint to ingest data with #8067

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
9fa88cb
Documented the endpoint that is used with this option.
landon-lengyel Aug 21, 2024
bc190c7
Update _data-prepper/pipelines/configuration/sources/http.md
vagimeli Aug 23, 2024
db2e9f6
Update _data-prepper/pipelines/configuration/sources/http.md
vagimeli Aug 23, 2024
5f04490
Update _data-prepper/pipelines/configuration/sources/http.md
vagimeli Aug 23, 2024
4465390
Update _data-prepper/pipelines/configuration/sources/http.md
vagimeli Aug 23, 2024
8a28868
Merge branch 'main' into main
vagimeli Aug 23, 2024
682be6b
Update http.md
vagimeli Aug 26, 2024
84ad7d4
Update http.md
vagimeli Aug 27, 2024
bf96903
Merge branch 'main' into main
vagimeli Aug 28, 2024
4d8b7e5
Merge branch 'main' into main
vagimeli Sep 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion _data-prepper/pipelines/configuration/sources/http.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ redirect_from:

# http

The `http` plugin accepts HTTP requests from clients. Currently, `http` only supports the JSON UTF-8 codec for incoming requests, such as `[{"key1": "value1"}, {"key2": "value2"}]`. The following table describes options you can use to configure the `http` source.
The `http` plugin accepts HTTP requests from clients. The following table describes options you can use to configure the `http` source.

Option | Required | Type | Description
:--- | :--- | :--- | :---
Expand All @@ -36,6 +36,17 @@ aws_region | Conditionally | String | AWS region used by ACM or Amazon S3. Requi

Content will be added to this section.--->

## Ingestion
Clients should send HTTP `POST` requests to the endpoint `/log/ingest`
vagimeli marked this conversation as resolved.
Show resolved Hide resolved

Currently, `http` only supports the JSON UTF-8 codec for incoming requests, such as `[{"key1": "value1"}, {"key2": "value2"}]`.
vagimeli marked this conversation as resolved.
Show resolved Hide resolved

**Example: Ingest data with cURL**
vagimeli marked this conversation as resolved.
Show resolved Hide resolved

The following example shows ingesting data with cURL:
vagimeli marked this conversation as resolved.
Show resolved Hide resolved

`curl "http://localhost:2021/log/ingest" --data '[{"key1": "value1"}, {"key2": "value2"}]'`

## Metrics

The `http` source includes the following metrics.
Expand Down
Loading