Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Upsert action requires existing document in OpenSearch #4036

Closed
graytaylor0 opened this issue Jan 30, 2024 · 2 comments · Fixed by #4178
Closed

[BUG] Upsert action requires existing document in OpenSearch #4036

graytaylor0 opened this issue Jan 30, 2024 · 2 comments · Fixed by #4178
Labels
bug Something isn't working
Milestone

Comments

@graytaylor0
Copy link
Member

Describe the bug
The upsert action is supposed to insert a document if it does not exist, and update a document if it does exist. However, the upsert action as part of a bulk request from the opensearch sink receives a document not found error from OpenSearch.

To Reproduce
Steps to reproduce the behavior:

  1. Configure and start a pipeline with an opensearch sink with action: upsert
  2. Send an Event that does not have an existing document_id for that document in the OpenSearch index
  3. Observe the error
WARN  org.opensearch.dataprepper.plugins.sink.opensearch.BulkRetryStrategy - operation 
= Update, error = [2]: document missing

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

  • OS: [e.g. Ubuntu 20.04 LTS]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@dlvenable
Copy link
Member

This is related to #3988.

@graytaylor0 , Is it a duplicate as well?

@graytaylor0
Copy link
Member Author

It is not the same as #3988. #3988 is might be consolidated with #3933 .

However, this one is completely different, and it is strictly focused on upsert not inserting documents when they don't exist

@github-project-automation github-project-automation bot moved this from Unplanned to Done in Data Prepper Tracking Board Feb 23, 2024
@dlvenable dlvenable added this to the v2.7 milestone Mar 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Development

Successfully merging a pull request may close this issue.

2 participants