Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not send empty lists to the DLQ when all items share the same retryable failure #3660

Merged
merged 1 commit into from
Nov 15, 2023

Conversation

dlvenable
Copy link
Member

Description

This adds a check for an empty list of failed documents. This could happen when a bulk request fails with all documents having the failure. For example, when there is no permission to write to a certain index, but there are permissions to write to a domain, all of the documents in that index will fail.

Issues Resolved

Resolves #3644

Check List

  • New functionality includes testing.
  • New functionality has a documentation issue. Please link to it in this PR.
    • New functionality has javadoc added
  • Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

@dlvenable dlvenable merged commit ae04689 into opensearch-project:main Nov 15, 2023
63 of 64 checks passed
@dlvenable dlvenable deleted the 3644-empty-dlq branch November 16, 2023 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Data Prepper is writting empty DLQ objects
3 participants