[BUG] S3 Source fails to load all records for large compressed logs with automatic compression #2026
Comments
dlvenable
added a commit
to dlvenable/data-prepper
that referenced
this issue
Nov 19, 2022
…ompression engine. Fixes opensearch-project#2026. Signed-off-by: David Venable <[email protected]>
Merged
4 tasks
dlvenable
added a commit
that referenced
this issue
Nov 21, 2022
…ompression engine. Fixes #2026. (#2027) Signed-off-by: David Venable <[email protected]>
opensearch-trigger-bot bot
pushed a commit
that referenced
this issue
Nov 21, 2022
…ompression engine. Fixes #2026. (#2027) Signed-off-by: David Venable <[email protected]> (cherry picked from commit 729c2d4)
dlvenable
added a commit
that referenced
this issue
Nov 21, 2022
…ompression engine. Fixes #2026. (#2027) (#2029) Signed-off-by: David Venable <[email protected]> (cherry picked from commit 729c2d4) Co-authored-by: David Venable <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
The S3 source does not process all records from compressed files when using
automaticcompression.This is a repeat of #1568 for
automaticcompression. That fix was never applied to that option.The text was updated successfully, but these errors were encountered: