You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
cat "has some spaces.log"
This file has spaces.
Two to be precise.
Upload that file:
aws s3 cp "has some spaces.log" s3://s3-source-manual-test/
Expected behavior
The S3 object should be read just like the one without spaces.
Actual Outputs
2022-10-15T16:56:08,659 [Thread-1] WARN org.opensearch.dataprepper.plugins.source.SqsWorker - Unable to process S3Object: s3ObjectReference=[bucketName=***, key=has+some+spaces.log].
software.amazon.awssdk.services.s3.model.NoSuchKeyException: The specified key does not exist. (Service: S3, Status Code: 404, Request ID: ***, Extended Request ID: ***)
Environment (please complete the following information):
Describe the bug
The Data Prepper S3 source is unable to read from keys with spaces in them.
To Reproduce
Simple pipeline:
Here is a sample file:
Upload that file:
Expected behavior
The S3 object should be read just like the one without spaces.
Actual Outputs
Environment (please complete the following information):
Data Prepper Docker build from
main
.Files uploaded via macOS using the AWS CLI.
Additional context
The following values come from the S3 Console:
s3://***/has some spaces.log
https://***.s3.amazonaws.com/has+some+spaces.log
arn:aws:s3:::***/has some spaces.log
SQS Body:
The text was updated successfully, but these errors were encountered: