Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MPU failed to upload part of files #3158

Closed
2 tasks done
zhaohehuhu opened this issue Nov 4, 2024 · 3 comments
Closed
2 tasks done

MPU failed to upload part of files #3158

zhaohehuhu opened this issue Nov 4, 2024 · 3 comments
Labels
bug This issue is a bug. closed-for-staleness p3 This is a minor priority issue

Comments

@zhaohehuhu
Copy link

Upcoming End-of-Support

  • I acknowledge the upcoming end-of-support for AWS SDK for Java v1 was announced, and migration to AWS SDK for Java v2 is recommended.

Describe the bug

I adopt AWS MPU to upload tons of files in parallel, and all MPU upload request is done after calling completeMultipartUpload. But I checked the AWS s3 and found some files failed to be uploaded on AWS.

Regression Issue

  • Select this option if this issue appears to be a regression.

Expected Behavior

all MPU upload request is done and all files are on AWS.

Current Behavior

some files failed to be uploaded on AWS and there is no any error message shown.

Reproduction Steps

  1. Initialize AWS S3 Client
  2. Simulate 3000 Upload Requests:
  3. Complete the upload through calling completeMultipartUpload function

Possible Solution

No response

Additional Information/Context

No response

AWS Java SDK version used

1.12.532

JDK version used

JDK 8

Operating System and version

Centos

@zhaohehuhu zhaohehuhu added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Nov 4, 2024
@github-actions github-actions bot added the potential-regression Marking this issue as a potential regression to be checked by team member label Nov 4, 2024
@debora-ito
Copy link
Member

@zhaohehuhu please provide:

  • a self-contained code sample we can use to reproduce
  • the full error stacktrace

Consider using the Java SDK 2.x S3TransferManager, it will manage multipart uploads automatically. The Java SDK 1.x is under Maintenance Mode and will only receive security updates and critical bugfixes.

@debora-ito debora-ito added response-requested Waiting on additional info or feedback. Will move to "closing-soon" in 5 days. p3 This is a minor priority issue and removed needs-triage This issue or PR still needs to be triaged. potential-regression Marking this issue as a potential regression to be checked by team member labels Nov 4, 2024
Copy link

It looks like this issue has not been active for more than five days. In the absence of more information, we will be closing this issue soon. If you find that this is still a problem, please add a comment to prevent automatic closure, or if the issue is already closed please feel free to reopen it.

@github-actions github-actions bot added the closing-soon This issue will close in 2 days unless further comments are made. label Nov 14, 2024
@zhaohehuhu
Copy link
Author

@zhaohehuhu please provide:

  • a self-contained code sample we can use to reproduce
  • the full error stacktrace

Consider using the Java SDK 2.x S3TransferManager, it will manage multipart uploads automatically. The Java SDK 1.x is under Maintenance Mode and will only receive security updates and critical bugfixes.

Thanks. I'll take a shot.

@github-actions github-actions bot removed closing-soon This issue will close in 2 days unless further comments are made. response-requested Waiting on additional info or feedback. Will move to "closing-soon" in 5 days. labels Nov 18, 2024
@debora-ito debora-ito added the closing-soon This issue will close in 2 days unless further comments are made. label Nov 20, 2024
@github-actions github-actions bot added closed-for-staleness and removed closing-soon This issue will close in 2 days unless further comments are made. labels Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug This issue is a bug. closed-for-staleness p3 This is a minor priority issue
Projects
None yet
Development

No branches or pull requests

2 participants