Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support concurrent write for S3 writer #48607

Closed
CharlesCheung96 opened this issue Nov 15, 2023 · 0 comments · Fixed by #45723
Closed

support concurrent write for S3 writer #48607

CharlesCheung96 opened this issue Nov 15, 2023 · 0 comments · Fixed by #45723
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. component/ticdc type/enhancement The issue or PR belongs to an enhancement.

Comments

@CharlesCheung96
Copy link
Contributor

Enhancement

Use the multi-part s3 uploader to improve throughput for uploading single file.
@CharlesCheung96 CharlesCheung96 added type/enhancement The issue or PR belongs to an enhancement. component/br This issue is related to BR of TiDB. affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. labels Nov 15, 2023
This was referenced Nov 15, 2023
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Nov 24, 2023
@ti-chi-bot
*: support concurrent write for S3 writer (#45723) (#48603)
a06279f 
ref #45719, close #48607
This was referenced Dec 5, 2023
Merged
Closed
ti-chi-bot bot pushed a commit that referenced this issue Dec 6, 2023
@ti-chi-bot
*: support concurrent write for S3 writer (#45723) (#49185)
79bcffb 
ref #45719, close #48607
@jebter jebter added component/ticdc and removed component/br This issue is related to BR of TiDB. labels Dec 12, 2023
@wjhuang2016 wjhuang2016 removed the affects-7.5 This bug affects the 7.5.x(LTS) versions. label Feb 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. component/ticdc type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

*: support concurrent write for S3 writer wjhuang2016/tidb
3 participants
@jebter @wjhuang2016 @CharlesCheung96