Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

COS: Add http_config for cos object store client #4482

Merged
merged 4 commits into from
Jul 27, 2021

Conversation

hanjm
Copy link
Member

@hanjm hanjm commented Jul 25, 2021

Fix #4479

The http.Transport is not auto-tuning and one size does not seem to fit all cases.
Add HTTPConfig Allow to tune most of the http.Transport parameters and MaxIdleConnsPerHost tune to 100.

Signed-off-by: hanjm [email protected]

  • I added CHANGELOG entry for this change.
  • Change is not relevant to the end user.

Changes

add http_config for cos storage.

Verification

unit test .
redeploy thanos tools bucket web, no TIME_WAIT connection.

@hanjm hanjm changed the title Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT (#4479) Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT Jul 25, 2021
@hanjm hanjm changed the title Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT COS: Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT Jul 25, 2021
@hanjm hanjm changed the title COS: Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT COS: Add http_config for cos object store client Jul 25, 2021
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch from 2a05db2 to f63c1c4 Compare July 25, 2021 03:27
…s-io#4479)

The http.Transport is not auto-tuning and one size does not seem to fit all cases.
Add `HTTPConfig` Allow to tune most of the http.Transport parameters and `MaxIdleConnsPerHost` tune to 100.

Signed-off-by: hanjm <[email protected]>
Signed-off-by: hanjm <[email protected]>
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch 3 times, most recently from e1b8520 to 49d1ca9 Compare July 25, 2021 04:27
Signed-off-by: hanjm <[email protected]>
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch from 49d1ca9 to cca6bf3 Compare July 25, 2021 06:16
@hanjm
Copy link
Member Author

hanjm commented Jul 25, 2021

Hi @ jojohappy,could you help me review this PR if convenient,thank you.

Copy link
Member

@bwplotka bwplotka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing, thanks 👍🏽

LGTM!

@bwplotka bwplotka merged commit 46ac4d5 into thanos-io:main Jul 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

COS objetstore client MaxIdleConnsPerHost too few
2 participants