Skip to content

COS: Add http_config for cos object store client#4482

Merged
bwplotka merged 4 commits intothanos-io:mainfrom
hanjm:feature/optimize-cos-object-transport
Jul 27, 2021
Merged

COS: Add http_config for cos object store client#4482
bwplotka merged 4 commits intothanos-io:mainfrom
hanjm:feature/optimize-cos-object-transport

Conversation

@hanjm
Copy link
Copy Markdown
Member

@hanjm hanjm commented Jul 25, 2021

Fix #4479

The http.Transport is not auto-tuning and one size does not seem to fit all cases.
Add HTTPConfig Allow to tune most of the http.Transport parameters and MaxIdleConnsPerHost tune to 100.

Signed-off-by: hanjm hanjinming@outlook.com

  • I added CHANGELOG entry for this change.
  • Change is not relevant to the end user.

Changes

add http_config for cos storage.

Verification

unit test .
redeploy thanos tools bucket web, no TIME_WAIT connection.

@hanjm hanjm changed the title Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT (#4479) Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT Jul 25, 2021
@hanjm hanjm changed the title Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT COS: Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT Jul 25, 2021
@hanjm hanjm changed the title COS: Fix cos client MaxIdleConnsPerHost too low, too many TIME_WAIT COS: Add http_config for cos object store client Jul 25, 2021
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch from 2a05db2 to f63c1c4 Compare July 25, 2021 03:27
hanjm added 3 commits July 25, 2021 11:30
…s-io#4479)

The http.Transport is not auto-tuning and one size does not seem to fit all cases.
Add `HTTPConfig` Allow to tune most of the http.Transport parameters and `MaxIdleConnsPerHost` tune to 100.

Signed-off-by: hanjm <hanjinming@outlook.com>
Signed-off-by: hanjm <hanjinming@outlook.com>
Signed-off-by: hanjm <hanjinming@outlook.com>
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch 3 times, most recently from e1b8520 to 49d1ca9 Compare July 25, 2021 04:27
Signed-off-by: hanjm <hanjinming@outlook.com>
@hanjm hanjm force-pushed the feature/optimize-cos-object-transport branch from 49d1ca9 to cca6bf3 Compare July 25, 2021 06:16
@hanjm
Copy link
Copy Markdown
Member Author

hanjm commented Jul 25, 2021

Hi @ jojohappy,could you help me review this PR if convenient,thank you.

Copy link
Copy Markdown
Member

@bwplotka bwplotka left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing, thanks 👍🏽

LGTM!

@bwplotka bwplotka merged commit 46ac4d5 into thanos-io:main Jul 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

COS objetstore client MaxIdleConnsPerHost too few

2 participants