-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
objstore: Add uploaded TSDB bytes metric #66
objstore: Add uploaded TSDB bytes metric #66
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Epic! Good start, some suggestions for the start (:
Approved CI, will try to fix setting so it allows you to use CI without approvals
I was separately working in exposing the fetched bytes as a histogram. Wonder if it makes sense to integrate both of our work into a single histogram: #69 |
Hi @simonswine, if I understood correctly, it seems that we are working on different subjects so perhaps we should keep our PRs separated. |
Merged your PR @simonswine. I think @simonswine has a good point. We have two options: A. Since we have both total fetched and distribution of fetched bytes per op, we could have similar for written bytes (total and later histogram in separate PR) I don't have strong opinion, I trust @simonswine you have good judgment here. Would you like to help @ritaCanavarro to get this contribution to mergable state? 🤗 |
Also, @ritaCanavarro you need to rebase now (: |
I am also okay with both options. And of course happy to help out @ritaCanavarro with this contribution. |
bc6cbbb
to
3e7f602
Compare
@bwplotka will work on the changes alongside @simonswine (thanks for the help!). |
7ac6c07
to
2230f4a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @ritaCanavarro for putting the hard work in. I think we have it working, just a few more clean-ups as per my other comments
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@ritaCanavarro thanks for looking into this, I another pass and I noticed a few little things, but I think it is time to get more eyes on this
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good from my side, thank you 🎖️
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Co-authored-by: Christian Simon <[email protected]> Signed-off-by: Rita Canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
Signed-off-by: rita.canavarro <[email protected]>
1f3f56f
to
d5dfb06
Compare
Signed-off-by: rita.canavarro <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@simonswine would you like to take another look before we merge this one?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes I think this LGTM 🚀
Changes
As suggested on thanos-io/thanos#6544 (review) the metric regarding the number of bytes the shipper has uploaded is best suited to be on the objstore. Therefore, this PR aims to add it to the objstore.go class.
Verification
I updated the TestTimingTracingReader test in objstore_test.go but I can add more tests if needed.
Thanks!