-
Notifications
You must be signed in to change notification settings - Fork 2.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
query: add --grpc-compression for enabling compression #5654
Conversation
87df299
to
e74fa3a
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice 👍
Out of curiosity, how much was the throughput drop, and did you get a chance to observe any difference in query performance?
Network usage throughput has dropped by about 2x - from ~50MiB/s to ~25MiB/s. But my servers are not using much, to begin with, due to client-side caching in Rueidis. 😄 99p now sometimes even drops to 2-3 seconds whereas before it never dipped below 5s. |
e74fa3a
to
aff3dcb
Compare
Add a new `--grpc-compression` option that enables gRPC compression. Snappy works well - I've observed barely any increase in CPU/RAM usage and the network throughput dropped. Signed-off-by: Giedrius Statkevičius <[email protected]>
aff3dcb
to
b36ebcd
Compare
This is a nice improvement! Can you update the changelog as well? Thanks! |
…query Signed-off-by: Giedrius Statkevičius <[email protected]>
Signed-off-by: Giedrius Statkevičius <[email protected]>
Added, PTAL @yeya24 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Signed-off-by: Prakul Jain <[email protected]>
Add a new
--grpc-compression
option that enables gRPC compression.Snappy works well - I've observed barely any increase in CPU/RAM usage
and the network throughput dropped.
I have also tried zstd with default settings but it increased the
99p quite a bit. Perhaps we could investigate zstd more in the future.