Set default send_batch_max_size on k8s cluster receiver #717
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dmitryax
force-pushed
the
set-send_batch_max_size-default
branch
from
8e341cb to
6cc0884
Compare
Big k8s clusters with many pods cause k8s cluster receiver to fetch metrics batches with huge number of datapoints that are timing to be sent on signalfx exporter. This change introduces maximum limit of datapoints that one metrics batch can contain. batches with more than 64k datapoints will be broken in several batches
dmitryax
force-pushed
the
set-send_batch_max_size-default
branch
from
6cc0884 to
d380b76
Compare
rmfitzpatrick
approved these changes
Apr 3, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Big k8s clusters with many pods cause the k8s cluster receiver to fetch metrics batches with many data points which leads to timeouts on signalfx exporter.
This change introduces a maximum limit of data points that one metrics batch can contain. Batches with more than 32k data points will be broken down in several batches.
Resolves #716