Skip to content
This repository has been archived by the owner on Apr 22, 2020. It is now read-only.

Implement limit on tag cardinality of check results #108

Open
vibhory2j opened this issue Jan 3, 2019 · 0 comments
Open

Implement limit on tag cardinality of check results #108

vibhory2j opened this issue Jan 3, 2019 · 0 comments
Labels
chore technical debts, operational excellence, compliance and minor security topics, re-factoring needs Java

Comments

@vibhory2j
Copy link
Contributor

vibhory2j commented Jan 3, 2019

The underlying time series backend gets under pressure due to high cardinality on the tags (metadata that characterises the metrics) associated with check results. The current implementation processes unlimited number of tags and forwards them to the time series backend for storage.

Check results are provided to data-service at per entity level containing tags produced as per check definition. There are checks which produce large number of tags(key results) and sometimes with unique name every execution resulting in explosion in tag cardinality.

This issue is created to validate hypothesis and implement that the tags cardinality (and consequently pressure on time series backend) can be reduced significantly by putting a rate limit on tags processed in data-service layer.

vibhory2j pushed a commit that referenced this issue Jan 3, 2019
@vibhory2j vibhory2j changed the title Implement rate limit on tag cardinality of check results Implement limit on tag cardinality of check results Jan 4, 2019
@alexkorotkikh alexkorotkikh added chore technical debts, operational excellence, compliance and minor security topics, re-factoring needs Java labels May 14, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
chore technical debts, operational excellence, compliance and minor security topics, re-factoring needs Java
Projects
None yet
Development

No branches or pull requests

2 participants