Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

workload: tolerate special chars in histogram names #66491

Closed
tbg opened this issue Jun 15, 2021 · 2 comments
Closed

workload: tolerate special chars in histogram names #66491

tbg opened this issue Jun 15, 2021 · 2 comments
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.

Comments

@tbg
Copy link
Member

tbg commented Jun 15, 2021

Describe the problem

The histograms package will panic if a histogram contains characters that prometheus disallows in metrics names.

To Reproduce

https://cockroachlabs.slack.com/archives/CJ0H8Q97C/p1623776034188400

Expected behavior

We need to either gracefully reject such metric names or eliminiate the special chars under the hood.

Additional data / screenshots

Environment:

Additional context

Lost 5 days of roachtest

@tbg tbg added the C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. label Jun 15, 2021
tbg added a commit to tbg/cockroach that referenced this issue Jun 15, 2021
When we added prometheus histograms we did not realize that this method would
register a histogram containing special characters. This would break the
roachtest run; it hasn't been running for a few days.

This is a hotfix to get it back on its feet. Real fix is tracked in:
cockroachdb#66491

cc @cockroachdb/test-eng @cockroachdb/bulk-io

Release note: None
@tbg
Copy link
Member Author

tbg commented Jun 15, 2021

As part of fixing this, we also need to undo #66492 (comment).

craig bot pushed a commit that referenced this issue Jun 15, 2021
66492: roachtest: skip initBulkJobPerfArtifacts r=adityamaru a=tbg

When we added prometheus histograms we did not realize that this method would
register a histogram containing special characters. This would break the
roachtest run; it hasn't been running for a few days.

This is a hotfix to get it back on its feet. Real fix is tracked in:
#66491

cc @cockroachdb/test-eng @cockroachdb/bulk-io

Release note: None


Co-authored-by: Tobias Grieger <[email protected]>
@tbg
Copy link
Member Author

tbg commented Jun 30, 2021

We fixed this.

@tbg tbg closed this as completed Jun 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.
Projects
None yet
Development

No branches or pull requests

1 participant