Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Beyla looses K8s metadata after ~20m #1152

Closed
mariomac opened this issue Sep 10, 2024 · 3 comments · Fixed by #1156 or #1157
Closed

Beyla looses K8s metadata after ~20m #1152

mariomac opened this issue Sep 10, 2024 · 3 comments · Fixed by #1156 or #1157
Assignees

Comments

@mariomac
Copy link
Contributor

Observed at least in process and RED metrics. Beyla eventually stops reporting the kubernetes metadata of pods. None of the instrumented pods were restarted at that time.

Observed with:

  • Beyla 1.8
  • Prometheus exporter
  • Running Kind on Mac+Colima

Image

@mariomac mariomac self-assigned this Sep 10, 2024
@grcevski
Copy link
Contributor

Actually I noticed this as well, but I've only been able to reproduce it once. I had my laptop wake up from sleep and I had a running cluster with Beyla on, when I restarted the load generator to drive some traffic, all services came in with their executable names, like the k8s DB was empty. My guess is that somehow we lost a reference to the DB, it might've lost the internal maps or something like it.

@marevers
Copy link
Collaborator

Seen this exact behavior as well, since 1.8.0, the service_name label seems to revert to the executable name, in my case it would after some time display java everywhere.

@mariomac
Copy link
Contributor Author

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants