-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add memory metrics into compute googlecloud #18802
Conversation
Pinging @elastic/integrations-platforms (Team:Platforms) |
💔 Build FailedExpand to view the summary
Build stats
Test stats 🧪
Steps errorsExpand to view the steps failures
Log outputExpand to view the last 100 lines of log output
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
- `instance_name`: The name of the VM instance. | ||
|
||
* `instance.memory.balloon.swap_out_bytes_count`: The amount of memory written from the guest to its own swap space. This metric is only available for VMs that belong to the e2 family. | ||
- `instance_name`: The name of the VM instance. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How are you generating this list of metrics? I find it a bit redundant with metricbeat/docs/fields.asciidoc
. If we feel the need of having the metrics descriptions in two places maybe we have to rethink how we generate these docs.
In any case they should be auto-generated from the fields.yml
files, so we only have to maintain the descriptions in one place.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm manually copying these fields in here so it can be displayed on individual metricset doc: https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-metricset-googlecloud-compute.html
Good point! I shouldn't have to copy paste these descriptions twice and maintain in two different places. Maybe in the doc, I should just display x-pack/metricbeat/module/googlecloud/compute/_meta/fields.yml
instead?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is already a link to exported fields in the metricset docs.
But the one for this module seems quite empty: https://www.elastic.co/guide/en/beats/metricbeat/current/exported-fields-googlecloud.html
We will have to review this. If we think that the fields should appear directly in the metricset docs page, we should generate them automatically there. If we want to continue using the separated page we will have to check why the fields of this module doesn't appear there.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is an old issue discussing about fields descriptions in docs: #9288
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you! I will create a separate PR to fix the exported fields
section.
- `instance_name`: The name of the VM instance. | ||
|
||
* `instance.memory.balloon.swap_in_bytes_count`: The amount of memory read into the guest from its own swap space. This metric is only available for VMs that belong to the e2 family. | ||
- `instance_name`: The name of the VM instance. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this instance_name
repeated in all metrics?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
instance_name
is label that comes with these metrics, like a default dimension in gcp.
- "compute.googleapis.com/instance/network/received_bytes_count" | ||
- "compute.googleapis.com/instance/network/received_packets_count" | ||
- "compute.googleapis.com/instance/network/sent_bytes_count" | ||
- "compute.googleapis.com/instance/network/sent_packets_count" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
Oh, btw, before merging please remember to add a changelog entry. |
Failure in CI can be ignored, it is related to #18741 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM! We can leave by now the discussions about fields descriptions.
…ric into compute googlecloud (#18834)
…-stage-level * upstream/master: (30 commits) Add a GRPC listener service for Agent (elastic#18827) Disable host.* fields by default for iptables module (elastic#18756) [WIP] Clarify capabilities of the Filebeat auditd module (elastic#17068) fix: rename file and remove extra separator (elastic#18881) ci: enable JJBB (elastic#18812) Disable host.* fields by default for Checkpoint module (elastic#18754) Disable host.* fields by default for Cisco module (elastic#18753) Update latest.yml testing env to 7.7.0 (elastic#18535) Upgrade k8s.io/client-go and k8s keystore tests (elastic#18817) Add missing Jenkins stages for Auditbeat (elastic#18835) [Elastic Log Driver] Create a config shim between libbeat and the user (elastic#18605) Use indexers and matchers in config when defaults are enabled (elastic#18818) Fix panic on `metricbeat test modules` (elastic#18797) [CI] Fix permissions in MacOSX agents (elastic#18847) [Ingest Manager] When not port are specified and the https is used fallback to 443 (elastic#18844) [Ingest Manager] Fix install service script for windows (elastic#18814) [Metricbeat] Fix getting compute instance metadata with partial zone/region config (elastic#18757) Improve error messages in s3 input (elastic#18824) Add memory metrics into compute googlecloud (elastic#18802) include bucket name when logging error (elastic#18679) ...
…unt metric into compute googlecloud (elastic#18834)
This PR is to add 4 memory metrics(only for e2 family VMs) into googlecloud compute metricset and also added the missing
network.sent_packets_count
metric.