Google-managed prometheus ingestion for metrics

[lstanczak]

Hello
Java applications need to be able to export metrics using manage prometheus interface:
https://cloud.google.com/stackdriver/docs/managed-prometheus

Similar solution is done for Go (and used in otel-collector)
https://github.com/GoogleCloudPlatform/opentelemetry-operations-go/tree/main/exporter/collector/googlemanagedprometheus

[aabmass]

For now, we don't plan to support this in individual language SDK exporters. There are a few other options you could try:

• Configure the OTel Java Prometheus exporter with Google Managed Prometheus agent scraping it
• Send OTLP to an OTel collector and use the googlemanagedprometheus exporter than you mentioned to send to Google Managed Prometheus

Would either of these work for your use case?

[lstanczak]

For now, we don't plan to support this in individual language SDK exporters. There are a few other options you could try:

• Configure the OTel Java Prometheus exporter with Google Managed Prometheus agent scraping it
• Send OTLP to an OTel collector and use the googlemanagedprometheus exporter than you mentioned to send to Google Managed Prometheus

Would either of these work for your use case?

It would be more efficient to integrate directly. Do you know if there is a documentation for this protocol/format?

[aabmass]

It would be more efficient to integrate directly.

Are you using GKE or GCE? It would be good to know some more details of your use case and what you mean by "efficient" here.

Do you know if there is a documentation for this protocol/format?

We don't publicly document the format and it could be subject to change. I don't think we would want to take on maintenance of such an exporter right now, but I'll leave this open as a feature request.

[evantorrie]

One use-case for wanting direct integration of exporter is when running as a Cloud Function. In that case, having to deploy an Otel Collector somewhere just in order to receive the OTLP metrics and then use the Collector to translate to googlemanagedprometheus seems somewhat contrary to the promise of "serverless" code.

It would probably be better if Google Monitoring just had a direct OTLP endpoint, rather than providing googlecloud or googlemanagedprometheus endpoints.

[psx95]

@evantorrie
Would something like #377 work for you in the meantime ? (As a workaround)

The example showcase exporting metrics from a Google Cloud Run Function (formerly known as Cloud Function) to Google Managed Prometheus using an OTel Collector.

Granted it still uses an OpenTelemetry Collector, but it leverages Cloud Run's multi-container support, so you don't need to manage a separate persistent server (GCE instance or something similar) constantly running that hosts a collector.