Metrics exported with wrong name (keptn_app_count_total)

[thschue]

The metric 'keptn_app_count_total' seems to have naming issues, as it exists multiple times with '_total' appended every time. This leads to incorrect calculations in the dashboards.

keptn_app_count_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-left-leg",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.2.7"} 1
# HELP keptn_app_count_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total counter
keptn_app_count_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-right-arm",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.1.0"} 1
# HELP keptn_app_count_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total counter
keptn_app_count_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_app_namespace="podtato-kubectl",keptn_deployment_app_status="Succeeded",keptn_deployment_app_version="0.1.1"} 1
# HELP keptn_app_count_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total counter
keptn_app_count_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_app_namespace="podtato-kubectl",keptn_deployment_app_status="Succeeded",keptn_deployment_app_version="0.1.2"} 1
# HELP keptn_app_count_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_app_namespace="podtato-kubectl",keptn_deployment_app_status="Failed",keptn_deployment_app_version="0.1.0"} 1
# HELP keptn_app_count_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-entry",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.2.7"} 1
# HELP keptn_app_count_total_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-right-leg",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.2.7"} 1
# HELP keptn_app_count_total_total_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-left-arm",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.2.7"} 1
# HELP keptn_app_count_total_total_total_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_app_namespace="podtato-kubectl",keptn_deployment_app_status="Failed",keptn_deployment_app_version="0.1.4"} 1
# HELP keptn_app_count_total_total_total_total_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-hat",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.1.0"} 1
# HELP keptn_app_count_total_total_total_total_total_total_total_total_total_total_total a simple counter for Keptn Apps
# TYPE keptn_app_count_total_total_total_total_total_total_total_total_total_total_total counter
keptn_app_count_total_total_total_total_total_total_total_total_total_total_total{keptn_deployment_app_name="podtato-head",keptn_deployment_workload_name="podtato-head-podtato-head-hat",keptn_deployment_workload_namespace="podtato-kubectl",keptn_deployment_workload_status="Succeeded",keptn_deployment_workload_version="0.1.1"} 1

[odubajDT]

The problem is caused by OTel sdk, which was introduced here:
open-telemetry/opentelemetry-go@1d9d4b2

and afterwards fixed here:
open-telemetry/opentelemetry-go@ccbc38e

The fixed version is not released yet, so either we will wait for the bugfix release, or we use master version.

@bacherfl thx for finding the real cause of the problem :)

[odubajDT]

Putting this bug on hold, until the next release of OTel

[odubajDT]

Fixed via #447