Remote secret rejected data upload metric

[mshaposhnik]

What does this PR do?

PR adds metrics for the failed upload data operations, with the operation name and failure reason labels, so the counterscan be filtered/ordered by them.

Screenshot/screencast of this PR

What issues does this PR fix or reference?

https://issues.redhat.com/browse/SVPI-575

How to test this PR?

1. Need to setup minikube with moniroting (PR is on the way)
2. Try to upload data with some error condidion (like duplicate field, or bad source secret etc)
   (can use the remote-secret-conflicting-targets sample or example below )

apiVersion: appstudio.redhat.com/v1beta1
kind: RemoteSecret
metadata:
  name: myrs1
  namespace: target-namespace
spec:
  secret:
    generateName: copied-
dataFrom:
  name: non-existent-secret
  namespace: default

3. Verify counter incremented with correct labels

[openshift-ci]

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

[metlos]

Generally looks good with the nitpick of maybe precreating the differently labeled counters and incrementing. Not sure if that's even worth the trouble though, because it means saving a couple of allocations only in the error cases of which there should be few.

[mshaposhnik]

/retest

[mshaposhnik]

/retest

[skabashnyuk]

The code is working for me.
Checked

• redhat_appstudio_remotesecret_data_upload_rejected_total{operation="webhook_validate",reason="unique_targets_check_failed"}
• redhat_appstudio_remotesecret_data_upload_rejected_total{operation="secret_data_upload",reason="invalid_upload_secret"}

Documentation

Let's think about some documentation before the merge. For example docs/Monitoring.md

Mertric	Description
redhat_appstudio_remotesecret_data_upload_rejected_total{operation="webhook_validate",reason="unique_targets_check_failed"}`	This is ...

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: mshaposhnik, skabashnyuk

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [mshaposhnik,skabashnyuk]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment