Investigate deployment and cronjob enrichement

[gizas]

Since v0.6.4 of elastic-agent-autodiscover is merged (see PR), this means that 2nd level ancestor of pods when they are created from deployments or cronjobs is no more created by default.

The flow is:
Deployment -> Replicaset > pod
Cronjob -> Job > pod

So although job and replicaset name is enriched in pods, the deployment and cronjob no more.

• Enhance code and see if you can strip suffixes from replicasets and jobs and create the deployment/cronjob name

• Investigate https://www.elastic.co/guide/en/fleet/8.10/data-streams-pipeline-tutorial.html

• Relates #[Kubernetes Module] Add missing metrics for replicaset and pod owners beats#36746

[gizas]

Ingest pipeline that tested 👍

Login to Kibana Console:

POST _ingest/pipeline/_simulate
{
  "pipeline": {
    "processors": [
      {"gsub": {
          "field": "kubernetes.replicaset.name",
          "pattern": "(?:.(?!-))+$",
          "replacement": "",
          "target_field": "kubernetes.deployment",
          "ignore_failure": true,
          "ignore_missing": true
      }
      } 
      ]
  }, 
  "docs": [
    {
    "_id": "-NYBC4kBqzI6pGDGasKv",
    "_index": ".ds-metrics-kuberntes.state_pod-2023.06.29-000013",
      "_source": {
    "kubernetes": {
        "replicaset": { "name": "pasole-3456-1234-567890789"},
        "node": {
            "uid": "57ccd748-c877-4be9-9b0e-568e9f205025",
            "hostname": "kind-control-plane",
            "name": "kind-control-plane",
            "labels": {
                "node_kubernetes_io/exclude-from-external-load-balancers": "",
                "node-role_kubernetes_io/master": "",
                "kubernetes_io/hostname": "kind-control-plane",
                "node-role_kubernetes_io/control-plane": "",
                "beta_kubernetes_io/os": "linux",
                "kubernetes_io/arch": "amd64",
                "kubernetes_io/os": "linux",
                "beta_kubernetes_io/arch": "amd64"
            }}}
  }
      
    }
    ]
}

Output:

{
  "docs": [
    {
      "doc": {
        "_index": ".ds-metrics-kuberntes.state_pod-2023.06.29-000013",
        "_id": "-NYBC4kBqzI6pGDGasKv",
        "_version": "-3",
        "_source": {
          "kubernetes": {
            "node": {
              "uid": "57ccd748-c877-4be9-9b0e-568e9f205025",
              "hostname": "kind-control-plane",
              "name": "kind-control-plane",
            ....
            },
            "replicaset": {
              "name": "pasole-3456-1234-567890789"
            },
            "deployment": "pasole-3456-1234"
          }
        },