Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prometheus target dropped when using k8c.spec.cassandra.datacenters.datacenterName #1404

Open
Arun-Trichy opened this issue Sep 11, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@Arun-Trichy
Copy link

Arun-Trichy commented Sep 11, 2024

What happened?
When we override the k8c.spec.cassandra.datacenters.datacenterName also enabling telemetry for monitoring, Prometheus is dropping the target due to selector label mismatch.

Did you expect to see something different?
Prometheus should be able to monitor the cassandra instance even with datacenterName override.

How to reproduce it (as minimally and precisely as possible):
Enable telemetry & override the datacenterName

Environment

  • K8ssandra Operator version: v1.15.0
  • Kubernetes version information:
    Client Version: v1.28.3
    Kustomize Version: v5.0.4-0.20230601165947-6ce0bf390ce3
    Server Version: v1.29.1
  • Kubernetes cluster kind:
    kind cluster v1.29.1
  • Manifests:
apiVersion: k8ssandra.io/v1alpha1
kind: K8ssandraCluster
metadata:
  name: axone-dsecluster
spec:
  cassandra:
    config:
      cassandraYaml:
        ...
      dseYaml:
        ...
      jvmOptions:
        ...
    datacenters:
    - datacenterName: Cassandra
      metadata:
        name: dc1
      racks:
      - name: rack1
      resources:
        limits:
          memory: 40Gi
        requests:
          cpu: 3
          memory: 17.5Gi
      size: 1
      storageConfig:
        cassandraDataVolumeClaimSpec:
          accessModes:
          - ReadWriteOnce
          resources:
            requests:
              storage: 300Gi
    serverType: dse
    serverVersion: 6.8.47
    telemetry:
      cassandra:
        endpoint:
          address: 0.0.0.0
          port: "9000"
      mcac:
        enabled: false
      prometheus:
        enabled: true

Anything else we need to know?:
Selector used in SVC vs ServiceMonitor
image

Prometheus Target Empty
image

┆Issue is synchronized with this Jira Story by Unito
┆Issue Number: K8OP-252

@Arun-Trichy Arun-Trichy added the bug Something isn't working label Sep 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
No open projects
Status: No status
Development

No branches or pull requests

1 participant