New Monitoring

New Roles

DeepSea now knows the prometheus and grafana roles and deploys the monitoring stack accordingly. This allows for e.g. multiple prometheus instances for an HA setup.

There is also code to remove Prometheus and Grafana from nodes that do not have the respective roles. If you have a Prometheus/Grafana installation that is managed outside of DeepSea on DeepSea minions, make sure to add rescind-prometheus (or -grafana) to your pillar, otherwise DeepSea will remove your installation.

Pillar variables

Default pillar available to all nodes. Either alter this in /srv/pillar/ceph/stack/global.yml to globally (all prometheus nodes) overwrite individual keys or alter /srv/pillar/ceph/stack/<cluster_name>/minions/<host> if specific minion configs should be altered.

monitoring:
  prometheus:
    rule_files: []
    scrape_interval:
      ceph: 10
      node: 10
      prometheus: 10
      grafana: 10
    relabel_config:
      ceph: ''
      node: ''
      prometheus: ''
      grafana: ''
    metric_relabel_config:
      ceph: ''
      node: ''
      prometheus: ''
      grafana: ''