InitiaMonitor

InitiaMonitor: This tool is to monitor the status of the node/validator.

This tool is intended to monitor and alert on telegram any problem related to the cosmos node:

• Server down
• Out of memory (<10%)
• Out of disk space (<10%)
• Out of disk space within 24h
• High CPU load (>85%)

Cosmos-based validator alerts

• Missing blocks
• Degraded syncing (sync less than 40 blocks in last 5 min)
• Low peers count (<5)

Used containers from Docker

• grafana sever
• node_exporter
• prometheus
• alertmanager

Login Data http://<your_server_ip>:3000

• username: admin
• default password: admin

Coommands for run this monitoring tool:

1. Install Docker first

bash <(curl -s https://raw.githubusercontent.com/VuzzyM/InitiaMonitor/main/utils/install_docker.sh)

2. Clone the repo

cd ~
git clone https://github.com/VuzzyM/InitiaMonitor.git

3. Create configuration files from examples

cd monitoring-tool
cp prometheus/prometheus.yml.example prometheus/prometheus.yml
cp alertmanager/config.yml.example alertmanager/config.yml

4. Start containers

sudo docker compose up -d

How to set up

Servers to monitor

Add your servers with installed node_exporter or installed cosmos-based node with enabled prometheus port to file prometheus/prometheus.yml

  # example for servers with node_exporter installed
  - job_name: "my-servers"
    static_configs:
    - targets: ["172.0.0.1:9100"]
      labels:
        instance: "server1"
    - targets: ["172.0.0.2:9100"]
      labels:
        instance: "server2"
    
  # example for servers with node_exporter and cosmos-based node installed
  - job_name: "cosmos-validator-nodes"
    static_configs:
    - targets: ["192.0.0.1:9100","192.0.0.1:26660"]
      labels:
        instance: "validator1"
    - targets: ["192.0.0.2:9100","192.0.0.2:26660"]
      labels:
        instance: "validator2"
    - targets: ["192.0.0.3:9100","192.0.0.3:26660"]
      labels:
        instance: "validator3"

Don't forgot to turn on Prometheus metrics

sudo nano $HOME/.initia/config/app.toml

Telegram notifications

In order to enable telegram notifications, create your own bot and fill in the following fields in the file alertmanager/config.yml

chat_id=1111111                 # your telegram user id
bot_token=11111111:AAG_XXXXXXX  # your telegram bot token

You can see the metrics and graphs below

Server metrics

In the screenshots below are statistics about how much a server with the Initia validator consumes, from CPU, RAM, SSD etc

How to update

How to update the docker container

cd monitoring-tool
sudo docker compose down
git pull
sudo docker compose pull
sudo docker compose up -d

Thanks for the support received from the nodejumper team