Prometheus and Grafana, Part 2

The Prometheus.yml:

# my global config
global:
scrape_interval: 15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.

scrape_…


This content originally appeared on DEV Community and was authored by muckitymuck

The Prometheus.yml:

# my global config
global:
  scrape_interval:     15s # Set the scrape interval to every 15 seconds. Default is every 1 minute.
  evaluation_interval: 15s # Evaluate rules every 15 seconds. The default is every 1 minute.

scrape_configs:
  # The job name is added as a label `job=<job_name>` to any timeseries scraped from this config.
  - job_name: 'prometheus'

    # metrics_path defaults to '/metrics'
    # scheme defaults to 'http'.

    static_configs:
      - targets: ['localhost:9090']

  - job_name: 'node-exporter'

    # Override the global default and scrape targets from this job every 5 seconds.
    scrape_interval: 5s
    metrics_path: /metrics

    static_configs:
      - targets:
        - <PUBLIC IP>:9100

This is a good starting place for a monitoring system for Linux boxes

Running the services in docker is also advised as it simplifies the rollout.

Docker node exporter:

sudo docker run --restart always -d --net="host" --pid="host"  -v "/:/host:ro,rslave"  prom/node-exporter:latest  --path.rootfs=/host

Docker prometheus:

sudo docker service create --replicas 1 --name dockerprometheus     --mount type=bind,source=/home/ubuntu/prometheus/prometheus.yml,destination=/etc/prometheus/prometheus.yml     --publish published=9090,target=9090,protocol=tcp     prom/prometheus

When you get around to making panels in Grafana, these queries are very useful:

100 - ((node_filesystem_avail_bytes{mountpoint="/",fstype!="rootfs"} * 100) /            node_filesystem_size_bytes{mountpoint="/",fstype!="rootfs"})
node_filesystem_avail_bytes

OR you could just setup a template for Node Exporter:
To import a new dashboard for Node Exporter, go to Dashboards -> Manage
Image description

Enter 405 for the Grafana ID.
Image description

Pick up the name and choose a Data Source for the dashboard.
Image description

To make an alert, start a NEW dashboard and NEW panel. Template dashboards like above will not work.

Enter the query for the item you want to track and press the Alert tab.
That should do it for a basic monitoring service.


This content originally appeared on DEV Community and was authored by muckitymuck


Print Share Comment Cite Upload Translate Updates
APA

muckitymuck | Sciencx (2021-11-22T20:13:46+00:00) Prometheus and Grafana, Part 2. Retrieved from https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/

MLA
" » Prometheus and Grafana, Part 2." muckitymuck | Sciencx - Monday November 22, 2021, https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/
HARVARD
muckitymuck | Sciencx Monday November 22, 2021 » Prometheus and Grafana, Part 2., viewed ,<https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/>
VANCOUVER
muckitymuck | Sciencx - » Prometheus and Grafana, Part 2. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/
CHICAGO
" » Prometheus and Grafana, Part 2." muckitymuck | Sciencx - Accessed . https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/
IEEE
" » Prometheus and Grafana, Part 2." muckitymuck | Sciencx [Online]. Available: https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/. [Accessed: ]
rf:citation
» Prometheus and Grafana, Part 2 | muckitymuck | Sciencx | https://www.scien.cx/2021/11/22/prometheus-and-grafana-part-2/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.