Prometheus + Grafana actually working

[cadorn]

Has anyone actually hooked up Grafana to Promtheus (both installed using cloudron)?

When I try and add the prometheus server I get CORS errors and it is preventing the page from redirecting (to authenticate I guess).

It says it needs a Access-Control-Allow-Origin header on the prometheus side to allow grafana hostname.

What is odd is that I have it set the access mode set to Server yet is it still trying to connect to it from the browser.

Any tips would be welcome. This would be great to get working.

[BrutalBirdie]

@cadorn Yes I do.

(alt: multiple screenshots showing grafana and prometheus hooked up in cloudron with data in a dashboard)

[andreasdueren]

@BrutalBirdie Nice! Would you mind sharing setup instructions for absolute grafana noobs? I tried to set things up but failed completely with the documentation.

[BrutalBirdie]

@andreasdueren well Grafana is only a view source, it does not provide any data it self.
I am collecting data from servers via prometheus and I am displaying this in grafana.

ps: up the retention_time in your /app/data/prometheus_variables.sh

#!/bin/bash

# https://prometheus.io/docs/prometheus/latest/storage/#operational-aspects
export retention_time="180d"

Default is 15 days which is... well useless for long term analytics.
https://prometheus.io/docs/prometheus/latest/storage/#operational-aspects

What exactly do you mean by setup instructions?
Building a dashboard? Adding Datasources?

[cadorn]

@BrutalBirdie Ah thanks! Got it working now.

The browser trying to connect threw me off. Once I supplied Basic Auth credentials it works!

[andreasdueren]

@BrutalBirdie Yes, adding data sources. I wasn't able to get prometheus integrated

[Jan Macenka]

just had the same issue and wanted to add something here as a documentation:

If both Grafana and Prometheus are running as a cloudron-app, you can add Prometheus as a data-source in Grafana by inputting http://<PROMETHEUS-SERVICE-UUID>:9090 in the URL-field where PROMETHEUS-SERVICE-UUID can be found form the prometheus container either by looking up its installation location in the Storage-Tab or by connecting via terminal and copying the hostname.

Cheers,
Jan

[jdaviescoates]

@Jan-Macenka said in Prometheus + Grafana actually working:

just had the same issue and wanted to add something here as a documentation:

If both Grafana and Prometheus are running as a cloudron-app, you can add Prometheus as a data-source in Grafana by inputting http://<PROMETHEUS-SERVICE-UUID>:9090 in the URL-field where PROMETHEUS-SERVICE-UUID can be found form the prometheus container either by looking up its installation location in the Storage-Tab or by connecting via terminal and copying the hostname.

Cheers,
Jan

@staff sounds like something that belongs in the docs

[lcd_official]

@BrutalBirdie said in Prometheus + Grafana actually working:

ps: up the retention_time in your /app/data/prometheus_variables.sh

#!/bin/bash

# https://prometheus.io/docs/prometheus/latest/storage/#operational-aspects
export retention_time="180d"

Default is 15 days which is... well useless for long term analytics.
https://prometheus.io/docs/prometheus/latest/storage/#operational-aspects

Just FYI, I noticed that /app/data/prometheus_variables.sh did not exist anymore - and in fact the app at startup will actually take prometheus_variables.sh if it DOES exist, and mv (replace) over /app/data/env.sh, which isn't good...

You can edit /app/data/env.sh itself though, and update the storage.tsdb.retention.time CLI option. Here is my env.sh for reference:

#!/bin/bash

# https://prometheus.io/docs/prometheus/latest/storage/#operational-aspects
# edit this variable to change startup options
export cli_options="--storage.tsdb.retention.time=180d --storage.tsdb.path=/app/data/storage"

Thanks

[girish]

@lcd_official indeed, prometheus_variables.sh is obsolete by now. Use env.sh instead.