What port do Prometheus listen on, for Grafana to connect?

[stoccafisso]

Hmm....Grafana seems not to pick up on the new sources. And I cant find any refresh/reload button in Grafana. Any advice?

[james]

@stoccafisso when changing config files inside an app, it is always a good idea to restart the app.
Did you do that?

[stoccafisso]

Yes, restarted both after updating "Status - Service discovery" in Prometheus. Even deleted the "prometheus" in Grafana and loaded a new one. It did not pick up on the new services in Prometheus

[stoccafisso]

As you see, I have two new endpoints recogniced by Prometheus, but Grafana will not pick up that information

[stoccafisso]

[james]

Can you push the metrics to the demo instance as well so I can take a look?

[james]

Also, inside Grafana, for the Prometheus Data source.
There is a pre-made dashboard for Prometheus:

Import it, and please view it so see, if you get any data at all.

[stoccafisso]

I did a brutal problemsolving hack, deleted Grafana and reinstalled it. Now it works.

I think it may have been the "Node Exporter Full" dashboard that was holding the old config in cache, I may have solved it just by deleting the Node Exporter Full and then reinstalled it.

[stoccafisso]

@james How do I do that? And is it needed? I have solved the problem?

[james]

@stoccafisso no, that is no longer needed since you have solved your issue.

[stoccafisso]

@james and @joseph Thanks for helping

[jadudm]

For anyone doing a setup on Cloudron, I found my way here. I was specifically trying to set up monitoring of a Minio instance on my installation.

1. Install Prometheus normally. No special configuration is needed.
2. When you do mc admin prometheus generate ALIAS, you will need to make sure you set that alias up as having enough permissions to actually read everything. Using an alias that has limited access controls (e.g. read-only on a single bucket) will not work; Prometheus will not be able to query the Minio API.
3. Once Prometheus has a positive health check on the Minio instance, you can then set up Grafana. Install normally.
4. When you add Prometheus as a data source, per above, just use the HTTPS URL of the Prometheus installation on Cloudron. No port is needed.
5. The user must be a valid cloudron user. You might want to create a new cloudron user called "prom-graf" or similar, and only give that user permission to access Prometheus. This is just to isolate the access from (say) a standard account you use for all your other tasks/work. Add that username and password in the "basic auth" section.

At this point, you can add some dashboards. I used the "import" option, and copy-pasted JSON from these dashboards:

https://grafana.com/grafana/dashboards/13502-minio-dashboard/

At that point, I had dashboards living for my Minio installation.

I have no idea yet what log volume will look like, or rotation, or... or... but, I might update this thread (or start another) later as I discover those things. I found myself having to dig around for this information/experiment. Perhaps I just didn't read the correct docs.