Grafana Loki

[doodlemania2]

Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.

https://grafana.com/oss/loki/
https://github.com/grafana/loki

Initial functional version located here for comment: https://git.cloudron.io/doodlemania2/loki

[olearycrew]

@doodlemania2 FWIW here's another implementation of it. Wish I had seen your post first

https://gitlab.com/liscioapps/loki-cloudron

[robi]

@olearycrew
If this is ready for testing.. it may be ready for @staff to add to the store..

[doodlemania2]

@robi I've been using it as posted for over a year works like a champ.

[girish]

@doodlemania2 does the app have any UI? After login, it simply says "not found" . Is that expected?

[girish]

I get the same behavior with @olearycrew 's repo as well.

[doodlemania2]

@girish correct - no UX at all - just an open port.
For the official version, you could easily add a static page that shows it is up and running and instructions on how to get at it.

[girish]

@doodlemania2 Do you know how to put a place holder page? As in, is it something upstream Loki supports or we have to put some nginx proxy of sorts in the package?

[doodlemania2]

@girish figured it would be just like we did with the vpn package, nothing upstream really.

[olearycrew]

@doodlemania2

I also got Promtail which is part of this stack working as well: https://gitlab.com/liscioapps/promtail-cloudron.

Also yes, it's really a service that is used as part of a stack with Grafana and Prometheus.

Similar to the "ELK" stack where logstash (promtail) pushes to Elasticsearch (Loki) but it's all actually visualized in Kibana (Grafana). That's not an exact map but sort of that way.

[AyoubHabra]

Hi @doodlemania2 ,
Thanks for this package;
Actually, I'm trying to set up this, but the authentication is not working with the default vhost added by cloudron. I'm receiving 301 error. (moved permanently)
On the other hand, I have set up a custom vhost (simple) and it's working correctly. Have you applied any changes to the vhost on your setup?

[AyoubHabra]

Hi @doodlemania2,
Thanks for the package,
I'm trying to set up this, but it's not working for me with the default vhost added by cloudron.
However it's working with a simple vhsot with basic http_auth, in your case did you applied any changes to the reverse proxy conf ?
myvhost : https://privatebin.wpprovider.nl/?4dcc2cf01ed14692#DSVsPUfCmTv2oxE93CyykLw4H4kkDx3BpfzGT5gnhCKP
cloudronvhost : https://privatebin.wpprovider.nl/?ea0a92aeb57d6c8e#Eo4ffmb3qg6VqLbCFktBpqe6ju23DnnHXGeBXXbjsAEB
Thanks.

[doodlemania2]

@AyoubHabra Apologies for the delay - somehow I missed the alert on this. I've not changed anything to permit/reject traffic - not sure why it works for me but not you That said, I haven't tried to formally package it for the ecosystem due to lack of interest, but will take a peak and see if I can figure out why it's not working for you.

[TomsFreitas]

@doodlemania2 Hello, do you have any plans to add authentication to this app?

[doodlemania2]

@TomsFreitas haven't had the need what's the scenario?

[TomsFreitas]

@doodlemania2 I have several servers that need to push logs to loki so it must be exposed to the internet and I wanted it to be secure. Protecting it with cloudron auth would make it so that loki could be exposed and not have to worry about someone fetching all my logs using loki's API

[girish]

How do servers send their logs to Loki? With a token? Wouldn't putting basic auth affect the API?

[TomsFreitas]

@girish Well, the most used setup with Loki is using it with promtail. Promtail resides in your agents and it pushes the logs to loki. Grafana then fetches the logs from loki. It's my understanding that both promtail and grafana support basic auth when interacting with loki

[doodlemania2]

@TomsFreitas yeah, i think that's right - I've never done it because it's always just been me pushing to it from a tailscale endpoint but I can see the value there.

@girish - I think the best approach would be to leave it open (but behind SSL) and let Loki handle the auth.

No?

[girish]

@doodlemania2 agree, but apparently loki doesn't have any auth of it's own - https://grafana.com/docs/loki/latest/operations/authentication/ . I guess this is why @TomsFreitas wants Cloudron to provide the auth.