Cloudron Forum

@joseph I like the idea of delegating mail to Cloudron entirely and being able to switch mail providers / mail configuration / rotate tokens easily from within the Cloudron UI, so I don't have to edit my own config files / manage SDKs etc.

Keeps my apps simple: Just send mail using the envvars and let Cloudron figure it out. The event log is nice too, for monitoring.

The setting you mentioned would definitely help a lot, but I have a workable solution now, thanks!

@joseph said:

@mmolivier I think the mail relay token does what you want. All you have to do is create a token and this give you permission to send email as whatever you want for that domain (just like mailjet/sendgrid tokens work). Fix your setup to use relay@yourdomain.com as username and the token as the password. You can then send any email as anyone@yourdomain.com .

Just to ensure that we're talking about the same problem and same fix.

Old behaviour:

• App sends mail from noreply@domain.com, Email tab of the app is set to noreply@domain.com > Email is accepted and sent based on config of domain.com (which is set to Outbound only, SendGrid)
• App sends mail from noreply2@domain.com, Email tab of the app is set to noreply@domain.com > Email is accepted and sent based on config of domain.com (which is set to Outbound only, SendGrid)
• App sends mail from noreply@otherdomain.com, Email tab of the app is set to noreply@domain.com > Email is accepted and sent based on config of otherdomain.com (which is set to Outbound only, SendGrid)

Behaviour since last night:

• App sends mail from noreply@domain.com, Email tab of the app is set to noreply@domain.com > Email is accepted and sent based on config of domain.com (which is set to Outbound only, SendGrid)
• App sends mail from noreply2@domain.com, Email tab of the app is set to noreply@domain.com > Email is denied because Cloudron allows mails from noreply@domain.com only
• App sends mail from noreply@otherdomain.com, Email tab of the app is set to noreply@domain.com > Email is denied because Cloudron allows mails from noreply@domain.com only

Given this example, your suggested fix is:

• App sends mail from noreply2@domain.com, Email tab of the app is set to noreply@domain.com > Email is denied because Cloudron allows mails from noreply@domain.com only

  To fix this, I should add a "SMTP Relay" token on domain.com, make sure the app authenticates with relay@domain.com and [token of domain.com]

• App sends mail from noreply@otherdomain.com, Email tab of the app is set to noreply@domain.com > Email is denied because Cloudron allows mails from noreply@domain.com only

  To fix this, I should add a "SMTP Relay" token on otherdomain.com, make sure the app authenticates with relay@otherdomain.com and [token of otherdomain.com]

Did I interpret it correctly?

@joseph hi, the apps are based on a fork of the lamp app (I already updated the base image) so that shouldn't be too relevant, if you want I can give you access of course.

Behaviour before the update: App was capable of sending all emails, from different senders of different domains

Behaviour after the update: App runs into the "Connection denied. Authenticated user [mail address configured on the email tab, which i ignore] cannot send mail as [from address specified from within the app]"

The quickest workaround is to align the mail address configured on the app email tab with the from addresses used, but some apps send mails from other addresses (even from other domains in some cases). The domains are all configured within Cloudron. Mails are never sent from an email unknown to Cloudron.

The domains are configured like this

As far as I understand, Cloudron is being too strict here. Mailjet and SendGrid handle everything just fine.

I'd like to be able to turn off this restriction or at least be able to configure accepted mailaddresses somewhere. I can't find neither of those two options.

@joseph I don't work with mailboxes, all mail is relayed through external providers (in case of given example SendGrid)

FWIW, the error message. This one sends mails from different sender domains. I need to be able to turn off this validation.

Hi @james tried that one already, but it didn't work unfortunately. I don't work with aliases, all email is relayed through external providers.

Since the last update I'm getting errors because the sender mails don't exactly match the sender mail configured under the Email tab.

According to https://docs.cloudron.io/email/#disable-from-address-validation there should be an option 'Allow custom from address' but that option is no longer available.

How to restore this feature / add a workaround for this as soon as possible?

Hi @girish sorry for the delay.

I think -D does not necessarily impact performance, my test after removing -D was much quicker but after adding it again it was just as quick. Seems like there's some kind of filesystem caching. Maybe at some point I could analyse the differences but I suspect changing this doesn't impact performance so much.

The part that does impact performance a lot is the -x flag, but as far as I've seen, that will only prevent iteration on the remote (s3fs) filesystem if du is initiated on the parent dir, e.g. /mnt and not on the mount itself /mnt/s3fs.

Would be a lifesaver if you could add this, but understandable if it cannot be done. If it cannot be done, a workaround to exclude certain volumes from disk usage calculation would be fine too. Or maybe you could add an option to the Disk Usage UI: Offer an option to include/exclude certain volumes before actually executing calculation

@nebulon I think I'm seeing where it fails now. I have s3fs mounts set up and the Disk Usage Calculation seems to include these:

Jan 22 12:16:08 box:shell df: df -B1 --output=source,fstype,size,used,avail,pcent,target /mnt/[path_to_s3fs]

That will obviously fail (or at least take ages) because du will try to navigate my s3fs mounts.

Suggestion for a fix:

• Consider removing D because it slows things down a lot when there's lots of symlinks
• In case of mountpoints, instead of du -DsB1 /mnt/path you could du -DxB1 /mnt with some additional filtering/grouping, or just du -DxB1 /mnt | grep /mnt/path (less efficient obviously).

Hi @joseph,
I've tried:

• du -DB1 /srv/[redacted]: removed the s to see output, takes a while (it's a lot of symlinks) but it does complete
• du -B1 /srv/[redacted]: removed the D to no longer follow symlinks, much faster, same end result, does complete as well

Context: SSH session, logged in as root. Tried to log in as 'yellowtent' to retry using sudo but I got 'This account is currently not available.'

When I click the "Details" button under Server > Disk Usage it gets stuck at about 25%. The logs show it's hanging at the following line:

box:shell system: /usr/bin/sudo --non-interactive /home/yellowtent/box/src/scripts/du.sh /srv/[redacted]

This /srv/[redacted] directory is configured as a filesystem volume which contains various symlinks, of which:

1. products points to products_s3fs (this symlink is here as an 'entry point' so i can quickly switch to another target when necessary)
2. products_s3fs points to /media/path_to_s3fs
3. a lot of symlinks within subdirectories which point to paths relative to /app/data/public

I know s3fs isn't officially supported by Cloudron, but in theory du should simply skip/ignore these symlinks because they shouldn't resolve anywhere, as these paths only exist at app level. Maybe it gets stuck because of some recursion issue at the first symlink.

Maybe the solution is to simply never follow symlinks during disk usage calculation.

Any ideas? Thanks!

@girish thanks!

Hi,
My SFTPGo instance has blocked all access through the Web UI. I suspect a bot has been trying to access it and SFTPGo decided to block the local IP instead of the remote IP.

The web UI shows

{"error":"your IP address is blocked","message":""}

The logs show that the local IP 172.18.0.1 is being banned.

Hi @girish that's understandable, profiling is beyond what Cloudron is meant to do. However it would be useful if the charts would be more accurate.

Imagine this usecase: You have an install with 10 apps. Suddenly there's a lot of incoming traffic on one of these apps, slowing the entire machine down. If this happens, at least you'd want to be able to quickly identify the app which should be stopped.

Anyways, it's understandable that this doesn't get much priority given the amazing popularity on this thread

Hi, would it be possible to include the services/processes within the CPU Usage chart?

Some context. My chart is looking like this at the moment:

The blue line is shown as "CPU" while the other lines are apps.

If I open top from within the shell, I can see there are 3 processes which are utilizing a lot of CPU:

1. mysqld: After enabling performance_schema through these instructions (thanks by the way!), I've found out that one of my apps has inefficient queries. It would be very very helpful to me if this CPU load would be included as part of this specific app within the chart.
2. minio: Pretty much the same as what was happening with mysqld, I'd expect this CPU load to be included in my Minio app.
3. php: Pretty much the same as what was happening with mysqld, I'd expect this CPU load to be included in the apps that are running heavy PHP scripts.

What would be really cool, but I can imagine this to be too much work (maybe an idea for a separate app or something), would be the ability to enable some kind of debug mode to get more details on CPU usage, e.g. recent queries, recent file reads/writes, details on processes etc.

I hope this request makes sense Thanks!

@micmc Doesn't work unfortunately:

mysql> SET slow_query_log = 'ON';

ERROR 1229 (HY000): Variable 'slow_query_log' is a GLOBAL variable and should be set with SET GLOBAL

...meaning it has to be set as a global variable. Logging a single database isn't possible apparently. The app level user doesn't have access to set global variables:

mysql> SET GLOBAL slow_query_log = 'ON';
ERROR 1227 (42000): Access denied; you need (at least one of) the SUPER or SYSTEM_VARIABLES_ADMIN privilege(s) for this operation

@girish I tried to modify the variables using this approach but unfortunately MySQL doesn't log anything after doing this. Seems like these variables are overridden at the database level: If I open the 'Variables' section for my app database in Phpmyadmin the logging is disabled.

Is there any way to get root/admin access to the MySQL CLI? I'd like to try this approach: https://ma.ttias.be/mysql-slow-query-log-without-restart/

This approach would be much better because I want to enable logging on a single database, not on all of them.

@girish I'll try it out, thanks!

Any recommendations on how to enable mysql slow query logging?

Before using Cloudron I'd just temporarily elevate the MySQL user's permissions and set the global variables within a SQL query.

Is there any way to:

1. Get root access to temporarily elevate the MySQL user's permissions?
2. Set some variable somewhere? The variables I need to set are slow_query_log, log_queries_not_using_indexes and slow_query_log_file
3. Access the my.cnf?

Thanks!

Maybe one of these? https://phoenixnap.com/blog/docker-container-monitoring-tools

I'll look into Zabbix, thanks for the recommendation