Cloudron Forum

Hi @girish sorry for the delay.

I think -D does not necessarily impact performance, my test after removing -D was much quicker but after adding it again it was just as quick. Seems like there's some kind of filesystem caching. Maybe at some point I could analyse the differences but I suspect changing this doesn't impact performance so much.

The part that does impact performance a lot is the -x flag, but as far as I've seen, that will only prevent iteration on the remote (s3fs) filesystem if du is initiated on the parent dir, e.g. /mnt and not on the mount itself /mnt/s3fs.

Would be a lifesaver if you could add this, but understandable if it cannot be done. If it cannot be done, a workaround to exclude certain volumes from disk usage calculation would be fine too. Or maybe you could add an option to the Disk Usage UI: Offer an option to include/exclude certain volumes before actually executing calculation

@nebulon I think I'm seeing where it fails now. I have s3fs mounts set up and the Disk Usage Calculation seems to include these:

Jan 22 12:16:08 box:shell df: df -B1 --output=source,fstype,size,used,avail,pcent,target /mnt/[path_to_s3fs]

That will obviously fail (or at least take ages) because du will try to navigate my s3fs mounts.

Suggestion for a fix:

• Consider removing D because it slows things down a lot when there's lots of symlinks
• In case of mountpoints, instead of du -DsB1 /mnt/path you could du -DxB1 /mnt with some additional filtering/grouping, or just du -DxB1 /mnt | grep /mnt/path (less efficient obviously).

Hi @joseph,
I've tried:

• du -DB1 /srv/[redacted]: removed the s to see output, takes a while (it's a lot of symlinks) but it does complete
• du -B1 /srv/[redacted]: removed the D to no longer follow symlinks, much faster, same end result, does complete as well

Context: SSH session, logged in as root. Tried to log in as 'yellowtent' to retry using sudo but I got 'This account is currently not available.'

When I click the "Details" button under Server > Disk Usage it gets stuck at about 25%. The logs show it's hanging at the following line:

box:shell system: /usr/bin/sudo --non-interactive /home/yellowtent/box/src/scripts/du.sh /srv/[redacted]

This /srv/[redacted] directory is configured as a filesystem volume which contains various symlinks, of which:

1. products points to products_s3fs (this symlink is here as an 'entry point' so i can quickly switch to another target when necessary)
2. products_s3fs points to /media/path_to_s3fs
3. a lot of symlinks within subdirectories which point to paths relative to /app/data/public

I know s3fs isn't officially supported by Cloudron, but in theory du should simply skip/ignore these symlinks because they shouldn't resolve anywhere, as these paths only exist at app level. Maybe it gets stuck because of some recursion issue at the first symlink.

Maybe the solution is to simply never follow symlinks during disk usage calculation.

Any ideas? Thanks!

@girish thanks!

Hi,
My SFTPGo instance has blocked all access through the Web UI. I suspect a bot has been trying to access it and SFTPGo decided to block the local IP instead of the remote IP.

The web UI shows

{"error":"your IP address is blocked","message":""}

The logs show that the local IP 172.18.0.1 is being banned.

Hi @girish that's understandable, profiling is beyond what Cloudron is meant to do. However it would be useful if the charts would be more accurate.

Imagine this usecase: You have an install with 10 apps. Suddenly there's a lot of incoming traffic on one of these apps, slowing the entire machine down. If this happens, at least you'd want to be able to quickly identify the app which should be stopped.

Anyways, it's understandable that this doesn't get much priority given the amazing popularity on this thread

Hi, would it be possible to include the services/processes within the CPU Usage chart?

Some context. My chart is looking like this at the moment:

The blue line is shown as "CPU" while the other lines are apps.

If I open top from within the shell, I can see there are 3 processes which are utilizing a lot of CPU:

1. mysqld: After enabling performance_schema through these instructions (thanks by the way!), I've found out that one of my apps has inefficient queries. It would be very very helpful to me if this CPU load would be included as part of this specific app within the chart.
2. minio: Pretty much the same as what was happening with mysqld, I'd expect this CPU load to be included in my Minio app.
3. php: Pretty much the same as what was happening with mysqld, I'd expect this CPU load to be included in the apps that are running heavy PHP scripts.

What would be really cool, but I can imagine this to be too much work (maybe an idea for a separate app or something), would be the ability to enable some kind of debug mode to get more details on CPU usage, e.g. recent queries, recent file reads/writes, details on processes etc.

I hope this request makes sense Thanks!

@micmc Doesn't work unfortunately:

mysql> SET slow_query_log = 'ON';

ERROR 1229 (HY000): Variable 'slow_query_log' is a GLOBAL variable and should be set with SET GLOBAL

...meaning it has to be set as a global variable. Logging a single database isn't possible apparently. The app level user doesn't have access to set global variables:

mysql> SET GLOBAL slow_query_log = 'ON';
ERROR 1227 (42000): Access denied; you need (at least one of) the SUPER or SYSTEM_VARIABLES_ADMIN privilege(s) for this operation

@girish I tried to modify the variables using this approach but unfortunately MySQL doesn't log anything after doing this. Seems like these variables are overridden at the database level: If I open the 'Variables' section for my app database in Phpmyadmin the logging is disabled.

Is there any way to get root/admin access to the MySQL CLI? I'd like to try this approach: https://ma.ttias.be/mysql-slow-query-log-without-restart/

This approach would be much better because I want to enable logging on a single database, not on all of them.

@girish I'll try it out, thanks!

Any recommendations on how to enable mysql slow query logging?

Before using Cloudron I'd just temporarily elevate the MySQL user's permissions and set the global variables within a SQL query.

Is there any way to:

1. Get root access to temporarily elevate the MySQL user's permissions?
2. Set some variable somewhere? The variables I need to set are slow_query_log, log_queries_not_using_indexes and slow_query_log_file
3. Access the my.cnf?

Thanks!

Maybe one of these? https://phoenixnap.com/blog/docker-container-monitoring-tools

I'll look into Zabbix, thanks for the recommendation

Hi all,
I'd like to have more insight in how every app and service is performing. For example:

• Average response time for each app
• Whether an app is doing too many I/O operations (and/or swapping)
• Whether I should increase RAM on services such as MySQL
• Some API for error logging and reporting of async tasks

Some general dashboard with a notification system would be brilliant.

Any idea how to approach this without having to build it from scratch or using some expensive and overly complex cloud service?

Thanks!

Hi @nebulon, the usecase is that I want my dev environment on a remote VPS so I don't need to worry about backups or my laptop breaking all of a sudden. I need to be able to switch to another laptop with minimal effort.

Up until now I've got this working pretty well on a VPS but keeping it up to date and managing configurations is a pain. Cloudron seems to solve that.

Even though the CLI is very intuitive, the build service seems interesting, I'll look into that, thanks!

@brutalbirdie right, but you're running these commands from your local desktop right? In my case the "local desktop" would be an installed app. In theory the Cloudron CLI tool should work, but the warning in the docs made me doubt.

Hi,
While reading the docs for creating a Custom App I ran into the following warning:

The Cloudron CLI is intended to be installed on your PC/Mac and should NOT be installed on the Cloudron.

Some background regarding the problem I'm trying to solve: I want to create a Custom App based on the Docker image of coder.com. Within this environment I'll be developing applications. After each git push the idea is to do a docker build and docker push. At this point git and the Docker Registry are up to date.

The next step would be to 'push' these changes to Cloudron. To do this I have to execute cloudron push or cloudron update. Would this work considering that I'm working within a Cloudron app? Or would it be more recommended to do this step on a higher level or a different environment?

Does this flow make sense? Apologies if this is a dumb question

@girish it's been solved. I did a docker logout and tried again. Got the error again but this time the error was a bit more detailed. Tried it again and it worked.

Thanks!

Hi,
I'm running into an authentication error while installing Cloudron:

molivier@ubuntu:~/Downloads$ sudo ./cloudron-setup

##############################################
         Cloudron Setup (latest)
##############################################

 Follow setup logs in a second terminal with:
 $ tail -f /var/log/cloudron-setup.log

 Join us at https://forum.cloudron.io for any questions.

=> Updating apt and installing script dependencies
=> Checking version
=> Downloading version 6.1.2 ...
=> Installing base dependencies and downloading docker images (this takes some time) ...Init script failed. See /var/log/cloudron-setup.log for details

Log:

echo -e "\tPulling docker images: ${images}"
        Pulling docker images: cloudron/base:2.0.0@sha256:f9fea80513aa7c92fe2e7bf3978b54c8ac5222f47a9a32a7f8833edf0eb5a4f4 cloudron/turn:1.2.0@sha256:4359aae80050a92bae3be30600fb93ef4dbaec6dc9254bda353c0>
for image in ${images}; do
    docker pull "${image}"
    docker pull "${image%@sha256:*}" # this will tag the image for readability
done
Error response from daemon: unauthorized: authentication required

Seems like the init script runs into an authentication error here, but I can't seem to find out which docker image is throwing authentication errors https://git.cloudron.io/cloudron/box/blob/5a7e636f2d5fee2c3c5bec166e61ab4bcaa41531/baseimage/initializeBaseUbuntuImage.sh#L89

Am I doing something wrong?

Thanks!