my.cloudron.tld is not accessible

[joesitsolutions]

First regarding

/home/yellowtent/box/src/scripts/restartservice.sh: line 20: BOX_ENV: unbound variable`

please to not run shell scripts like that directly, the start.sh is a bit special but otherwise it may be risky to run them directly as mostly they are only tested to be run from other code or scripts. Maybe we can add safeguard checks early on to avoid this.

Regarding the main issue, looks like fro both cases collectd does not start, this may be caused by outdated or broken config files.

For a start, can you check journalctl -u collectd and the main log file at /home/yellowtent/platformdata/logs/collectd/collectd.log?

Sorry, wasn't aware of not running those shell scripts but definitely something to take a note of.
journalctl -u collectd
Output:

root@cloudron:~# journalctl -u collectd
-- Logs begin at Sun 2022-03-13 06:27:27 UTC, end at Sun 2022-03-13 09:27:33 UTC. --
-- No entries --
root@cloudron:~# systemctl status collectd
● collectd.service - Statistics collection and monitoring daemon
     Loaded: loaded (/lib/systemd/system/collectd.service; enabled; vendor preset: enabled)
     Active: inactive (dead)
       Docs: man:collectd(1)
             man:collectd.conf(5)
             https://collectd.org
root@cloudron:~#

Contents of "/home/yellowtent/platformdata/logs/collectd/collectd.log"
(might be very long)

[done in pastebin due to size]
Pastebin link

Also I attempted to start it manually as a test.

root@cloudron:~# journalctl -u collectd
-- Logs begin at Sun 2022-03-13 06:27:27 UTC, end at Sun 2022-03-13 09:30:47 UTC. --
Mar 13 09:30:42 cloudron systemd[1]: Dependency failed for Statistics collection and monitoring daemon.
Mar 13 09:30:42 cloudron systemd[1]: collectd.service: Job collectd.service/start failed with result 'dependency'.
root@cloudron:~#

Please let me know if you'd like the information in a different format or in a file form. Thanks for the assistance.

[nebulon]

@joesitsolutions do you happen to have stopped apps? If so and if possible, can you start them and run the start.sh script again then? I suspect there is a bug with stopped apps during collectd startup.

[joesitsolutions]

@nebulon uncertain on how to stop / start apps as I cant access the my.cloudron.com.au side of things.

Docker shows this:

root@cloudron:~# docker ps -a
CONTAINER ID   IMAGE                                                          COMMAND                  CREATED        STATUS                    PORTS                                                          NAMES
2b22cebcd8dd   cloudron/org.getgrav.cloudronapp:20220208-133214-844e92676     "/bin/sh -c 'echo '=…"   29 hours ago   Exited (0) 15 hours ago                                                                  f17bb001-deeb-4120-ba11-55ef90f0e3b4-grav_scheduler
443c1145e43f   cloudron/net.freescout.cloudronapp:20220223-121510-86737ae89   "/bin/sh -c /app/pkg…"   29 hours ago   Exited (0) 15 hours ago                                                                  119a7c1a-f70a-4933-bd82-4fec92fe981a-housekeeping
b811af4c3a3e   cloudron/com.grafana.cloudronapp:20220224-180629-5687a838f     "/app/pkg/start.sh"      2 days ago     Up 6 hours                                                                               0708633b-f7ec-4a01-9d38-20690f924ade
85baeb1e8340   cloudron/redis:3.0.4                                           "/app/code/start.sh"     2 days ago     Up 6 hours                3000/tcp, 6379/tcp                                             redis-0708633b-f7ec-4a01-9d38-20690f924ade
75cadb64d6b8   cloudron/louislam.uptimekuma.app:20220209-152854-0147f4790     "/app/pkg/start.sh"      2 days ago     Up 6 hours                                                                               69dfed39-c1a3-441c-90b7-8b8eb3ccad8b
a75d5ca8221c   cloudron/net.freescout.cloudronapp:20220223-121510-86737ae89   "/app/pkg/start.sh"      2 weeks ago    Up 6 hours                                                                               119a7c1a-f70a-4933-bd82-4fec92fe981a
6620dc0b8126   cloudron/mail:3.5.0                                            "/app/code/start.sh"     3 weeks ago    Up 6 hours                                                                               mail
e596de9e8743   cloudron/org.getgrav.cloudronapp:20220208-133214-844e92676     "/app/pkg/start.sh"      4 weeks ago    Up 6 hours                                                                               f17bb001-deeb-4120-ba11-55ef90f0e3b4
39f11158be76   cloudron/sftp:3.4.2                                            "/app/code/start.sh"     2 months ago   Up 6 hours                0.0.0.0:222->22/tcp, :::222->22/tcp                            sftp
3b1a13866b42   cloudron/graphite:3.0.1                                        "/app/code/start.sh"     2 months ago   Up 6 hours                127.0.0.1:2003-2004->2003-2004/tcp, 127.0.0.1:8417->8000/tcp   graphite
f75c940bc6be   cloudron/mongodb:4.0.2                                         "/app/code/start.sh"     2 months ago   Up 6 hours                                                                               mongodb
55cda1c3bf9f   cloudron/postgresql:4.1.1                                      "/app/code/start.sh"     2 months ago   Up 6 hours                3000/tcp, 5432/tcp                                             postgresql
8a5049411810   cloudron/mysql:3.0.7                                           "/app/code/start.sh"     2 months ago   Up 6 hours                                                                               mysql
d0dac59c07e4   cloudron/turn:1.3.1                                            "/app/code/start.sh"     2 months ago   Up 6 hours                                                                               turn
root@cloudron:~#

These appear to all be running. Or at least appear to have all my apps running as expected. I can go to all of my apps/sites aside from my.cloudron.com.au side of things.

I do see two stopped containers at the top. Is it possible that these are stuck?

[nebulon]

@joesitsolutions ah of course, I forgot about the dashboard not being accessible. However those two containers are cron job container, so this is fine.

To take one example of the pasted log file table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f1fff4243dd29c177ec2167b33b1f25c9e98158f6a84aa7706daf4bb89df188d/cpuacct.stat": No such file or directory.

This may indicate that there are collectd configs for some apps referencing container, which do not exist anymore. Can you run the following in /home/yellowtent/platformdata/collectd/collectd.conf.d/:

grep f1fff4243dd29c177ec2167b33b1f25c9e98158f6a84aa7706daf4bb89df188d *

This hopefully reveals which collectd config is referencing this and then you can delete this file and restart collectd via systemctl restart collectd If it still does not start, we have to do the same thing as above for the next errored file.

You can also enable remote ssh for us and send a mail to support@cloudron.io with your dashboard domain.

[joesitsolutions]

@nebulon doing as requested

root@cloudron:~# cd /home/yellowtent/platformdata/collectd/collectd.conf.d/
root@cloudron:/home/yellowtent/platformdata/collectd/collectd.conf.d# grep f1fff4243dd29c177ec2167b33b1f25c9e98158f6a84aa7706daf4bb89df188d *
root@cloudron:/home/yellowtent/platformdata/collectd/collectd.conf.d# ls -la
total 28
drwxr-xr-x 2 yellowtent yellowtent 4096 Mar 10 14:38 .
drwxr-xr-x 3 yellowtent yellowtent 4096 Dec 18 01:10 ..
-rw-r--r-- 1 yellowtent yellowtent 1175 Mar 10 14:38 0708633b-f7ec-4a01-9d38-20690f924ade.conf
-rw-r--r-- 1 yellowtent yellowtent 1175 Feb 23 15:05 119a7c1a-f70a-4933-bd82-4fec92fe981a.conf
-rw-r--r-- 1 yellowtent yellowtent 1175 Mar 10 13:50 69dfed39-c1a3-441c-90b7-8b8eb3ccad8b.conf
-rw-r--r-- 1 yellowtent yellowtent  138 Dec 18 01:11 cloudron-backup.conf
-rw-r--r-- 1 yellowtent yellowtent 1175 Feb  8 15:07 f17bb001-deeb-4120-ba11-55ef90f0e3b4.conf
root@cloudron:/home/yellowtent/platformdata/collectd/collectd.conf.d#

That file appears to not exist. I'll enable ssh and send through an email now.
Feel free to message or reach out if you need more input from me.

[nebulon]

Just to update this thread. @joesitsolutions cloudron had a broken line in /etc/fstab which made further local-fs.target dependencies fail, one of them is collectd. Disabling/removing that line following systemctl daemon-reload and running start.sh fixes the issue.

Not sure if this is now related to @JOduMonT 's issue though.

[joesitsolutions]

@nebulon huge thanks for the assistance!
My poor attempt at adding a cloud backup caused the error as stated. ty for the prompt and friendly assistance

[JOduMonT]

@nebulon said in my.cloudron.tld is not accessible:

Just to update this thread. @joesitsolutions cloudron had a broken line in /etc/fstab which made further local-fs.target dependencies fail, one of them is collectd. Disabling/removing that line following systemctl daemon-reload and running start.sh fixes the issue.

Not sure if this is now related to @JOduMonT 's issue though.

I had 2 drives, now only one
the drive I removed was attached to moodle, which I removed before removing the drive which I remove before rebooting.

Yes for a long time, statistic (probably populated by collected) was not working in the dashboard

[2021-11-26 02:28:04] Initialization complete, entering read-loop.
d to connect to remote host: Connection refused
d to connect to remote host: Connection refused
[2021-11-26 07:25:15] du plugin: monitoring /home/yellowtent/platformdata
[2021-11-27 02:49:25] du plugin: monitoring /home/yellowtent/appsdata/b72cc559-faeb-4d2f-bf51-2a2da800c5d4/data
feb-bb90-e4be79c69fcb/data"
[2021-11-27 02:49:30] du plugin: monitoring /home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08c4f5d8/data
[2021-11-27 02:49:30] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/aa40b16d-62fd-4[2021-11-27 02:49:47] du plugin: monitoring /home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data
[2021-11-27 02:49:47] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/bb96e514-a988-4f51-2a2da8
e: 1637981409)
[2021-11-27 02:50:18]   size of /home/yellowtent/appsdata/6deb1be7-d241-4d47-afb9-e63f4a2c00cf/data is 8192 (time: [2021-11-27 02:50:35] du plugin: monitoring /home/yellowtent/platformdata
1637981435)
[2021-11-27 02:50:45] du plugin: monitoring /home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data
[2021-11-27 02:50:45]   size of /home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data is 45056 (time:{'name': '6cef9864-730b-4d01-be6c-327e08c4f5d8', 'dir': '/home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08c[2021-11-27 02:50:55]   size of /home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data is 45056 (time:{'name': '6cef9864-730b-4d01-be6c-327e08c4f5d8', 'dir': '/home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08c1637981480)
a', 'dir': '/home/yellowtent/platformdata', 'exclude': ''}, {'name': '0d4c4ffa-e715-465f-9d8f-2d911df4f0ed', 'dir':[2021-11-27 02:51:37]   size of /var/backups is 1941504 (time: 1637981496)
{'name': '6cef9864-730b-4d01-be6c-327e08c4f5d8', 'dir': '/home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08cb8f-9b4d-e9d09f426230/data"
{'name': '6cef9864-730b-4d01-be6c-327e08c4f5d8', 'dir': '/home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08cf90-8d4e-e58726a601c7/data"
[2021-11-27 02:53:09] Systemd detected, trying to signal readiness.
1637981588)
[2021-11-27 02:53:14] du plugin: monitoring /home/yellowtent/appsdata/e485da60-4fbd-4b8f-9b4d-e9d09f426230/data
: 1637981593)
[2021-11-27 02:53:19] du plugin: monitoring /home/yellowtent/appsdata/4cbc3621-1b02-422d-90fe-3d483d251522/data
1637981599)
[2021-11-27 02:58:40] plugin_load: plugin "interface" successfully loaded.
d01-be6c-327e08c4f5d8/data"
[2021-11-27 02:59:01] plugin_load: plugin "aggregation" successfully loaded.
65f-9d8f-2d911df4f0ed/data"
[2021-11-27 02:59:01]   size of /home/yellowtent/appsdata/f58e115c-abc1-4f3b-a40a-21b91f92c160/data is 1916928 (tim[2021-11-27 03:00:11] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/boxdata" --exclude "mailf3b-a40a-21b91f92c160/data"
b90-e4be79
f90-8d4e-e58726a601c7/data"
[2021-11-27 03:00:28] du plugin: monitoring /home/yellowtent/appsdata/b72cc559-faeb-4d2f-bf51-2a2da800c5d4/data
[2021-11-27 03:00:29] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/ae7fce0c-a5b4-4[2021-11-27 03:00:39] plugin_load: plugin "table" successfully loaded.
1637982039)
[2021-11-27 03:00:39]   size of /home/yellowtent/appsdata/fdb80dbd-191c-4d37-90c2-04c89050f543/data is 630784 (timea96bbe6ebc03bee32f0e85fab2bfe5a3c036/cpuacct.stat": No such file or directory.
: 1637982052)
'/home/yellowtent/appsdata/0d4c4ffa-e715-465f-9d8f-2d911df4f0ed/data', 'exclude': ''}, {'name': '10d75fb4-2ba7-43a[2021-11-27 03:00:57] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/aa40b16d-62fd-4[2021-11-27 03:01:26] plugin_load: plugin "python" successfully loaded.
[2021-11-27 03:01:26] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/6deb1be7-d241-4[2021-11-27 03:01:26] plugin_load: plugin "load" successfully loaded.
[2021-11-27 03:01:27] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/10d75fb4-2ba7-4f3b-a40a-21b91f92c160/data"
377747474e5961b371e8a7e95a0b3632725/memory.stat": No such file or directory.
b90-e4be79
[2021-11-27 03:04:16] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/e485da60-4fbd-4', 'exclude': ''}, {'name': 'boxdata', 'dir': '/home/yellowtent/boxdata', 'exclude': 'mail'}, {'name': 'platformdat: 1637982266)
[2021-11-27 03:04:40] du plugin: monitoring /home/yellowtent/appsdata/6cef9864-730b-4d01-be6c-327e08c4f5d8/data
feb-bb90-e4be79c69fcb/data"
[2021-11-27 03:04:45] plugin_load: plugin "write_graphite" successfully loaded.
e: 1637982285)
[2021-11-27 03:04:53] plugin_load: plugin "memory" successfully loaded.
22d-90fe-3d483d251522/data"
[2021-11-27 03:04:59] plugin_load: plugin "memory" successfully loaded.
e: 1637982299)
[2021-11-27 03:05:08] du plugin: monitoring /home/yellowtent/boxdata
[2021-11-27 03:05:08]   size of /home/yellowtent/appsdata/a27789a4-f7e2-4617-8d11-687b7e24e501/data is 40960 (time:[2021-11-27 03:05:16] Systemd detected, trying to signal readiness.
[2021-11-27 03:05:16]   size of /home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data is 45056 (time:a32ceef599ebc7cf60c4b7bdacab69cd39f/memory.max_usage_in_bytes": No such file or directory.
[2021-11-27 03:05:34] plugin_load: plugin "memory" successfully loaded.
03c-a654-2e30bad1fba3/data"
[2021-11-27 03:05:52] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/boxdata/mail"
[2021-11-27 03:06:32] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/76ae0d1f17bcc22e21cf39a873c91637982398)
home/yellowtent/appsdata/bb96e514-a988-4f90-8d4e-e58726a601c7/data', 'exclude': ''}, {'name': 'cloudron-backup', 'd[2021-11-27 03:07:07] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/76ae0d1f17bcc22e21cf39a873c90c-a654-2e30bad1fba3', 'dir': '/home/yellowtent/appsdata/aa40b16d-62fd-403c-a654-2e30bad1fba3/data', 'exclude': ''},[2021-11-27 03:08:32] plugin_load: plugin "load" successfully loaded.
22d-90fe-3d483d251522/data"
[2021-11-27 03:09:59] collectd: Stopping 5 read threads.
f90-8d4e-e58726a601c7/data"
[2021-11-27 03:10:07]   size of /home/yellowtent/appsdata/aa40b16d-62fd-403c-a654-2e30bad1fba3/data is 835584 (time[2021-11-27 03:10:09]   size of /home/yellowtent/boxdata is 778240 (time: 1637982608)
[2021-11-27 03:10:16] Systemd detected, trying to signal readiness.
1637982616)
[2021-11-27 03:10:34]   size of /home/yellowtent/appsdata/6deb1be7-d241-4d47-afb9-e63f4a2c00cf/data is 8192 (time: 1fba3/data', 'exclude': ''}, {'name': 'ae7fce0c-a5b4-4618-9add-59384eef3d2a', 'dir': '/home/yellowtent/appsdata/ae7[2021-11-27 03:10:54] collectd: Stopping 5 read threads.
[2021-11-27 03:10:54] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/bb96e514-a988-4[2021-11-27 03:11:05]   size of /home/yellowtent/boxdata/mail is 1208320 (time: 1637982664)
[2021-11-27 03:12:05] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/57d5fc7d52ba29628e46fa72340e[2021-11-27 03:12:29]   size of /home/yellowtent/boxdata is 778240 (time: 1637982748)
[2021-11-27 03:12:49] du plugin: monitoring /home/yellowtent/appsdata/6deb1be7-d241-4d47-afb9-e63f4a2c00cf/data
e: 1637982769)
fce0c-a5b4-4618-9add-59384eef3d2a/data', 'exclude': ''}, {'name': 'cloudron-backup', 'dir': '/var/backups', 'exclud071317a7ec01ac986baeb7ca39997b4f2cd/memory.stat": No such file or directory.
322e2ecc68038ca7839e1085c9a5670641ff/cpuacct.stat": No such file or directory.
[2021-11-27 03:14:43] Systemd detected, trying to signal readiness.
[2021-11-27 03:15:04] plugin_load: plugin "memory" successfully loaded.
03c-a654-2e30bad1fba3/data"
[2021-11-27 03:16:04] du plugin: monitoring /home/yellowtent/appsdata/4cbc3621-1b02-422d-90fe-3d483d251522/data
[2021-11-27 03:16:11] collectd: Stopping 5 write threads.
[2021-11-27 03:16:11]   size of /var/backups is 1941504 (time: 1637982970)
e: 1637982988)
/dev/sdb', '/var/backups', '10255636', '38764', '9676200']]
[2021-11-27 03:17:00] collectd: Stopping 5 write threads.
1637983019)
fce0c-a5b4-4618-9add-59384eef3d2a/data', 'exclude': ''}, {'name': 'bb96e514-a988-4f90-8d4e-e58726a601c7', 'dir': '/[2021-11-27 03:17:15]   size of /var/backups is 1941504 (time: 1637983035)
[2021-11-27 03:18:29] plugin_load: plugin "cpu" successfully loaded.
[2021-11-27 03:18:29] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/platformdata"
[2021-11-27 03:19:01] plugin_load: plugin "swap" successfully loaded.
[2021-11-27 03:19:01]   size of /home/yellowtent/appsdata/4cbc3621-1b02-422d-90fe-3d483d251522/data is 2134016 (tim[2021-11-27 03:19:05] du plugin: monitoring /home/yellowtent/appsdata/ae7fce0c-a5b4-4618-9add-59384eef3d2a/data
[2021-11-27 03:19:05] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/bb96e514-a988-4[2021-11-27 03:19:32] du plugin: monitoring /home/yellowtent/appsdata/ae7fce0c-a5b4-4618-9add-59384eef3d2a/data
[2021-11-27 03:19:32] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/aa40b16d-62fd-4'/home/yellowtent/appsdata/4cbc3621-1b02-422d-90fe-3d483d251522/data', 'exclude': ''}, {'name': '6deb1be7-d241-4d4[2021-11-27 03:19:45] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/f58e115c-abc1-4', 'exclude': ''}, {'name': 'boxdata', 'dir': '/home/yellowtent/boxdata', 'exclude': 'mail'}, {'name': 'platformdat[2021-11-27 03:20:05]   size of /home/yellowtent/appsdata/aa40b16d-62fd-403c-a654-2e30bad1fba3/data is 835584 (time45801737aa558ab816690ec0d033215cc63/memory.max_usage_in_bytes": No such file or directory.
[2021-11-27 03:21:08] du plugin: monitoring /home/yellowtent/appsdata/a27789a4-f7e2-4617-8d11-687b7e24e501/data
617-8d11-687b7e24e501/data"
[2021-11-27 03:21:35] plugin_load: plugin "interface" successfully loaded.
a45801737aa558ab816690ec0d033215cc63/cpuacct.stat": No such file or directory.
f98421229124a116f5e6925429780ff8589/memory.max_usage_in_bytes": No such file or directory.
{'name': 'aa40b16d-62fd-403c-a654-2e30bad1fba3', 'dir': '/home/yellowtent/appsdata/aa40b16d-62fd-403c-a654-2e30bad[2021-11-27 03:22:07] computing size with command: timeout 1800 du -DsB1 "/var/backups"
c00cf/data', 'exclude': ''}, {'name': '93172ad5-f9c8-4feb-bb90-e4be79c69fcb', 'dir': '/home/yellowtent/appsdata/931[2021-12-01 07:44:47] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/4cbc3621-1b02-4[2021-12-11 07:29:56] plugin_load: plugin "aggregation" successfully loaded.
[2021-12-11 07:29:56] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/platformdata"
[2021-12-11 07:29:59] Exiting normally.
1639207799)
[2021-12-11 07:30:01] plugin_load: plugin "aggregation" successfully loaded.
[2021-12-11 07:30:02]   size of /home/yellowtent/boxdata is 1830912 (time: 1639207801)
[2021-12-11 07:30:02]   size of /home/yellowtent/appsdata/fdb80dbd-191c-4d37-90c2-04c89050f543/data is 1191936 (tim[2021-12-11 07:30:23] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/boxdata/mail"
[2021-12-11 07:30:23] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/appsdata/bb96e514-a988-4[2021-12-11 07:33:08] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/boxdata" --exclude "maild37-90c2-04c89050f543/data"
1639208157)
[2021-12-11 07:38:41] collectd: Stopping 5 write threads.
[2022-01-18 22:02:09]   size of /home/yellowtent/boxdata is 2842624 (time: 1642543329)
[2022-01-18 22:02:16] plugin_load: plugin "load" successfully loaded.
[2022-01-18 22:02:16] computing size with command: timeout 1800 du -DsB1 "/home/yellowtent/boxdata" --exclude "mail[2022-01-18 22:02:21] collectd: Stopping 5 read threads.
fe9-9c61-9b0129c7fac7/data"
[2022-01-18 22:02:23] plugin_load: plugin "python" successfully loaded.
ime: 1642543343)
[2022-01-18 22:02:28] du plugin: monitoring /home/yellowtent/appsdata/021b33dd-57a9-4e25-8187-9e2dfac0294c/data
65f-9d8f-2d911df4f0ed/data"
[2022-01-18 22:02:48] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281[2022-01-18 22:02:54] custom df plugin initialized with [['/dev/sda1', '/', '78452316', '25895872', '49323180']]
1642543374)
82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.stat": No such file or directory.
82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.stat": No such file or directory.
[2022-01-18 22:06:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721ccf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
[2022-01-18 22:09:34] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/aec230922c7fe8d26900e718ca28f2036f4da0de06fa5f3863e5eee5cac05b8/memory.max_usage_in_bytes": No such file or directory.
82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 22:13:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721cf2036f4da0de06fa5f3863e5eee5cac05b8/memory.stat": No such file or directory.
82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.stat": No such file or directory.
[2022-01-18 22:16:54] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
[2022-01-18 22:19:14] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b837721[2022-01-18 22:20:14] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/aec230922c7fe8d26900e718ca28f2036f4da0de06fa5f3863e5eee5cac05b8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 22:22:54] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 22:23:54] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281f2036f4da0de06fa5f3863e5eee5cac05b8/memory.stat": No such file or directory.
[2022-01-18 22:26:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281cf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
[2022-01-18 22:27:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281[2022-01-18 22:28:54] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721ccf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
[2022-01-18 22:30:54] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/aec230922c7fe8d26900e718ca28[2022-01-18 22:32:14] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/aec230922c7fe8d26900e718ca28[2022-01-18 22:33:34] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b83772182ffd2a5fd782f44c1556e2bbea96fba3e8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 22:35:54] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 22:37:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 22:38:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
[2022-01-18 22:40:34] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b837721[2022-01-18 22:41:34] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/aec230922c7fe8d26900e718ca28[2022-01-18 22:42:54] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b83772182ffd2a5fd782f44c1556e2bbea96fba3e8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 22:45:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 22:46:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 22:47:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281f2036f4da0de06fa5f3863e5eee5cac05b8/memory.stat": No such file or directory.
[2022-01-18 22:50:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721ccf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
[2022-01-18 22:53:34] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b837721f2036f4da0de06fa5f3863e5eee5cac05b8/memory.max_usage_in_bytes": No such file or directory.
82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 22:57:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c82ffd2a5fd782f44c1556e2bbea96fba3e8/memory.stat": No such file or directory.
f2036f4da0de06fa5f3863e5eee5cac05b8/memory.stat": No such file or directory.
[2022-01-18 23:00:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca281182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
cf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
[2022-01-18 23:04:14] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/f79696562bd1ddb444a34b83772182ffd2a5fd782f44c1556e2bbea96fba3e8/memory.max_usage_in_bytes": No such file or directory.
[2022-01-18 23:06:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721c[2022-01-18 23:07:34] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/aec230922c7fe8d26900e718ca28182ffd2a5fd782f44c1556e2bbea96fba3e8/memory.stat": No such file or directory.
[2022-01-18 23:10:14] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/f79696562bd1ddb444a34b837721ccf2036f4da0de06fa5f3863e5eee5cac05b8/cpuacct.stat": No such file or directory.
182ffd2a5fd782f44c1556e2bbea96fba3e8/cpuacct.stat": No such file or directory.
[2022-02-15 03:23:48] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/cpuacct.stat": No such file or directory.
[2022-02-15 03:24:08] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/cfeb423a79e3e47a8c490064bfe84e5bd42074b497d27be5dd5fe2c1f93ec061/memory.max_usage_in_bytes": No such file or directory.
[2022-02-15 03:24:08] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/520e5e35123f72ad7579b33ffcdafe5bd42074b497d27be5dd5fe2c1f93ec061/cpuacct.stat": No such file or directory.
[2022-02-15 03:24:08] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/memory.stat": No such file or directory.
[2022-02-15 03:24:08] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/memory.max_usage_in_bytes": No such file or directory.
[2022-02-15 03:24:08] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/cpuacct.stat": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/cfeb423a79e3e47a8c490064bfe84cd53a267f08d1388e1113659d56602136bc/memory.stat": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/cfeb423a79e3e47a8c490064bfe84cd53a267f08d1388e1113659d56602136bc/memory.max_usage_in_bytes": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/cfeb423a79e3e47a8c490064bfe84cd53a267f08d1388e1113659d56602136bc/cpuacct.stat": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/memory.stat": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/memory/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/memory.max_usage_in_bytes": No such file or directory.
[2022-02-15 03:24:28] table plugin: Failed to open file "/sys/fs/cgroup/cpuacct/docker/ee45dfb44e5014ea1e9cce7c93f7efc2587c3759e68c5811d37ff0deef087a6b/cpuacct.stat": No such file or directory.
[2022-02-15 03:24:46] Exiting normally.
[2022-02-15 03:24:46] collectd: Stopping 5 read threads.
[2022-02-15 03:24:46] collectd: Stopping 5 write threads.

how could we accelerate the process ?????

[nebulon]

@JOduMonT to get your server going again faster, I guess it would help if you could enable remote SSH support for us and send a mail with your dashboard domain / raw IP to support@cloudron.io for investigation.

[JOduMonT]

@nebulon sorry, a lot is happening also on my side
thanks for your help,

as explained here
your ssh id has been added and the ssh support has been activated

if it is not possible to debug, or too long
I would like the database of each services since I already backuped the files (data).

[nebulon]

So to update this thread, also for @JOduMonT the issue was an error in the /etc/fstab file. This triggered the same issue about systemd's local-fs.target, which is quite crucial to the whole system as a dependency for example for collectd but also many more daemons.

In this case is was a nosudo option for a fileystem. That option does not exist however for this type of filesystem. The solution was to fixup /etc/fstab then run systemctl daemon-reload and systemctl restart local-fs.target following the command to initialize Cloudron again /home/yellowtent/box/setup.start.sh

[JOduMonT]

@nebulon said in my.cloudron.tld is not accessible:

nosudo

thank you for eyes and help
this is so weird and like you I don't know that option.

also; etckeeper as not being initiated on that server, so I'm unable to retrace when that change has been made