Overview - What is PageKite?

pagekite.net
PageKite is a system for connecting your localhost servers to the public Internet, giving them names and making them globally accessible. It works on most common operating systems and it doesn't matter what kind of Internet connection you have.

Using a laptop over 3G? No problem.
A desktop sharing an ADSL line with 10 other computers? That's fine too.
Is port 80 already taken on your virtual cloud server? PageKite can help.

PageKite opens up a whole world of new possibilities - see below for some examples of what it can do for you. Maybe you'll come up with something we didn't even think of!

How Can PageKite Help Me?

Designers

Temporarily share and show off your designs and works in progress, without having to upload them first ...

Web Developers

Test live sites directly off your workstation or laptop, saving time by not having to deploy to a staging server in every single iteration ...

Hackers & Tinkerers

Host a live web or SSH server on any computer and any network, without having to worry about IP addresses and port number, routers and DNS ...

Admins & Tech Support

Directly access machines you are responsible for whenever they are on-line, even if they are mobile or trapped behind restrictive firewalls ...

Embedded Developers

Take part in the Internet Of Things by giving all your devices names and a live presence on-line - using standard, royalty free protocols ...

Students

Learn by doing: in minutes you can have a live Internet server running on your own computer, visible to the world ...

Parents

Share family photos and videos with loved ones, without having to put your most personal data under some corporation's control ...

...

kudos to @girish
he found the real pbl. (out of i-nodes) within minutes.
from there, we could nail down the cause, by following this:
https://unix.stackexchange.com/questions/26598/how-can-i-increase-the-number-of-inodes-in-an-ext4-filesystem

TL,DR:
one cannot raise i-nodes after fs creation. normally, a tar from rootfs, reformat the rootfs, and restore would be necessary.
but to find out, who is consuming all the inodes, one can do the following:

try du -s --inodes * 2>/dev/null |sort -g then cd into the last dir in output and repeat.

Full Disclosure: not all OS's support --inodes flag for du command (my Mac OS does not) but many Linux OS's do.

one has to cd into the dir with the most i-nodes, recursively going down the tree and finally find the dir with the biggest i-node consumption.

in this case, as girish had mentioned, it was caused by not right configured nullmailer, writing tons of error-msg to /var/spool/nullmailer/failed useing 4.4M i-nodes…
deleting that dir eased the situation ad hoc.
rebooting the server and restart all failed apps (GUI & CLI) fixed it.

thanks for all your help

@nebulon backup failed completely yesterday without any notification. so I missed a complete day of backup without being informed about it. that's not acceptable!

the latest update to 6.3.3 left nextcloud & wallabag not responding/restarting.
the pbl. was access to the pgsql container, which was fixed by a manual restart of the container...

the necessary system reboot left the firewall down: (due to a race condition?)

Jun 30 08:27:20 my.eb8.org cloudron-firewall.sh[5559]: ==> Setting up firewall
Jun 30 08:27:20 my.eb8.org cloudron-firewall.sh[5613]: iptables: Bad rule (does a matching rule exist in that chain?).
Jun 30 08:27:22 my.eb8.org cloudron-firewall.sh[5828]: Another app is currently holding the xtables lock. Perhaps you want to use the -w option?
Jun 30 08:27:22 my.eb8.org cloudron-firewall.sh[5833]: iptables: No chain/target/match by that name.
Jun 30 08:27:22 my.eb8.org systemd[1]: cloudron-firewall.service: Main process exited, code=exited, status=1/FAILURE
Jun 30 08:27:22 my.eb8.org systemd[1]: cloudron-firewall.service: Failed with result 'exit-code'.
Jun 30 08:27:22 my.eb8.org systemd[1]: Failed to start Cloudron Firewall.

manual restating the FW brought it back online.

@nebulon, ok now I'm getting to understand you better.
It should have sent a mail after complete failure of backup, not only after 3 days… - I see.

but even in the past, when backup failed, I got only 1 single mail.
from my understanding now, it should have sent me a mail per try - which never happened.

thx for clarification.
do you need any logs/info?

@nebulon backup failed completely yesterday without any notification. so I missed a complete day of backup without being informed about it. that's not acceptable!

Just saw the latest announcment and was figuring out (at the same time) that cloudron is not informing me any longer, about mission-critical errors, like when a backup fails and:

… Backup renewal notification will only be sent if 3 consecutive backups fail. This way we allow for "external services" to fail now and then without being too aggressive about notifying user.

Since the Users data are the most precious thing in a installation like that, it's just not acceptable, that in a worse case scenario, 3 days of these are lost!

allow for "external services" to fail now and then.

IMHO, that's the wrong strategy. if external services fails, the sysadmin should fix it A.S.A.P. or go for a reliable service.
not reporting system critical failures at once compromises the security and reliability of the whole installation.

during my research i saw a statement, "that one had to log in to oversee the system...." (and find out, whether it has failed already)
imagine, one sysadmin is responsible for more then just one cloudron installation and cloudron is just one VM/setup of about a dozend+ or more installations of diff. apps/setups, at all kind of different places/customers and you suggest, to login to everyone to see whether it's healthy? think big, guys. that's just not doable.

all mission-critical information has to be delivered in realtime to the responsible person/team.
instead of turning of critical information, a way to configure different notification-channels for diff. typ/classes/importance of notifications like matrix/telegarm/mail would make much more sense - IMHO.

hey @nebulon,
no, only 2-3 ports tcp/udp (wireguard/snmp/ssh)
and it happened inbetween again, without any reboots/upgrades/etc. I got notfied by network mgmgt system, that my cloudron server is down - luckily it was just the firewall…

the latest update to 6.3.3 left nextcloud & wallabag not responding/restarting.
the pbl. was access to the pgsql container, which was fixed by a manual restart of the container...

the necessary system reboot left the firewall down: (due to a race condition?)

Jun 30 08:27:20 my.eb8.org cloudron-firewall.sh[5559]: ==> Setting up firewall
Jun 30 08:27:20 my.eb8.org cloudron-firewall.sh[5613]: iptables: Bad rule (does a matching rule exist in that chain?).
Jun 30 08:27:22 my.eb8.org cloudron-firewall.sh[5828]: Another app is currently holding the xtables lock. Perhaps you want to use the -w option?
Jun 30 08:27:22 my.eb8.org cloudron-firewall.sh[5833]: iptables: No chain/target/match by that name.
Jun 30 08:27:22 my.eb8.org systemd[1]: cloudron-firewall.service: Main process exited, code=exited, status=1/FAILURE
Jun 30 08:27:22 my.eb8.org systemd[1]: cloudron-firewall.service: Failed with result 'exit-code'.
Jun 30 08:27:22 my.eb8.org systemd[1]: Failed to start Cloudron Firewall.

manual restating the FW brought it back online.

there had been a 4 dependencies missing, 3 from the cloudron-module. while installing these, there was an error about /app/code/package.json, which is missing.

root@214b3494-371d-4518-9be3-af8707db4284:/app/code# npm i async body-parser ldapjs
npm WARN saveError ENOENT: no such file or directory, open '/app/code/package.json'
npm WARN saveError EROFS: read-only file system, open '/app/code/package-lock.json.2931527070'
npm WARN enoent ENOENT: no such file or directory, open '/app/code/package.json'
npm WARN code No description
npm WARN code No repository field.
npm WARN code No README data
npm WARN code No license field.

+ async@3.2.0
+ ldapjs@2.2.4
+ body-parser@1.19.0
removed 34 packages, updated 3 packages and audited 1855 packages in 239.516s

and a series of dependencies for these:

npm ls 2>&1 | grep -i missing|cut -d":" -f2,3 
 bytes@3.1.0, required by body-parser@1.19.0
 content-type@~1.0.4, required by body-parser@1.19.0
 debug@2.6.9, required by body-parser@1.19.0
 depd@~1.1.2, required by body-parser@1.19.0
 http-errors@1.7.2, required by body-parser@1.19.0
 iconv-lite@0.4.24, required by body-parser@1.19.0
 on-finished@~2.3.0, required by body-parser@1.19.0
 qs@6.7.0, required by body-parser@1.19.0
 raw-body@2.4.0, required by body-parser@1.19.0
 type-is@~1.6.17, required by body-parser@1.19.0
 abstract-logging@^2.0.0, required by ldapjs@2.2.4
 asn1@^0.2.4, required by ldapjs@2.2.4
 assert-plus@^1.0.0, required by ldapjs@2.2.4
 backoff@^2.5.0, required by ldapjs@2.2.4
 ldap-filter@^0.3.3, required by ldapjs@2.2.4
 once@^1.4.0, required by ldapjs@2.2.4
 vasync@^2.2.0, required by ldapjs@2.2.4
 verror@^1.8.1, required by ldapjs@2.2.4

install all dependencies with:

npm i `npm ls 2>&1 | grep -i missing|cut -d":" -f2 |cut -d"," -f1|xargs`

there are further sub-depenencies, so run it again, but modified because of some tag-quirks

npm ERR! code EINVALIDTAGNAME
npm ERR! Invalid tag name ">=": Tags may not have any characters that encodeURIComponent encodes.

for 2 times run:

npm i ` npm ls 2>&1 | grep -i missing|cut -d":" -f2 |cut -d"," -f1|cut -d"<" -f1|tr -d ">" |tr -d "=" |tr -d " "| xargs`

after all dependencies have been installed, the APP was restarted to normal operation. according to the log, all went fine, but the status at the WEBinterface is: "it's not responding":

Mar 09 11:06:07 ==========================
Mar 09 11:06:07 Etherpad start
Mar 09 11:06:07 ==========================
Mar 09 11:06:07 => Ensure directories
Mar 09 11:06:07 => Fixing up node_modules
Mar 09 11:06:07 => Ensuring cloudron plugin
Mar 09 11:06:07 box:tasks 5789: {"percent":100,"message":"Done"}
Mar 09 11:06:08 box:apptask etherpad.eb8.org updating app with values: {"installationState":"installed","error":null,"health":null}
Mar 09 11:06:08 box:taskworker Task took 39.009 seconds
Mar 09 11:06:08 box:tasks setCompleted - 5789: {"result":null,"error":null}
Mar 09 11:06:08 box:tasks 5789: {"percent":100,"result":null,"error":null}
Mar 09 11:08:47 npm WARN saveError ENOENT: no such file or directory, open '/app/code/package.json'
Mar 09 11:08:48 npm WARN saveError EROFS: read-only file system, open '/app/code/package-lock.json.3085602016'
Mar 09 11:08:48 npm WARN enoent ENOENT: no such file or directory, open '/app/code/package.json'
Mar 09 11:08:48 npm WARN code No description
Mar 09 11:08:49 npm WARN code No repository field.
Mar 09 11:08:49 npm WARN code No README data
Mar 09 11:08:49 npm WARN code No license field.
Mar 09 11:08:49
Mar 09 11:08:49 + ep_cloudron@4.1.0
Mar 09 11:08:49 removed 36 packages, updated 1 package and audited 1841 packages in 149.421s
Mar 09 11:08:57
Mar 09 11:08:57 85 packages are looking for funding
Mar 09 11:08:57 run `npm fund` for details
Mar 09 11:08:57
Mar 09 11:08:57 found 0 vulnerabilities
Mar 09 11:08:57
Mar 09 11:08:57
Mar 09 11:08:57 ┌───────────────────────────────────────────────────┐
Mar 09 11:08:57 │ npm update check failed │
Mar 09 11:08:57 │ Try running with sudo or get access │
Mar 09 11:08:57 │ to the local update config store via │
Mar 09 11:08:57 │ sudo chown -R $USER:$(id -gn $USER) /root/.config │
Mar 09 11:08:57 └───────────────────────────────────────────────────┘
Mar 09 11:08:57 => Generating settings.json
Mar 09 11:08:57 => Ensure /app/data/settings.json
Mar 09 11:08:57 => Ensure folder permissions
Mar 09 11:08:58 => Starting etherpad
Mar 09 11:08:59 [2021-03-09 10:08:59.011] [DEBUG] console - Running on Node v14.15.4 (minimum required Node version: 10.17.0)
Mar 09 11:08:59 [2021-03-09 10:08:59.135] [INFO] console - All relative paths will be interpreted relative to the identified Etherpad base dir: /app/code
Mar 09 11:08:59 [2021-03-09 10:08:59.229] [INFO] console - settings loaded from: /run/etherpad-lite/settings.json
Mar 09 11:08:59 [2021-03-09 10:08:59.232] [INFO] console - credentials loaded from: /app/data/settings.json
Mar 09 11:08:59 [2021-03-09 10:08:59.234] [WARN] console - Unknown Setting: 'sessionNoPassword'. This setting doesn't exist or it was removed
Mar 09 11:08:59 [2021-03-09 10:08:59.236] [INFO] console - Using skin "colibris" in dir: /app/code/src/static/skins/colibris
Mar 09 11:08:59 [2021-03-09 10:08:59.242] [INFO] console - Session key loaded from: /app/code/SESSIONKEY.txt
Mar 09 11:08:59 [2021-03-09 10:08:59.245] [INFO] console - Random string used for versioning assets: 1a60d277
Mar 09 11:09:04 [2021-03-09 10:09:04.533] [INFO] server - Starting Etherpad...
Mar 09 11:09:06 [2021-03-09 10:09:06.407] [INFO] plugins - Running npm to get a list of installed plugins...
Mar 09 11:09:06 [2021-03-09 10:09:06.721] [INFO] plugins - npm --version: 6.14.11
Mar 09 11:10:03 [2021-03-09 10:10:03.141] [ERROR] runCmd|npm -
Mar 09 11:10:03 [2021-03-09 10:10:03.141] [ERROR] runCmd|npm - ┌────────────────────────────────────────────────────────────┐
Mar 09 11:10:03 [2021-03-09 10:10:03.144] [ERROR] runCmd|npm - │ npm update check failed │
Mar 09 11:10:03 [2021-03-09 10:10:03.223] [ERROR] runCmd|npm - │ Try running with sudo or get access │
Mar 09 11:10:03 [2021-03-09 10:10:03.231] [ERROR] runCmd|npm - │ to the local update config store via │
Mar 09 11:10:03 [2021-03-09 10:10:03.337] [ERROR] runCmd|npm - │ sudo chown -R $USER:$(id -gn $USER) /home/cloudron/.config │
Mar 09 11:10:03 [2021-03-09 10:10:03.338] [ERROR] runCmd|npm - └────────────────────────────────────────────────────────────┘
Mar 09 11:10:04 [2021-03-09 10:10:04.933] [INFO] plugins - Loading plugin ep_aa_file_menu_toolbar...
Mar 09 11:10:05 [2021-03-09 10:10:04.935] [INFO] plugins - Loading plugin ep_add_buttons...
Mar 09 11:10:05 [2021-03-09 10:10:04.936] [INFO] plugins - Loading plugin ep_adminpads2...
Mar 09 11:10:05 [2021-03-09 10:10:04.937] [INFO] plugins - Loading plugin ep_bookmark...
Mar 09 11:10:05 [2021-03-09 10:10:05.007] [INFO] plugins - Loading plugin ep_bottom_chat_bar...
Mar 09 11:10:05 [2021-03-09 10:10:05.092] [INFO] plugins - Loading plugin ep_cloudron...
Mar 09 11:10:05 [2021-03-09 10:10:05.096] [INFO] plugins - Loading plugin ep_code_formatting...
Mar 09 11:10:05 [2021-03-09 10:10:05.097] [INFO] plugins - Loading plugin ep_codepad...
Mar 09 11:10:05 [2021-03-09 10:10:05.106] [INFO] plugins - Loading plugin ep_comments_page...
Mar 09 11:10:05 [2021-03-09 10:10:05.117] [INFO] plugins - Loading plugin ep_draw...
Mar 09 11:10:05 [2021-03-09 10:10:05.123] [INFO] plugins - Loading plugin ep_etherpad-lite...
Mar 09 11:10:05 [2021-03-09 10:10:05.147] [INFO] plugins - Loading plugin ep_headings2...
Mar 09 11:10:05 [2021-03-09 10:10:05.148] [INFO] plugins - Loading plugin ep_markdown...
Mar 09 11:10:05 [2021-03-09 10:10:05.149] [INFO] plugins - Loading plugin ep_pad_overview...
Mar 09 11:10:05 [2021-03-09 10:10:05.149] [INFO] plugins - Loading plugin ep_previewimages...
Mar 09 11:10:05 [2021-03-09 10:10:05.150] [INFO] plugins - Loading plugin ep_print_preview_pdf...
Mar 09 11:10:05 [2021-03-09 10:10:05.151] [INFO] plugins - Loading plugin ep_real_time_chat...
Mar 09 11:10:05 [2021-03-09 10:10:05.214] [INFO] plugins - Loading plugin ep_spellcheck...
Mar 09 11:10:05 [2021-03-09 10:10:05.231] [INFO] plugins - Loading plugin ep_webrtc...
Mar 09 11:10:05 [2021-03-09 10:10:05.527] [INFO] plugins - Loaded 19 plugins
Mar 09 11:10:06 [2021-03-09 10:10:06.320] [INFO] console - CODEPAD needs ep_codepad parameters in settings.json.
Mar 09 11:10:15 [2021-03-09 10:10:15.115] [INFO] APIHandler - Api key file read from: "/app/code/APIKEY.txt"
Mar 09 11:10:24 [2021-03-09 10:10:24.119] [INFO] server - Installed plugins: ep_aa_file_menu_toolbar@0.2.1, ep_add_buttons@0.0.21, ep_bookmark@1.2.1, ep_bottom_chat_bar@1.0.1, ep_adminpads2@2.1.25, ep_cloudron@4.1.0, ep_draw@0.1.6, ep_headings2@0.2.26, ep_pad_overview@0.1.2, ep_previewimages@0.0.13, ep_print_preview_pdf@0.0.6, ep_real_time_chat@0.2.9, ep_spellcheck@0.0.20, ep_webrtc@0.1.11, ep_markdown@0.1.21, ep_code_formatting@1.0.0, ep_codepad@1.3.3, ep_comments_page@0.1.47
Mar 09 11:10:24 [2021-03-09 10:10:24.416] [INFO] console - Report bugs at https://github.com/ether/etherpad-lite/issues
Mar 09 11:10:24 [2021-03-09 10:10:24.418] [WARN] console - Can't get git version for server header
Mar 09 11:10:24 ENOENT: no such file or directory, lstat '/app/code/.git'
Mar 09 11:10:24 [2021-03-09 10:10:24.419] [WARN] console - Can't get git version for server header
Mar 09 11:10:24 ENOENT: no such file or directory, lstat '/app/code/.git'
Mar 09 11:10:24 [2021-03-09 10:10:24.419] [INFO] console - Your Etherpad version is 1.8.12 ()

org.etherpad.cloudronapp@3.4.1

after updating to the for mentioned version, etherpad refuses to start.

from the log (repeating):

Mar 06 08:56:44 │ npm update check failed │
Mar 06 08:56:44 │ Try running with sudo or get access │
Mar 06 08:56:44 │ to the local update config store via │
Mar 06 08:56:44 │ sudo chown -R $USER:$(id -gn $USER) /root/.config │
Mar 06 08:56:44 └───────────────────────────────────────────────────┘
Mar 06 08:56:45 => Generating settings.json
Mar 06 08:56:45 => Ensure /app/data/settings.json
Mar 06 08:56:45 => Ensure folder permissions
Mar 06 08:56:46 => Starting etherpad
Mar 06 08:56:48 [2021-03-06 07:56:48.039] [DEBUG] console - Running on Node v14.15.4 (minimum required Node version: 10.17.0)
Mar 06 08:56:48 [2021-03-06 07:56:48.416] [INFO] console - All relative paths will be interpreted relative to the identified Etherpad base dir: /app/code
Mar 06 08:56:48 [2021-03-06 07:56:48.521] [INFO] console - settings loaded from: /run/etherpad-lite/settings.json
Mar 06 08:56:48 [2021-03-06 07:56:48.523] [INFO] console - credentials loaded from: /app/data/settings.json
Mar 06 08:56:48 [2021-03-06 07:56:48.524] [WARN] console - Unknown Setting: 'sessionNoPassword'. This setting doesn't exist or it was removed
Mar 06 08:56:48 [2021-03-06 07:56:48.526] [INFO] console - Using skin "colibris" in dir: /app/code/src/static/skins/colibris
Mar 06 08:56:48 [2021-03-06 07:56:48.616] [INFO] console - Session key loaded from: /app/code/SESSIONKEY.txt
Mar 06 08:56:48 [2021-03-06 07:56:48.624] [INFO] console - Random string used for versioning assets: 25fbe5bb
Mar 06 08:56:53 [2021-03-06 07:56:53.912] [INFO] server - Starting Etherpad...
Mar 06 08:56:55 [2021-03-06 07:56:55.733] [INFO] plugins - Running npm to get a list of installed plugins...
Mar 06 08:56:57 [2021-03-06 07:56:57.821] [INFO] plugins - npm --version: 6.14.11
Mar 06 08:57:57 [2021-03-06 07:57:57.751] [ERROR] runCmd|npm - npm ERR! peer dep missing: ep_headings2@*, required by ep_markdown@0.1.21
Mar 06 08:57:57 [2021-03-06 07:57:57.840] [ERROR] server - Error occurred while starting Etherpad
Mar 06 08:57:57 [2021-03-06 07:57:57.842] [ERROR] server - Error: Command exited with code 1: npm ls --long --json --depth=0 --no-production
Mar 06 08:57:57 at exports (/app/code/src/node/utils/run_cmd.js:119:25)
Mar 06 08:57:57 at Object.exports.getPackages (/app/code/src/static/js/pluginfw/plugins.js:125:48)
Mar 06 08:57:57 at Object.exports.update (/app/code/src/static/js/pluginfw/plugins.js:99:34)
Mar 06 08:57:57 at Object.exports.start (/app/code/src/node/server.js:140:19)
Mar 06 08:57:57 at processTicksAndRejections (internal/process/task_queues.js:93:5)
Mar 06 08:57:57 [2021-03-06 07:57:57.843] [INFO] server - Exiting...
Mar 06 08:57:57 [2021-03-06 07:57:57.845] [INFO] server - Waiting for Node.js to exit...
Mar 06 08:58:02 [2021-03-06 07:58:02.844] [ERROR] server - Something that should have been cleaned up during the shutdown hook (such as a timer, worker thread, or open connection) is preventing Node.js from exiting
Mar 06 08:58:02 [2021-03-06 07:58:02.849] [INFO] console - [WTF Node?] open handles:
Mar 06 08:58:02 [2021-03-06 07:58:02.851] [INFO] console - - File descriptors: (note: stdio always exists)
Mar 06 08:58:02 [2021-03-06 07:58:02.854] [INFO] console - - fd 1 (tty) (stdio)
Mar 06 08:58:02 [2021-03-06 07:58:02.864] [INFO] console - - fd 2 (tty) (stdio)
Mar 06 08:58:02 [2021-03-06 07:58:02.865] [INFO] console - - Sockets:
Mar 06 08:58:02 [2021-03-06 07:58:02.867] [INFO] console - - 172.18.20.37:38954 -> 172.18.0.5:3306
Mar 06 08:58:02 [2021-03-06 07:58:02.868] [INFO] console - - Listeners:
Mar 06 08:58:02 [2021-03-06 07:58:02.870] [INFO] console - - connect: bound @ /app/code/src/node_modules/mysql/lib/Connection.js:98
Mar 06 08:58:02 [2021-03-06 07:58:02.871] [INFO] console - - Intervals:
Mar 06 08:58:02 [2021-03-06 07:58:02.872] [INFO] console - - (100 ~ 100 ms) (anonymous) @ /app/code/src/node_modules/ueberdb2/lib/CacheAndBufferLayer.js:180
Mar 06 08:58:02 [2021-03-06 07:58:02.873] [INFO] console - - (10000 ~ 10 s) (anonymous) @ /app/code/src/node_modules/ueberdb2/databases/mysql_db.js:62
Mar 06 08:58:02 [2021-03-06 07:58:02.874] [ERROR] server - Forcing an unclean exit...
Mar 06 08:58:10 ==========================
Mar 06 08:58:10 Etherpad start
Mar 06 08:58:10 ==========================
Mar 06 08:58:10 => Ensure directories
Mar 06 08:58:11 => Fixing up node_modules
Mar 06 08:58:11 => Ensuring cloudron plugin
Mar 06 08:59:39 npm WARN saveError ENOENT: no such file or directory, open '/app/code/package.json'
Mar 06 08:59:40 npm WARN saveError EROFS: read-only file system, open '/app/code/package-lock.json.1268770558'
Mar 06 08:59:40 npm WARN enoent ENOENT: no such file or directory, open '/app/code/package.json'
Mar 06 08:59:40 npm WARN ep_markdown@0.1.21 requires a peer of ep_headings2@* but none is installed. You must install peer dependencies yourself.
Mar 06 08:59:40 npm WARN code No description
Mar 06 08:59:41 npm WARN code No repository field.
Mar 06 08:59:41 npm WARN code No README data
Mar 06 08:59:41 npm WARN code No license field.
Mar 06 08:59:41
Mar 06 08:59:41 + ep_cloudron@4.1.0
Mar 06 08:59:41 updated 1 package and audited 1840 packages in 83.689s
Mar 06 08:59:46
Mar 06 08:59:46 84 packages are looking for funding
Mar 06 08:59:46 run `npm fund` for details
Mar 06 08:59:46
Mar 06 08:59:46 found 0 vulnerabilities

@girish said in Expand Matrix app features:

@yusf I have to look into the extensions more closely but do you know if these extensions are run in-process or out of process? For maintainability, out of process would be great.

what's the status of expanding matrix with bridges?
is there a how-to?

Cloudron updated to 6.1.2 and the same time, firewall started to drop packages:
in this case UDP 161/SNMP (and others) and NM-Management reported device down, so I realized quickly.

just restarting the FW with systemctl did not solve the pbl. had to reboot.

kudos to @girish
he found the real pbl. (out of i-nodes) within minutes.
from there, we could nail down the cause, by following this:
https://unix.stackexchange.com/questions/26598/how-can-i-increase-the-number-of-inodes-in-an-ext4-filesystem

TL,DR:
one cannot raise i-nodes after fs creation. normally, a tar from rootfs, reformat the rootfs, and restore would be necessary.
but to find out, who is consuming all the inodes, one can do the following:

try du -s --inodes * 2>/dev/null |sort -g then cd into the last dir in output and repeat.

Full Disclosure: not all OS's support --inodes flag for du command (my Mac OS does not) but many Linux OS's do.

one has to cd into the dir with the most i-nodes, recursively going down the tree and finally find the dir with the biggest i-node consumption.

in this case, as girish had mentioned, it was caused by not right configured nullmailer, writing tons of error-msg to /var/spool/nullmailer/failed useing 4.4M i-nodes…
deleting that dir eased the situation ad hoc.
rebooting the server and restart all failed apps (GUI & CLI) fixed it.

thanks for all your help