MySQL addon not starting

stratus41298

Hi folks,

I had this same exact thing happen to me, though not minio. I tried the recreate docker steps and got to the third step where it says, "This will take a while...........", but i'm probably on my second or third page of only dots at this point. I can't tell if anything's actually happening or not. When should I pull the plug and just do a restore? It's probably been about four hours.

stratus41298

That makes sense that there was no apt repo, but the fact was that we couldn't even get out to apt due to the DNS issue so i'd caution an immediate dismissal of AI hallucination. We were also able to get the healthcheck up and running for postgresql after it had gotten stuck during the docker recreate (see forked post) using AI as well so i'm not sure how many of the commands were inappropriate as they all went through. We did indeed disable resolved, stopped unbound, overrode resolv.conf (which i've done before for pihole many times), digged DNS, bypassed DNS using hosts, and I myself had previously performed a docker recreate. All of those commands exist except I guess the apt reinstall, but that's something I myself might have tried, if i'm being honest as it's a fairly common command on other apps.

After the 8.3.1 update many services wouldn't come up and nothing worked on this instance. I guess if you have all the information you care about on this issue, i'll go ahead and restore since i've been down for quite a while at this point.

I get the whole "AI = bad" thing, but I spent about 2 hours troubleshooting with GPT 4o (the paid version) and made significant progress until we hit a wall that we couldn't get around, which at least gave me satisfaction that we tried everything we could.

Take care.

stratus41298

It looks like maybe mySQL is still causing an issue? Not sure...
Screenshot 2025-03-31 211042.png

joseph

Can you check docker logs -f mysql as to why mysql is not starting up?

stratus41298

I let it run all night just to be safe and it's still doing the dots. I see a chown error?
Screenshot 2025-04-01 113725.png

nebulon

Seems like mysql itself started fine according to those logs. Where exactly is your Cloudron hanging at the moment?

stratus41298

All of the apps were stuck configuring (queued) and there was a banner at the top saying "starting services, this can take a while".

It stayed like that for quite a while so I checked the forums and saw the previous post. I tried the usual fixes of rebooting etc... But I noticed in services that mysql and postgres were spinning. I figured I'd give the docker rebuild a try rather than restore. Once I rebooted twice I got to the, "this will take a while........." And that's where it stayed.

joseph

@stratus41298 Can you check the file /home/yellowtent/platformdata/logs/box.log ? This should contain where it is getting stuck .

stratus41298

Here you go.

**********************************************************************

*** System restart required ***
Last login: Wed Apr  2 23:57:56 2025
cloudron:~$ sudo cat /home/yellowtent/platformdata/logs/box.log

2025-03-31T03:13:25.642Z box:updatechecker checkBoxUpdates: checking for updates
2025-03-31T03:13:25.843Z box:updatechecker checkBoxUpdates: no updates
2025-03-31T03:13:25.843Z box:updatechecker checkAppUpdates: checking for updates
2025-03-31T03:13:59.108Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:13:59.539Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T03:14:00.935Z box:shell services: systemctl is-active unbound
2025-03-31T03:14:00.939Z box:shell services: systemctl is-active nginx
2025-03-31T03:14:16.122Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:14:19.734Z box:shell system /usr/bin/sudo -S /home/yellowtent/box/src/scripts/reboot.sh
2025-03-31T03:14:20.182Z box:box Received SIGTERM. Shutting down.
2025-03-31T03:14:20.183Z box:platform uninitializing platform
2025-03-31T03:14:20.194Z box:shell system: /usr/bin/sudo -S /home/yellowtent/box/src/scripts/reboot.sh errored BoxError: system exited with code null signal SIGTERM
    at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19)
    at ChildProcess.emit (node:events:519:28)
    at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
  reason: 'Shell Error',
  details: {},
  code: null,
  signal: 'SIGTERM'
}
2025-03-31T03:14:20.197Z box:system reboot: could not reboot. BoxError: system exited with code null signal SIGTERM at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19) at ChildProcess.emit (node:events:519:28) at ChildProcess._handle.onexit (node:internal/child_process:294:12) { reason: 'Shell Error', details: {}, code: null, signal: 'SIGTERM' }
2025-03-31T03:14:20.235Z box:platform onDeactivated: stopping post activation services
2025-03-31T03:14:20.235Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T03:14:20.235Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T03:14:20.437Z box:shell All tasks stopped

HttpError: Expected "actual" to be strictly unequal to: null
    at BoxError.toHttpError (/home/yellowtent/box/src/boxerror.js:109:16)
    at get (/home/yellowtent/box/src/routes/services.js:38:37)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
  status: 500,
  internalError: AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: null
      at Object.query (/home/yellowtent/box/src/database.js:87:12)
      at get (/home/yellowtent/box/src/settings.js:61:35)
      at Object.getJson (/home/yellowtent/box/src/settings.js:77:34)
      at getConfig (/home/yellowtent/box/src/services.js:361:27)
      at getServiceConfig (/home/yellowtent/box/src/services.js:369:38)
      at Object.getServiceStatus (/home/yellowtent/box/src/services.js:414:27)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
    generatedMessage: true,
    code: 'ERR_ASSERTION',
    actual: null,
    expected: null,
    operator: 'notStrictEqual'
  },
  details: null
}
2025-03-31T03:16:37.637Z box:server ==========================================
2025-03-31T03:16:37.638Z box:server            Cloudron 8.3.1
2025-03-31T03:16:37.639Z box:server ==========================================
2025-03-31T03:16:37.639Z box:platform initialize: start platform
2025-03-31T03:16:39.844Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T03:16:39.844Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T03:16:41.767Z box:shell All tasks stopped

2025-03-31T03:16:45.573Z box:locks releaseAll: all locks released
2025-03-31T03:16:45.753Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-03-31T03:16:45.854Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-03-31T03:16:46.075Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-03-31T03:16:53.863Z box:platform onActivated: starting post activation services
2025-03-31T03:16:53.864Z box:platform startInfra: checking infrastructure
2025-03-31T03:16:53.910Z box:platform startInfra: updating infrastructure from 49.8.0 to 49.8.0
2025-03-31T03:16:53.910Z box:platform markApps: changedAddons: ["mysql","postgresql","mongodb","redis"]
2025-03-31T03:16:54.107Z box:services startServices: existing infra. incremental service create ["start","startTurn","startMysql","startPostgresql","startMongodb","startRedis","startGraphite","start"]
2025-03-31T03:16:54.108Z box:mailserver startMail: starting
2025-03-31T03:16:54.111Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-03-31T03:16:55.275Z box:locks write: current locks: {"mail_restart":null}
2025-03-31T03:16:55.275Z box:locks acquire: mail_restart
2025-03-31T03:16:55.352Z box:mailserver configureMail: stopping and deleting previous mail container
2025-03-31T03:17:37.666Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-03-31T03:17:40.248Z box:mailserver configureMail: starting mail container
2025-03-31T03:17:40.248Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=522021f2c68295261f295fca261a05ee2f347f625138cc677bcf5df8aa5c5fdc21560ebb33fa95c98b2d25eeddd573c54748c52b68e953c5177ccda6f72c320562f376981f326c76b506d91f9a874a382e053ef62865073692da5aa2a43debfa9c3bb8663b88cd8faacc469274bf45635056a5698c6aaecc8c50f84eba8d1000            -e CLOUDRON_RELAY_TOKEN=0e7ec23ad82b0bae3bdf563989bc8a8413162d8b5f429fbd46bbfce5aabe90b56d7b0da93f0739748751839eae37f0ff1949bad0ff8803d149cafb021c7a286704e029be3092f4f9f6ef0f5845aa1a5254959ab082bc2db17c0066e6ae872be42ac0ef09e161eef01e5f19354e27993fcaf049e392a85cfa603c75c0a9b7d0a7                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-03-31T03:18:38.481Z box:locks write: current locks: {}
2025-03-31T03:18:38.482Z box:locks release: mail_restart
2025-03-31T03:18:38.482Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-03-31T03:18:38.538Z box:services startTurn: stopping and deleting previous turn container
2025-03-31T03:19:04.126Z box:services startTurn: starting turn container
2025-03-31T03:19:04.126Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-03-31T03:19:15.440Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-03-31T03:19:15.446Z box:services startMysql: stopping and deleting previous mysql container
2025-03-31T03:19:34.856Z box:services startMysql: starting mysql container
2025-03-31T03:19:34.857Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=ebad60a56847c4c8b2a689e01e20e875e08f169d85beda1850e2a9f102e58898bd528f348b1b9c063dc16dd41237eb29f572ee97d96ef80221d8ebf18f60795c3ec524694d9dcb8e53d27386f6afbee8699da5913219166eee2ca25c84ec25f5a1131317fb22f4a9da92e0a0b4fe6008f3a8347c9f8743fcda890cd38bce6acb                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=0b123d12ac2400e06c57d1e9e5d4589a11fc495291d0045ade9d9726144c174b7112c812491765b37ad68841dca95df826d9e903bbf2478317f40972e13a927fb2f93732748c2c646648f9e5e8b67f8173f2e440b3ff5f4ec73e549f9f3d71f2c665c810bed562bed7a5ebfbe384b21c1ba9b0ca20c451cae60e2f754c8e6ce3                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-03-31T03:19:55.912Z box:services Waiting for mysql
2025-03-31T03:19:55.923Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T03:20:10.933Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T03:20:25.936Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T03:20:40.951Z box:services Attempt 4 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T03:20:55.953Z box:services Attempt 5 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T03:21:11.462Z box:services Attempt 6 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-03-31T03:21:20.967Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:21:21.741Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T03:21:22.094Z box:shell services: systemctl is-active unbound
2025-03-31T03:21:22.097Z box:shell services: systemctl is-active nginx
2025-03-31T03:21:26.687Z box:services Attempt 7 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-03-31T03:21:42.164Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
2025-03-31T03:21:42.573Z box:services configureService: postgresql rebuild=true
2025-03-31T03:21:42.576Z box:services startPostgresql: stopping and deleting previous postgresql container
2025-03-31T03:21:44.246Z box:services startPostgresql: postgresql will be upgraded
2025-03-31T03:21:44.247Z box:services exportDatabase: Exporting postgresql
2025-03-31T03:21:44.250Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
2025-03-31T03:21:44.251Z box:services Backing up postgresql
2025-03-31T03:21:44.257Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED172.18.30.2:3000 at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1350:47) at ClientRequest.emit (node:events:519:28) at emitErrorEvent (node:_http_client:101:11) at Socket.socketErrorListener (node:_http_client:504:5) atSocket.emit (node:events:519:28) at emitErrorNT (node:internal/streams/destroy:169:8) at emitErrorCloseNT (node:internal/streams/destroy:128:3) at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { reason: 'Network Error', details: {} }
2025-03-31T03:21:44.257Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED 172.18.30.2:3000
2025-03-31T03:21:44.257Z box:platform BoxError: Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED 172.18.30.2:3000
    at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1350:47)
    at ClientRequest.emit (node:events:519:28)
    at emitErrorEvent (node:_http_client:101:11)
    at Socket.socketErrorListener (node:_http_client:504:5)
    at Socket.emit (node:events:519:28)
    at emitErrorNT (node:internal/streams/destroy:169:8)
    at emitErrorCloseNT (node:internal/streams/destroy:128:3)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
2025-03-31T03:21:46.022Z box:services getServiceLogs: getting logs for mysql
2025-03-31T03:21:50.268Z box:services startPostgresql: starting postgresql container
2025-03-31T03:21:50.268Z box:shell services: /bin/bash -c docker run --restart=always -d --name=postgresql   --hostname postgresql                 --net cloudron                 --net-alias postgresql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock  --log-opt syslog-format=rfc5424                 --log-opt tag=postgresql                 --ip 172.18.30.2    --shm-size=128M                 -e CLOUDRON_POSTGRESQL_ROOT_PASSWORD=b665caae06f5a5109bd1ca5f9246380950393bffd3c54f34823e0fcba311260597473fbcf1b28948c893bdf05f8a4caf14a916bac99db01d15ca8301eb57e8d9c7459f263037eda2cbf7cada26016f2915ab51d371a72647b27af7de27b7643cb84f51f488586239375480a7e42cc3ed501a68507e93da75c30cc5b081ed2ebc                 -e CLOUDRON_POSTGRESQL_TOKEN=6840b183874cadf1a94f533cf74a00e82b61e9dd3fff8a118d0945ee47c2e2985c2a39b4d4d384de69ead291bd2710aa57905cd75c1f598215e6e8b3bb673e665ce7370421654e7547bece206c6be9e4806c8200ebaa11ac233c2923733c102f55d9b862d491df3b2694ae7656aae0ca51fc4420d6bbd944509eca42da512999                 -v /home/yellowtent/platformdata/postgresql:/var/lib/postgresql        --label isCloudronManaged=true                  -v /tmp -v /run registry.docker.com/cloudron/postgresql:6.0.1@sha256:c24dc6ff43cc4f7dc080836adf5e9fd0d1e0e65b44b4e2d107faa379cb0185ab /bin/bash -c 'echo "Debug mode. Sleeping" && sleep infinity'
2025-03-31T03:21:51.515Z box:services configureService: mysql rebuild=true
2025-03-31T03:21:51.517Z box:services startMysql: stopping and deleting previous mysql container
2025-03-31T03:22:00.073Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:22:00.720Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T03:22:01.009Z box:shell services: systemctl is-active unbound
2025-03-31T03:22:01.168Z box:shell services: systemctl is-active nginx
2025-03-31T03:22:01.481Z box:services startMysql: starting mysql container
2025-03-31T03:22:01.482Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=854694e85433131dbd968220d06ee7a81d384c4078f389125c32832fa3c172be302d289947cd61a862ecf0522d7bf81d14f68ea3b6acf91acca1e384dc69304bd2ce7f56cc150f56c521f57030f7baa903fa602035602c4e7c1cb7ddf7582a6ce296de38c90ae7263ea47a75738104321cfbf3fa66770da9ae2b1ce03cf274d7                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=3f2ab0be1e77d7233ab062d8fa0460a79b3fc4f3e308b0219473cae1b6e5ae1ecb6c5fb691efd9999f80ca4f198ac51497ba96cd5edcdac41c8600912b16a09c78a9ae41a79957711ffe7e345fdc10460048a024abb31c5890e7e55acd395e1f56ad5f7c2439b906508412a2cddc853294f0edf9ff2a5c2792642d4b7208182b                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                  -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280 /bin/bash -c 'echo "Debug mode. Sleeping" && sleep infinity'
2025-03-31T03:22:03.035Z box:services applyMemoryLimit: postgresql {"memoryLimit":1073741824,"recoveryMode":true}
2025-03-31T03:22:03.035Z box:shell docker: docker update --memory 1073741824 --memory-swap -1 postgresql
2025-03-31T03:22:07.409Z box:services applyMemoryLimit: mysql {"memoryLimit":1342177280,"recoveryMode":true}
2025-03-31T03:22:07.409Z box:shell docker: docker update --memory 1342177280 --memory-swap -1 mysql
2025-03-31T03:22:08.433Z box:services getServiceLogs: getting logs for mysql
2025-03-31T03:22:50.048Z box:services configureService: mysql rebuild=false
2025-03-31T03:22:50.050Z box:services applyMemoryLimit: mysql {"memoryLimit":1879048192,"recoveryMode":true}
2025-03-31T03:22:50.050Z box:shell docker: docker update --memory 1879048192 --memory-swap -1 mysql
2025-03-31T03:23:01.784Z box:services configureService: postgresql rebuild=false
2025-03-31T03:23:01.785Z box:services applyMemoryLimit: postgresql {"memoryLimit":2013265920,"recoveryMode":true}
2025-03-31T03:23:01.785Z box:shell docker: docker update --memory 2013265920 --memory-swap -1 postgresql
2025-03-31T03:23:07.915Z box:services configureService: mysql rebuild=true
2025-03-31T03:23:07.917Z box:services startMysql: stopping and deleting previous mysql container
2025-03-31T03:23:11.835Z box:services configureService: postgresql rebuild=true
2025-03-31T03:23:11.839Z box:services startPostgresql: stopping and deleting previous postgresql container
2025-03-31T03:23:23.064Z box:services getServiceLogs: getting logs for mysql
2025-03-31T03:23:26.170Z box:services startPostgresql: starting postgresql container
2025-03-31T03:23:26.170Z box:shell services: /bin/bash -c docker run --restart=always -d --name=postgresql   --hostname postgresql                 --net cloudron                 --net-alias postgresql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock  --log-opt syslog-format=rfc5424                 --log-opt tag=postgresql                 --ip 172.18.30.2    --shm-size=128M                 -e CLOUDRON_POSTGRESQL_ROOT_PASSWORD=9ee85f2580f1a3ba8900440e92cf952f4b859e47a6caf0ab3fe29915c00c79f4ba864cec7e30ce3b5132f8c23d1cf38fcf22e65c1e012c75175b0a5af27ae1e9b2137b50278df31909ef93c1c1fc6e03d226f19194cedd1f6fee9d974f93b08307edcce7277a77ae5eb97ecbb232821bc21586a137c12b0cbb0253eb7160c7ac                 -e CLOUDRON_POSTGRESQL_TOKEN=5868baf82ca3d6c2c69e25a4557aa62261d290d273dd58a419c28d37dae06bb977213233b702881a9025a5ac841c7b161d507287387c78131b61b25bb2662d06df5d13d7a0a47f3be843ffcbf94bdb8da83676c3274101aa635e7bb1867cf7b51ed01f74dc6978eaf9be114c74edc56fc7b1090b41dabd4a942c0a9bdeeb133b                 -v /home/yellowtent/platformdata/postgresql:/var/lib/postgresql        --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/postgresql:6.0.1@sha256:c24dc6ff43cc4f7dc080836adf5e9fd0d1e0e65b44b4e2d107faa379cb0185ab
2025-03-31T03:23:32.665Z box:services Waiting for postgresql
2025-03-31T03:23:32.671Z box:services Attempt 1 failed. Will retry: Network error waiting for postgresql: connect ECONNREFUSED 172.18.30.2:3000
2025-03-31T03:23:41.829Z box:services getServiceLogs: getting logs for mysql
2025-03-31T03:23:47.924Z box:services applyMemoryLimit: postgresql {"memoryLimit":2013265920,"recoveryMode":false}
2025-03-31T03:23:47.924Z box:shell docker: docker update --memory 2013265920 --memory-swap -1 postgresql
2025-03-31T03:23:54.537Z box:services getServiceLogs: getting logs for postgresql
2025-03-31T03:24:28.209Z box:services getServiceLogs: getting logs for postgresql
2025-03-31T03:24:39.922Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:24:40.382Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T03:24:40.598Z box:shell services: systemctl is-active nginx
2025-03-31T03:24:40.604Z box:shell services: systemctl is-active unbound
2025-03-31T03:24:59.835Z box:services configureService: postgresql rebuild=false
2025-03-31T03:24:59.837Z box:services applyMemoryLimit: postgresql {"memoryLimit":1342177280,"recoveryMode":false}
2025-03-31T03:24:59.837Z box:shell docker: docker update --memory 1342177280 --memory-swap -1 postgresql
2025-03-31T03:25:37.083Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T03:25:37.758Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T03:25:37.913Z box:shell services: systemctl is-active unbound
2025-03-31T03:25:38.033Z box:shell services: systemctl is-active nginx
2025-03-31T03:25:45.936Z box:services getServiceLogs: getting logs for mysql
2025-03-31T03:27:01.382Z box:services configureService: mysql rebuild=false
2025-03-31T03:27:01.383Z box:services applyMemoryLimit: mysql {"memoryLimit":2550136832,"recoveryMode":false}
2025-03-31T03:27:01.384Z box:shell docker: docker update --memory 2550136832 --memory-swap -1 mysql
2025-03-31T03:29:03.081Z box:services configureService: mysql rebuild=false
2025-03-31T03:29:03.090Z box:services applyMemoryLimit: mysql {"memoryLimit":2550136832,"recoveryMode":false}
2025-03-31T03:29:03.090Z box:shell docker: docker update --memory 2550136832 --memory-swap -1 mysql
2025-03-31T17:59:00.006Z box:box Received SIGTERM. Shutting down.
2025-03-31T17:59:00.006Z box:platform uninitializing platform
2025-03-31T17:59:00.073Z box:platform onDeactivated: stopping post activation services
2025-03-31T17:59:00.074Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T17:59:00.075Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T17:59:00.253Z box:shell All tasks stopped

2025-03-31T18:00:39.073Z box:server ==========================================
2025-03-31T18:00:39.074Z box:server            Cloudron 8.3.1
2025-03-31T18:00:39.074Z box:server ==========================================
2025-03-31T18:00:39.074Z box:platform initialize: start platform
2025-03-31T18:00:40.179Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T18:00:40.179Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T18:00:40.628Z box:shell All tasks stopped

2025-03-31T18:00:41.686Z box:locks releaseAll: all locks released
2025-03-31T18:00:41.864Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-03-31T18:00:42.170Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-03-31T18:00:42.363Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-03-31T18:00:45.531Z box:platform onActivated: starting post activation services
2025-03-31T18:00:45.532Z box:platform startInfra: checking infrastructure
2025-03-31T18:00:45.545Z box:platform startInfra: updating infrastructure from 49.8.0 to 49.8.0
2025-03-31T18:00:45.545Z box:platform markApps: changedAddons: ["mysql","postgresql","mongodb","redis"]
2025-03-31T18:00:46.428Z box:services startServices: existing infra. incremental service create ["start","startTurn","startMysql","startPostgresql","startMongodb","startRedis","startGraphite","start"]
2025-03-31T18:00:46.428Z box:mailserver startMail: starting
2025-03-31T18:00:46.433Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-03-31T18:00:47.065Z box:locks write: current locks: {"mail_restart":null}
2025-03-31T18:00:47.065Z box:locks acquire: mail_restart
2025-03-31T18:00:47.074Z box:mailserver configureMail: stopping and deleting previous mail container
2025-03-31T18:01:35.443Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-03-31T18:01:35.639Z box:mailserver configureMail: starting mail container
2025-03-31T18:01:35.639Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=2110af8ba5f376c53c75485690d8a9f42106c20743e5aa2f88df67d4ef444dfde6ba10e6868f7a70b38b2281b7c5bdd133f7cb74224f478ec1756af27eeb2c75ac04f718de9c96b51ddc26c189ec6573fa4028ac15e8e4982b1cc4b5775c4ed767caeb4ed8f17b4834698be6f516f3a5cff60a3df062fba563680a860ce1e1fd            -e CLOUDRON_RELAY_TOKEN=382ade952e64c50db1d8218703020f63d11589a1f559b178c36e0466c086f0900b31ce07c6b3bf6b83ea7442125052db25913febe558226ae18369beeed6bde83577ced853705b4c29a2e2d360271f43e1ee8e08c0b9592e61e36ef68afcb763e347d60b52651ed3bbf7ce8acc81afbdbf64cfc953a15540dfe433e9a080e80c                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-03-31T18:02:12.082Z box:locks write: current locks: {}
2025-03-31T18:02:12.082Z box:locks release: mail_restart
2025-03-31T18:02:12.082Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-03-31T18:02:12.091Z box:services startTurn: stopping and deleting previous turn container
2025-03-31T18:02:35.199Z box:services startTurn: starting turn container
2025-03-31T18:02:35.199Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-03-31T18:02:41.824Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-03-31T18:02:41.834Z box:services startMysql: stopping and deleting previous mysql container
2025-03-31T18:03:01.809Z box:services startMysql: starting mysql container
2025-03-31T18:03:01.809Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=3d318a97bfff10f57e3b557c0e92a5bedadd1e97a79463043588de6ac39ad625adbfe1b004ad44f1945ed72b139b5e02cc767f75116e42d2fc6e930ab5b76161b125a3f78297ac49d06556cd004f27bcd291a2f3588d4810238a4134cd02195318d07b5fbf7ca0438790d3466cfcfdcf4e996da5bea1e615e5c2f7933bb94007                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=e5f88fc1d5042192d1efb08b77f8e5dd516aaff89aedc8b4968b859d3362de112fb1ab595d784256e70435dae66384759f19289982108f8fc36e777c75319f672e1fd06629715c561324ca05ece36bbea0f2ebf24c4c345565a5fff9fc9df414cec40228fa1c48495b0c58df5507bdd6f9c7707aa4df8fc973cbaaa42179d753                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-03-31T18:03:12.329Z box:services Waiting for mysql
2025-03-31T18:03:12.337Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:03:27.346Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:03:42.362Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000

stratus41298

2025-03-31T18:03:57.365Z box:services Attempt 4 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:04:12.368Z box:services Attempt 5 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:04:27.791Z box:box Received SIGTERM. Shutting down.
2025-03-31T18:04:27.792Z box:platform uninitializing platform
2025-03-31T18:04:27.794Z box:platform onDeactivated: stopping post activation services
2025-03-31T18:04:27.794Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T18:04:27.794Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T18:04:27.822Z box:shell All tasks stopped

2025-03-31T18:04:28.015Z box:services Attempt 6 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-03-31T18:18:31.807Z box:server ==========================================
2025-03-31T18:18:31.809Z box:server            Cloudron 8.3.1
2025-03-31T18:18:31.809Z box:server ==========================================
2025-03-31T18:18:31.809Z box:platform initialize: start platform
2025-03-31T18:18:31.907Z box:tasks stopAllTasks: stopping all tasks
2025-03-31T18:18:31.907Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-03-31T18:18:31.998Z box:shell All tasks stopped

2025-03-31T18:18:32.392Z box:locks releaseAll: all locks released
2025-03-31T18:18:32.439Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-03-31T18:18:32.617Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-03-31T18:18:32.663Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-03-31T18:18:34.600Z box:platform onActivated: starting post activation services
2025-03-31T18:18:34.601Z box:platform startInfra: checking infrastructure
2025-03-31T18:18:34.602Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
2025-03-31T18:18:34.602Z box:platform markApps: reconfiguring apps
2025-03-31T18:18:34.602Z box:reverseproxy removeAppConfigs: removing app nginx configs
2025-03-31T18:18:34.923Z box:apps configureApps: marking cloud.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:35.603Z box:apps configureApps: marked 3147d06c-a773-4d59-b8d7-170517ef116c for re-configure with taskId 14249
2025-03-31T18:18:35.603Z box:apps configureApps: marking send.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:35.995Z box:apps configureApps: marked 560f6a5c-55de-433b-92c5-737f8ec678a6 for re-configure with taskId 14250
2025-03-31T18:18:35.995Z box:apps configureApps: marking cloud.hlhphotos.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:36.403Z box:apps configureApps: marked 6deb5899-a69c-4c85-a050-7fe5dbdcac8a for re-configure with taskId 14251
2025-03-31T18:18:36.403Z box:apps configureApps: marking blog.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:36.686Z box:apps configureApps: marked 7aab94d0-57f9-47f9-9c4e-44d308a436e8 for re-configure with taskId 14252
2025-03-31T18:18:36.686Z box:apps configureApps: marking project.hopefullylevelheaded.com for reconfigure (scheduleNow:false)
2025-03-31T18:18:36.978Z box:apps configureApps: marked 7bdabb63-43c6-4f0c-beff-5636b81d1b95 for re-configure with taskId 14253
2025-03-31T18:18:36.978Z box:apps configureApps: marking secret.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:37.261Z box:apps configureApps: marked 8f185540-993d-4de2-9282-7f24789553fc for re-configure with taskId 14254
2025-03-31T18:18:37.261Z box:apps configureApps: marking me.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:37.653Z box:apps configureApps: marked bbb8aa64-c1d4-4d47-ba2e-17b8e7e76434 for re-configure with taskId 14255
2025-03-31T18:18:37.653Z box:apps configureApps: marking leantime.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:37.994Z box:apps configureApps: marked d02843ef-6725-4a21-8a57-246de35f9fa8 for re-configure with taskId 14256
2025-03-31T18:18:37.994Z box:apps configureApps: marking edit.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
2025-03-31T18:18:38.294Z box:apps configureApps: marked df360484-c000-4666-94c6-4cd2272151d8 for re-configure with taskId 14257
2025-03-31T18:18:38.294Z box:platform removeAllContainers: removing all containers for infra upgrade
2025-03-31T18:18:38.294Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
2025-03-31T18:18:38.318Z box:platform createDockerNetwork: recreating docker network
2025-03-31T18:18:38.318Z box:shell platform: docker network rm -f cloudron
2025-03-31T18:18:38.359Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
2025-03-31T18:18:39.091Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
2025-03-31T18:18:39.092Z box:mailserver startMail: starting
2025-03-31T18:18:39.097Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-03-31T18:18:39.210Z box:locks write: current locks: {"mail_restart":null}
2025-03-31T18:18:39.210Z box:locks acquire: mail_restart
2025-03-31T18:18:39.218Z box:mailserver configureMail: stopping and deleting previous mail container
2025-03-31T18:18:39.237Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-03-31T18:18:39.320Z box:mailserver configureMail: starting mail container
2025-03-31T18:18:39.321Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=6a031485bd2f38213e1712f11dca281f9de0c064bbbaf4f395c41a309e07c8c3b2e1cce27a770b49e9729be3d2b10eccee43176c8f547850337d12779e9e6af66210d3556b34f3b3cea23c4d5754b96702dbd04f7f3da6df57bc76b10cd16e53f94a68b6863cf2f30bd21bc83dd2ddf7ba8b68ac02e75e3e646b96ae9bda13dd            -e CLOUDRON_RELAY_TOKEN=e5557b05e35adc01b3f41b33d3972e082c8282adb673960d12f314feabf0b1190acaa3d2f3acd4ce054d924aae05f6b526336bfa9842dad22346a225f1a744e781ee03a288a940663b4ea1181a9c54714d8e67f284e21b0761027ac16982524b8a19aa55748603c9e040b704fb9cc22f63c2e9f658ceb9caa42c7657b825b37d                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-03-31T18:18:52.456Z box:locks write: current locks: {}
2025-03-31T18:18:52.456Z box:locks release: mail_restart
2025-03-31T18:18:52.457Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-03-31T18:18:52.465Z box:services startTurn: stopping and deleting previous turn container
2025-03-31T18:18:52.470Z box:services startTurn: starting turn container
2025-03-31T18:18:52.470Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-03-31T18:18:57.683Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-03-31T18:18:57.689Z box:services startMysql: stopping and deleting previous mysql container
2025-03-31T18:18:57.694Z box:services startMysql: starting mysql container
2025-03-31T18:18:57.694Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=02b5ac1afe345cc775b0dce98f560a4405728946b68bfa63d738182ce6ab3c2898de69ee5048d52922331f2ea6c4976bc4ae9e04511bdbbf71ce44da513faf16e861f278ddb36ff7852718d430048b7f6af95ff8631037cd0ef98bb1e28f15dd5629c59cb30ec240dce2d384ccc02366bcfa555eee413487b51551d358a62269                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=32cefb55bb775b6540f2a72bbde8cdaaf179acf2737272df35804a6c675e43aacd81c63f62274bbd9be82ad3cb19e96f00d1e1836f16d4354346ac76f579ed0c951bedf1297e103eac18122d695df4eb80903d911c5438d38db903f3007613ae322fbf1dc2e0734a542d88c642d4d476651a75d61ba0a4ad08b852df6397c01d                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-03-31T18:19:10.201Z box:services Waiting for mysql
2025-03-31T18:19:10.213Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:19:25.220Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:19:40.224Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-03-31T18:19:55.768Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
2025-03-31T18:19:55.773Z box:services startPostgresql: postgresql will be upgraded
2025-03-31T18:19:55.773Z box:services exportDatabase: Exporting postgresql
2025-03-31T18:19:55.779Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
2025-03-31T18:19:55.780Z box:services Backing up postgresql
2025-03-31T18:19:55.784Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
2025-03-31T18:19:55.784Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
2025-03-31T18:19:55.785Z box:platform BoxError: Unable to find container postgresql
    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
2025-03-31T19:56:14.205Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T19:56:14.963Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T19:56:15.247Z box:shell services: systemctl is-active unbound
2025-03-31T19:56:15.255Z box:shell services: systemctl is-active nginx
2025-03-31T20:55:32.324Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T20:55:32.825Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T20:55:33.180Z box:shell services: systemctl is-active unbound
2025-03-31T20:55:33.183Z box:shell services: systemctl is-active nginx
2025-03-31T23:39:41.075Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T23:39:41.322Z box:shell services: systemctl is-active unbound
2025-03-31T23:39:41.434Z box:shell services: systemctl is-active nginx
2025-03-31T23:43:30.647Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T23:43:31.189Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T23:43:31.456Z box:shell services: systemctl is-active nginx
2025-03-31T23:43:31.464Z box:shell services: systemctl is-active unbound
2025-03-31T23:43:56.735Z box:shell services: grep -q avx /proc/cpuinfo
2025-03-31T23:43:56.984Z box:shell services: systemctl is-active unbound
2025-03-31T23:43:56.990Z box:shell services: systemctl is-active nginx
2025-03-31T23:44:03.283Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
2025-03-31T23:44:03.354Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory

2025-03-31T23:44:03.354Z box:shell false

2025-03-31T23:44:27.358Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-03-31T23:44:28.587Z box:shell mounts: mountpoint -q -- /mnt/cloudronbackup
2025-04-01T01:05:05.305Z box:box Received SIGTERM. Shutting down.
2025-04-01T01:05:05.305Z box:platform uninitializing platform
2025-04-01T01:05:05.308Z box:platform onDeactivated: stopping post activation services
2025-04-01T01:05:05.308Z box:tasks stopAllTasks: stopping all tasks
2025-04-01T01:05:05.312Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-04-01T01:05:05.345Z box:shell All tasks stopped

2025-04-01T01:05:14.730Z box:server ==========================================
2025-04-01T01:05:14.731Z box:server            Cloudron 8.3.1
2025-04-01T01:05:14.731Z box:server ==========================================
2025-04-01T01:05:14.731Z box:platform initialize: start platform
2025-04-01T01:05:14.768Z box:tasks stopAllTasks: stopping all tasks
2025-04-01T01:05:14.769Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-04-01T01:05:14.859Z box:shell All tasks stopped

2025-04-01T01:05:15.923Z box:locks releaseAll: all locks released
2025-04-01T01:05:15.928Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-04-01T01:05:15.937Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-04-01T01:05:15.948Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-04-01T01:05:16.624Z box:platform onActivated: starting post activation services
2025-04-01T01:05:16.626Z box:platform startInfra: checking infrastructure
2025-04-01T01:05:16.626Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
2025-04-01T01:05:16.627Z box:platform markApps: reconfiguring apps
2025-04-01T01:05:16.627Z box:reverseproxy removeAppConfigs: removing app nginx configs
2025-04-01T01:05:16.659Z box:platform removeAllContainers: removing all containers for infra upgrade
2025-04-01T01:05:16.659Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
2025-04-01T01:05:16.680Z box:platform removeAllContainers: stopping and removing 4e3f8a0712ee
2025-04-01T01:05:16.680Z box:shell platform: docker stop 4e3f8a0712ee
2025-04-01T01:05:24.828Z box:shell platform: docker rm -f 4e3f8a0712ee
2025-04-01T01:05:25.807Z box:platform removeAllContainers: stopping and removing 01c0887bfca0
2025-04-01T01:05:25.807Z box:shell platform: docker stop 01c0887bfca0
2025-04-01T01:05:37.095Z box:shell platform: docker rm -f 01c0887bfca0
2025-04-01T01:05:37.462Z box:platform removeAllContainers: stopping and removing 913d0e63ddaf

stratus41298

2025-04-01T01:05:37.462Z box:shell platform: docker stop 913d0e63ddaf
2025-04-01T01:05:43.061Z box:shell platform: docker rm -f 913d0e63ddaf
2025-04-01T01:05:43.496Z box:platform createDockerNetwork: recreating docker network
2025-04-01T01:05:43.497Z box:shell platform: docker network rm -f cloudron
2025-04-01T01:05:44.274Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
2025-04-01T01:05:44.763Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
2025-04-01T01:05:44.764Z box:mailserver startMail: starting
2025-04-01T01:05:44.768Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-04-01T01:05:44.872Z box:locks write: current locks: {"mail_restart":null}
2025-04-01T01:05:44.872Z box:locks acquire: mail_restart
2025-04-01T01:05:44.886Z box:mailserver configureMail: stopping and deleting previous mail container
2025-04-01T01:05:44.912Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-04-01T01:05:44.922Z box:mailserver configureMail: starting mail container
2025-04-01T01:05:44.922Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=c05f8214c1146e22a46316d68fe6874190ca2a180fc8b9aa3130fdd3585a62129c67620b24bef204078186a619bc0929272a6e57b3f66886fee7ed9312b64d6243dd07a374e6af3b584a9b815283d4de46b9e2ededc00c74f820100f2056933c63d6599add108cf525d8d6d710d8f3586205b5049d84ffa86866d78a4a8d8ea6            -e CLOUDRON_RELAY_TOKEN=ca6423deb379ceeb825a09fc1a636586bd0a4fa223c8ffd6e0e48e666c721a85e255ab0a7d538ab0d2f942da4af54fb0832369327e6d7ea467088809cb2312c8313d0d4306377c2692c89afbb735cec1a8c3cb045f5fc5af325a14f9787118b5e7a1c3f86fdad3ae20035fce5be5c66733b73ba493418dce18261e150c64fb28                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-04-01T01:05:49.604Z box:locks write: current locks: {}
2025-04-01T01:05:49.604Z box:locks release: mail_restart
2025-04-01T01:05:49.605Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-04-01T01:05:49.614Z box:services startTurn: stopping and deleting previous turn container
2025-04-01T01:05:49.624Z box:services startTurn: starting turn container
2025-04-01T01:05:49.624Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-04-01T01:05:53.563Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-04-01T01:05:53.569Z box:services startMysql: stopping and deleting previous mysql container
2025-04-01T01:05:53.582Z box:services startMysql: starting mysql container
2025-04-01T01:05:53.582Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=5f41ef1daee14c3a5d31b5dc12122dd7211de3fd802bbd4292a254fe2766fd684db952e57f4bbecc3f03b40edc831c25e0b1e1d02e4499ea94ead7c64d635158db9d0ba9d4235a801bbfa23c6a7d9b80294d84df3d8670eebf94044eeca50b678cc392073df05501d99f30651185e1525a708c60c43d2bc07b4766c8aecc21ba                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=ed8e8295784b922e63e25e84dafc9553283970779f1681d89067bb8565d5f446490a939ebcbbb426b38987a394ce9946d3c466d07efbc6b82cf3a581a0bbdbf8d01696e129dfe7cb58258866114851a6414e4c04defb45f12c7d17b2dd8107a58978ede718699d8b842bef11880ab88b760fdc7d83118e1764280cf8129aed45                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-04-01T01:05:57.358Z box:services Waiting for mysql
2025-04-01T01:05:57.367Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-01T01:06:12.375Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-01T01:06:27.631Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-04-01T01:06:42.874Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
2025-04-01T01:06:42.877Z box:services startPostgresql: postgresql will be upgraded
2025-04-01T01:06:42.878Z box:services exportDatabase: Exporting postgresql
2025-04-01T01:06:42.885Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
2025-04-01T01:06:42.885Z box:services Backing up postgresql
2025-04-01T01:06:42.888Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
2025-04-01T01:06:42.888Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
2025-04-01T01:06:42.888Z box:platform BoxError: Unable to find container postgresql
    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
2025-04-01T01:07:06.871Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-04-01T01:07:07.304Z box:shell services: grep -q avx /proc/cpuinfo
2025-04-01T01:07:07.396Z box:shell services: systemctl is-active unbound
2025-04-01T01:07:07.509Z box:shell services: systemctl is-active nginx
2025-04-01T01:07:27.807Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-04-01T01:07:28.722Z box:shell mounts: mountpoint -q -- /mnt/cloudronbackup
2025-04-01T01:07:52.957Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
2025-04-01T01:07:52.968Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory

2025-04-01T01:07:52.969Z box:shell false

2025-04-01T01:13:29.280Z box:user notifyLoginLocation: uid-dc448a93-1ce7-4d9a-ac7a-e1faba413c8d 192.168.50.2 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36
2025-04-01T01:14:15.784Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
2025-04-01T01:14:15.795Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory

2025-04-01T01:14:15.795Z box:shell false

2025-04-01T01:14:58.298Z box:box Received SIGTERM. Shutting down.
2025-04-01T01:14:58.298Z box:platform uninitializing platform
2025-04-01T01:14:58.300Z box:platform onDeactivated: stopping post activation services
2025-04-01T01:14:58.300Z box:tasks stopAllTasks: stopping all tasks
2025-04-01T01:14:58.300Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-04-01T01:14:58.328Z box:shell All tasks stopped

2025-04-01T01:15:02.313Z box:server ==========================================
2025-04-01T01:15:02.313Z box:server            Cloudron 8.3.1
2025-04-01T01:15:02.313Z box:server ==========================================
2025-04-01T01:15:02.314Z box:platform initialize: start platform
2025-04-01T01:15:02.348Z box:tasks stopAllTasks: stopping all tasks
2025-04-01T01:15:02.348Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-04-01T01:15:02.383Z box:shell All tasks stopped

2025-04-01T01:15:02.850Z box:locks releaseAll: all locks released
2025-04-01T01:15:02.856Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-04-01T01:15:02.863Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-04-01T01:15:02.874Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-04-01T01:15:03.278Z box:platform onActivated: starting post activation services
2025-04-01T01:15:03.278Z box:platform startInfra: checking infrastructure
2025-04-01T01:15:03.279Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
2025-04-01T01:15:03.298Z box:platform markApps: reconfiguring apps
2025-04-01T01:15:03.298Z box:reverseproxy removeAppConfigs: removing app nginx configs
2025-04-01T01:15:03.330Z box:platform removeAllContainers: removing all containers for infra upgrade
2025-04-01T01:15:03.330Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
2025-04-01T01:15:03.360Z box:platform removeAllContainers: stopping and removing 5b25b2c59cbe
2025-04-01T01:15:03.360Z box:shell platform: docker stop 5b25b2c59cbe
2025-04-01T01:15:08.502Z box:shell platform: docker rm -f 5b25b2c59cbe
2025-04-01T01:15:09.039Z box:platform removeAllContainers: stopping and removing 3af5ff670ea1
2025-04-01T01:15:09.039Z box:shell platform: docker stop 3af5ff670ea1
2025-04-01T01:15:20.257Z box:shell platform: docker rm -f 3af5ff670ea1
2025-04-01T01:15:20.708Z box:platform removeAllContainers: stopping and removing 1c45f903edf4
2025-04-01T01:15:20.709Z box:shell platform: docker stop 1c45f903edf4
2025-04-01T01:15:26.517Z box:shell platform: docker rm -f 1c45f903edf4
2025-04-01T01:15:26.902Z box:platform createDockerNetwork: recreating docker network
2025-04-01T01:15:26.902Z box:shell platform: docker network rm -f cloudron
2025-04-01T01:15:27.765Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
2025-04-01T01:15:28.203Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
2025-04-01T01:15:28.203Z box:mailserver startMail: starting
2025-04-01T01:15:28.207Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-04-01T01:15:28.313Z box:locks write: current locks: {"mail_restart":null}
2025-04-01T01:15:28.313Z box:locks acquire: mail_restart
2025-04-01T01:15:28.324Z box:mailserver configureMail: stopping and deleting previous mail container
2025-04-01T01:15:28.343Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-04-01T01:15:28.347Z box:mailserver configureMail: starting mail container
2025-04-01T01:15:28.347Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=e193c77f0c7fbaea669901e75397e2eb802f1b6b4d3195d1e60a8be234636f49620c3121561c6757a09f7afb9e5825a57aee74e6370124f7b539621f983bcd4ae587be6d1acdf8fc67b15832aba0354fecc37458bc5d56fccbb9bdee25f994583c2cba28f6f9d48353d141b0b44f44134b1fdfcb748a1b59daa1bceff9c1f503            -e CLOUDRON_RELAY_TOKEN=d1749634d5113fe1c4c09cdeaa0ddf6cdf473080c6a7893cd9c36dd64707d548020fa65859ea4f65339e2b2d34b0e7e004fc4f3aa7af0a03de2d4fcf57b3d25d778ab279fd11f46fc38015f395c97682693e0086a0c6b6d4f8555828a68259ad26d8e1f409171a343ed1eb30189abe7ddb4de9ec64d472b5389e307c911be2ab                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-04-01T01:15:32.783Z box:locks write: current locks: {}
2025-04-01T01:15:32.783Z box:locks release: mail_restart
2025-04-01T01:15:32.784Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-04-01T01:15:32.791Z box:services startTurn: stopping and deleting previous turn container
2025-04-01T01:15:32.796Z box:services startTurn: starting turn container
2025-04-01T01:15:32.796Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-04-01T01:15:36.909Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-04-01T01:15:36.926Z box:services startMysql: stopping and deleting previous mysql container
2025-04-01T01:15:36.933Z box:services startMysql: starting mysql container
2025-04-01T01:15:36.933Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=1885ed4ab1851e763171680d3b7443077f43a345fc4b8222d183bcd21437ae56d3a09c502becd8bdb23dcd25f2e4c97bf1ae52eb47ee8e83298b1547e828d1bd23c4620cd2978742ab9bd0c95e9a555fb912c9690cbb745f2dd1e88b4b325ce6f138d0f05a9c2ce9454cb78799fe9f4a032f6eb68fb3b27063f88742cb6e715a                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=3e8ce027c04caea01a1a956d46d7c9fad00d00b79d26d27f9439662e96fbaf38bf86f7fb6fd3191426cf29969a0b06cab4a9bf5206fff01de0abc3ae450631881868bb2475f628c61f3335c4c427a8ce16dee38e4b7a61c1936b6c75575c77933cf18fafc1a3dbb99fce4e44dcba57ad7b0cbf5a08d9c54a88e21aa7eadb5629                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-04-01T01:15:42.220Z box:services Waiting for mysql
2025-04-01T01:15:42.230Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-01T01:15:57.233Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-01T01:16:12.471Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-04-01T01:16:28.345Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
2025-04-01T01:16:28.348Z box:services startPostgresql: postgresql will be upgraded
2025-04-01T01:16:28.349Z box:services exportDatabase: Exporting postgresql
2025-04-01T01:16:28.354Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
2025-04-01T01:16:28.354Z box:services Backing up postgresql
2025-04-01T01:16:28.357Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
2025-04-01T01:16:28.358Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
2025-04-01T01:16:28.358Z box:platform BoxError: Unable to find container postgresql
    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
2025-04-02T22:37:24.205Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
2025-04-02T22:37:24.216Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory

2025-04-02T22:37:24.216Z box:shell false

2025-04-02T22:37:44.881Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
HttpError: Unknown error: 400 <html>
<head><title>400 Bad Request</title></head>
<body>
<center><h1>400 Bad Request</h1></center>
<hr><center>nginx</center>
</body>
</html>

    at getSystemGraphs (/home/yellowtent/box/src/routes/system.js:126:28)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
  status: 500,
  internalError: BoxError: Unknown error: 400 <html>
  <head><title>400 Bad Request</title></head>
  <body>
  <center><h1>400 Bad Request</h1></center>
  <hr><center>nginx</center>
  </body>
  </html>

      at Object.getSystem (/home/yellowtent/box/src/graphs.js:106:46)
      at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
    reason: 'External Error',
    details: {}
  },
  details: {}
}

I'll be away all day tomorrow so take your time. Thank you for your help!

nebulon

Thanks for the detailed logs. For a start it seems mysql is actually not the issue but the postgresql addon causes trouble. Is that service up and running?

The Expected "actual" to be strictly unequal to: null error can be ignored here, as it just happened while the process was winding down and the mysql (host instance, not service addon, Cloudron has two) connection was already terminated. Not nice to assert here, but also harmless.

stratus41298

When I first noticed the problem that and mysql were down. I was able to restart postgres but not mysql. Today I was able to restart all services, but there was no effect to the environment. I resumed the docker recreate and am now waiting for a result. I'll let you know. Thank you.

stratus41298

Alas, still seeing the same thing after about six hours. I noticed that the recreate-docker shut down a lot of services so I bounced them again and they are showing up in the event log as rebuilt, but it's seemed to have no effect in the terminal; just endless dots. There is a reboot required so i'm tempted to do that and see how it goes, but also don't want to interrupt the process if it's actually doing something.
Screenshot 2025-04-05 163423.png

BrutalBirdie

I've seen something like this before.
=> https://forum.cloudron.io/post/94377

Can you please share the box.log of that failed attempt?

stratus41298

Much less in there this time:

@cloudron:~$ sudo cat /home/yellowtent/platformdata/logs/box.log
[sudo] password for :
2025-04-06T00:18:41.199Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-04-06T00:18:41.849Z box:shell services: grep -q avx /proc/cpuinfo
2025-04-06T00:18:42.065Z box:shell services: systemctl is-active unbound
2025-04-06T00:18:42.132Z box:shell services: systemctl is-active nginx
2025-04-06T00:18:51.922Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
2025-04-06T00:18:51.933Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory

2025-04-06T00:18:51.933Z box:shell false

stratus41298

Did that reboot it was asking for. Came back and the same services were down again.

New box.log after reboot:

Screenshot 2025-04-05 203212.png

2025-04-06T00:30:35.868Z box:server ==========================================
2025-04-06T00:30:35.870Z box:server            Cloudron 8.3.1
2025-04-06T00:30:35.870Z box:server ==========================================
2025-04-06T00:30:35.870Z box:platform initialize: start platform
2025-04-06T00:30:36.079Z box:tasks stopAllTasks: stopping all tasks
2025-04-06T00:30:36.079Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
2025-04-06T00:30:36.268Z box:shell All tasks stopped

2025-04-06T00:30:37.082Z box:locks releaseAll: all locks released
2025-04-06T00:30:37.158Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
2025-04-06T00:30:37.227Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
2025-04-06T00:30:37.265Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-04-06T00:30:39.353Z box:platform onActivated: starting post activation services
2025-04-06T00:30:39.353Z box:platform startInfra: checking infrastructure
2025-04-06T00:30:39.365Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
2025-04-06T00:30:39.365Z box:platform markApps: reconfiguring apps
2025-04-06T00:30:39.366Z box:reverseproxy removeAppConfigs: removing app nginx configs
2025-04-06T00:30:39.479Z box:platform removeAllContainers: removing all containers for infra upgrade
2025-04-06T00:30:39.479Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
2025-04-06T00:30:39.502Z box:platform removeAllContainers: stopping and removing e77cfa1fb71d
2025-04-06T00:30:39.502Z box:shell platform: docker stop e77cfa1fb71d
2025-04-06T00:30:44.009Z box:shell platform: docker rm -f e77cfa1fb71d
2025-04-06T00:30:44.967Z box:platform removeAllContainers: stopping and removing 3af0b28f8899
2025-04-06T00:30:44.967Z box:shell platform: docker stop 3af0b28f8899
2025-04-06T00:30:48.236Z box:shell platform: docker rm -f 3af0b28f8899
2025-04-06T00:30:49.250Z box:platform removeAllContainers: stopping and removing 254b1c19f3af
2025-04-06T00:30:49.250Z box:shell platform: docker stop 254b1c19f3af
2025-04-06T00:30:53.888Z box:shell platform: docker rm -f 254b1c19f3af
2025-04-06T00:30:54.687Z box:platform removeAllContainers: stopping and removing 3ca2ffe09606
2025-04-06T00:30:54.687Z box:shell platform: docker stop 3ca2ffe09606
2025-04-06T00:31:04.508Z box:shell platform: docker rm -f 3ca2ffe09606
2025-04-06T00:31:06.291Z box:platform removeAllContainers: stopping and removing 197cd2129268
2025-04-06T00:31:06.292Z box:shell platform: docker stop 197cd2129268
2025-04-06T00:31:09.682Z box:shell platform: docker rm -f 197cd2129268
2025-04-06T00:31:10.643Z box:platform removeAllContainers: stopping and removing 0bfbc0e4cc90
2025-04-06T00:31:10.643Z box:shell platform: docker stop 0bfbc0e4cc90
2025-04-06T00:31:16.299Z box:shell platform: docker rm -f 0bfbc0e4cc90
2025-04-06T00:31:17.164Z box:platform removeAllContainers: stopping and removing c87aa4f6d6e9
2025-04-06T00:31:17.164Z box:shell platform: docker stop c87aa4f6d6e9
2025-04-06T00:31:29.125Z box:shell platform: docker rm -f c87aa4f6d6e9

stratus41298

2025-04-06T00:31:29.650Z box:platform removeAllContainers: stopping and removing 82ff73d0f943
2025-04-06T00:31:29.651Z box:shell platform: docker stop 82ff73d0f943
2025-04-06T00:31:40.939Z box:shell platform: docker rm -f 82ff73d0f943
2025-04-06T00:31:41.380Z box:platform removeAllContainers: stopping and removing b8ebac43901c
2025-04-06T00:31:41.380Z box:shell platform: docker stop b8ebac43901c
2025-04-06T00:31:47.702Z box:shell platform: docker rm -f b8ebac43901c
2025-04-06T00:31:48.170Z box:platform createDockerNetwork: recreating docker network
2025-04-06T00:31:48.170Z box:shell platform: docker network rm -f cloudron
2025-04-06T00:31:48.942Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
2025-04-06T00:31:49.408Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
2025-04-06T00:31:49.408Z box:mailserver startMail: starting
2025-04-06T00:31:49.411Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
2025-04-06T00:31:49.507Z box:locks write: current locks: {"mail_restart":null}
2025-04-06T00:31:49.507Z box:locks acquire: mail_restart
2025-04-06T00:31:49.518Z box:mailserver configureMail: stopping and deleting previous mail container
2025-04-06T00:31:49.537Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
2025-04-06T00:31:49.612Z box:mailserver configureMail: starting mail container
2025-04-06T00:31:49.613Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1                 --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=b1323c8162862c3c9f73cfddd65cdc37761b1316b80ea7b626a257b3aec90e077007ac33255b0855191299f33b490228b9904af26b251ed6876fd9e56d54c4c88ec1111884c6d9559e598d3785b2de4f0f89f96297a980b406e5ea6a5078f4727023f2886f34e5726624be27c9d2b1fd73770d126c740f035ce6bbf37e4d697e                 -e CLOUDRON_RELAY_TOKEN=3c622e0c2f602488debbfaab91e101a164ddc8058b08bd83eac9f4c011ede0c5c5804d63999f72e44aa5bd694b44c44776d47b5e025a9917dc3e5c6b2a024c36ce3829c2626d6223bcfb26b8b47491721cd2ecc7d8493407139d92a294ae05d26379f197d948f0086069ad65e59fa16544e415d40c139d584dddeb115d2d9502                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true                 --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
2025-04-06T00:31:58.071Z box:locks write: current locks: {}
2025-04-06T00:31:58.071Z box:locks release: mail_restart
2025-04-06T00:31:58.071Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
2025-04-06T00:31:58.079Z box:services startTurn: stopping and deleting previous turn container
2025-04-06T00:31:58.085Z box:services startTurn: starting turn container
2025-04-06T00:31:58.085Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
2025-04-06T00:32:02.815Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
2025-04-06T00:32:03.400Z box:shell services: grep -q avx /proc/cpuinfo
2025-04-06T00:32:03.720Z box:shell services: systemctl is-active unbound
2025-04-06T00:32:03.728Z box:shell services: systemctl is-active nginx
2025-04-06T00:32:06.333Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
2025-04-06T00:32:06.337Z box:services startMysql: stopping and deleting previous mysql container
2025-04-06T00:32:06.343Z box:services startMysql: starting mysql container
2025-04-06T00:32:06.344Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=985d03b1df1c62feffc9fe7064da8300b7793d9ebf437ad4b33b3bca6f3b0cb21a88cda345c2e2edd6a4f03d100ad0f1d52239f4dd2d3615164ae0d31b420cc9ce336ab325c887a972df953d557ad9ce08e4f7bb31ec4bd2f544bc9695fa888bd9e65b641d91401f0cb7e8d1e98cb67f7247770a7a20c2c91c42d51375463f64                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=31803f70cf6bfdc77e859e7d182c52633bf2e6de21b6e494e52c4d1fbb47703f3a71b54f05e041117e0e6c9694c88c416f79522ecc0111585da86b74ffb9c567c45cf095a26de5396bf7ec0187b2bb722f16ed5afe9cdf97dab8b494492acded7818de789efb10833d498839d1e8c06616fc9c0f08b9901bfad13c5b7d7bb657                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
2025-04-06T00:32:10.503Z box:services Waiting for mysql
2025-04-06T00:32:10.509Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-06T00:32:25.511Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
2025-04-06T00:32:40.753Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
2025-04-06T00:32:56.076Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
2025-04-06T00:32:56.080Z box:services startPostgresql: postgresql will be upgraded
2025-04-06T00:32:56.080Z box:services exportDatabase: Exporting postgresql
2025-04-06T00:32:56.085Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
2025-04-06T00:32:56.086Z box:services Backing up postgresql
2025-04-06T00:32:56.089Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
2025-04-06T00:32:56.089Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
2025-04-06T00:32:56.089Z box:platform BoxError: Unable to find container postgresql
    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)

BrutalBirdie

I see a pattern that everytime it postgresql tries to touch app 3147d06c-a773-4d59-b8d7-170517ef116c it errors.
What app is 3147d06c-a773-4d59-b8d7-170517ef116c on your system?

stratus41298

That would be my nextcloud app. I could maybe try to archive the app to preserve the whole system. I don't appear to have much recourse from the GUI due to the app being busy, but if there's some other CLI command I could run, let me know.

I also see these connection refused errors with redis, which also stay down upon reboot:

2025-04-06T16:48:40.302Z box:services Attempt 1 failed. Will retry: Network error waiting for redis-3147d06c-a773-4d59-b8d7-170517ef116c: connect ECONNREFUSED 172.18.0.2:3000
2025-04-06T16:48:43.538Z box:services Waiting for redis-6deb5899-a69c-4c85-a050-7fe5dbdcac8a
2025-04-06T16:48:43.543Z box:services Attempt 1 failed. Will retry: Network error waiting for redis-6deb5899-a69c-4c85-a050-7fe5dbdcac8a: connect ECONNREFUSED 172.18.0.3:3000

Is this normal behavior? I've never had a firewall issue with this instance before. Seems like all of this started happening after 8.3.1.

stratus41298

Okay, so it seems like postgresql is actually running fine, but cloudron/docker can't seem to pass a health check:

[GET] /healthcheck
healthcheck: disconnected
[GET] /healthcheck
healthcheck: disconnected

Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.

Cloudron Forum

MySQL addon not starting