Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Support
  3. MySQL addon not starting

MySQL addon not starting

Scheduled Pinned Locked Moved Solved Support
mysql
25 Posts 5 Posters 898 Views 5 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic was forked from Restarting - Waiting for a platform to initialize joseph
This topic has been deleted. Only users with topic management privileges can see it.
  • J Offline
    J Offline
    joseph
    Staff
    wrote on last edited by
    #3

    Can you check docker logs -f mysql as to why mysql is not starting up?

    1 Reply Last reply
    0
    • J joseph marked this topic as a question on
    • S Offline
      S Offline
      stratus41298
      wrote on last edited by stratus41298
      #4

      I let it run all night just to be safe and it's still doing the dots. I see a chown error?
      Screenshot 2025-04-01 113725.png

      1 Reply Last reply
      1
      • nebulonN Offline
        nebulonN Offline
        nebulon
        Staff
        wrote on last edited by
        #5

        Seems like mysql itself started fine according to those logs. Where exactly is your Cloudron hanging at the moment?

        1 Reply Last reply
        0
        • S Offline
          S Offline
          stratus41298
          wrote on last edited by
          #6

          All of the apps were stuck configuring (queued) and there was a banner at the top saying "starting services, this can take a while".

          It stayed like that for quite a while so I checked the forums and saw the previous post. I tried the usual fixes of rebooting etc... But I noticed in services that mysql and postgres were spinning. I figured I'd give the docker rebuild a try rather than restore. Once I rebooted twice I got to the, "this will take a while........." And that's where it stayed.

          J 1 Reply Last reply
          1
          • S stratus41298

            All of the apps were stuck configuring (queued) and there was a banner at the top saying "starting services, this can take a while".

            It stayed like that for quite a while so I checked the forums and saw the previous post. I tried the usual fixes of rebooting etc... But I noticed in services that mysql and postgres were spinning. I figured I'd give the docker rebuild a try rather than restore. Once I rebooted twice I got to the, "this will take a while........." And that's where it stayed.

            J Offline
            J Offline
            joseph
            Staff
            wrote on last edited by
            #7

            @stratus41298 Can you check the file /home/yellowtent/platformdata/logs/box.log ? This should contain where it is getting stuck .

            1 Reply Last reply
            0
            • S Offline
              S Offline
              stratus41298
              wrote on last edited by
              #8

              Here you go.

              **********************************************************************
              
              *** System restart required ***
              Last login: Wed Apr  2 23:57:56 2025
              cloudron:~$ sudo cat /home/yellowtent/platformdata/logs/box.log
              
              2025-03-31T03:13:25.642Z box:updatechecker checkBoxUpdates: checking for updates
              2025-03-31T03:13:25.843Z box:updatechecker checkBoxUpdates: no updates
              2025-03-31T03:13:25.843Z box:updatechecker checkAppUpdates: checking for updates
              2025-03-31T03:13:59.108Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:13:59.539Z box:shell services: grep -q avx /proc/cpuinfo
              2025-03-31T03:14:00.935Z box:shell services: systemctl is-active unbound
              2025-03-31T03:14:00.939Z box:shell services: systemctl is-active nginx
              2025-03-31T03:14:16.122Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:14:19.734Z box:shell system /usr/bin/sudo -S /home/yellowtent/box/src/scripts/reboot.sh
              2025-03-31T03:14:20.182Z box:box Received SIGTERM. Shutting down.
              2025-03-31T03:14:20.183Z box:platform uninitializing platform
              2025-03-31T03:14:20.194Z box:shell system: /usr/bin/sudo -S /home/yellowtent/box/src/scripts/reboot.sh errored BoxError: system exited with code null signal SIGTERM
                  at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19)
                  at ChildProcess.emit (node:events:519:28)
                  at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
                reason: 'Shell Error',
                details: {},
                code: null,
                signal: 'SIGTERM'
              }
              2025-03-31T03:14:20.197Z box:system reboot: could not reboot. BoxError: system exited with code null signal SIGTERM at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19) at ChildProcess.emit (node:events:519:28) at ChildProcess._handle.onexit (node:internal/child_process:294:12) { reason: 'Shell Error', details: {}, code: null, signal: 'SIGTERM' }
              2025-03-31T03:14:20.235Z box:platform onDeactivated: stopping post activation services
              2025-03-31T03:14:20.235Z box:tasks stopAllTasks: stopping all tasks
              2025-03-31T03:14:20.235Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
              2025-03-31T03:14:20.437Z box:shell All tasks stopped
              
              HttpError: Expected "actual" to be strictly unequal to: null
                  at BoxError.toHttpError (/home/yellowtent/box/src/boxerror.js:109:16)
                  at get (/home/yellowtent/box/src/routes/services.js:38:37)
                  at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
                status: 500,
                internalError: AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: null
                    at Object.query (/home/yellowtent/box/src/database.js:87:12)
                    at get (/home/yellowtent/box/src/settings.js:61:35)
                    at Object.getJson (/home/yellowtent/box/src/settings.js:77:34)
                    at getConfig (/home/yellowtent/box/src/services.js:361:27)
                    at getServiceConfig (/home/yellowtent/box/src/services.js:369:38)
                    at Object.getServiceStatus (/home/yellowtent/box/src/services.js:414:27)
                    at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
                  generatedMessage: true,
                  code: 'ERR_ASSERTION',
                  actual: null,
                  expected: null,
                  operator: 'notStrictEqual'
                },
                details: null
              }
              2025-03-31T03:16:37.637Z box:server ==========================================
              2025-03-31T03:16:37.638Z box:server            Cloudron 8.3.1
              2025-03-31T03:16:37.639Z box:server ==========================================
              2025-03-31T03:16:37.639Z box:platform initialize: start platform
              2025-03-31T03:16:39.844Z box:tasks stopAllTasks: stopping all tasks
              2025-03-31T03:16:39.844Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
              2025-03-31T03:16:41.767Z box:shell All tasks stopped
              
              2025-03-31T03:16:45.573Z box:locks releaseAll: all locks released
              2025-03-31T03:16:45.753Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
              2025-03-31T03:16:45.854Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
              2025-03-31T03:16:46.075Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
              2025-03-31T03:16:53.863Z box:platform onActivated: starting post activation services
              2025-03-31T03:16:53.864Z box:platform startInfra: checking infrastructure
              2025-03-31T03:16:53.910Z box:platform startInfra: updating infrastructure from 49.8.0 to 49.8.0
              2025-03-31T03:16:53.910Z box:platform markApps: changedAddons: ["mysql","postgresql","mongodb","redis"]
              2025-03-31T03:16:54.107Z box:services startServices: existing infra. incremental service create ["start","startTurn","startMysql","startPostgresql","startMongodb","startRedis","startGraphite","start"]
              2025-03-31T03:16:54.108Z box:mailserver startMail: starting
              2025-03-31T03:16:54.111Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
              2025-03-31T03:16:55.275Z box:locks write: current locks: {"mail_restart":null}
              2025-03-31T03:16:55.275Z box:locks acquire: mail_restart
              2025-03-31T03:16:55.352Z box:mailserver configureMail: stopping and deleting previous mail container
              2025-03-31T03:17:37.666Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
              2025-03-31T03:17:40.248Z box:mailserver configureMail: starting mail container
              2025-03-31T03:17:40.248Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=522021f2c68295261f295fca261a05ee2f347f625138cc677bcf5df8aa5c5fdc21560ebb33fa95c98b2d25eeddd573c54748c52b68e953c5177ccda6f72c320562f376981f326c76b506d91f9a874a382e053ef62865073692da5aa2a43debfa9c3bb8663b88cd8faacc469274bf45635056a5698c6aaecc8c50f84eba8d1000            -e CLOUDRON_RELAY_TOKEN=0e7ec23ad82b0bae3bdf563989bc8a8413162d8b5f429fbd46bbfce5aabe90b56d7b0da93f0739748751839eae37f0ff1949bad0ff8803d149cafb021c7a286704e029be3092f4f9f6ef0f5845aa1a5254959ab082bc2db17c0066e6ae872be42ac0ef09e161eef01e5f19354e27993fcaf049e392a85cfa603c75c0a9b7d0a7                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
              2025-03-31T03:18:38.481Z box:locks write: current locks: {}
              2025-03-31T03:18:38.482Z box:locks release: mail_restart
              2025-03-31T03:18:38.482Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
              2025-03-31T03:18:38.538Z box:services startTurn: stopping and deleting previous turn container
              2025-03-31T03:19:04.126Z box:services startTurn: starting turn container
              2025-03-31T03:19:04.126Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
              2025-03-31T03:19:15.440Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
              2025-03-31T03:19:15.446Z box:services startMysql: stopping and deleting previous mysql container
              2025-03-31T03:19:34.856Z box:services startMysql: starting mysql container
              2025-03-31T03:19:34.857Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=ebad60a56847c4c8b2a689e01e20e875e08f169d85beda1850e2a9f102e58898bd528f348b1b9c063dc16dd41237eb29f572ee97d96ef80221d8ebf18f60795c3ec524694d9dcb8e53d27386f6afbee8699da5913219166eee2ca25c84ec25f5a1131317fb22f4a9da92e0a0b4fe6008f3a8347c9f8743fcda890cd38bce6acb                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=0b123d12ac2400e06c57d1e9e5d4589a11fc495291d0045ade9d9726144c174b7112c812491765b37ad68841dca95df826d9e903bbf2478317f40972e13a927fb2f93732748c2c646648f9e5e8b67f8173f2e440b3ff5f4ec73e549f9f3d71f2c665c810bed562bed7a5ebfbe384b21c1ba9b0ca20c451cae60e2f754c8e6ce3                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
              2025-03-31T03:19:55.912Z box:services Waiting for mysql
              2025-03-31T03:19:55.923Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T03:20:10.933Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T03:20:25.936Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T03:20:40.951Z box:services Attempt 4 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T03:20:55.953Z box:services Attempt 5 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T03:21:11.462Z box:services Attempt 6 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
              2025-03-31T03:21:20.967Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:21:21.741Z box:shell services: grep -q avx /proc/cpuinfo
              2025-03-31T03:21:22.094Z box:shell services: systemctl is-active unbound
              2025-03-31T03:21:22.097Z box:shell services: systemctl is-active nginx
              2025-03-31T03:21:26.687Z box:services Attempt 7 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
              2025-03-31T03:21:42.164Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
              2025-03-31T03:21:42.573Z box:services configureService: postgresql rebuild=true
              2025-03-31T03:21:42.576Z box:services startPostgresql: stopping and deleting previous postgresql container
              2025-03-31T03:21:44.246Z box:services startPostgresql: postgresql will be upgraded
              2025-03-31T03:21:44.247Z box:services exportDatabase: Exporting postgresql
              2025-03-31T03:21:44.250Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
              2025-03-31T03:21:44.251Z box:services Backing up postgresql
              2025-03-31T03:21:44.257Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED172.18.30.2:3000 at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1350:47) at ClientRequest.emit (node:events:519:28) at emitErrorEvent (node:_http_client:101:11) at Socket.socketErrorListener (node:_http_client:504:5) atSocket.emit (node:events:519:28) at emitErrorNT (node:internal/streams/destroy:169:8) at emitErrorCloseNT (node:internal/streams/destroy:128:3) at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { reason: 'Network Error', details: {} }
              2025-03-31T03:21:44.257Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED 172.18.30.2:3000
              2025-03-31T03:21:44.257Z box:platform BoxError: Could not pipe http://172.18.30.2:3000/databases/db3147d06ca7734d59b8d7170517ef116c/backup?access_token=58280df0d744960e94aba33dd113a97c34c4b5a980e54e3264be0e2ebd840456090c9e3140da777474ea0706cef091aa9e6d0de12fb46ebf974aa719116f73a370d0b2f2139d0165de3578e6c903a5f450b5bd75904e4e3d4a6205bf2afdd3280d8a5a804ac90ef1ed879f5232c56d2dfecdf3fd33ea04be6266279e97851981 to /home/yellowtent/appsdata/3147d06c-a773-4d59-b8d7-170517ef116c/postgresqldump: connect ECONNREFUSED 172.18.30.2:3000
                  at ClientRequest.<anonymous> (/home/yellowtent/box/src/services.js:1350:47)
                  at ClientRequest.emit (node:events:519:28)
                  at emitErrorEvent (node:_http_client:101:11)
                  at Socket.socketErrorListener (node:_http_client:504:5)
                  at Socket.emit (node:events:519:28)
                  at emitErrorNT (node:internal/streams/destroy:169:8)
                  at emitErrorCloseNT (node:internal/streams/destroy:128:3)
                  at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
              2025-03-31T03:21:46.022Z box:services getServiceLogs: getting logs for mysql
              2025-03-31T03:21:50.268Z box:services startPostgresql: starting postgresql container
              2025-03-31T03:21:50.268Z box:shell services: /bin/bash -c docker run --restart=always -d --name=postgresql   --hostname postgresql                 --net cloudron                 --net-alias postgresql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock  --log-opt syslog-format=rfc5424                 --log-opt tag=postgresql                 --ip 172.18.30.2    --shm-size=128M                 -e CLOUDRON_POSTGRESQL_ROOT_PASSWORD=b665caae06f5a5109bd1ca5f9246380950393bffd3c54f34823e0fcba311260597473fbcf1b28948c893bdf05f8a4caf14a916bac99db01d15ca8301eb57e8d9c7459f263037eda2cbf7cada26016f2915ab51d371a72647b27af7de27b7643cb84f51f488586239375480a7e42cc3ed501a68507e93da75c30cc5b081ed2ebc                 -e CLOUDRON_POSTGRESQL_TOKEN=6840b183874cadf1a94f533cf74a00e82b61e9dd3fff8a118d0945ee47c2e2985c2a39b4d4d384de69ead291bd2710aa57905cd75c1f598215e6e8b3bb673e665ce7370421654e7547bece206c6be9e4806c8200ebaa11ac233c2923733c102f55d9b862d491df3b2694ae7656aae0ca51fc4420d6bbd944509eca42da512999                 -v /home/yellowtent/platformdata/postgresql:/var/lib/postgresql        --label isCloudronManaged=true                  -v /tmp -v /run registry.docker.com/cloudron/postgresql:6.0.1@sha256:c24dc6ff43cc4f7dc080836adf5e9fd0d1e0e65b44b4e2d107faa379cb0185ab /bin/bash -c 'echo "Debug mode. Sleeping" && sleep infinity'
              2025-03-31T03:21:51.515Z box:services configureService: mysql rebuild=true
              2025-03-31T03:21:51.517Z box:services startMysql: stopping and deleting previous mysql container
              2025-03-31T03:22:00.073Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:22:00.720Z box:shell services: grep -q avx /proc/cpuinfo
              2025-03-31T03:22:01.009Z box:shell services: systemctl is-active unbound
              2025-03-31T03:22:01.168Z box:shell services: systemctl is-active nginx
              2025-03-31T03:22:01.481Z box:services startMysql: starting mysql container
              2025-03-31T03:22:01.482Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=854694e85433131dbd968220d06ee7a81d384c4078f389125c32832fa3c172be302d289947cd61a862ecf0522d7bf81d14f68ea3b6acf91acca1e384dc69304bd2ce7f56cc150f56c521f57030f7baa903fa602035602c4e7c1cb7ddf7582a6ce296de38c90ae7263ea47a75738104321cfbf3fa66770da9ae2b1ce03cf274d7                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=3f2ab0be1e77d7233ab062d8fa0460a79b3fc4f3e308b0219473cae1b6e5ae1ecb6c5fb691efd9999f80ca4f198ac51497ba96cd5edcdac41c8600912b16a09c78a9ae41a79957711ffe7e345fdc10460048a024abb31c5890e7e55acd395e1f56ad5f7c2439b906508412a2cddc853294f0edf9ff2a5c2792642d4b7208182b                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                  -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280 /bin/bash -c 'echo "Debug mode. Sleeping" && sleep infinity'
              2025-03-31T03:22:03.035Z box:services applyMemoryLimit: postgresql {"memoryLimit":1073741824,"recoveryMode":true}
              2025-03-31T03:22:03.035Z box:shell docker: docker update --memory 1073741824 --memory-swap -1 postgresql
              2025-03-31T03:22:07.409Z box:services applyMemoryLimit: mysql {"memoryLimit":1342177280,"recoveryMode":true}
              2025-03-31T03:22:07.409Z box:shell docker: docker update --memory 1342177280 --memory-swap -1 mysql
              2025-03-31T03:22:08.433Z box:services getServiceLogs: getting logs for mysql
              2025-03-31T03:22:50.048Z box:services configureService: mysql rebuild=false
              2025-03-31T03:22:50.050Z box:services applyMemoryLimit: mysql {"memoryLimit":1879048192,"recoveryMode":true}
              2025-03-31T03:22:50.050Z box:shell docker: docker update --memory 1879048192 --memory-swap -1 mysql
              2025-03-31T03:23:01.784Z box:services configureService: postgresql rebuild=false
              2025-03-31T03:23:01.785Z box:services applyMemoryLimit: postgresql {"memoryLimit":2013265920,"recoveryMode":true}
              2025-03-31T03:23:01.785Z box:shell docker: docker update --memory 2013265920 --memory-swap -1 postgresql
              2025-03-31T03:23:07.915Z box:services configureService: mysql rebuild=true
              2025-03-31T03:23:07.917Z box:services startMysql: stopping and deleting previous mysql container
              2025-03-31T03:23:11.835Z box:services configureService: postgresql rebuild=true
              2025-03-31T03:23:11.839Z box:services startPostgresql: stopping and deleting previous postgresql container
              2025-03-31T03:23:23.064Z box:services getServiceLogs: getting logs for mysql
              2025-03-31T03:23:26.170Z box:services startPostgresql: starting postgresql container
              2025-03-31T03:23:26.170Z box:shell services: /bin/bash -c docker run --restart=always -d --name=postgresql   --hostname postgresql                 --net cloudron                 --net-alias postgresql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock  --log-opt syslog-format=rfc5424                 --log-opt tag=postgresql                 --ip 172.18.30.2    --shm-size=128M                 -e CLOUDRON_POSTGRESQL_ROOT_PASSWORD=9ee85f2580f1a3ba8900440e92cf952f4b859e47a6caf0ab3fe29915c00c79f4ba864cec7e30ce3b5132f8c23d1cf38fcf22e65c1e012c75175b0a5af27ae1e9b2137b50278df31909ef93c1c1fc6e03d226f19194cedd1f6fee9d974f93b08307edcce7277a77ae5eb97ecbb232821bc21586a137c12b0cbb0253eb7160c7ac                 -e CLOUDRON_POSTGRESQL_TOKEN=5868baf82ca3d6c2c69e25a4557aa62261d290d273dd58a419c28d37dae06bb977213233b702881a9025a5ac841c7b161d507287387c78131b61b25bb2662d06df5d13d7a0a47f3be843ffcbf94bdb8da83676c3274101aa635e7bb1867cf7b51ed01f74dc6978eaf9be114c74edc56fc7b1090b41dabd4a942c0a9bdeeb133b                 -v /home/yellowtent/platformdata/postgresql:/var/lib/postgresql        --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/postgresql:6.0.1@sha256:c24dc6ff43cc4f7dc080836adf5e9fd0d1e0e65b44b4e2d107faa379cb0185ab
              2025-03-31T03:23:32.665Z box:services Waiting for postgresql
              2025-03-31T03:23:32.671Z box:services Attempt 1 failed. Will retry: Network error waiting for postgresql: connect ECONNREFUSED 172.18.30.2:3000
              2025-03-31T03:23:41.829Z box:services getServiceLogs: getting logs for mysql
              2025-03-31T03:23:47.924Z box:services applyMemoryLimit: postgresql {"memoryLimit":2013265920,"recoveryMode":false}
              2025-03-31T03:23:47.924Z box:shell docker: docker update --memory 2013265920 --memory-swap -1 postgresql
              2025-03-31T03:23:54.537Z box:services getServiceLogs: getting logs for postgresql
              2025-03-31T03:24:28.209Z box:services getServiceLogs: getting logs for postgresql
              2025-03-31T03:24:39.922Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:24:40.382Z box:shell services: grep -q avx /proc/cpuinfo
              2025-03-31T03:24:40.598Z box:shell services: systemctl is-active nginx
              2025-03-31T03:24:40.604Z box:shell services: systemctl is-active unbound
              2025-03-31T03:24:59.835Z box:services configureService: postgresql rebuild=false
              2025-03-31T03:24:59.837Z box:services applyMemoryLimit: postgresql {"memoryLimit":1342177280,"recoveryMode":false}
              2025-03-31T03:24:59.837Z box:shell docker: docker update --memory 1342177280 --memory-swap -1 postgresql
              2025-03-31T03:25:37.083Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
              2025-03-31T03:25:37.758Z box:shell services: grep -q avx /proc/cpuinfo
              2025-03-31T03:25:37.913Z box:shell services: systemctl is-active unbound
              2025-03-31T03:25:38.033Z box:shell services: systemctl is-active nginx
              2025-03-31T03:25:45.936Z box:services getServiceLogs: getting logs for mysql
              2025-03-31T03:27:01.382Z box:services configureService: mysql rebuild=false
              2025-03-31T03:27:01.383Z box:services applyMemoryLimit: mysql {"memoryLimit":2550136832,"recoveryMode":false}
              2025-03-31T03:27:01.384Z box:shell docker: docker update --memory 2550136832 --memory-swap -1 mysql
              2025-03-31T03:29:03.081Z box:services configureService: mysql rebuild=false
              2025-03-31T03:29:03.090Z box:services applyMemoryLimit: mysql {"memoryLimit":2550136832,"recoveryMode":false}
              2025-03-31T03:29:03.090Z box:shell docker: docker update --memory 2550136832 --memory-swap -1 mysql
              2025-03-31T17:59:00.006Z box:box Received SIGTERM. Shutting down.
              2025-03-31T17:59:00.006Z box:platform uninitializing platform
              2025-03-31T17:59:00.073Z box:platform onDeactivated: stopping post activation services
              2025-03-31T17:59:00.074Z box:tasks stopAllTasks: stopping all tasks
              2025-03-31T17:59:00.075Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
              2025-03-31T17:59:00.253Z box:shell All tasks stopped
              
              2025-03-31T18:00:39.073Z box:server ==========================================
              2025-03-31T18:00:39.074Z box:server            Cloudron 8.3.1
              2025-03-31T18:00:39.074Z box:server ==========================================
              2025-03-31T18:00:39.074Z box:platform initialize: start platform
              2025-03-31T18:00:40.179Z box:tasks stopAllTasks: stopping all tasks
              2025-03-31T18:00:40.179Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
              2025-03-31T18:00:40.628Z box:shell All tasks stopped
              
              2025-03-31T18:00:41.686Z box:locks releaseAll: all locks released
              2025-03-31T18:00:41.864Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
              2025-03-31T18:00:42.170Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
              2025-03-31T18:00:42.363Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
              2025-03-31T18:00:45.531Z box:platform onActivated: starting post activation services
              2025-03-31T18:00:45.532Z box:platform startInfra: checking infrastructure
              2025-03-31T18:00:45.545Z box:platform startInfra: updating infrastructure from 49.8.0 to 49.8.0
              2025-03-31T18:00:45.545Z box:platform markApps: changedAddons: ["mysql","postgresql","mongodb","redis"]
              2025-03-31T18:00:46.428Z box:services startServices: existing infra. incremental service create ["start","startTurn","startMysql","startPostgresql","startMongodb","startRedis","startGraphite","start"]
              2025-03-31T18:00:46.428Z box:mailserver startMail: starting
              2025-03-31T18:00:46.433Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
              2025-03-31T18:00:47.065Z box:locks write: current locks: {"mail_restart":null}
              2025-03-31T18:00:47.065Z box:locks acquire: mail_restart
              2025-03-31T18:00:47.074Z box:mailserver configureMail: stopping and deleting previous mail container
              2025-03-31T18:01:35.443Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
              2025-03-31T18:01:35.639Z box:mailserver configureMail: starting mail container
              2025-03-31T18:01:35.639Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=2110af8ba5f376c53c75485690d8a9f42106c20743e5aa2f88df67d4ef444dfde6ba10e6868f7a70b38b2281b7c5bdd133f7cb74224f478ec1756af27eeb2c75ac04f718de9c96b51ddc26c189ec6573fa4028ac15e8e4982b1cc4b5775c4ed767caeb4ed8f17b4834698be6f516f3a5cff60a3df062fba563680a860ce1e1fd            -e CLOUDRON_RELAY_TOKEN=382ade952e64c50db1d8218703020f63d11589a1f559b178c36e0466c086f0900b31ce07c6b3bf6b83ea7442125052db25913febe558226ae18369beeed6bde83577ced853705b4c29a2e2d360271f43e1ee8e08c0b9592e61e36ef68afcb763e347d60b52651ed3bbf7ce8acc81afbdbf64cfc953a15540dfe433e9a080e80c                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
              2025-03-31T18:02:12.082Z box:locks write: current locks: {}
              2025-03-31T18:02:12.082Z box:locks release: mail_restart
              2025-03-31T18:02:12.082Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
              2025-03-31T18:02:12.091Z box:services startTurn: stopping and deleting previous turn container
              2025-03-31T18:02:35.199Z box:services startTurn: starting turn container
              2025-03-31T18:02:35.199Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
              2025-03-31T18:02:41.824Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
              2025-03-31T18:02:41.834Z box:services startMysql: stopping and deleting previous mysql container
              2025-03-31T18:03:01.809Z box:services startMysql: starting mysql container
              2025-03-31T18:03:01.809Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=3d318a97bfff10f57e3b557c0e92a5bedadd1e97a79463043588de6ac39ad625adbfe1b004ad44f1945ed72b139b5e02cc767f75116e42d2fc6e930ab5b76161b125a3f78297ac49d06556cd004f27bcd291a2f3588d4810238a4134cd02195318d07b5fbf7ca0438790d3466cfcfdcf4e996da5bea1e615e5c2f7933bb94007                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=e5f88fc1d5042192d1efb08b77f8e5dd516aaff89aedc8b4968b859d3362de112fb1ab595d784256e70435dae66384759f19289982108f8fc36e777c75319f672e1fd06629715c561324ca05ece36bbea0f2ebf24c4c345565a5fff9fc9df414cec40228fa1c48495b0c58df5507bdd6f9c7707aa4df8fc973cbaaa42179d753                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
              2025-03-31T18:03:12.329Z box:services Waiting for mysql
              2025-03-31T18:03:12.337Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T18:03:27.346Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              2025-03-31T18:03:42.362Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
              
              
              
              1 Reply Last reply
              0
              • S Offline
                S Offline
                stratus41298
                wrote on last edited by
                #9
                2025-03-31T18:03:57.365Z box:services Attempt 4 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                2025-03-31T18:04:12.368Z box:services Attempt 5 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                2025-03-31T18:04:27.791Z box:box Received SIGTERM. Shutting down.
                2025-03-31T18:04:27.792Z box:platform uninitializing platform
                2025-03-31T18:04:27.794Z box:platform onDeactivated: stopping post activation services
                2025-03-31T18:04:27.794Z box:tasks stopAllTasks: stopping all tasks
                2025-03-31T18:04:27.794Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                2025-03-31T18:04:27.822Z box:shell All tasks stopped
                
                2025-03-31T18:04:28.015Z box:services Attempt 6 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
                2025-03-31T18:18:31.807Z box:server ==========================================
                2025-03-31T18:18:31.809Z box:server            Cloudron 8.3.1
                2025-03-31T18:18:31.809Z box:server ==========================================
                2025-03-31T18:18:31.809Z box:platform initialize: start platform
                2025-03-31T18:18:31.907Z box:tasks stopAllTasks: stopping all tasks
                2025-03-31T18:18:31.907Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                2025-03-31T18:18:31.998Z box:shell All tasks stopped
                
                2025-03-31T18:18:32.392Z box:locks releaseAll: all locks released
                2025-03-31T18:18:32.439Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
                2025-03-31T18:18:32.617Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
                2025-03-31T18:18:32.663Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
                2025-03-31T18:18:34.600Z box:platform onActivated: starting post activation services
                2025-03-31T18:18:34.601Z box:platform startInfra: checking infrastructure
                2025-03-31T18:18:34.602Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
                2025-03-31T18:18:34.602Z box:platform markApps: reconfiguring apps
                2025-03-31T18:18:34.602Z box:reverseproxy removeAppConfigs: removing app nginx configs
                2025-03-31T18:18:34.923Z box:apps configureApps: marking cloud.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:35.603Z box:apps configureApps: marked 3147d06c-a773-4d59-b8d7-170517ef116c for re-configure with taskId 14249
                2025-03-31T18:18:35.603Z box:apps configureApps: marking send.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:35.995Z box:apps configureApps: marked 560f6a5c-55de-433b-92c5-737f8ec678a6 for re-configure with taskId 14250
                2025-03-31T18:18:35.995Z box:apps configureApps: marking cloud.hlhphotos.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:36.403Z box:apps configureApps: marked 6deb5899-a69c-4c85-a050-7fe5dbdcac8a for re-configure with taskId 14251
                2025-03-31T18:18:36.403Z box:apps configureApps: marking blog.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:36.686Z box:apps configureApps: marked 7aab94d0-57f9-47f9-9c4e-44d308a436e8 for re-configure with taskId 14252
                2025-03-31T18:18:36.686Z box:apps configureApps: marking project.hopefullylevelheaded.com for reconfigure (scheduleNow:false)
                2025-03-31T18:18:36.978Z box:apps configureApps: marked 7bdabb63-43c6-4f0c-beff-5636b81d1b95 for re-configure with taskId 14253
                2025-03-31T18:18:36.978Z box:apps configureApps: marking secret.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:37.261Z box:apps configureApps: marked 8f185540-993d-4de2-9282-7f24789553fc for re-configure with taskId 14254
                2025-03-31T18:18:37.261Z box:apps configureApps: marking me.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:37.653Z box:apps configureApps: marked bbb8aa64-c1d4-4d47-ba2e-17b8e7e76434 for re-configure with taskId 14255
                2025-03-31T18:18:37.653Z box:apps configureApps: marking leantime.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:37.994Z box:apps configureApps: marked d02843ef-6725-4a21-8a57-246de35f9fa8 for re-configure with taskId 14256
                2025-03-31T18:18:37.994Z box:apps configureApps: marking edit.hopefullylevelheaded.com for reconfigure (scheduleNow: false)
                2025-03-31T18:18:38.294Z box:apps configureApps: marked df360484-c000-4666-94c6-4cd2272151d8 for re-configure with taskId 14257
                2025-03-31T18:18:38.294Z box:platform removeAllContainers: removing all containers for infra upgrade
                2025-03-31T18:18:38.294Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
                2025-03-31T18:18:38.318Z box:platform createDockerNetwork: recreating docker network
                2025-03-31T18:18:38.318Z box:shell platform: docker network rm -f cloudron
                2025-03-31T18:18:38.359Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
                2025-03-31T18:18:39.091Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
                2025-03-31T18:18:39.092Z box:mailserver startMail: starting
                2025-03-31T18:18:39.097Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
                2025-03-31T18:18:39.210Z box:locks write: current locks: {"mail_restart":null}
                2025-03-31T18:18:39.210Z box:locks acquire: mail_restart
                2025-03-31T18:18:39.218Z box:mailserver configureMail: stopping and deleting previous mail container
                2025-03-31T18:18:39.237Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
                2025-03-31T18:18:39.320Z box:mailserver configureMail: starting mail container
                2025-03-31T18:18:39.321Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=6a031485bd2f38213e1712f11dca281f9de0c064bbbaf4f395c41a309e07c8c3b2e1cce27a770b49e9729be3d2b10eccee43176c8f547850337d12779e9e6af66210d3556b34f3b3cea23c4d5754b96702dbd04f7f3da6df57bc76b10cd16e53f94a68b6863cf2f30bd21bc83dd2ddf7ba8b68ac02e75e3e646b96ae9bda13dd            -e CLOUDRON_RELAY_TOKEN=e5557b05e35adc01b3f41b33d3972e082c8282adb673960d12f314feabf0b1190acaa3d2f3acd4ce054d924aae05f6b526336bfa9842dad22346a225f1a744e781ee03a288a940663b4ea1181a9c54714d8e67f284e21b0761027ac16982524b8a19aa55748603c9e040b704fb9cc22f63c2e9f658ceb9caa42c7657b825b37d                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
                2025-03-31T18:18:52.456Z box:locks write: current locks: {}
                2025-03-31T18:18:52.456Z box:locks release: mail_restart
                2025-03-31T18:18:52.457Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
                2025-03-31T18:18:52.465Z box:services startTurn: stopping and deleting previous turn container
                2025-03-31T18:18:52.470Z box:services startTurn: starting turn container
                2025-03-31T18:18:52.470Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
                2025-03-31T18:18:57.683Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
                2025-03-31T18:18:57.689Z box:services startMysql: stopping and deleting previous mysql container
                2025-03-31T18:18:57.694Z box:services startMysql: starting mysql container
                2025-03-31T18:18:57.694Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=02b5ac1afe345cc775b0dce98f560a4405728946b68bfa63d738182ce6ab3c2898de69ee5048d52922331f2ea6c4976bc4ae9e04511bdbbf71ce44da513faf16e861f278ddb36ff7852718d430048b7f6af95ff8631037cd0ef98bb1e28f15dd5629c59cb30ec240dce2d384ccc02366bcfa555eee413487b51551d358a62269                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=32cefb55bb775b6540f2a72bbde8cdaaf179acf2737272df35804a6c675e43aacd81c63f62274bbd9be82ad3cb19e96f00d1e1836f16d4354346ac76f579ed0c951bedf1297e103eac18122d695df4eb80903d911c5438d38db903f3007613ae322fbf1dc2e0734a542d88c642d4d476651a75d61ba0a4ad08b852df6397c01d                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
                2025-03-31T18:19:10.201Z box:services Waiting for mysql
                2025-03-31T18:19:10.213Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                2025-03-31T18:19:25.220Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                2025-03-31T18:19:40.224Z box:services Attempt 3 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                2025-03-31T18:19:55.768Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
                2025-03-31T18:19:55.773Z box:services startPostgresql: postgresql will be upgraded
                2025-03-31T18:19:55.773Z box:services exportDatabase: Exporting postgresql
                2025-03-31T18:19:55.779Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
                2025-03-31T18:19:55.780Z box:services Backing up postgresql
                2025-03-31T18:19:55.784Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
                2025-03-31T18:19:55.784Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
                2025-03-31T18:19:55.785Z box:platform BoxError: Unable to find container postgresql
                    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
                    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
                    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
                    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
                2025-03-31T19:56:14.205Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                2025-03-31T19:56:14.963Z box:shell services: grep -q avx /proc/cpuinfo
                2025-03-31T19:56:15.247Z box:shell services: systemctl is-active unbound
                2025-03-31T19:56:15.255Z box:shell services: systemctl is-active nginx
                2025-03-31T20:55:32.324Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                2025-03-31T20:55:32.825Z box:shell services: grep -q avx /proc/cpuinfo
                2025-03-31T20:55:33.180Z box:shell services: systemctl is-active unbound
                2025-03-31T20:55:33.183Z box:shell services: systemctl is-active nginx
                2025-03-31T23:39:41.075Z box:shell services: grep -q avx /proc/cpuinfo
                2025-03-31T23:39:41.322Z box:shell services: systemctl is-active unbound
                2025-03-31T23:39:41.434Z box:shell services: systemctl is-active nginx
                2025-03-31T23:43:30.647Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                2025-03-31T23:43:31.189Z box:shell services: grep -q avx /proc/cpuinfo
                2025-03-31T23:43:31.456Z box:shell services: systemctl is-active nginx
                2025-03-31T23:43:31.464Z box:shell services: systemctl is-active unbound
                2025-03-31T23:43:56.735Z box:shell services: grep -q avx /proc/cpuinfo
                2025-03-31T23:43:56.984Z box:shell services: systemctl is-active unbound
                2025-03-31T23:43:56.990Z box:shell services: systemctl is-active nginx
                2025-03-31T23:44:03.283Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
                2025-03-31T23:44:03.354Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory
                
                2025-03-31T23:44:03.354Z box:shell false
                
                2025-03-31T23:44:27.358Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                2025-03-31T23:44:28.587Z box:shell mounts: mountpoint -q -- /mnt/cloudronbackup
                2025-04-01T01:05:05.305Z box:box Received SIGTERM. Shutting down.
                2025-04-01T01:05:05.305Z box:platform uninitializing platform
                2025-04-01T01:05:05.308Z box:platform onDeactivated: stopping post activation services
                2025-04-01T01:05:05.308Z box:tasks stopAllTasks: stopping all tasks
                2025-04-01T01:05:05.312Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                2025-04-01T01:05:05.345Z box:shell All tasks stopped
                
                2025-04-01T01:05:14.730Z box:server ==========================================
                2025-04-01T01:05:14.731Z box:server            Cloudron 8.3.1
                2025-04-01T01:05:14.731Z box:server ==========================================
                2025-04-01T01:05:14.731Z box:platform initialize: start platform
                2025-04-01T01:05:14.768Z box:tasks stopAllTasks: stopping all tasks
                2025-04-01T01:05:14.769Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                2025-04-01T01:05:14.859Z box:shell All tasks stopped
                
                2025-04-01T01:05:15.923Z box:locks releaseAll: all locks released
                2025-04-01T01:05:15.928Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
                2025-04-01T01:05:15.937Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
                2025-04-01T01:05:15.948Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
                2025-04-01T01:05:16.624Z box:platform onActivated: starting post activation services
                2025-04-01T01:05:16.626Z box:platform startInfra: checking infrastructure
                2025-04-01T01:05:16.626Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
                2025-04-01T01:05:16.627Z box:platform markApps: reconfiguring apps
                2025-04-01T01:05:16.627Z box:reverseproxy removeAppConfigs: removing app nginx configs
                2025-04-01T01:05:16.659Z box:platform removeAllContainers: removing all containers for infra upgrade
                2025-04-01T01:05:16.659Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
                2025-04-01T01:05:16.680Z box:platform removeAllContainers: stopping and removing 4e3f8a0712ee
                2025-04-01T01:05:16.680Z box:shell platform: docker stop 4e3f8a0712ee
                2025-04-01T01:05:24.828Z box:shell platform: docker rm -f 4e3f8a0712ee
                2025-04-01T01:05:25.807Z box:platform removeAllContainers: stopping and removing 01c0887bfca0
                2025-04-01T01:05:25.807Z box:shell platform: docker stop 01c0887bfca0
                2025-04-01T01:05:37.095Z box:shell platform: docker rm -f 01c0887bfca0
                2025-04-01T01:05:37.462Z box:platform removeAllContainers: stopping and removing 913d0e63ddaf
                
                
                1 Reply Last reply
                0
                • S Offline
                  S Offline
                  stratus41298
                  wrote on last edited by stratus41298
                  #10
                  2025-04-01T01:05:37.462Z box:shell platform: docker stop 913d0e63ddaf
                  2025-04-01T01:05:43.061Z box:shell platform: docker rm -f 913d0e63ddaf
                  2025-04-01T01:05:43.496Z box:platform createDockerNetwork: recreating docker network
                  2025-04-01T01:05:43.497Z box:shell platform: docker network rm -f cloudron
                  2025-04-01T01:05:44.274Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
                  2025-04-01T01:05:44.763Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
                  2025-04-01T01:05:44.764Z box:mailserver startMail: starting
                  2025-04-01T01:05:44.768Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
                  2025-04-01T01:05:44.872Z box:locks write: current locks: {"mail_restart":null}
                  2025-04-01T01:05:44.872Z box:locks acquire: mail_restart
                  2025-04-01T01:05:44.886Z box:mailserver configureMail: stopping and deleting previous mail container
                  2025-04-01T01:05:44.912Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
                  2025-04-01T01:05:44.922Z box:mailserver configureMail: starting mail container
                  2025-04-01T01:05:44.922Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=c05f8214c1146e22a46316d68fe6874190ca2a180fc8b9aa3130fdd3585a62129c67620b24bef204078186a619bc0929272a6e57b3f66886fee7ed9312b64d6243dd07a374e6af3b584a9b815283d4de46b9e2ededc00c74f820100f2056933c63d6599add108cf525d8d6d710d8f3586205b5049d84ffa86866d78a4a8d8ea6            -e CLOUDRON_RELAY_TOKEN=ca6423deb379ceeb825a09fc1a636586bd0a4fa223c8ffd6e0e48e666c721a85e255ab0a7d538ab0d2f942da4af54fb0832369327e6d7ea467088809cb2312c8313d0d4306377c2692c89afbb735cec1a8c3cb045f5fc5af325a14f9787118b5e7a1c3f86fdad3ae20035fce5be5c66733b73ba493418dce18261e150c64fb28                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
                  2025-04-01T01:05:49.604Z box:locks write: current locks: {}
                  2025-04-01T01:05:49.604Z box:locks release: mail_restart
                  2025-04-01T01:05:49.605Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
                  2025-04-01T01:05:49.614Z box:services startTurn: stopping and deleting previous turn container
                  2025-04-01T01:05:49.624Z box:services startTurn: starting turn container
                  2025-04-01T01:05:49.624Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
                  2025-04-01T01:05:53.563Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
                  2025-04-01T01:05:53.569Z box:services startMysql: stopping and deleting previous mysql container
                  2025-04-01T01:05:53.582Z box:services startMysql: starting mysql container
                  2025-04-01T01:05:53.582Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=5f41ef1daee14c3a5d31b5dc12122dd7211de3fd802bbd4292a254fe2766fd684db952e57f4bbecc3f03b40edc831c25e0b1e1d02e4499ea94ead7c64d635158db9d0ba9d4235a801bbfa23c6a7d9b80294d84df3d8670eebf94044eeca50b678cc392073df05501d99f30651185e1525a708c60c43d2bc07b4766c8aecc21ba                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=ed8e8295784b922e63e25e84dafc9553283970779f1681d89067bb8565d5f446490a939ebcbbb426b38987a394ce9946d3c466d07efbc6b82cf3a581a0bbdbf8d01696e129dfe7cb58258866114851a6414e4c04defb45f12c7d17b2dd8107a58978ede718699d8b842bef11880ab88b760fdc7d83118e1764280cf8129aed45                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
                  2025-04-01T01:05:57.358Z box:services Waiting for mysql
                  2025-04-01T01:05:57.367Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                  2025-04-01T01:06:12.375Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                  2025-04-01T01:06:27.631Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
                  2025-04-01T01:06:42.874Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
                  2025-04-01T01:06:42.877Z box:services startPostgresql: postgresql will be upgraded
                  2025-04-01T01:06:42.878Z box:services exportDatabase: Exporting postgresql
                  2025-04-01T01:06:42.885Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
                  2025-04-01T01:06:42.885Z box:services Backing up postgresql
                  2025-04-01T01:06:42.888Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
                  2025-04-01T01:06:42.888Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
                  2025-04-01T01:06:42.888Z box:platform BoxError: Unable to find container postgresql
                      at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
                      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
                      at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
                      at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
                  2025-04-01T01:07:06.871Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                  2025-04-01T01:07:07.304Z box:shell services: grep -q avx /proc/cpuinfo
                  2025-04-01T01:07:07.396Z box:shell services: systemctl is-active unbound
                  2025-04-01T01:07:07.509Z box:shell services: systemctl is-active nginx
                  2025-04-01T01:07:27.807Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                  2025-04-01T01:07:28.722Z box:shell mounts: mountpoint -q -- /mnt/cloudronbackup
                  2025-04-01T01:07:52.957Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
                  2025-04-01T01:07:52.968Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory
                  
                  2025-04-01T01:07:52.969Z box:shell false
                  
                  2025-04-01T01:13:29.280Z box:user notifyLoginLocation: uid-dc448a93-1ce7-4d9a-ac7a-e1faba413c8d 192.168.50.2 Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.0.0 Safari/537.36
                  2025-04-01T01:14:15.784Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
                  2025-04-01T01:14:15.795Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory
                  
                  2025-04-01T01:14:15.795Z box:shell false
                  
                  2025-04-01T01:14:58.298Z box:box Received SIGTERM. Shutting down.
                  2025-04-01T01:14:58.298Z box:platform uninitializing platform
                  2025-04-01T01:14:58.300Z box:platform onDeactivated: stopping post activation services
                  2025-04-01T01:14:58.300Z box:tasks stopAllTasks: stopping all tasks
                  2025-04-01T01:14:58.300Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                  2025-04-01T01:14:58.328Z box:shell All tasks stopped
                  
                  2025-04-01T01:15:02.313Z box:server ==========================================
                  2025-04-01T01:15:02.313Z box:server            Cloudron 8.3.1
                  2025-04-01T01:15:02.313Z box:server ==========================================
                  2025-04-01T01:15:02.314Z box:platform initialize: start platform
                  2025-04-01T01:15:02.348Z box:tasks stopAllTasks: stopping all tasks
                  2025-04-01T01:15:02.348Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                  2025-04-01T01:15:02.383Z box:shell All tasks stopped
                  
                  2025-04-01T01:15:02.850Z box:locks releaseAll: all locks released
                  2025-04-01T01:15:02.856Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
                  2025-04-01T01:15:02.863Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
                  2025-04-01T01:15:02.874Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
                  2025-04-01T01:15:03.278Z box:platform onActivated: starting post activation services
                  2025-04-01T01:15:03.278Z box:platform startInfra: checking infrastructure
                  2025-04-01T01:15:03.279Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
                  2025-04-01T01:15:03.298Z box:platform markApps: reconfiguring apps
                  2025-04-01T01:15:03.298Z box:reverseproxy removeAppConfigs: removing app nginx configs
                  2025-04-01T01:15:03.330Z box:platform removeAllContainers: removing all containers for infra upgrade
                  2025-04-01T01:15:03.330Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
                  2025-04-01T01:15:03.360Z box:platform removeAllContainers: stopping and removing 5b25b2c59cbe
                  2025-04-01T01:15:03.360Z box:shell platform: docker stop 5b25b2c59cbe
                  2025-04-01T01:15:08.502Z box:shell platform: docker rm -f 5b25b2c59cbe
                  2025-04-01T01:15:09.039Z box:platform removeAllContainers: stopping and removing 3af5ff670ea1
                  2025-04-01T01:15:09.039Z box:shell platform: docker stop 3af5ff670ea1
                  2025-04-01T01:15:20.257Z box:shell platform: docker rm -f 3af5ff670ea1
                  2025-04-01T01:15:20.708Z box:platform removeAllContainers: stopping and removing 1c45f903edf4
                  2025-04-01T01:15:20.709Z box:shell platform: docker stop 1c45f903edf4
                  2025-04-01T01:15:26.517Z box:shell platform: docker rm -f 1c45f903edf4
                  2025-04-01T01:15:26.902Z box:platform createDockerNetwork: recreating docker network
                  2025-04-01T01:15:26.902Z box:shell platform: docker network rm -f cloudron
                  2025-04-01T01:15:27.765Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
                  2025-04-01T01:15:28.203Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
                  2025-04-01T01:15:28.203Z box:mailserver startMail: starting
                  2025-04-01T01:15:28.207Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
                  2025-04-01T01:15:28.313Z box:locks write: current locks: {"mail_restart":null}
                  2025-04-01T01:15:28.313Z box:locks acquire: mail_restart
                  2025-04-01T01:15:28.324Z box:mailserver configureMail: stopping and deleting previous mail container
                  2025-04-01T01:15:28.343Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
                  2025-04-01T01:15:28.347Z box:mailserver configureMail: starting mail container
                  2025-04-01T01:15:28.347Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424  --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1            --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=e193c77f0c7fbaea669901e75397e2eb802f1b6b4d3195d1e60a8be234636f49620c3121561c6757a09f7afb9e5825a57aee74e6370124f7b539621f983bcd4ae587be6d1acdf8fc67b15832aba0354fecc37458bc5d56fccbb9bdee25f994583c2cba28f6f9d48353d141b0b44f44134b1fdfcb748a1b59daa1bceff9c1f503            -e CLOUDRON_RELAY_TOKEN=d1749634d5113fe1c4c09cdeaa0ddf6cdf473080c6a7893cd9c36dd64707d548020fa65859ea4f65339e2b2d34b0e7e004fc4f3aa7af0a03de2d4fcf57b3d25d778ab279fd11f46fc38015f395c97682693e0086a0c6b6d4f8555828a68259ad26d8e1f409171a343ed1eb30189abe7ddb4de9ec64d472b5389e307c911be2ab                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true          --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
                  2025-04-01T01:15:32.783Z box:locks write: current locks: {}
                  2025-04-01T01:15:32.783Z box:locks release: mail_restart
                  2025-04-01T01:15:32.784Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
                  2025-04-01T01:15:32.791Z box:services startTurn: stopping and deleting previous turn container
                  2025-04-01T01:15:32.796Z box:services startTurn: starting turn container
                  2025-04-01T01:15:32.796Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
                  2025-04-01T01:15:36.909Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
                  2025-04-01T01:15:36.926Z box:services startMysql: stopping and deleting previous mysql container
                  2025-04-01T01:15:36.933Z box:services startMysql: starting mysql container
                  2025-04-01T01:15:36.933Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog            --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=1885ed4ab1851e763171680d3b7443077f43a345fc4b8222d183bcd21437ae56d3a09c502becd8bdb23dcd25f2e4c97bf1ae52eb47ee8e83298b1547e828d1bd23c4620cd2978742ab9bd0c95e9a555fb912c9690cbb745f2dd1e88b4b325ce6f138d0f05a9c2ce9454cb78799fe9f4a032f6eb68fb3b27063f88742cb6e715a                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=3e8ce027c04caea01a1a956d46d7c9fad00d00b79d26d27f9439662e96fbaf38bf86f7fb6fd3191426cf29969a0b06cab4a9bf5206fff01de0abc3ae450631881868bb2475f628c61f3335c4c427a8ce16dee38e4b7a61c1936b6c75575c77933cf18fafc1a3dbb99fce4e44dcba57ad7b0cbf5a08d9c54a88e21aa7eadb5629                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
                  2025-04-01T01:15:42.220Z box:services Waiting for mysql
                  2025-04-01T01:15:42.230Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                  2025-04-01T01:15:57.233Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                  2025-04-01T01:16:12.471Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
                  2025-04-01T01:16:28.345Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
                  2025-04-01T01:16:28.348Z box:services startPostgresql: postgresql will be upgraded
                  2025-04-01T01:16:28.349Z box:services exportDatabase: Exporting postgresql
                  2025-04-01T01:16:28.354Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
                  2025-04-01T01:16:28.354Z box:services Backing up postgresql
                  2025-04-01T01:16:28.357Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
                  2025-04-01T01:16:28.358Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
                  2025-04-01T01:16:28.358Z box:platform BoxError: Unable to find container postgresql
                      at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
                      at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
                      at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
                      at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
                  2025-04-02T22:37:24.205Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
                  2025-04-02T22:37:24.216Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory
                  
                  2025-04-02T22:37:24.216Z box:shell false
                  
                  2025-04-02T22:37:44.881Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                  HttpError: Unknown error: 400 <html>
                  <head><title>400 Bad Request</title></head>
                  <body>
                  <center><h1>400 Bad Request</h1></center>
                  <hr><center>nginx</center>
                  </body>
                  </html>
                  
                      at getSystemGraphs (/home/yellowtent/box/src/routes/system.js:126:28)
                      at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
                    status: 500,
                    internalError: BoxError: Unknown error: 400 <html>
                    <head><title>400 Bad Request</title></head>
                    <body>
                    <center><h1>400 Bad Request</h1></center>
                    <hr><center>nginx</center>
                    </body>
                    </html>
                  
                        at Object.getSystem (/home/yellowtent/box/src/graphs.js:106:46)
                        at process.processTicksAndRejections (node:internal/process/task_queues:95:5) {
                      reason: 'External Error',
                      details: {}
                    },
                    details: {}
                  }
                  

                  I'll be away all day tomorrow so take your time. Thank you for your help!

                  1 Reply Last reply
                  0
                  • nebulonN Offline
                    nebulonN Offline
                    nebulon
                    Staff
                    wrote on last edited by
                    #11

                    Thanks for the detailed logs. For a start it seems mysql is actually not the issue but the postgresql addon causes trouble. Is that service up and running?

                    The Expected "actual" to be strictly unequal to: null error can be ignored here, as it just happened while the process was winding down and the mysql (host instance, not service addon, Cloudron has two) connection was already terminated. Not nice to assert here, but also harmless.

                    1 Reply Last reply
                    0
                    • S Offline
                      S Offline
                      stratus41298
                      wrote on last edited by
                      #12

                      When I first noticed the problem that and mysql were down. I was able to restart postgres but not mysql. Today I was able to restart all services, but there was no effect to the environment. I resumed the docker recreate and am now waiting for a result. I'll let you know. Thank you.

                      1 Reply Last reply
                      0
                      • S Offline
                        S Offline
                        stratus41298
                        wrote on last edited by stratus41298
                        #13

                        Alas, still seeing the same thing after about six hours. I noticed that the recreate-docker shut down a lot of services so I bounced them again and they are showing up in the event log as rebuilt, but it's seemed to have no effect in the terminal; just endless dots. There is a reboot required so i'm tempted to do that and see how it goes, but also don't want to interrupt the process if it's actually doing something.
                        Screenshot 2025-04-05 163423.png

                        1 Reply Last reply
                        0
                        • BrutalBirdieB Offline
                          BrutalBirdieB Offline
                          BrutalBirdie
                          Partner
                          wrote on last edited by BrutalBirdie
                          #14

                          I've seen something like this before.
                          => https://forum.cloudron.io/post/94377

                          Can you please share the box.log of that failed attempt?

                          Like my work? Consider donating a drink. Cheers!

                          1 Reply Last reply
                          0
                          • S Offline
                            S Offline
                            stratus41298
                            wrote on last edited by
                            #15

                            Much less in there this time:

                            @cloudron:~$ sudo cat /home/yellowtent/platformdata/logs/box.log
                            [sudo] password for :
                            2025-04-06T00:18:41.199Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                            2025-04-06T00:18:41.849Z box:shell services: grep -q avx /proc/cpuinfo
                            2025-04-06T00:18:42.065Z box:shell services: systemctl is-active unbound
                            2025-04-06T00:18:42.132Z box:shell services: systemctl is-active nginx
                            2025-04-06T00:18:51.922Z box:shell support /usr/bin/sudo -S /home/yellowtent/box/src/scripts/remotesupport.sh is-enabled /home/cloudron-support/.ssh/authorized_keys
                            2025-04-06T00:18:51.933Z box:shell grep: /home/cloudron-support/.ssh/authorized_keys: No such file or directory
                            
                            2025-04-06T00:18:51.933Z box:shell false
                            
                            1 Reply Last reply
                            0
                            • S Offline
                              S Offline
                              stratus41298
                              wrote on last edited by stratus41298
                              #16

                              Did that reboot it was asking for. Came back and the same services were down again.

                              New box.log after reboot:

                              Screenshot 2025-04-05 203212.png

                              2025-04-06T00:30:35.868Z box:server ==========================================
                              2025-04-06T00:30:35.870Z box:server            Cloudron 8.3.1
                              2025-04-06T00:30:35.870Z box:server ==========================================
                              2025-04-06T00:30:35.870Z box:platform initialize: start platform
                              2025-04-06T00:30:36.079Z box:tasks stopAllTasks: stopping all tasks
                              2025-04-06T00:30:36.079Z box:shell tasks /usr/bin/sudo -S /home/yellowtent/box/src/scripts/stoptask.sh all
                              2025-04-06T00:30:36.268Z box:shell All tasks stopped
                              
                              2025-04-06T00:30:37.082Z box:locks releaseAll: all locks released
                              2025-04-06T00:30:37.158Z box:reverseproxy writeDashboardConfig: writing dashboard config for hopefullylevelheaded.com
                              2025-04-06T00:30:37.227Z box:shell reverseproxy: openssl x509 -in /home/yellowtent/platformdata/nginx/cert/_.hopefullylevelheaded.com.cert -noout -ocsp_uri
                              2025-04-06T00:30:37.265Z box:shell reverseproxy /usr/bin/sudo -S /home/yellowtent/box/src/scripts/restartservice.sh nginx
                              2025-04-06T00:30:39.353Z box:platform onActivated: starting post activation services
                              2025-04-06T00:30:39.353Z box:platform startInfra: checking infrastructure
                              2025-04-06T00:30:39.365Z box:platform startInfra: updating infrastructure from 48.0.0 to 49.8.0
                              2025-04-06T00:30:39.365Z box:platform markApps: reconfiguring apps
                              2025-04-06T00:30:39.366Z box:reverseproxy removeAppConfigs: removing app nginx configs
                              2025-04-06T00:30:39.479Z box:platform removeAllContainers: removing all containers for infra upgrade
                              2025-04-06T00:30:39.479Z box:shell platform: docker ps -qa --filter label=isCloudronManaged
                              2025-04-06T00:30:39.502Z box:platform removeAllContainers: stopping and removing e77cfa1fb71d
                              2025-04-06T00:30:39.502Z box:shell platform: docker stop e77cfa1fb71d
                              2025-04-06T00:30:44.009Z box:shell platform: docker rm -f e77cfa1fb71d
                              2025-04-06T00:30:44.967Z box:platform removeAllContainers: stopping and removing 3af0b28f8899
                              2025-04-06T00:30:44.967Z box:shell platform: docker stop 3af0b28f8899
                              2025-04-06T00:30:48.236Z box:shell platform: docker rm -f 3af0b28f8899
                              2025-04-06T00:30:49.250Z box:platform removeAllContainers: stopping and removing 254b1c19f3af
                              2025-04-06T00:30:49.250Z box:shell platform: docker stop 254b1c19f3af
                              2025-04-06T00:30:53.888Z box:shell platform: docker rm -f 254b1c19f3af
                              2025-04-06T00:30:54.687Z box:platform removeAllContainers: stopping and removing 3ca2ffe09606
                              2025-04-06T00:30:54.687Z box:shell platform: docker stop 3ca2ffe09606
                              2025-04-06T00:31:04.508Z box:shell platform: docker rm -f 3ca2ffe09606
                              2025-04-06T00:31:06.291Z box:platform removeAllContainers: stopping and removing 197cd2129268
                              2025-04-06T00:31:06.292Z box:shell platform: docker stop 197cd2129268
                              2025-04-06T00:31:09.682Z box:shell platform: docker rm -f 197cd2129268
                              2025-04-06T00:31:10.643Z box:platform removeAllContainers: stopping and removing 0bfbc0e4cc90
                              2025-04-06T00:31:10.643Z box:shell platform: docker stop 0bfbc0e4cc90
                              2025-04-06T00:31:16.299Z box:shell platform: docker rm -f 0bfbc0e4cc90
                              2025-04-06T00:31:17.164Z box:platform removeAllContainers: stopping and removing c87aa4f6d6e9
                              2025-04-06T00:31:17.164Z box:shell platform: docker stop c87aa4f6d6e9
                              2025-04-06T00:31:29.125Z box:shell platform: docker rm -f c87aa4f6d6e9
                              
                              
                              1 Reply Last reply
                              0
                              • S Offline
                                S Offline
                                stratus41298
                                wrote on last edited by
                                #17
                                2025-04-06T00:31:29.650Z box:platform removeAllContainers: stopping and removing 82ff73d0f943
                                2025-04-06T00:31:29.651Z box:shell platform: docker stop 82ff73d0f943
                                2025-04-06T00:31:40.939Z box:shell platform: docker rm -f 82ff73d0f943
                                2025-04-06T00:31:41.380Z box:platform removeAllContainers: stopping and removing b8ebac43901c
                                2025-04-06T00:31:41.380Z box:shell platform: docker stop b8ebac43901c
                                2025-04-06T00:31:47.702Z box:shell platform: docker rm -f b8ebac43901c
                                2025-04-06T00:31:48.170Z box:platform createDockerNetwork: recreating docker network
                                2025-04-06T00:31:48.170Z box:shell platform: docker network rm -f cloudron
                                2025-04-06T00:31:48.942Z box:shell platform: docker network create --subnet=172.18.0.0/16 --ip-range=172.18.0.0/20 --gateway=172.18.0.1 --ipv6 --subnet=fd00:c107:d509::/64 cloudron
                                2025-04-06T00:31:49.408Z box:services startServices: 48.0.0 -> 49.8.0. starting all services
                                2025-04-06T00:31:49.408Z box:mailserver startMail: starting
                                2025-04-06T00:31:49.411Z box:mailserver restart: restarting mail container with mailFqdn:my.hopefullylevelheaded.com mailDomain:hopefullylevelheaded.com
                                2025-04-06T00:31:49.507Z box:locks write: current locks: {"mail_restart":null}
                                2025-04-06T00:31:49.507Z box:locks acquire: mail_restart
                                2025-04-06T00:31:49.518Z box:mailserver configureMail: stopping and deleting previous mail container
                                2025-04-06T00:31:49.537Z box:mailserver createMailConfig: generating mail config with my.hopefullylevelheaded.com
                                2025-04-06T00:31:49.612Z box:mailserver configureMail: starting mail container
                                2025-04-06T00:31:49.613Z box:shell mailserver: /bin/bash -c docker run --restart=always -d --name=mail                 --net cloudron                 --net-alias mail                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mail                 -m 671088640                 --memory-swap -1                 --dns 172.18.0.1                 --dns-search=.                 --ip 172.18.30.4                 -e CLOUDRON_MAIL_TOKEN=b1323c8162862c3c9f73cfddd65cdc37761b1316b80ea7b626a257b3aec90e077007ac33255b0855191299f33b490228b9904af26b251ed6876fd9e56d54c4c88ec1111884c6d9559e598d3785b2de4f0f89f96297a980b406e5ea6a5078f4727023f2886f34e5726624be27c9d2b1fd73770d126c740f035ce6bbf37e4d697e                 -e CLOUDRON_RELAY_TOKEN=3c622e0c2f602488debbfaab91e101a164ddc8058b08bd83eac9f4c011ede0c5c5804d63999f72e44aa5bd694b44c44776d47b5e025a9917dc3e5c6b2a024c36ce3829c2626d6223bcfb26b8b47491721cd2ecc7d8493407139d92a294ae05d26379f197d948f0086069ad65e59fa16544e415d40c139d584dddeb115d2d9502                 -e LOGLEVEL=info                 -v /home/yellowtent/boxdata/mail:/app/data                 -v /home/yellowtent/platformdata/addons/mail:/etc/mail:ro                 -p 587:2587 -p 993:9993 -p 4190:4190 -p 25:2587 -p 465:2465 -p 995:9995                 --label isCloudronManaged=true                 --read-only -v /run -v /tmp registry.docker.com/cloudron/mail:3.15.0@sha256:c93b5a83fc4e775bda4e05010bd19e5a658936e7a09cf7e51281e3696fde4536
                                2025-04-06T00:31:58.071Z box:locks write: current locks: {}
                                2025-04-06T00:31:58.071Z box:locks release: mail_restart
                                2025-04-06T00:31:58.071Z box:docker deleteImage: removing registry.docker.com/cloudron/mail:3.14.9@sha256:c51a2ee20b2087e208084a9115cc6a525e3b3b227b52d8cfdac2d98a6409672e
                                2025-04-06T00:31:58.079Z box:services startTurn: stopping and deleting previous turn container
                                2025-04-06T00:31:58.085Z box:services startTurn: starting turn container
                                2025-04-06T00:31:58.085Z box:shell services: /bin/bash -c docker run --restart=always -d --name=turn                 --hostname turn                 --net host                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=turn                 -m 268435456                 --memory-swap -1                 -e CLOUDRON_TURN_SECRET=a07d85effc3c5732cde5341587d878d                 -e CLOUDRON_REALM=my.hopefullylevelheaded.com                 --label isCloudronManaged=true                 --read-only -v /tmp -v /run registry.docker.com/cloudron/turn:1.8.0@sha256:cdbe83c3c83b8f25de3a5814b121eb941b457dca7127d2e6ff446c7a0cfa1570
                                2025-04-06T00:32:02.815Z box:shell system: swapon --noheadings --raw --bytes --show=type,size,used,name
                                2025-04-06T00:32:03.400Z box:shell services: grep -q avx /proc/cpuinfo
                                2025-04-06T00:32:03.720Z box:shell services: systemctl is-active unbound
                                2025-04-06T00:32:03.728Z box:shell services: systemctl is-active nginx
                                2025-04-06T00:32:06.333Z box:docker deleteImage: removing registry.docker.com/cloudron/turn:1.7.2@sha256:9ed8da613c1edc5cb8700657cf6e49f0f285b446222a8f459f80919945352f6d
                                2025-04-06T00:32:06.337Z box:services startMysql: stopping and deleting previous mysql container
                                2025-04-06T00:32:06.343Z box:services startMysql: starting mysql container
                                2025-04-06T00:32:06.344Z box:shell services: /bin/bash -c docker run --restart=always -d --name=mysql                 --hostname mysql                 --net cloudron                 --net-alias mysql                 --log-driver syslog                 --log-opt syslog-address=unix:///home/yellowtent/platformdata/logs/syslog.sock                 --log-opt syslog-format=rfc5424                 --log-opt tag=mysql                 --ip 172.18.30.1                 -e CLOUDRON_MYSQL_TOKEN=985d03b1df1c62feffc9fe7064da8300b7793d9ebf437ad4b33b3bca6f3b0cb21a88cda345c2e2edd6a4f03d100ad0f1d52239f4dd2d3615164ae0d31b420cc9ce336ab325c887a972df953d557ad9ce08e4f7bb31ec4bd2f544bc9695fa888bd9e65b641d91401f0cb7e8d1e98cb67f7247770a7a20c2c91c42d51375463f64                 -e CLOUDRON_MYSQL_ROOT_HOST=172.18.0.1                 -e CLOUDRON_MYSQL_ROOT_PASSWORD=31803f70cf6bfdc77e859e7d182c52633bf2e6de21b6e494e52c4d1fbb47703f3a71b54f05e041117e0e6c9694c88c416f79522ecc0111585da86b74ffb9c567c45cf095a26de5396bf7ec0187b2bb722f16ed5afe9cdf97dab8b494492acded7818de789efb10833d498839d1e8c06616fc9c0f08b9901bfad13c5b7d7bb657                 -v /home/yellowtent/platformdata/mysql:/var/lib/mysql                 --label isCloudronManaged=true                 --cap-add SYS_NICE                 --read-only -v /tmp -v /run registry.docker.com/cloudron/mysql:3.5.0@sha256:969ea5b2f91861940ca6309c7676c52e479d2a864ba3aabd08a4266799707280
                                2025-04-06T00:32:10.503Z box:services Waiting for mysql
                                2025-04-06T00:32:10.509Z box:services Attempt 1 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                                2025-04-06T00:32:25.511Z box:services Attempt 2 failed. Will retry: Network error waiting for mysql: connect ECONNREFUSED 172.18.30.1:3000
                                2025-04-06T00:32:40.753Z box:services Attempt 3 failed. Will retry: Error waiting for mysql. Status code: 200 message: connect ECONNREFUSED 127.0.0.1:3306
                                2025-04-06T00:32:56.076Z box:docker deleteImage: removing registry.docker.com/cloudron/mysql:3.4.3@sha256:8934c5ddcd69f24740d9a38f0de2937e47240238f3b8f5c482862eeccc5a21d2
                                2025-04-06T00:32:56.080Z box:services startPostgresql: postgresql will be upgraded
                                2025-04-06T00:32:56.080Z box:services exportDatabase: Exporting postgresql
                                2025-04-06T00:32:56.085Z box:services exportDatabase: Exporting addon postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c
                                2025-04-06T00:32:56.086Z box:services Backing up postgresql
                                2025-04-06T00:32:56.089Z box:services exportDatabase: Error exporting postgresql of app 3147d06c-a773-4d59-b8d7-170517ef116c. BoxError: Unable to find container postgresql at Object.inspect (/home/yellowtent/box/src/docker.js:607:50) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20) at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20) { reason: 'Not found', details: {} }
                                2025-04-06T00:32:56.089Z box:platform startInfra: Failed to start services. retry=false (attempt 0): Unable to find container postgresql
                                2025-04-06T00:32:56.089Z box:platform BoxError: Unable to find container postgresql
                                    at Object.inspect (/home/yellowtent/box/src/docker.js:607:50)
                                    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
                                    at async getContainerDetails (/home/yellowtent/box/src/services.js:307:20)
                                    at async Object.backupPostgreSql [as backup] (/home/yellowtent/box/src/services.js:1557:20)
                                
                                1 Reply Last reply
                                0
                                • BrutalBirdieB Offline
                                  BrutalBirdieB Offline
                                  BrutalBirdie
                                  Partner
                                  wrote on last edited by
                                  #18

                                  I see a pattern that everytime it postgresql tries to touch app 3147d06c-a773-4d59-b8d7-170517ef116c it errors.
                                  What app is 3147d06c-a773-4d59-b8d7-170517ef116c on your system?

                                  Like my work? Consider donating a drink. Cheers!

                                  1 Reply Last reply
                                  0
                                  • S Offline
                                    S Offline
                                    stratus41298
                                    wrote on last edited by stratus41298
                                    #19

                                    That would be my nextcloud app. I could maybe try to archive the app to preserve the whole system. I don't appear to have much recourse from the GUI due to the app being busy, but if there's some other CLI command I could run, let me know.

                                    I also see these connection refused errors with redis, which also stay down upon reboot:

                                    2025-04-06T16:48:40.302Z box:services Attempt 1 failed. Will retry: Network error waiting for redis-3147d06c-a773-4d59-b8d7-170517ef116c: connect ECONNREFUSED 172.18.0.2:3000
                                    2025-04-06T16:48:43.538Z box:services Waiting for redis-6deb5899-a69c-4c85-a050-7fe5dbdcac8a
                                    2025-04-06T16:48:43.543Z box:services Attempt 1 failed. Will retry: Network error waiting for redis-6deb5899-a69c-4c85-a050-7fe5dbdcac8a: connect ECONNREFUSED 172.18.0.3:3000
                                    

                                    Is this normal behavior? I've never had a firewall issue with this instance before. Seems like all of this started happening after 8.3.1.

                                    1 Reply Last reply
                                    0
                                    • S Offline
                                      S Offline
                                      stratus41298
                                      wrote on last edited by
                                      #20

                                      Okay, so it seems like postgresql is actually running fine, but cloudron/docker can't seem to pass a health check:

                                      [GET] /healthcheck
                                      healthcheck: disconnected
                                      [GET] /healthcheck
                                      healthcheck: disconnected
                                      
                                      robiR 1 Reply Last reply
                                      0
                                      • S stratus41298

                                        Okay, so it seems like postgresql is actually running fine, but cloudron/docker can't seem to pass a health check:

                                        [GET] /healthcheck
                                        healthcheck: disconnected
                                        [GET] /healthcheck
                                        healthcheck: disconnected
                                        
                                        robiR Offline
                                        robiR Offline
                                        robi
                                        wrote on last edited by robi
                                        #21

                                        @stratus41298 for that you need a web service that will have a 200 response on that /healthcheck endpoint

                                        Conscious tech

                                        S 1 Reply Last reply
                                        0
                                        • robiR robi

                                          @stratus41298 for that you need a web service that will have a 200 response on that /healthcheck endpoint

                                          S Offline
                                          S Offline
                                          stratus41298
                                          wrote on last edited by
                                          #22

                                          @robi I'm not really sure where you're going with that so I can't comment.

                                          As for the continued troubleshooting, I was able to get postgresql up manually with extensive help of ChatGPT. We ran into a DNS issue trying to do an APT reinstall of docker even after adjusting the resolv.conf. If anyone is interested I can give a full writeup, but i'll summarize here:


                                          🧩 Cloudron 8.3.1 Upgrade – PostgreSQL & DNS Issues Summary

                                          💥 1. PostgreSQL Socket Failure

                                          • After updating to Cloudron 8.3.1, the PostgreSQL service showed as down in the Cloudron dashboard.

                                          • However, logs showed the database was running fine and accepting connections over TCP.

                                          • Cloudron healthchecks (and dependent services) failed due to the absence of the expected Unix socket at /var/run/postgresql/.s.PGSQL.5432.

                                          • Investigation showed:

                                            • The actual socket was created in /run/postgresql/
                                            • The symlink /var/run/postgresql → /run/postgresql was missing inside the PostgreSQL container
                                          • Fix: Re-created the symlink inside the container:

                                            ln -s /run/postgresql /var/run/postgresql
                                            

                                            Followed by:

                                            supervisorctl restart postgresql
                                            
                                          • After this, PostgreSQL healthcheck passed, and dependent services began recovering.


                                          💥 2. APT Repository DNS/TLS Failure

                                          • While attempting to reinstall the Cloudron CLI to recover from a broken docker recreate, the APT repo at https://apt.cloudron.io was unreachable.

                                          • DNS (dig apt.cloudron.io) returned SOA records but no A records — even after:

                                            • Disabling systemd-resolved
                                            • Stopping unbound
                                            • Overriding /etc/resolv.conf to use 8.8.8.8
                                            • Confirming DNS worked for other domains (cloudron.io, google.com)
                                          • Attempts to work around with /etc/hosts resulted in a TLS handshake failure:

                                            error:0A000410:SSL routines::sslv3 alert handshake failure
                                            
                                          • Root cause appears to be Cloudflare (which fronts apt.cloudron.io) rejecting connections when:

                                            • DNS is bypassed via /etc/hosts, or
                                            • Something in the server environment breaks SNI or TLS negotiation
                                          • Result: Unable to reinstall cloudron CLI using APT despite proper DNS config and working CA certs.


                                          🧠 Context

                                          • This all occurred during/after a failed cloudron docker recreate attempt (as suggested on the forums).
                                          • That left the system partially repaired, with missing CLI tools and broken DNS.

                                          So that's pretty much it. At this point i'm going to just set up a restore either through VM backup or Cloudron backup. I haven't decided yet. I won't do it until tomorrow though in case there's anything you'd like me to provide for future maintenance or research.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • Bookmarks
                                          • Search