"Could not load dashboard website with loopback check" + "BoxError: Unknown column 'pending' in 'field list'" (update from 8.3.2 to 9.0.13)

[Camille]

Hi,
Our Cloudron is unreachable since this morning.

Description

It seems to be related to the automatic upgrade from 8.3.2 to 9.0.13

The dashboard and all the apps show the same error message :

This app is currently not responding. Please try refreshing the page in a few minutes.

Steps to reproduce

Just try to access any app, including the dashboard

When I first ran ~# cloudron-support --troubleshoot it would fail at step 2 about IPv6.I added an IPv6 (AAAA) entry for the dashboard and it fixed the problem.
But now it fails a bit further down the process : see the logs below.

Logs

~# cloudron-support --troubleshoot
Vendor: Scaleway Product: SCW-GP1-S
Linux: 5.15.0-124-generic
Ubuntu: jammy 22.04
Processor: AMD EPYC 7401P 24-Core Processor x 8
RAM: 32856760KB
Disk: /dev/vda1        51G
[OK]	node version is correct
[OK]	IPv6 is enabled and public IPv6 address is working
[OK]	docker is running
[OK]	docker version is correct
[OK]	MySQL is running
[OK]	nginx is running
[OK]	dashboard cert is valid
[FAIL]	Could not load dashboard website with loopback check

If applicable, attach relevant logs from /home/yellowtent/platformdata/logs/box.log or the Dashboard

~# cat /home/yellowtent/platformdata/logs/box.log

[...]
2025-12-01T09:20:58.622Z box:server ==========================================
2025-12-01T09:20:58.622Z box:server            Cloudron 9.0.13  
2025-12-01T09:20:58.622Z box:server ==========================================
2025-12-01T09:20:58.623Z box:platform initialize: start platform
2025-12-01T09:20:58.624Z box:tasks stopAllTasks: 0 tasks are running. sending abort signal
2025-12-01T09:20:58.624Z box:shell tasks: /usr/bin/sudo --non-interactive /home/yellowtent/box/src/scripts/stoptask.sh all
2025-12-01T09:20:59.089Z box:locks releaseAll: all locks released
2025-12-01T09:20:59.099Z box:reverseproxy writeDashboardConfig: writing dashboard config for inno3.eu
2025-12-01T09:20:59.121Z box:shell reverseproxy: /usr/bin/sudo --non-interactive /home/yellowtent/box/src/scripts/restartservice.sh nginx
2025-12-01T09:20:59.598Z box:updater notifyBoxUpdate: update finished from 8.3.2 to 9.0.13
2025-12-01T09:20:59.599Z Error starting servers
2025-12-01T09:20:59.599Z BoxError: Unknown column 'pending' in 'field list'
2025-12-01T09:20:59.599Z     at Object.query (/home/yellowtent/box/src/database.js:96:22)
2025-12-01T09:20:59.599Z     at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
2025-12-01T09:20:59.599Z     at async list (/home/yellowtent/box/src/tasks.js:163:21)
2025-12-01T09:20:59.599Z     at async Object.setCompletedByType (/home/yellowtent/box/src/tasks.js:172:21)

Troubleshooting Already Performed

I have already rebooted a few times.

System Details

Generate Diagnostics Data

WARNING

The command cloudron-support --send-diagnostics generated URL might contain sensitive details.

When choosing this option, you can delete everything below.

Your https://paste.cloudron.io/ URL generated from cloudron-support --send-diagnostics.

Cloudron Version

"update finished from 8.3.2 to 9.0.13"

Ubuntu Version

No LSB modules are available.
Distributor ID:	Ubuntu
Description:	Ubuntu 22.04.5 LTS
Release:	22.04
Codename:	jammy

Cloudron installation method

• Manual with ./cloudron-setup

Output of cloudron-support --troubleshoot

Vendor: Scaleway Product: SCW-GP1-S
Linux: 5.15.0-124-generic
Ubuntu: jammy 22.04
Processor: AMD EPYC 7401P 24-Core Processor x 8
RAM: 32856760KB
Disk: /dev/vda1        51G
[OK]	node version is correct
[OK]	IPv6 is enabled and public IPv6 address is working
[OK]	docker is running
[OK]	docker version is correct
[OK]	MySQL is running
[OK]	nginx is running
[OK]	dashboard cert is valid
[FAIL]	Could not load dashboard website with loopback check

[joseph]

@Camille the migration did not run. Please run this manually and it should start again:

/home/yellowtent/box/setup/start.sh

[Camille]

@joseph Thanks for the speedy feedback !
Unfortunately, there seems to be another problem

~# /home/yellowtent/box/setup/start.sh
2025-12-01T09:52:57 ==> start: Cloudron Start
media:x:500:
2025-12-01T09:52:57 ==> start: Configuring docker
Synchronizing state of apparmor.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable apparmor
2025-12-01T09:52:59 ==> start: Ensuring directories
2025-12-01T09:52:59 ==> start: Configuring journald
2025-12-01T09:53:01 ==> start: Setting up unbound
2025-12-01T09:53:01 ==> start: Adding systemd services
Synchronizing state of unbound.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable unbound
Job for cloudron-firewall.service failed because the control process exited with error code.
See "systemctl status cloudron-firewall.service" and "journalctl -xeu cloudron-firewall.service" for details.
root@Cloudron-4eme-GP1-S:~# systemctl status cloudron-firewall.service
× cloudron-firewall.service - Cloudron Firewall
     Loaded: loaded (/etc/systemd/system/cloudron-firewall.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Mon 2025-12-01 09:53:06 UTC; 35s ago
    Process: 60647 ExecStart=/home/yellowtent/box/setup/start/cloudron-firewall.sh (code=exited, status=1/FAILURE)
   Main PID: 60647 (code=exited, status=1/FAILURE)
        CPU: 477ms

Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60782]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60822]: CLOUDRON_RATELIMIT  all opt -- in * out *  0.0.0.0/0  -> 0.0.0.0/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60823]: CLOUDRON_RATELIMIT  all opt    in * out *  ::/0  -> ::/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Adding cloudron output chain
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60828]: iptables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60829]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60832]: root is not in the sudoers file.  This incident will be reported.
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: cloudron-firewall.service: Main process exited, code=exited, status=1/FAILURE
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: cloudron-firewall.service: Failed with result 'exit-code'.
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: Failed to start Cloudron Firewall.
root@Cloudron-4eme-GP1-S:~# journalctl -xeu cloudron-firewall.service
Dec 01 09:53:04 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Setting up firewall
Dec 01 09:53:04 Cloudron-4eme-GP1-S cloudron-firewall.sh[60654]: iptables: Chain already exists.
Dec 01 09:53:04 Cloudron-4eme-GP1-S cloudron-firewall.sh[60656]: ip6tables: Chain already exists.
Dec 01 09:53:04 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Creating ipset cloudron_blocklist
Dec 01 09:53:05 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Creating ipset cloudron_blocklist6
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Opening standard ports
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Opening up user specified ports
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Configuring LDAP allow list
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60746]: ip6tables: Bad rule (does a matching rule exist in that chain?).
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Opening ports for TURN and STUN
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Allow ICMP
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Adding cloudron filter chain
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60767]: CLOUDRON  all opt -- in * out *  0.0.0.0/0  -> 0.0.0.0/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60768]: CLOUDRON  all opt    in * out *  ::/0  -> ::/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Adding cloudron postrouting chain
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60769]: iptables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60770]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60775]: CLOUDRON_POSTROUTING  all opt -- in * out *  0.0.0.0/0  -> 0.0.0.0/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60776]: CLOUDRON_POSTROUTING  all opt    in * out *  ::/0  -> ::/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Setup rate limit chain
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60777]: iptables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60778]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Setup logging
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60781]: iptables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60782]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60822]: CLOUDRON_RATELIMIT  all opt -- in * out *  0.0.0.0/0  -> 0.0.0.0/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60823]: CLOUDRON_RATELIMIT  all opt    in * out *  ::/0  -> ::/0
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60647]: ==> Adding cloudron output chain
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60828]: iptables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60829]: ip6tables: Chain already exists.
Dec 01 09:53:06 Cloudron-4eme-GP1-S cloudron-firewall.sh[60832]: root is not in the sudoers file.  This incident will be reported.
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: cloudron-firewall.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ An ExecStart= process belonging to unit cloudron-firewall.service has exited.
░░ 
░░ The process' exit code is 'exited' and its exit status is 1.
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: cloudron-firewall.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ The unit cloudron-firewall.service has entered the 'failed' state with result 'exit-code'.
Dec 01 09:53:06 Cloudron-4eme-GP1-S systemd[1]: Failed to start Cloudron Firewall.
░░ Subject: A start job for unit cloudron-firewall.service has failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░ 
░░ A start job for unit cloudron-firewall.service has finished with a failure.
░░ 
░░ The job identifier is 136415 and the job result is failed.

[Camille]

I added root to the sudoers, which seems to have unlocked a few steps : I now have access to the dashboard, waiting for the apps to start.

[joseph]

@camille right, forgot to mention. you have to run that script as root

[Camille]

I was logged in as root, but root was not part of the sudoers

[Camille]

All the apps are back, thanks for your support !