<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[Cloudron 10.1.5 update failed – Database migrations pending, firewall failure and Docker networking broken]]></title><description><![CDATA[<p dir="auto">Hello Cloudron Team,</p>
<p dir="auto">I'm experiencing critical issues with my Cloudron installation following an automatic update. The Cloudron dashboard is no longer allowing me to log in, the firewall service is failing, and Docker containers cannot establish outbound internet connections.</p>
<p dir="auto">I've performed extensive troubleshooting and would appreciate guidance on safely restoring the server without losing application data.</p>
<h2>1. Server information</h2>
<ul>
<li><strong>Cloudron:</strong> 10.1.5</li>
<li><strong>OS:</strong> Ubuntu 24.04 LTS</li>
<li><strong>Kernel:</strong> 6.8.0-147-generic</li>
<li><strong>Docker:</strong> 29.6.2</li>
<li><strong>Docker firewall backend:</strong> iptables</li>
<li><strong>Hosting provider:</strong> Contabo (KVM VPS)</li>
<li><strong>Dashboard:</strong> <a href="https://my.baskethunt.com" target="_blank" rel="noopener noreferrer nofollow ugc">https://my.baskethunt.com</a></li>
</ul>
<p dir="auto">Docker 29.6.2 was installed on September 13, 2026, and kernel 6.8.0-147 was installed on October 14, 2026.</p>
<h2>2. Cloudron dashboard login failure</h2>
<p dir="auto">After the automatic update, the login page loads successfully, but submitting my credentials produces:</p>
<p dir="auto"><code>Internal error, try again later</code></p>
<p dir="auto">The Cloudron box log contains:</p>
<pre><code class="language-text">HttpError: Unknown column 'inviteTokenCreationTime' in 'field list'
SQL Error: ER_BAD_FIELD_ERROR (1054)
</code></pre>
<p dir="auto">Running <code>cloudron-support --troubleshoot</code> shows:</p>
<pre><code class="language-text">PASS: 32
WARN: 0
FAIL: 1
SKIP: 0

[FAIL] Database migrations are pending.

Last migration in DB:
20260908124000-appPasswords-add-ownerId.js

Last migration file:
20261009112100-oidcClients-add-allowTokenExchange.js
</code></pre>
<p dir="auto">I attempted:</p>
<pre><code class="language-bash">sudo cloudron-support --apply-db-migrations
</code></pre>
<p dir="auto">However, the process failed while starting the firewall service:</p>
<pre><code class="language-text">Job for cloudron-firewall.service failed
[FAIL] Database migrations failed
</code></pre>
<h2>3. Cloudron firewall service failure</h2>
<p dir="auto">Running <code>systemctl status cloudron-firewall.service</code> produces:</p>
<pre><code class="language-text">iptables: Bad rule (does a matching rule exist in that chain?).
ip6tables: Bad rule (does a matching rule exist in that chain?).
iptables: No chain/target/match by that name.

cloudron-firewall.service:
Failed with result 'exit-code'
</code></pre>
<p dir="auto">The firewall startup script attempts to insert rules into <code>DOCKER-USER</code>, but this chain appears to be unavailable when Cloudron tries to use it.</p>
<h2>4. Missing Docker firewall and NAT rules</h2>
<p dir="auto">I checked Docker's networking configuration.</p>
<p dir="auto">Docker reports:</p>
<pre><code class="language-text">Firewall Backend: iptables
</code></pre>
<p dir="auto">However:</p>
<pre><code class="language-bash">sudo iptables -t nat -S
</code></pre>
<p dir="auto">Returns only:</p>
<pre><code class="language-text">-P PREROUTING ACCEPT
-P INPUT ACCEPT
-P OUTPUT ACCEPT
-P POSTROUTING ACCEPT
</code></pre>
<p dir="auto">No Docker NAT/MASQUERADE rules are present.</p>
<p dir="auto">Additionally, <code>iptables-legacy</code> NAT and filtering checks showed no Docker-managed rules.</p>
<p dir="auto">I restarted Docker using:</p>
<pre><code class="language-bash">sudo systemctl restart docker
</code></pre>
<p dir="auto">Immediately afterward, the <code>DOCKER-USER</code> chain appeared:</p>
<pre><code class="language-text">-N DOCKER-USER
</code></pre>
<p dir="auto">But subsequent checks showed that the chain was missing again.</p>
<p dir="auto">Restarting <code>cloudron-firewall.service</code> still fails with the same error.</p>
<p dir="auto">I have not manually flushed the firewall, switched iptables backends, or edited Docker configuration files.</p>
<h2>5. Docker container internet connectivity failure</h2>
<p dir="auto">My Chatwoot installation is also affected.</p>
<p dir="auto">Outgoing WhatsApp messages, including approved templates, remain stuck on "Sending."</p>
<p dir="auto">Chatwoot's Sidekiq jobs report:</p>
<pre><code class="language-text">SendReplyJob
Channels::Whatsapp::TemplatesSyncJob

Net::OpenTimeout:
Failed to open TCP connection to
graph.facebook.com:443 (execution expired)
</code></pre>
<p dir="auto">Connectivity tests show:</p>
<ul>
<li>The Ubuntu host successfully reaches Google and Meta's Graph API.</li>
<li>The Chatwoot container times out connecting to both.</li>
<li>IPv4-only connections also time out inside Chatwoot.</li>
<li>IPv4 forwarding is enabled.</li>
<li>The <code>br_netfilter</code> module is loaded.</li>
<li>Both <code>bridge-nf-call-iptables</code> and <code>bridge-nf-call-ip6tables</code> are enabled.</li>
</ul>
<p dir="auto">This appears to be a broader Docker container networking issue rather than a WhatsApp configuration issue.</p>
<h2>6. Additional checks completed</h2>
<p dir="auto">I've also verified that:</p>
<ul>
<li><code>box.service</code> is running.</li>
<li>Docker is running.</li>
<li>UFW is inactive.</li>
<li><code>nftables.service</code> is disabled and inactive.</li>
<li><code>netfilter-persistent.service</code> is not installed.</li>
<li>The Docker <code>cloudron</code> bridge network is not marked internal.</li>
<li><code>/etc/docker/daemon.json</code> does not exist.</li>
<li>Docker's systemd Cloudron override is present.</li>
<li>The Docker logs show successful daemon initialization.</li>
</ul>
<h2>7. Assistance requested</h2>
<p dir="auto">Could you please help determine:</p>
<ol>
<li>Why Docker's firewall and NAT rules are missing or disappearing?</li>
<li>Why <code>cloudron-firewall.service</code> cannot initialize?</li>
<li>Whether the current Docker and Cloudron versions have a known compatibility issue?</li>
<li>What is the recommended recovery procedure to complete the pending database migrations and restore dashboard login?</li>
<li>How can we restore outbound connectivity to Cloudron-hosted applications?</li>
</ol>
<p dir="auto"><strong>This is an active server, so preserving application data and minimizing downtime are important.</strong></p>
<p dir="auto">I can provide additional logs, screenshots, and diagnostic information if required.</p>
<p dir="auto">Thank you for your assistance.</p>
]]></description><link>https://forum.cloudron.io/topic/16286/cloudron-10.1.5-update-failed-database-migrations-pending-firewall-failure-and-docker-networking-broken</link><generator>RSS for Node</generator><lastBuildDate>Thu, 12 Nov 2026 13:55:24 GMT</lastBuildDate><atom:link href="https://forum.cloudron.io/topic/16286.rss" rel="self" type="application/rss+xml"/><pubDate>Thu, 12 Nov 2026 04:46:29 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to Cloudron 10.1.5 update failed – Database migrations pending, firewall failure and Docker networking broken on Thu, 12 Nov 2026 11:33:29 GMT]]></title><description><![CDATA[<p dir="auto">So, on this server legacy iptable modules are being loaded in the kernel. Maybe some change in your server provider? Cloudron doesn't configure or load these modules (cloudron uses nft backend for iptables). Docker is not configuring iptables properly because of this.</p>
<pre><code>root@vmi3573607:~# lsmod | grep -E 'iptable_|ip6table_'
ip6table_filter        12288  0
ip6_tables             36864  1 ip6table_filter
iptable_filter         12288  0
iptable_nat            12288  0
nf_nat                 61440  5 xt_nat,nft_chain_nat,iptable_nat,xt_MASQUERADE,xt_REDIRECT
ip_tables              32768  2 iptable_filter,iptable_nat
x_tables               65536  18 ip6table_filter,xt_conntrack,iptable_filter,nft_compat,xt_LOG,xt_multiport,xt_tcpudp,xt_hashlimit,xt_addrtype,xt_recent,xt_nat,xt_set,ip6_tables,ip_tables,iptable_nat,xt_limit,xt_MASQUERADE,xt_REDIRECT
root@vmi3573607:~# cat /proc/net/ip_tables_names /proc/net/ip6_tables_names
filter
nat
filter
</code></pre>
<p dir="auto">I manually unloaded them and it work again:</p>
<pre><code>sudo modprobe -r iptable_nat iptable_filter ip6table_filter
</code></pre>
<p dir="auto">Could an agent or something have loaded these legacy modules?</p>
]]></description><link>https://forum.cloudron.io/post/132788</link><guid isPermaLink="true">https://forum.cloudron.io/post/132788</guid><dc:creator><![CDATA[joseph]]></dc:creator><pubDate>Thu, 12 Nov 2026 11:33:29 GMT</pubDate></item><item><title><![CDATA[Reply to Cloudron 10.1.5 update failed – Database migrations pending, firewall failure and Docker networking broken on Thu, 12 Nov 2026 11:06:33 GMT]]></title><description><![CDATA[<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/weesaal" aria-label="Profile: weesaal">@<bdi>weesaal</bdi></a> I replied from support earlier today but I see you have responded now. I am looking into this.</p>
]]></description><link>https://forum.cloudron.io/post/132787</link><guid isPermaLink="true">https://forum.cloudron.io/post/132787</guid><dc:creator><![CDATA[joseph]]></dc:creator><pubDate>Thu, 12 Nov 2026 11:06:33 GMT</pubDate></item><item><title><![CDATA[Reply to Cloudron 10.1.5 update failed – Database migrations pending, firewall failure and Docker networking broken on Thu, 12 Nov 2026 11:02:21 GMT]]></title><description><![CDATA[<p dir="auto">Hi <a class="plugin-mentions-user plugin-mentions-a" href="/user/james" aria-label="Profile: james">@<bdi>james</bdi></a>,</p>
<p dir="auto">Thank you for your response and for sharing the related discussion.</p>
<p dir="auto">Unfortunately, I've already tried the suggested recovery procedure, but the issue remains unresolved.</p>
<h3>1. Database migration recovery already attempted</h3>
<p dir="auto">I previously ran the following command as the root user:</p>
<pre><code class="language-bash">sudo cloudron-support --apply-db-migrations
</code></pre>
<p dir="auto">The process started but failed when attempting to initialize Cloudron's firewall:</p>
<pre><code class="language-text">Job for cloudron-firewall.service failed because the control process exited with error code.
[FAIL] Database migrations failed
</code></pre>
<p dir="auto">I also verified that root has working sudo permissions:</p>
<pre><code class="language-bash">sudo -n true &amp;&amp; echo "ROOT SUDO WORKS" || echo "ROOT SUDO FAILED"
</code></pre>
<p dir="auto">Result:</p>
<pre><code class="language-text">ROOT SUDO WORKS
</code></pre>
<p dir="auto">Therefore, the sudo permission issue mentioned in the linked discussion doesn't appear to be the cause in my case.</p>
<p dir="auto">I haven't separately executed <code>/home/yellowtent/box/setup/start.sh</code>, since the migration recovery command already invokes that startup process and stops at the firewall error.</p>
<h3>2. Cloudron firewall failure</h3>
<p dir="auto">The <code>cloudron-firewall.service</code> repeatedly fails with:</p>
<pre><code class="language-text">iptables: Bad rule (does a matching rule exist in that chain?).
ip6tables: Bad rule (does a matching rule exist in that chain?).
iptables: No chain/target/match by that name.
</code></pre>
<p dir="auto">The firewall initialization script attempts to insert a rule into the <code>DOCKER-USER</code> chain, but that chain appears to be missing or unavailable.</p>
<h3>3. Docker networking troubleshooting completed</h3>
<p dir="auto">I have checked the following:</p>
<ul>
<li>Docker 29.6.2 is running, with the iptables firewall backend.</li>
<li>IPv4 forwarding is enabled.</li>
<li>The <code>br_netfilter</code> module is loaded.</li>
<li>Both IPv4 and IPv6 bridge netfilter settings are enabled.</li>
<li>UFW is inactive.</li>
<li>The nftables service is inactive and disabled.</li>
<li>No <code>netfilter-persistent</code> service is installed.</li>
<li>No explicit Docker firewall configuration exists in <code>/etc/docker/daemon.json</code>.</li>
<li>The Cloudron Docker network uses the bridge driver and is not marked internal.</li>
<li>Docker's NAT/MASQUERADE rules are absent from both iptables backends.</li>
<li>Docker's standard forwarding/filtering chains are also missing.</li>
</ul>
<p dir="auto">I have also restarted Docker:</p>
<pre><code class="language-bash">sudo systemctl restart docker
</code></pre>
<p dir="auto">Immediately afterward, the <code>DOCKER-USER</code> chain appeared, but subsequent checks showed that it was missing again.</p>
<p dir="auto">Restarting the Cloudron firewall service did not resolve the issue:</p>
<pre><code class="language-bash">sudo systemctl restart cloudron-firewall.service
</code></pre>
<p dir="auto">The same error persists.</p>
<h3>4. Cloudron login is still broken</h3>
<p dir="auto">The login page loads, but attempting to sign in results in:</p>
<p dir="auto"><code>Internal error, try again later</code></p>
<p dir="auto">The box log reports:</p>
<pre><code class="language-text">Unknown column 'inviteTokenCreationTime' in 'field list'
ER_BAD_FIELD_ERROR (1054)
</code></pre>
<p dir="auto">The diagnostic tool reports pending database migrations, while the other 32 checks passed.</p>
<h3>5. Application networking is also affected</h3>
<p dir="auto">My Chatwoot application cannot establish outbound HTTPS connections to Meta or Google from inside its container, although the Ubuntu host can reach both.</p>
<p dir="auto">Chatwoot's Sidekiq logs repeatedly show:</p>
<pre><code class="language-text">Net::OpenTimeout:
Failed to open TCP connection to graph.facebook.com:443
</code></pre>
<p dir="auto">As a result, approved WhatsApp templates remain stuck on "Sending."</p>
<p dir="auto">This suggests that the Docker networking and Cloudron firewall issues may be related.</p>
<h3>6. Urgent concern about application data</h3>
<p dir="auto">I'm now particularly concerned about the safety of my application data.</p>
<p dir="auto">One of the applications hosted on this Cloudron server has <strong>not been backed up for approximately one week</strong>, and it contains important data that I cannot afford to lose.</p>
<p dir="auto">The application data may still be intact, but with the Cloudron dashboard inaccessible and the platform update incomplete, I'm concerned that further recovery attempts could put this data at risk.</p>
<p dir="auto"><strong>Before proceeding with additional repairs, could you please advise on the safest way to preserve the existing application data and database in their current state?</strong></p>
<p dir="auto">Specifically, I would appreciate guidance on whether we should create a server-level snapshot or perform an application/database backup through SSH before attempting any further recovery.</p>
<p dir="auto">I would also appreciate your help with the following:</p>
<ol>
<li>Identifying why the Docker-managed firewall chains and NAT rules are missing.</li>
<li>Restoring <code>cloudron-firewall.service</code> without disrupting existing application data.</li>
<li>Completing the pending Cloudron database migrations safely.</li>
<li>Restoring the Cloudron dashboard and application connectivity.</li>
</ol>
<p dir="auto">I've already spent considerable time diagnosing this issue, and I'm hesitant to perform further restarts, upgrades, or firewall changes without guidance because of the risk to my application data.</p>
<p dir="auto"><strong>Could a Cloudron engineer please review this and recommend the safest recovery procedure?</strong></p>
<p dir="auto">Thank you for your continued assistance.</p>
]]></description><link>https://forum.cloudron.io/post/132785</link><guid isPermaLink="true">https://forum.cloudron.io/post/132785</guid><dc:creator><![CDATA[weesaal]]></dc:creator><pubDate>Thu, 12 Nov 2026 11:02:21 GMT</pubDate></item><item><title><![CDATA[Reply to Cloudron 10.1.5 update failed – Database migrations pending, firewall failure and Docker networking broken on Thu, 12 Nov 2026 10:21:03 GMT]]></title><description><![CDATA[<p dir="auto">Hello <a class="plugin-mentions-user plugin-mentions-a" href="/user/weesaal" aria-label="Profile: weesaal">@<bdi>weesaal</bdi></a> and welcome to the Cloudron community forum</p>
<p dir="auto">I think you might be running into the same or similar issue as here <a href="https://forum.cloudron.io/topic/14652/could-not-load-dashboard-website-with-loopback-check-boxerror-unknown-column-pending-in-field-list-update-from-8.3.2-to-9.0.13">https://forum.cloudron.io/topic/14652/could-not-load-dashboard-website-with-loopback-check-boxerror-unknown-column-pending-in-field-list-update-from-8.3.2-to-9.0.13</a></p>
<p dir="auto">the solution was:</p>
<blockquote>
<p dir="auto"><a class="plugin-mentions-user plugin-mentions-a" href="/user/joseph" aria-label="Profile: joseph">@<bdi>joseph</bdi></a> <a href="/post/116266">said</a>:</p>
<p dir="auto">Please run this manually and it should start again:</p>
<p dir="auto"><code>/home/yellowtent/box/setup/start.sh</code></p>
</blockquote>
<p dir="auto">Although <code>cloudron-support --apply-db-migrations</code> does run <code>/home/yellowtent/box/setup/start.sh</code>.</p>
<p dir="auto">You did run <code>cloudron-support</code> with <code>sudo</code>, which might not work correctly.<br />
Just to make sure, please run <code>cloudron-support</code> as the root user:</p>
<pre><code class="language-bash">sudo su -
cloudron-support --apply-db-migrations
</code></pre>
<p dir="auto">and report back, if that resolves the issue.</p>
]]></description><link>https://forum.cloudron.io/post/132780</link><guid isPermaLink="true">https://forum.cloudron.io/post/132780</guid><dc:creator><![CDATA[james]]></dc:creator><pubDate>Thu, 12 Nov 2026 10:21:03 GMT</pubDate></item></channel></rss>