<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[issue with backups on Scaleway]]></title><description><![CDATA[<p dir="auto">For the past few days, I’ve been having a trouble with my automatic backup to Scaleway (in tgz format).</p>
<p dir="auto">Manual backups work, but I may encounter the same issue with large backups (&gt; 30 GB). The error displayed is <code>FileSystem Error</code> or <code>Error: getaddrinfo EAI_AGAIN s3.fr-par.scw.cloud</code>.</p>
<pre><code>Jul 23 11:42:19 backupformat/tgz: addToPack: error adding ./data/wp-content/uploads/2024/04/Le-Clan-des-renard-10-72dpiweb.jpg file The operation was aborted
Jul 23 11:42:19 backupformat/tgz: BoxError: The operation was aborted
    at file:///home/yellowtent/box/src/backupformat/tgz.js:67:24
    at Sink._continuePack (/home/yellowtent/box/node_modules/tar-stream/pack.js:42:5)
    at Sink._destroy (/home/yellowtent/box/node_modules/tar-stream/pack.js:121:10)
    at WritableState.updateNonPrimary (/home/yellowtent/box/node_modules/streamx/index.js:213:16)
    at WritableState.update (/home/yellowtent/box/node_modules/streamx/index.js:195:72)
    at WritableState.updateWriteNT (/home/yellowtent/box/node_modules/streamx/index.js:564:10)
    at node:internal/process/task_queues:149:7
    at AsyncResource.runInAsyncScope (node:async_hooks:214:14)
    at AsyncResource.runMicrotask (node:internal/process/task_queues:146:8)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5) {
  reason: 'FileSystem Error',
  details: {}
}
Jul 23 11:42:19 backupformat/tgz: tarPack: packed 0 files
Jul 23 11:42:19 backupformat/tgz: AbortError: The operation was aborted
    at Object.destroyer (node:internal/streams/destroy:328:11)
    at createAsyncIterator (node:internal/streams/readable:1404:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5) {
  code: 'ABORT_ERR'
}
Jul 23 11:42:19 backupformat/tgz: Attempt 1 failed. Will retry: tarPack pipeline error: The operation was aborted 
Jan 01 01:00:00 /home/yellowtent/box/node_modules/@aws-sdk/core/dist-cjs/submodules/protocols/index.js:69
Jan 01 01:00:00                 throw this.decorateServiceException(Object.assign(new ErrorCtor({ name: errorName }), errorMetadata), dataObject);
Jan 01 01:00:00                                                                   ^
Jan 01 01:00:00 
Jan 01 01:00:00 InvalidArgument: Part number must be an integer between 1 and 1000, inclusive
Jan 01 01:00:00     at ProtocolLib.getErrorSchemaOrThrowBaseException (/home/yellowtent/box/node_modules/@aws-sdk/core/dist-cjs/submodules/protocols/index.js:69:67)
Jan 01 01:00:00     at AwsRestXmlProtocol.handleError (/home/yellowtent/box/node_modules/@aws-sdk/core/dist-cjs/submodules/protocols/index.js:1810:65)
Jan 01 01:00:00     at AwsRestXmlProtocol.deserializeResponse (/home/yellowtent/box/node_modules/@smithy/core/dist-cjs/submodules/protocols/index.js:334:24)
Jan 01 01:00:00     at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@smithy/core/dist-cjs/submodules/schema/index.js:26:24
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:385:20
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@smithy/middleware-retry/dist-cjs/index.js:254:46
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@aws-sdk/middleware-flexible-checksums/dist-cjs/index.js:243:24
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:62:28
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@aws-sdk/middleware-sdk-s3/dist-cjs/index.js:89:20
Jan 01 01:00:00     at async /home/yellowtent/box/node_modules/@aws-sdk/middleware-logger/dist-cjs/index.js:5:26
Jan 01 01:00:00     at async Upload.__doConcurrentUpload (/home/yellowtent/box/node_modules/@aws-sdk/lib-storage/dist-cjs/index.js:374:32)
Jan 01 01:00:00     at async Promise.all (index 0)
Jan 01 01:00:00     at async Upload.__doMultipartUpload (/home/yellowtent/box/node_modules/@aws-sdk/lib-storage/dist-cjs/index.js:419:9)
Jan 01 01:00:00     at async Upload.done (/home/yellowtent/box/node_modules/@aws-sdk/lib-storage/dist-cjs/index.js:238:16) {
Jan 01 01:00:00   '$fault': 'client',
Jan 01 01:00:00   '$retryable': undefined,
Jan 01 01:00:00   '$metadata': {
Jan 01 01:00:00     httpStatusCode: 400,
Jan 01 01:00:00     requestId: 'txg807b949ef8da446bbd29-006a61e1fb',
Jan 01 01:00:00     extendedRequestId: 'txg807b949ef8da446bbd29-006a61e1fb',
Jan 01 01:00:00     cfId: undefined,
Jan 01 01:00:00     attempts: 1,
Jan 01 01:00:00     totalRetryDelay: 0
Jan 01 01:00:00   },
Jan 01 01:00:00   Code: 'InvalidArgument',
Jan 01 01:00:00   RequestId: 'txg807b949ef8da446bbd29-006a61e1fb',
Jan 01 01:00:00   HostId: 'txg807b949ef8da446bbd29-006a61e1fb',
Jan 01 01:00:00   Resource: '/cloudron/snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz'
Jan 01 01:00:00 }
Jan 01 01:00:00 
Jan 01 01:00:00 Node.js v24.13.0
Jul 23 11:42:25 shell: backuptask: /usr/bin/sudo --non-interactive -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz ecbe2048-0622-4fe7-ab86-0a2712ae1c2b {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]} errored with code 1 and signal null timeout false terminated false - stdout: "" - stderr: ""
Jul 23 11:42:25 backuptask: runBackupUpload: backuptask crashed BoxError: /usr/bin/sudo exited with code 1 signal null
    at ChildProcess.&lt;anonymous&gt; (file:///home/yellowtent/box/src/shell.js:70:23)
    at ChildProcess.emit (node:events:508:28)
    at maybeClose (node:internal/child_process:1101:16)
    at ChildProcess._handle.onexit (node:internal/child_process:305:5) {
  reason: 'Shell Error',
  details: {},
  stdout: '',
  stdoutString: '',
  stdoutLineCount: 0,
  stderr: '',
  stderrString: '',
  stderrLineCount: 0,
  code: 1,
  signal: null,
  timedOut: false,
  terminated: false
}
Jul 23 11:42:25 backuptask: fullBackup: app emf.fr backup finished. Took 1091.923 seconds
Jul 23 11:42:25 locks: write: current locks: {"full_backup_task_ecbe2048-0622-4fe7-ab86-0a2712ae1c2b":null}
Jul 23 11:42:25 locks: release: app_backup_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6
Jul 23 11:42:25 tasks: setCompleted - 27690: {"result":null,"error":{"message":"Backuptask crashed","reason":"Internal Error"},"percent":100}
Jul 23 11:42:25 tasks: updating task 27690 with: {"completed":true,"result":null,"error":{"message":"Backuptask crashed","reason":"Internal Error"},"percent":100}
Jul 23 11:42:25 taskworker: Task took 4824.905 seconds
Jul 23 11:42:25 BoxError: Backuptask crashed
    at runBackupUpload (file:///home/yellowtent/box/src/backuptask.js:190:15)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async uploadAppSnapshot (file:///home/yellowtent/box/src/backuptask.js:359:34)
    at async backupAppWithTag (file:///home/yellowtent/box/src/backuptask.js:382:26)
Jul 23 11:42:25 Exiting with code 0

</code></pre>
]]></description><link>https://forum.cloudron.io/topic/15727/issue-with-backups-on-scaleway</link><generator>RSS for Node</generator><lastBuildDate>Mon, 10 Aug 2026 18:12:21 GMT</lastBuildDate><atom:link href="https://forum.cloudron.io/topic/15727.rss" rel="self" type="application/rss+xml"/><pubDate>Thu, 23 Jul 2026 11:38:55 GMT</pubDate><ttl>60</ttl><item><title><![CDATA[Reply to issue with backups on Scaleway on Mon, 27 Jul 2026 07:13:09 GMT]]></title><description><![CDATA[<p dir="auto">I spent several days trying to understand why backups kept failing on my Cloudron instance. After investigating the issue with Claude’s help, I identified and fixed two infrastructure issues on my own (detailed below for context), but Claude also highlighted a weakness on the Cloudron side: the lack of retries for transient network/DNS errors during S3 backup operations. I’m sharing this report written by Claude here for review.</p>
<p dir="auto"><strong>Title</strong>: Backup fails entirely on a single transient DNS/network error during S3 copy/list operations — no retry</p>
<p dir="auto"><strong>Version:</strong> Cloudron 9.2.0 (Ubuntu 22.04.5 LTS Linux 5.15.0-186-generic)</p>
<p dir="auto">Context : self-hosted server, backups to Scaleway Object Storage (S3-compatible), both tar and rsync backup formats affected</p>
<p dir="auto"><strong>Summary</strong></p>
<p dir="auto">Over the past week I've had repeated backup failures, all sharing the same final symptom:</p>
<p dir="auto"><code>Error: getaddrinfo EAI_AGAIN cloudron-rsync.s3.fr-par.scw.cloud</code></p>
<p dir="auto">This occurred at different stages of the backup pipeline across different incidents: during initial tar packing/upload, during <code>copyInternal</code> (S3-to-S3 copy for snapshot rotation), during <code>checkPreconditions</code> (mount point check), and during <code>listDir</code> (listing objects for rsync-based copy). The common thread in every case: a single DNS resolution hiccup during a long-running backup (which can involve tens of thousands of individual S3 operations) causes the entire backup task to crash and be marked as failed, with no retry attempted at the DNS/network level or at the individual-operation level.</p>
<p dir="auto">Root causes I found and fixed on my own infrastructure (not Cloudron bugs, but worth noting for context)</p>
<ol>
<li>
<p dir="auto">A local mail service (Haraka, bundled with Cloudron) was stuck in an infinite retry loop performing reverse DNS (PTR) lookups on what turned out to be an IP in the reserved 240.0.0.0/4 range — never a real client IP, likely a bug in Haraka's own DNS-resolution/rDNS-check code generating a bad address internally. This flooded <code>systemd-resolved</code> with several lookups per second, 24/7, unrelated to backup timing.</p>
</li>
<li>
<p dir="auto">One of my two DHCP-provided DNS resolvers silently failed to respond at all over DNS-over-TCP (confirmed with <code>dig +tcp @&lt;ip&gt;</code>, consistent timeout), while working fine over UDP. When <code>systemd-resolved</code> fell back to TCP (e.g. due to the Haraka-induced UDP noise, or any other reason), it would sometimes pick this broken resolver and hang.</p>
</li>
</ol>
<p dir="auto">Both issues are now fixed (mail service restart + config fix for #1, resolver removed from netplan config for #2), and backups now get much further before any failure — but a single transient DNS hiccup can still occasionally happen (as it can on any network), and it still takes down the whole backup task when it does.</p>
<p dir="auto"><strong>What would help</strong></p>
<ol>
<li>
<p dir="auto">Wrap <code>listDir</code> / <code>copyDir</code> / <code>copyInternal</code> (and any other network-dependent step in the backup pipeline) with a retry mechanism (e.g. 3 attempts with exponential backoff) for transient DNS/network errors like <code>EAI_AGAIN</code>, <code>ETIMEDOUT</code>, <code>ECONNRESET</code>. A single flaky lookup during a backup touching 80k+ files should not fail a multi-hour backup task that has otherwise fully succeeded.</p>
</li>
<li>
<p dir="auto">If a retry budget is exhausted, consider resuming/retrying at the file level rather than aborting the entire task — some backups got quite far (tens of thousands of files copied) before the single failure.</p>
</li>
<li>
<p dir="auto">More generally: the current behavior converts what should be a transient, self-healing network condition into a hard failure with <code>reason: 'External Error' / 'Internal Error'</code>, requiring full backup task re-runs from scratch.</p>
</li>
</ol>
]]></description><link>https://forum.cloudron.io/post/127242</link><guid isPermaLink="true">https://forum.cloudron.io/post/127242</guid><dc:creator><![CDATA[jeau]]></dc:creator><pubDate>Mon, 27 Jul 2026 07:13:09 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Fri, 24 Jul 2026 19:26:48 GMT]]></title><description><![CDATA[<p dir="auto">hi <a class="plugin-mentions-user plugin-mentions-a" href="/user/james" aria-label="Profile: james">@<bdi>james</bdi></a>, hi <a class="plugin-mentions-user plugin-mentions-a" href="/user/joseph" aria-label="Profile: joseph">@<bdi>joseph</bdi></a></p>
<p dir="auto">I’m going to change the schedule, but I don’t think that’s the problem – I’ve already tried different ones.</p>
<p dir="auto">Here are the results of the commands:</p>
<pre><code>client_XX@YZ:~$ cat /etc/resolv.conf
...

nameserver 127.0.0.53
options edns0 trust-ad
search netadmin.local

client_XX@YZ:~$ cat /etc/systemd/resolved.conf
...
[Resolve]
# Some examples of DNS servers which may be used for DNS= and FallbackDNS=:
# Cloudflare: 1.1.1.1#cloudflare-dns.com 1.0.0.1#cloudflare-dns.com 2606:4700:4700::1111#cloudflare-dns.com 2606:4700:4700::1001#cloudflare-dns.com
# Google:     8.8.8.8#dns.google 8.8.4.4#dns.google 2001:4860:4860::8888#dns.google 2001:4860:4860::8844#dns.google
# Quad9:      9.9.9.9#dns.quad9.net 149.112.112.112#dns.quad9.net 2620:fe::fe#dns.quad9.net 2620:fe::9#dns.quad9.net
#DNS=
#FallbackDNS=
#Domains=
#DNSSEC=no
#DNSOverTLS=no
#MulticastDNS=no
#LLMNR=no
#Cache=no-negative
#CacheFromLocalhost=no
#DNSStubListener=yes
#DNSStubListenerExtra=
#ReadEtcHosts=yes
#ResolveUnicastSingleLabel=no

client_XX@YZ:~$ resolvectl
Global
       Protocols: -LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported
resolv.conf mode: stub

Link 2 (eth0)
    Current Scopes: DNS
         Protocols: +DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported
Current DNS Server: 109.69.184.202
       DNS Servers: 109.69.184.202 185.73.52.130
        DNS Domain: netadmin.local

Link 3 (ens19)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 4 (br-20b2daa3116f)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 5 (docker0)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 7 (veth60f4143)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 9 (vethaa60690)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 10 (veth8a31d71)
Current Scopes: none
     Protocols: -DefaultRoute +LLMNR -mDNS -DNSOverTLS DNSSEC=no/unsupported

Link 13 (vethaea343a)
</code></pre>
]]></description><link>https://forum.cloudron.io/post/127181</link><guid isPermaLink="true">https://forum.cloudron.io/post/127181</guid><dc:creator><![CDATA[jeau]]></dc:creator><pubDate>Fri, 24 Jul 2026 19:26:48 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Fri, 24 Jul 2026 09:50:36 GMT]]></title><description><![CDATA[<p dir="auto">Can you check how the DNS resolution is set up on your server? The default set up should use <code>systemd-resolved</code> . What nameservers are in /etc/resolve.conf (should be 127.0.0.53) . And then check /etc/systemd/resolved.conf and also <code>resolvctl</code> output</p>
]]></description><link>https://forum.cloudron.io/post/127143</link><guid isPermaLink="true">https://forum.cloudron.io/post/127143</guid><dc:creator><![CDATA[joseph]]></dc:creator><pubDate>Fri, 24 Jul 2026 09:50:36 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Fri, 24 Jul 2026 08:12:28 GMT]]></title><description><![CDATA[<p dir="auto">Hello <a class="plugin-mentions-user plugin-mentions-a" href="/user/jeau" aria-label="Profile: jeau">@<bdi>jeau</bdi></a><br />
The following is an assumption.<br />
If only the automated backup fails, at night, in this specific time frame could it be that the remote is simply overloaded and thus causing errors?<br />
Since 00:00 o'clock is a widely used time slot for creating backups maybe shifting the time to e.g.: 03:00 o'clock might help.<br />
Something similar also happened to Let's Encrypt with hard coded times for certificate renewals created a DDoS like behaviour impacting their service negatively.</p>
<p dir="auto">Maybe worth a try?</p>
]]></description><link>https://forum.cloudron.io/post/127141</link><guid isPermaLink="true">https://forum.cloudron.io/post/127141</guid><dc:creator><![CDATA[james]]></dc:creator><pubDate>Fri, 24 Jul 2026 08:12:28 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Fri, 24 Jul 2026 06:41:18 GMT]]></title><description><![CDATA[<p dir="auto">Hi,<br />
I have set the Memory limit to 16 GiB and the Upload part size to 512 MiB<br />
It worked yesterday with the manual backups of individual applications and the whole system.<br />
But last night’s automatic backup failed.<br />
I suspect a network issue as I’m seeing this message <code>Error: getaddrinfo EAI_AGAIN cloudron.s3.fr-par.scw.cloud</code>, which I’ve seen before at other times.<br />
Perhaps the problem comes from my hosting provider or from Scaleway, but it seems to only affect backups, which is strange.</p>
<pre><code>Jul 23 23:49:34 services: Backing up mysql
Jul 23 23:49:34 pipeRequestToFile: connected with status code 200
Jul 23 23:49:34 pipeRequestToFile: success
Jul 23 23:53:35 shell: backuptask: /usr/bin/sudo --non-interactive -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz ecbe2048-0622-4fe7-ab86-0a2712ae1c2b {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]}
Jul 23 23:53:35 backuptask: snapshotApp: emf.fr took 241.328 seconds
Jul 23 23:53:35 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading app snapshot emf.fr"}
Jul 23 23:53:35 backuptask: runBackupUpload: adjusting heap size to 8192M
Jul 23 23:53:36 backupupload: Backing up {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]} to snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz
Jul 23 23:53:36 backuptask: upload: path snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz site ecbe2048-0622-4fe7-ab86-0a2712ae1c2b dataLayout {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]}
Jul 23 23:53:37 backuptask: checkPreconditions: mount point status is {"state":"active","message":""}
Jul 23 23:53:37 backuptask: checkPreconditions: getting disk usage of /home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6
Jul 23 23:53:37 shell: backuptask: du --dereference-args --summarize --block-size=1 --exclude=*.lock --exclude=dovecot.list.index.log.* /home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6
Jul 23 23:53:43 backuptask: checkPreconditions: total required=45107490816 available=Infinity
Jul 23 23:53:43 backupformat/tgz: upload: uploading to site ecbe2048-0622-4fe7-ab86-0a2712ae1c2b path snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz (encrypted: false) dataLayout {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]}
Jul 23 23:53:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz (emf.fr)"}
Jul 23 23:53:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 49M@5MBps (emf.fr)"}
Jul 23 23:54:03 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 97M@5MBps (emf.fr)"}
Jul 23 23:54:13 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 145M@5MBps (emf.fr)"}
Jul 23 23:54:23 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 191M@5MBps (emf.fr)"}
Jul 23 23:54:33 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 236M@5MBps (emf.fr)"}
Jul 23 23:54:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (60s, 281M) (emf.fr)"}
Jul 23 23:54:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 325M@4MBps (emf.fr)"}
Jul 23 23:55:03 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 367M@4MBps (emf.fr)"}
Jul 23 23:55:13 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 410M@4MBps (emf.fr)"}
Jul 23 23:55:23 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 451M@4MBps (emf.fr)"}
Jul 23 23:55:33 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 498M@5MBps (emf.fr)"}
Jul 23 23:55:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (120s, 540M) (emf.fr)"}
Jul 23 23:55:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 620M@8MBps (emf.fr)"}
Jul 23 23:56:03 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 713M@9MBps (emf.fr)"}
Jul 23 23:56:13 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 736M@2MBps (emf.fr)"}
Jul 23 23:56:23 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 761M@2MBps (emf.fr)"}
Jul 23 23:56:33 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 834M@7MBps (emf.fr)"}
Jul 23 23:56:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (180s, 964M) (emf.fr)"}
Jul 23 23:56:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 1061M@10MBps (emf.fr)"}
Jul 23 23:57:03 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 1229M@17MBps (emf.fr)"}
Jul 23 23:57:13 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 1420M@19MBps (emf.fr)"}
Jul 23 23:57:23 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 1538M@12MBps (emf.fr)"}
Jul 23 23:57:33 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 1677M@14MBps (emf.fr)"}
Jul 23 23:57:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (240s, 1840M) (emf.fr)"}
Jul 23 23:57:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2016M@17MBps (emf.fr)"}
Jul 23 23:58:03 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2119M@10MBps (emf.fr)"}
Jul 23 23:58:13 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2299M@18MBps (emf.fr)"}
Jul 23 23:58:23 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2459M@16MBps (emf.fr)"}
Jul 23 23:58:33 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2567M@11MBps (emf.fr)"}
Jul 23 23:58:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (300s, 2714M) (emf.fr)"}
Jul 23 23:58:53 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 2875M@16MBps (emf.fr)"}
Jul 23 23:59:04 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 3072M@20MBps (emf.fr)"}
Jul 23 23:59:14 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 3254M@18MBps (emf.fr)"}
Jul 23 23:59:24 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 3426M@17MBps (emf.fr)"}
Jul 23 23:59:34 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 3584M@16MBps (emf.fr)"}
Jul 23 23:59:43 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (360s, 3718M) (emf.fr)"}
Jul 23 23:59:54 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 3923M@17MBps (emf.fr)"}
Jul 24 00:00:04 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4089M@17MBps (emf.fr)"}
Jul 24 00:00:14 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4181M@9MBps (emf.fr)"}
Jul 24 00:00:24 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4349M@17MBps (emf.fr)"}
Jul 24 00:00:34 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4514M@16MBps (emf.fr)"}
Jul 24 00:00:44 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (421s, 4611M) (emf.fr)"}
Jul 24 00:00:54 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4778M@16MBps (emf.fr)"}
Jul 24 00:01:04 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 4953M@17MBps (emf.fr)"}
Jul 24 00:01:16 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 5120M@17MBps (emf.fr)"}
Jul 24 00:01:26 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 5252M@13MBps (emf.fr)"}
Jul 24 00:01:36 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 5436M@18MBps (emf.fr)"}
Jul 24 00:01:44 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (481s, 5609M) (emf.fr)"}
Jul 24 00:01:57 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 5779M@15MBps (emf.fr)"}
Jul 24 00:02:07 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 5966M@19MBps (emf.fr)"}
Jul 24 00:02:18 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 6144M@18MBps (emf.fr)"}
Jul 24 00:02:28 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 6315M@17MBps (emf.fr)"}
Jul 24 00:02:38 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 6498M@18MBps (emf.fr)"}
Jul 24 00:02:44 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Still uploading backup (541s, 6596M) (emf.fr)"}
Jul 24 00:02:59 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 6812M@16MBps (emf.fr)"}
Jul 24 00:03:09 tasks: updating task 27695 with: {"percent":61.606060606060616,"message":"Uploading backup 6992M@18MBps (emf.fr)"}
Jul 24 00:03:20 backupformat/tgz: addToPack: error adding ./data/wp-content/uploads/2021/07/AFF9AEV-BD-SCIENCES-1400x1980.jpg file The operation was aborted
Jul 24 00:03:20 backupformat/tgz: BoxError: The operation was aborted
    at file:///home/yellowtent/box/src/backupformat/tgz.js:67:24
    at Sink._continuePack (/home/yellowtent/box/node_modules/tar-stream/pack.js:42:5)
    at Sink._destroy (/home/yellowtent/box/node_modules/tar-stream/pack.js:121:10)
    at WritableState.updateNonPrimary (/home/yellowtent/box/node_modules/streamx/index.js:213:16)
    at WritableState.update (/home/yellowtent/box/node_modules/streamx/index.js:195:72)
    at WritableState.updateWriteNT (/home/yellowtent/box/node_modules/streamx/index.js:564:10)
    at node:internal/process/task_queues:149:7
    at AsyncResource.runInAsyncScope (node:async_hooks:214:14)
    at AsyncResource.runMicrotask (node:internal/process/task_queues:146:8)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5) {
  reason: 'FileSystem Error',
  details: {}
}
Jul 24 00:03:20 backupformat/tgz: tarPack: packed 0 files
Jul 24 00:03:20 backupformat/tgz: Attempt 1 failed. Will retry: tarPack pipeline error: The operation was aborted 
Jul 24 00:03:20 backupformat/tgz: AbortError: The operation was aborted
    at Object.destroyer (node:internal/streams/destroy:328:11)
    at createAsyncIterator (node:internal/streams/readable:1404:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5) {
  code: 'ABORT_ERR'
}
Jan 01 00:09:21 node:internal/process/promises:394
Jan 01 00:09:21     triggerUncaughtException(err, true /* fromPromise */);
Jan 01 00:09:21     ^
Jan 01 00:09:21 
Jan 01 00:09:21 Error: getaddrinfo EAI_AGAIN cloudron.s3.fr-par.scw.cloud
Jan 01 00:09:21     at GetAddrInfoReqWrap.onlookupall [as oncomplete] (node:dns:122:26) {
Jan 01 00:09:21   errno: -3001,
Jan 01 00:09:21   code: 'EAI_AGAIN',
Jan 01 00:09:21   syscall: 'getaddrinfo',
Jan 01 00:09:21   hostname: 'cloudron.s3.fr-par.scw.cloud',
Jan 01 00:09:21   '$metadata': { attempts: 1, totalRetryDelay: 0 }
Jan 01 00:09:21 }
Jan 01 00:09:21 
Jan 01 00:09:21 Node.js v24.13.0
Jul 24 00:03:30 shell: backuptask: /usr/bin/sudo --non-interactive -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6.tar.gz ecbe2048-0622-4fe7-ab86-0a2712ae1c2b {"localRoot":"/home/yellowtent/appsdata/aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6","layout":[]} errored with code 1 and signal null timeout false terminated false - stdout: "" - stderr: ""
Jul 24 00:03:30 backuptask: runBackupUpload: backuptask crashed BoxError: /usr/bin/sudo exited with code 1 signal null
    at ChildProcess.&lt;anonymous&gt; (file:///home/yellowtent/box/src/shell.js:70:23)
    at ChildProcess.emit (node:events:508:28)
    at maybeClose (node:internal/child_process:1101:16)
    at ChildProcess._handle.onexit (node:internal/child_process:305:5) {
  reason: 'Shell Error',
  details: {},
  stdout: '',
  stdoutString: '',
  stdoutLineCount: 0,
  stderr: '',
  stderrString: '',
  stderrLineCount: 0,
  code: 1,
  signal: null,
  timedOut: false,
  terminated: false
}
Jul 24 00:03:30 backuptask: fullBackup: app emf.fr backup finished. Took 836.467 seconds
Jul 24 00:03:30 locks: write: current locks: {"full_backup_task_ecbe2048-0622-4fe7-ab86-0a2712ae1c2b":null}
Jul 24 00:03:30 locks: release: app_backup_aa1ac9b6-3ba1-46f6-b4dc-fcfd3fe0b8a6
Jul 24 00:03:30 tasks: setCompleted - 27695: {"result":null,"error":{"message":"Backuptask crashed","reason":"Internal Error"},"percent":100}
Jul 24 00:03:30 tasks: updating task 27695 with: {"completed":true,"result":null,"error":{"message":"Backuptask crashed","reason":"Internal Error"},"percent":100}
Jul 24 00:03:30 taskworker: Task took 3808.784 seconds
Jul 24 00:03:30 BoxError: Backuptask crashed
    at runBackupUpload (file:///home/yellowtent/box/src/backuptask.js:190:15)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async uploadAppSnapshot (file:///home/yellowtent/box/src/backuptask.js:359:34)
    at async backupAppWithTag (file:///home/yellowtent/box/src/backuptask.js:382:26)
Jul 24 00:03:30 Exiting with code 0
</code></pre>
]]></description><link>https://forum.cloudron.io/post/127127</link><guid isPermaLink="true">https://forum.cloudron.io/post/127127</guid><dc:creator><![CDATA[jeau]]></dc:creator><pubDate>Fri, 24 Jul 2026 06:41:18 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Thu, 23 Jul 2026 13:00:43 GMT]]></title><description><![CDATA[<p dir="auto">Many thanks <a class="plugin-mentions-user plugin-mentions-a" href="/user/james" aria-label="Profile: james">@<bdi>james</bdi></a><br />
I’ve made these two changes to the settings<br />
and I’m currently testing them;<br />
I’ll also see how it goes when the automatic backup runs<br />
I’ll keep you posted</p>
]]></description><link>https://forum.cloudron.io/post/127099</link><guid isPermaLink="true">https://forum.cloudron.io/post/127099</guid><dc:creator><![CDATA[jeau]]></dc:creator><pubDate>Thu, 23 Jul 2026 13:00:43 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Thu, 23 Jul 2026 12:48:55 GMT]]></title><description><![CDATA[<p dir="auto">Hello <a class="plugin-mentions-user plugin-mentions-a" href="/user/jeau" aria-label="Profile: jeau">@<bdi>jeau</bdi></a><br />
Adding to my last message, when increasing the <code>Upload part size</code> you should also increase the <code>Memory limit</code> at least double or triple.<br />
So when changing <code>50 MiB</code> to <code>100 MiB</code> the <code>Memory limit</code> should also go from <code>1 GiB</code> to at least <code>2 GiB</code> or better <code>3 GiB</code>.</p>
]]></description><link>https://forum.cloudron.io/post/127098</link><guid isPermaLink="true">https://forum.cloudron.io/post/127098</guid><dc:creator><![CDATA[james]]></dc:creator><pubDate>Thu, 23 Jul 2026 12:48:55 GMT</pubDate></item><item><title><![CDATA[Reply to issue with backups on Scaleway on Thu, 23 Jul 2026 12:21:41 GMT]]></title><description><![CDATA[<p dir="auto">Hello <a class="plugin-mentions-user plugin-mentions-a" href="/user/jeau" aria-label="Profile: jeau">@<bdi>jeau</bdi></a></p>
<p dir="auto">Thanks for reporting, I think I see the issue.</p>
<pre><code>InvalidArgument: Part number must be an integer between 1 and 1000, inclusive
</code></pre>
<p dir="auto">This suggests this is Scaleway's Object Storage rejecting the 1001st part of a multipart upload, not a Cloudron bug in the strict sense, it's a limit collision.<br />
See: <a href="https://www.scaleway.com/en/docs/object-storage/api-cli/multipart-uploads/" target="_blank" rel="noopener noreferrer nofollow ugc">https://www.scaleway.com/en/docs/object-storage/api-cli/multipart-uploads/</a></p>
<blockquote>
<p dir="auto">1 to 1000 parts per object<br />
5 MB to 5 GB per part (except for the last one)<br />
Each object stores up to 5 TB</p>
</blockquote>
<p dir="auto">The default configuration for a S3 based backup site is:</p>
<ul>
<li>Memory limit: 1 GiB</li>
<li>Upload part size: 50 MiB</li>
<li>Upload concurrency: 20</li>
<li>Download concurrency: 30</li>
<li>Copy concurrency: 500</li>
</ul>
<p dir="auto">So with your error, I would advise increasing the <code>Upload part size</code> to e.g.: <code>100 MiB</code> that should cut the parts per object in half and could resolve your issue.</p>
<p dir="auto">I am taking this topic also as feedback to improve the error message to make it more human readable.</p>
]]></description><link>https://forum.cloudron.io/post/127097</link><guid isPermaLink="true">https://forum.cloudron.io/post/127097</guid><dc:creator><![CDATA[james]]></dc:creator><pubDate>Thu, 23 Jul 2026 12:21:41 GMT</pubDate></item></channel></rss>