Backup failed

[CaeruleusAqua]

My Cloudron backups have been failing for some time now.

I use rsync for backups. Approximately 180 GB, of which approximately 145 GB is for Nextcloud.

At first, I got the following error:

Aug 29 04:34:05 box:tasks update 5586: {"percent":80.99999999999999,"message":"Copying +ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/uYbVX3iQfX9ZX3oi2MrYO+OXMcKUXMqPbEwUm2cEBTNEFKqHHl8s6HafSSU+bTUz/tkVG1KBPdeNa1nbZ66NCIIX3SkMFhT5lXOtJLWcg7Ps/TS2Uj0cyUXTWKt1+2U04XWBM0wrFxvkHTb5WCpgkU9w/JOyEKB54wsfiC8Ur0lRqnqAe9xpWM1fltgRvYlxcUZE/xKBO1jw7Yly60K3n4+wK4UGVol6qNC43rUIjLHHKQ+w/hND+OXzdXNZMUrd8FWx3N7F766WpNFbviBzGQkuL2Z0/GiI2Wgr5sD9j+h+6Z1lh6gp0Y2ECkzNT2e6-gW5xU0c/Ckc-OtdAyuVQ9W60xUXCpA2UXpg7r5T51MJjM60i9cE/S97H90ysHhQ4nXUOyMMHuEJA-UvEFS+27lB35T4sqcc/zwTOKFpZViYWCmrp2KiDklEhdpD26JQsCUiKPG43i5M/xod4paQs7-r+TZKYECcDmp8kVn9Ed8ssOOp0YL0fXhA"}
Aug 29 04:34:05 box:tasks update 5586: {"percent":80.99999999999999,"message":"Copying +ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/uYbVX3iQfX9ZX3oi2MrYO+OXMcKUXMqPbEwUm2cEBTNEFKqHHl8s6HafSSU+bTUz/tkVG1KBPdeNa1nbZ66NCIIX3SkMFhT5lXOtJLWcg7Ps/TS2Uj0cyUXTWKt1+2U04XWBM0wrFxvkHTb5WCpgkU9w/JOyEKB54wsfiC8Ur0lRqnqAe9xpWM1fltgRvYlxcUZE/zg9uigbEhW0XJuMA4wmH5T6Yra2tgoieJw8lROEB6+Q/Ckc-OtdAyuVQ9W60xUXCpA2UXpg7r5T51MJjM60i9cE/S97H90ysHhQ4nXUOyMMHuEJA-UvEFS+27lB35T4sqcc/ZB7X5ucjnMRQYKClPU-VZPiI0r16vmmtVFjcxLKNlxo/wpF57b8mwK7mjJVLE13y73hRqU5OLj7s2rxoCVy2fTI/wjieJyQM44Ul8KspUoYpqbZu2NkR2kJfQvvV9+GXLEw/5MMoNG03PDeAt9nC-2e3Hp3q3+oPzs9thQTuZnQtuu0"}
Aug 29 04:34:05 4:05.151Z box:tasks update 5586: {"percent":80.99999999999999,"message":"Copying +ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/uYbVX3iQfX9ZX3oi2MrYO+OXMcKUXMqPbEwUm2cEBTNEFKqHHl8s6HafSSU+bTUz/tkVG1KBPdeNa1nbZ66NCIIX3SkMFhT5lXOtJLWcg7Ps/TS2Uj0cyUXTWKt1+2U04XWBM0wrFxvkHTb5WCpgkU9w/JOyEKB54wsfiC8Ur0lRqnqAe9xpWM1fltgRvYlxcUZE/zg9uigbEhW0XJuMA4wmH5T6Yra2tgoieJw8lROEB6+Q/Ckc-OtdAyuVQ9W60xUXCpA2UXpg7r5T51MJjM60i9cE/S97H90ysHhQ4nXUOyMMHuEJA-UvEFS+27lB35T4sqcc/ZB7X5ucjnMRQYKClPU-VZPiI0r16vmmtVFjcxLKNlxo/wpF57b8mwK7mjJVLE13y73hRqU5OLj7s2rxoCVy2fTI/wjieJyQM44Ul8KspUoYpqbZu2NkR2kJfQvvV9+GXLEw/GwaF-tDFzuXbKEqImz3bXS09XdPv3f7qRgr5wKY1f18"}
Aug 29 12:34:05 box:database Connection 287 error: Packets out of order. Got: 0 Expected: 2 PROTOCOL_PACKETS_OUT_OF_ORDER
Aug 29 12:34:05 box:database Connection 269 error: Packets out of order. Got: 0 Expected: 2 PROTOCOL_PACKETS_OUT_OF_ORDER
Aug 29 12:34:05 box:database Connection 268 error: Packets out of order. Got: 0 Expected: 2 PROTOCOL_PACKETS_OUT_OF_ORDER
Aug 29 12:34:05 box:database Connection 286 error: Packets out of order. Got: 0 Expected: 2 PROTOCOL_PACKETS_OUT_OF_ORDER
Aug 29 12:34:05 box:database Connection 285 error: Packets out of order. Got: 0 Expected: 2 PROTOCOL_PACKETS_OUT_OF_ORDER

I then did some research and increased the memory of the Postgree and MySQL services. Since then, I have been getting the following error:

30 04:55:51 box:storage/s3 Upload progress: {"loaded":157286400,"part":17,"key":"backup/snapshot/app_da39dd94-29b5-4049-9aa5-76864ebc4608/PxfpEb7+wUmcI4HqtZyk3+S3X74-uOlD48PJw6USsRw"}
Aug 30 04:55:51 box:tasks update 5599: {"percent":80.99999999999999,"message":"Uploading /home/yellowtent/appsdata/da39dd94-29b5-4049-9aa5-76864ebc4608/postgresqldump: 186M@11MBps (cloud.sdsf.de)"}
Aug 30 04:55:52 box:storage/s3 Upload finished. {"ETag":"\"33160dc4ed64115c025804e2f7ee85bf\"","Location":"https://dsfsdjuh.s3.eu-central-3.ionoscloud.com/backup/snapshot/app_da39dd94-29b5-4049-9aa5-76864ebc4608/%2Bym30OeTAZmJJGSygsdvvo%2BQA-R6uI783QOB%2B9CR6-4/%2Bym30OeTAZmJJGSygsdvvo%2BQA-R6uI783QOB%2B9CR6-4/73cf3LW0lq8Gl9z%2B%2Buno9UZMcBYCsnUXKrSje95Irh8/DTXDa93HoxW4QTyb1SX%2Bv3o2u8y1K9OPHusDt43HE3E/Uml0E1jL5nx4k7awALYeoxUHGsDDj086JffucaV5Sx0/f1C3F5NR01z3YGzFF4xVmSa53CQ7YDYdoOLQhCFRZ2cXymhPiaFjrCPXeHVLWw3v/wyBpuP046dw9sW5eBM1TBBajKwevVv18UKfYc69FRow/VtjMWbuZ48jDDkj4SsNX782j8svZKhd4tIoPwc-vL9Z0QvmHRW5K0xf5twQ1eCuUXCj6nBytX86Dh6Jd81Mx0A/jL5sTQaH9cvpujCsHeY8Fwedtw%2BFYycO0KPLqEfiAZl5OuJn-TPt0zVLoreyZZhv%2B6R5uVKd1iLrngqLoanF9DbHExuqVGyMYEt65JFvA3o7Hf%2B0Kf7alzkiAlUiEWdSR-5dL84xxMSomfYCrm0EvA","key":"backup/snapshot/app_da39dd94-29b5-4049-9aa5-76864ebc4608/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/73cf3LW0lq8Gl9z++uno9UZMcBYCsnUXKrSje95Irh8/DTXDa93HoxW4QTyb1SX+v3o2u8y1K9OPHusDt43HE3E/Uml0E1jL5nx4k7awALYeoxUHGsDDj086JffucaV5Sx0/f1C3F5NR01z3YGzFF4xVmSa53CQ7YDYdoOLQhCFRZ2cXymhPiaFjrCPXeHVLWw3v/wyBpuP046dw9sW5eBM1TBBajKwevVv18UKfYc69FRow/VtjMWbuZ48jDDkj4SsNX782j8svZKhd4tIoPwc-vL9Z0QvmHRW5K0xf5twQ1eCuUXCj6nBytX86Dh6Jd81Mx0A/jL5sTQaH9cvpujCsHeY8Fwedtw+FYycO0KPLqEfiAZl5OuJn-TPt0zVLoreyZZhv+6R5uVKd1iLrngqLoanF9DbHExuqVGyMYEt65JFvA3o7Hf+0Kf7alzkiAlUiEWdSR-5dL84xxMSomfYCrm0EvA","Key":"backup/snapshot/app_da39dd94-29b5-4049-9aa5-76864ebc4608/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/73cf3LW0lq8Gl9z++uno9UZMcBYCsnUXKrSje95Irh8/DTXDa93HoxW4QTyb1SX+v3o2u8y1K9OPHusDt43HE3E/Uml0E1jL5nx4k7awALYeoxUHGsDDj086JffucaV5Sx0/f1C3F5NR01z3YGzFF4xVmSa53CQ7YDYdoOLQhCFRZ2cXymhPiaFjrCPXeHVLWw3v/wyBpuP046dw9sW5eBM1TBBajKwevVv18UKfYc69FRow/VtjMWbuZ48jDDkj4SsNX782j8svZKhd4tIoPwc-vL9Z0QvmHRW5K0xf5twQ1eCuUXCj6nBytX86Dh6Jd81Mx0A/jL5sTQaH9cvpujCsHeY8Fwedtw+FYycO0KPLqEfiAZl5OuJn-TPt0zVLoreyZZhv+6R5uVKd1iLrngqLoanF9DbHExuqVGyMYEt65JFvA3o7Hf+0Kf7alzkiAlUiEWdSR-5dL84xxMSomfYCrm0EvA","Bucket":"dsfsdjuh"}
Aug 30 04:55:52 /home/yellowtent/box/node_modules/aws-sdk/lib/services/s3.js:712
Aug 30 04:55:52 resp.error = AWS.util.error(new Error(), {
Aug 30 04:55:52 ^
Aug 30 04:55:52
Aug 30 04:55:52 400: null
Aug 30 04:55:52 at Request.extractError (/home/yellowtent/box/node_modules/aws-sdk/lib/services/s3.js:712:35)
Aug 30 04:55:52 at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
Aug 30 04:55:52 at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
Aug 30 04:55:52 at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:686:14)
Aug 30 04:55:52 at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)
Aug 30 04:55:52 at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)
Aug 30 04:55:52 at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10
Aug 30 04:55:52 at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)
Aug 30 04:55:52 at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:688:12)
Aug 30 04:55:52 at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:116:18) {
Aug 30 04:55:52 code: 400,
Aug 30 04:55:52 region: null,
Aug 30 04:55:52 time: 2025-08-30T02:55:53.849Z,
Aug 30 04:55:52 requestId: null,
Aug 30 04:55:52 extendedRequestId: undefined,
Aug 30 04:55:52 cfId: undefined,
Aug 30 04:55:52 statusCode: 400,
Aug 30 04:55:52 retryable: false,
Aug 30 04:55:52 retryDelay: 20000
Aug 30 04:55:52 }
Aug 30 04:55:52
Aug 30 04:55:52 Node.js v20.18.0
Aug 30 04:55:53 box:shell backuptask: /usr/bin/sudo -S -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_da39dd94-29b5-4049-9aa5-76864ebc4608 rsync {"localRoot":"/home/yellowtent/appsdata/da39dd94-29b5-4049-9aa5-76864ebc4608","layout":[]} errored BoxError: backuptask exited with code 1 signal null
Aug 30 04:55:53 at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19)
Aug 30 04:55:53 at ChildProcess.emit (node:events:519:28)
Aug 30 04:55:53 at ChildProcess.emit (node:domain:488:12)
Aug 30 04:55:53 at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
Aug 30 04:55:53 reason: 'Shell Error',
Aug 30 04:55:53 details: {},
Aug 30 04:55:53 code: 1,
Aug 30 04:55:53 signal: null
Aug 30 04:55:53 }
Aug 30 04:55:53 box:backuptask runBackupUpload: backuptask crashed BoxError: backuptask exited with code 1 signal null
Aug 30 04:55:53 at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:137:19)
Aug 30 04:55:53 at ChildProcess.emit (node:events:519:28)
Aug 30 04:55:53 at ChildProcess.emit (node:domain:488:12)
Aug 30 04:55:53 at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
Aug 30 04:55:53 reason: 'Shell Error',
Aug 30 04:55:53 details: {},
Aug 30 04:55:53 code: 1,
Aug 30 04:55:53 signal: null
Aug 30 04:55:53 }
Aug 30 04:55:53 box:backuptask fullBackup: app cloud.sdsf.de backup finished. Took 8402.405 seconds
Aug 30 04:55:53 box:locks write: current locks: {"backup_task":null}
Aug 30 04:55:53 box:locks release: app_da39dd94-29b5-4049-9aa5-76864ebc4608
Aug 30 04:55:53 box:taskworker Task took 14153.117 seconds
Aug 30 04:55:53 box:tasks setCompleted - 5599: {"result":null,"error":{"stack":"BoxError: Backuptask crashed\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:369:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:391:5)","name":"BoxError","reason":"Internal Error","details":{},"message":"Backuptask crashed"}}
Aug 30 04:55:53 box:tasks update 5599: {"percent":100,"result":null,"error":{"stack":"BoxError: Backuptask crashed\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:369:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:391:5)","name":"BoxError","reason":"Internal Error","details":{},"message":"Backuptask crashed"}}
Aug 30 04:55:53 BoxError: Backuptask crashed
Aug 30 04:55:53 at runBackupUpload (/home/yellowtent/box/src/backuptask.js:170:15)
Aug 30 04:55:53 at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Aug 30 04:55:53 at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:369:5)
Aug 30 04:55:53 at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:391:5)

[james]

Hello @CaeruleusAqua
Sorry that you are having these issues.
Are you using backup encryption and backup file-name encryption?
If so, can you try to disable only the file-name encryption and run the backup?
I suspect that file and folder names can't be longer than 255 UTF-8 and with a folder structure like Nextcloud e.g. folder1/folder2/folder3/PXL_20250824_105954759.jpg then being encrypted to e.g.

+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/+ym30OeTAZmJJGSygsdvvo+QA-R6uI783QOB+9CR6-4/uYbVX3iQfX9ZX3oi2MrYO+OXMcKUXMqPbEwUm2cEBTNEFKqHHl8s6HafSSU+bTUz/tkVG1KBPdeNa1nbZ66NCIIX3SkMFhT5lXOtJLWcg7Ps/TS2Uj0cyUXTWKt1+2U04XWBM0wrFxvkHTb5WCpgkU9w/JOyEKB54wsfiC8Ur0lRqnqAe9xpWM1fltgRvYlxcUZE/xKBO1jw7Yly60K3n4+wK4UGVol6qNC43rUIjLHHKQ+w/hND+OXzdXNZMUrd8FWx3N7F766WpNFbviBzGQkuL2Z0/GiI2Wgr5sD9j+h+6Z1lh6gp0Y2ECkzNT2e6-gW5xU0c/Ckc-OtdAyuVQ9W60xUXCpA2UXpg7r5T51MJjM60i9cE/S97H90ysHhQ4nXUOyMMHuEJA-UvEFS+27lB35T4sqcc/zwTOKFpZViYWCmrp2KiDklEhdpD26JQsCUiKPG43i5M/xod4paQs7-r+TZKYECcDmp8kVn9Ed8ssOOp0YL0fXhA

592 characters, from your log.
This might cause the issue.
Might be worth a try.

[CaeruleusAqua]

That fixed the problem. Thank you.

[james]

Hello @CaeruleusAqua
Please assist me in understanding this issue better.

I want to figure out if is just a single filename or path and filename causing this issue.
For this please go into the web terminal of your nextcloud and go into your /app/data/ folder.

cd /app/data/

Please run the following command. It will find the deepest path and the longest filename.
With these details I can further debug this issue.

find . -type d | awk -F/ '{if(NF>max){max=NF; path=$0}} END{print "Max depth:", max-1, "Path:", path}'; \
find . -type f | awk -F/ '{if(length($NF)>max){max=length($NF); file=$0}} END{print "Longest filename length:", max, "File:", file}'

Also can you please provide details about your backup provider?