Backup failed

[archos]

Hello, regularly every other day, I have a problem with a backup to S3 iDrive storage. Backups fail with this output.
Backup failed 4:31

Backup failed: backup not found. Logs are available

Nov 05 04:31:33box:tasks setCompleted - 7886: {"result":null,"error":{"stack":"BoxError: Backup not found\n at Object.setState (/home/yellowtent/box/src/backups.js:238:42)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async rotateAppBackup (/home/yellowtent/box/src/backuptask.js:304:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:384:12)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:504:29)","name":"BoxError","reason":"Not found","details":{},"message":"Backup not found"}}
Nov 05 04:31:33box:tasks update 7886: {"percent":100,"result":null,"error":{"stack":"BoxError: Backup not found\n at Object.setState (/home/yellowtent/box/src/backups.js:238:42)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async rotateAppBackup (/home/yellowtent/box/src/backuptask.js:304:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:384:12)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:504:29)","name":"BoxError","reason":"Not found","details":{},"message":"Backup not found"}}
Nov 05 04:31:33box:taskworker Task took 1891.178 seconds
Backup not found

Manual backup works without problems. I haven't had a problem backing up to iDrive for two months.
Does anyone know what is wrong? Thank you very much for the information.

[p44]

I've this problem too with Hetzner Storage Service, from Hetzner VPS...

I got this error:

"ENOENT: no such file or directory, open '/backups/snapshot/mail.tar.gz.enc'"

[archos]

@p44 I tried Hetzner about a year ago, but 14 days good and then the backups ended prematurely with an error. And most importantly they were terribly slow, sometimes up to 6 hours. The problem was both with Rsync also Tarball. That's why I switched to S3 storage, wasn't a problem for long until now.

[p44]

@archos I think problem should be better investigated. In latest two weeks I had this problem almost every day...

With a two-days retention policy, there is the risk to lost all old backups if problem occurs daily and cannot check backup status daily...

[d19dotca]

I also have had recent backup uploads failing recently with iDrive too. Most work but some fail and unfortunately they fail without any error in the logs. The latest logs in the latest failure from yesterday:

Nov 02 17:04:28box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:04:38box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:04:49box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:04:59box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:05:09box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:05:19box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:05:29box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}
Nov 02 17:05:39box:tasks update 22463: {"percent":96.45454545454537,"message":"Uploading backup 39936M@0MBps (mail)"}

I realized I went over my storage allotted in my plan, so I assumed it was that, but after clearing a bunch of old backups manually (since Cloudron's backup retention cleanup still doesn't seem to work as it should), it seemed to get a bit better as in less frequent but still see intermittent failures, so I guess storage wasn't the issue. I also increased memory allotted to the backup process but didn't notice any changes (and don't see any memory errors either).

I meant to open a support ticket with iDrive, and will do that too as I kind of suspect it's an iDrive issue but who knows, could be a Cloudron issue too.

[archos]

@d19dotca I also suspect it's a problem with the iDrive storage. Because the backup problem is not a regular one. If he writes to iDrive support please let me know.