Backup failed: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'

[jdaviescoates]

Got this error:

ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'

Logs:

 at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:383:5)
at async fullBackup (/home/yellowtent/box/src/backuptask.js:504:29)
at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:361:5)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at runBackupUpload (/home/yellowtent/box/src/backuptask.js:166:15)
Sep 01 04:00:01box:taskworker Starting task 13767. Logs are at /home/yellowtent/platformdata/logs/tasks/13767.log
Sep 01 04:00:01box:tasks update 13767: {"percent":1,"message":"Backing up files.uniteddiversity.coop (1/54)"}
Sep 01 04:00:01box:tasks update 13767: {"percent":2.754385964912281,"message":"Snapshotting app files.uniteddiversity.coop"}
Sep 01 04:00:01box:backuptask snapshotApp: files.uniteddiversity.coop took 0.005 seconds
Sep 01 04:00:01box:services backupAddons
Sep 01 04:00:01box:services backupAddons: backing up ["oidc","localstorage"]
Sep 01 04:00:01box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading app snapshot files.uniteddiversity.coop"}
Sep 01 04:00:01box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb spawn: /usr/bin/sudo -S -E --close-from=4 /home/yellowtent/box/src/scripts/backupupload.js snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb tgz {"localRoot":"/home/yellowtent/appsdata/08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb","layout":[]}
Sep 01 04:00:01box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:01.906Z box:backupupload Backing up {"localRoot":"/home/yellowtent/appsdata/08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb","layout":[]} to snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb
Sep 01 04:00:01box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:01.972Z box:backuptask upload: path snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb format tgz dataLayout {"localRoot":"/home/yellowtent/appsdata/08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb","layout":[]}
Sep 01 04:00:02box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:02.021Z box:backuptask upload: mount point status is {"state":"active","message":"Mounted"}
Sep 01 04:00:02box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:02.043Z box:backuptask checkPreconditions: getting disk usage of /home/yellowtent/appsdata/08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb
Sep 01 04:00:02box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:02.856Z box:backuptask checkPreconditions: total required =4097544461 available=undefined
Sep 01 04:00:02box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:02.857Z box:backupformat/tgz upload: Uploading {"localRoot":"/home/yellowtent/appsdata/08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb","layout":[]} to snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb
Sep 01 04:00:03box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:03.429Z box:storage/filesystem upload: [/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz] out stream error. [Error: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'] { errno: -2, code: 'ENOENT', syscall: 'open', path: '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' }
Sep 01 04:00:12box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:00:22box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:00:23box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:23.448Z box:storage/filesystem upload: [/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz] out stream error. [Error: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'] { errno: -2, code: 'ENOENT', syscall: 'open', path: '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' }
Sep 01 04:00:32box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:00:42box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:00:43box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:00:43.464Z box:storage/filesystem upload: [/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz] out stream error. [Error: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'] { errno: -2, code: 'ENOENT', syscall: 'open', path: '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' }
Sep 01 04:00:53box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:01:03box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:01:03box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:01:03.480Z box:storage/filesystem upload: [/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz] out stream error. [Error: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'] { errno: -2, code: 'ENOENT', syscall: 'open', path: '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' }
Sep 01 04:01:13box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:01:23box:tasks update 13767: {"percent":2.754385964912281,"message":"Uploading backup (files.uniteddiversity.coop)"}
Sep 01 04:01:23box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:01:23.495Z box:storage/filesystem upload: [/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz] out stream error. [Error: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'] { errno: -2, code: 'ENOENT', syscall: 'open', path: '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' }
Sep 01 04:01:23box:backuptask runBackupUpload: result - {"result":"ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'"}
Sep 01 04:01:23box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb (stderr): 2023-09-01T03:01:23.495Z box:backupupload upload completed. error: BoxError: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz' at WriteStream.<anonymous> (/home/yellowtent/box/src/storage/filesystem.js:104:22) at WriteStream.emit (node:events:513:28) at emitErrorNT (node:internal/streams/destroy:151:8) at emitErrorCloseNT (node:internal/streams/destroy:116:3) at process.processTicksAndRejections (node:internal/process/task_queues:82:21) { reason: 'External Error', details: {} }
Sep 01 04:01:23box:shell backup-snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb code: 50, signal: null
Sep 01 04:01:23box:tasks setCompleted - 13767: {"result":null,"error":{"stack":"BoxError: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:166:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:361:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:383:5)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:504:29)","name":"BoxError","reason":"External Error","details":{},"message":"ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'"}}
Sep 01 04:01:23box:tasks update 13767: {"percent":100,"result":null,"error":{"stack":"BoxError: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'\n at runBackupUpload (/home/yellowtent/box/src/backuptask.js:166:15)\n at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n at async uploadAppSnapshot (/home/yellowtent/box/src/backuptask.js:361:5)\n at async backupAppWithTag (/home/yellowtent/box/src/backuptask.js:383:5)\n at async fullBackup (/home/yellowtent/box/src/backuptask.js:504:29)","name":"BoxError","reason":"External Error","details":{},"message":"ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'"}}
Sep 01 04:01:23box:taskworker Task took 82.436 seconds
ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz'

What happened?

[girish]

@jdaviescoates can you go to Backup -> Configure and click save. And then try the Backup ?

[jdaviescoates]

@girish said in Backup failed: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz':

@jdaviescoates can you go to Backup -> Configure and click save. And then try the Backup ?

I could, but that was on my old server and I've now finished migrating to my new server (and have nearly completed a backup from there now, after applying some app updates) so probably just won't worry about it

[girish]

@jdaviescoates ah ok. For future reference, this seemed very similar to https://forum.cloudron.io/topic/9895/backup-error-after-server-move-and-update-to-cloudron-7-5-1 . We didn't find what the problem was there either.

[robi]

I've had a similar issue where backups just crashed/failed at a small app near the beginning of the backup on 7.4.x box. The SIGKILL in the logs suggested it ran out of memory, and when checking on that I found the 400MB default wasn't enough.

It's odd that backups ran fine until they didn't with that same default all this time. What would make backups use more memory over time?

Upping the memory solved the issue.

[micmc]

@robi said in Backup failed: ENOENT: no such file or directory, open '/mnt/cloudronbackup/my.uniteddiversity.coop-netcup/snapshot/app_08388b1d-12c7-42c2-b6bd-a5c5be5cfcbb.tar.gz':

It's odd that backups ran fine until they didn't with that same default all this time. What would make backups use more memory over time?

It would be interesting to know a little more about that, indeed.