Backuptask crashed
-
I get emails fairly regularly with this message and I'm not sure where I would begin to troubleshoot.
{ stack: 'BackupsError: Backuptask crashed\n at /home/yellowtent/box/src/backups.js:487:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:70:9)\n at emitOne (events.js:116:13)\n at ChildProcess.emit (events.js:211:7)\n at ChildProcess.kill (internal/child_process.js:395:12)\n at Timeout.<anonymous> (/home/yellowtent/box/src/backups.js:503:12)\n at ontimeout (timers.js:475:11)\n at tryOnTimeout (timers.js:310:5)\n at Timer.listOnTimeout (timers.js:270:5)',
name: 'BackupsError',
reason: 'internal error',
message: 'Backuptask crashed' }Possibly a memory issue?
-
@timmmmyboy Yes, most likely. If you have a lot of data, the default tgz backend can only do so much. If you go to the backup settings (settings -> backup -> configure) just change the format to
rsync
. https://cloudron.io/documentation/backups/#backup-formats has more information on the formats.Also, the backup logs are located at
/home/yellowtent/platformdata/backup/logs.txt
. -
Thanks, I'll try switching to rsync and see if that resolves it. The log seems pretty bare (I'm backing up to DO Spaces but I believe the failures were happening even with local filesystem). Will check back in if it persists.
-
@girish I'm also facing a similar issue with my ~600GB nextcloud instance. I'm backing up to a (physically separate) minio instance, both tgz and rsync results in crashes. How may I further investigate? Are there instructions for doing manual backups? Thank you.
-
relates to the discussion here: https://forum.cloudron.io/topic/1288/support-encrypted-rsync-backups-to-onedrive-dropbox-etc/7
I think Cloudron would benefit greatly from a working encrypted backup solution....
-
FWIW switching to rsync fixed the original issue of this thread in my case. Figured I'd update here to let folks know.
-
@uiharu As you probably know, Cloudron always takes a complete app backup because updating an app. Overall, would you prefer that Cloudron have an option to disable backups a per-app level or would you prefer the backup to actually work?
-
@girish ofc we need a working (reliable) backup mechanism!
imo the current disable option is already good enough and allows me to easily go around backup errors that prevent upgrades etc.
Maybe...
- differential backup/hard-linking support for some remote backup destination will help with stability
- btrfs, zfs offers more stable snapshots and should be supported in the future
-
If I was to push an rsync cloudron backup to a remote location, it should be sufficient to backup the "snapshot" folder, correct? not the folder named "2018-05-XX-XXXXXXXX" as well.
-
@necrevistonnezr yes, correct. The snapshot directory is the "working directory" for backups. It gets rotated as-is into the timestamped directory. For filesystem, you will notice that the files between snapshot directory and time stamped directory are hard-links.
-
@girish
rcloning the "snapshot" directory works. However, I'm getting two errors:2018/06/04 13:57:51 ERROR : Attempt 3/3 failed with 2 errors and: invalidRequest: nameContainsInvalidCharacters: Path (/LiveFolders/cloudron/205.oDD_s5s39188-3p61-1336-5p10-p26tp62t1oo5/154.qnGn/134.uJGwLA/19.ilohv/251.cmkxxoBZBy/1.ZkzsoBuBkw PsxkxJox Exn foBCsmroBExq ) contains invalid trailing character. 2018/06/04 13:57:51 Failed to sync: invalidRequest: nameContainsInvalidCharacters: Path (/LiveFolders/cloudron/205.oDD_s5s39188-3p61-1336-5p10-p26tp62t1oo5/154.qnGn/134.uJGwLA/19.ilohv/251.cmkxxoBZBy/1.ZkzsoBuBkw PsxkxJox Exn foBCsmroBExq ) contains invalid trailing character.
Is that problematic in a case of restore?
-
@necrevistonnezr What rclone backend are you using? It looks like rclone is complaining that the backend does not like having files with a trailing whitespace.
-
@girish I'm using the Onedrive backend via the crypt backend (https://rclone.org/crypt/) and obfuscated file names.