Backuptask crashed



  • I get emails fairly regularly with this message and I'm not sure where I would begin to troubleshoot.

    { stack: 'BackupsError: Backuptask crashed\n at /home/yellowtent/box/src/backups.js:487:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:70:9)\n at emitOne (events.js:116:13)\n at ChildProcess.emit (events.js:211:7)\n at ChildProcess.kill (internal/child_process.js:395:12)\n at Timeout.<anonymous> (/home/yellowtent/box/src/backups.js:503:12)\n at ontimeout (timers.js:475:11)\n at tryOnTimeout (timers.js:310:5)\n at Timer.listOnTimeout (timers.js:270:5)',
    name: 'BackupsError',
    reason: 'internal error',
    message: 'Backuptask crashed' }

    Possibly a memory issue?



  • @timmmmyboy Yes, most likely. If you have a lot of data, the default tgz backend can only do so much. If you go to the backup settings (settings -> backup -> configure) just change the format torsync.https://cloudron.io/documentation/backups/#backup-formats has more information on the formats.

    Also, the backup logs are located at/home/yellowtent/platformdata/backup/logs.txt.



  • Thanks, I'll try switching to rsync and see if that resolves it. The log seems pretty bare (I'm backing up to DO Spaces but I believe the failures were happening even with local filesystem). Will check back in if it persists.



  • @girish I'm also facing a similar issue with my ~600GB nextcloud instance. I'm backing up to a (physically separate) minio instance, both tgz and rsync results in crashes. How may I further investigate? Are there instructions for doing manual backups? Thank you.



  • I finally upgraded cloudron by switching to no-op :p



  • relates to the discussion here:https://forum.cloudron.io/topic/1288/support-encrypted-rsync-backups-to-onedrive-dropbox-etc/7

    I think Cloudron would benefit greatly from aworking encrypted backup solution....



  • FWIW switching to rsync fixed the original issue of this thread in my case. Figured I'd update here to let folks know.



  • @uiharu As you probably know, Cloudron always takes a complete app backup because updating an app. Overall, would you prefer that Cloudron have an option to disable backups a per-app level or would you prefer the backup to actually work?



  • @girish ofc we need a working (reliable) backup mechanism!

    imo the current disable option is already good enough and allows me to easily go around backup errors that prevent upgrades etc.

    Maybe...

    • differential backup/hard-linking support for some remote backup destination will help with stability
    • btrfs, zfs offers more stable snapshots and should be supported in the future


  • If I was to push an rsync cloudron backup to a remote location, it should be sufficient to backup the "snapshot" folder, correct? not the folder named "2018-05-XX-XXXXXXXX" as well.



  • @necrevistonnezr yes, correct. The snapshot directory is the "working directory" for backups. It gets rotated as-is into the timestamped directory. For filesystem, you will notice that the files between snapshot directory and time stamped directory are hard-links.



  • @girish
    rcloning the "snapshot" directory works. However, I'm getting two errors:

    2018/06/04 13:57:51 ERROR : Attempt 3/3 failed with 2 errors and: invalidRequest: nameContainsInvalidCharacters: Path (/LiveFolders/cloudron/205.oDD_s5s39188-3p61-1336-5p10-p26tp62t1oo5/154.qnGn/134.uJGwLA/19.ilohv/251.cmkxxoBZBy/1.ZkzsoBuBkw PsxkxJox Exn foBCsmroBExq ) contains invalid trailing character.
    
    2018/06/04 13:57:51 Failed to sync: invalidRequest: nameContainsInvalidCharacters: Path (/LiveFolders/cloudron/205.oDD_s5s39188-3p61-1336-5p10-p26tp62t1oo5/154.qnGn/134.uJGwLA/19.ilohv/251.cmkxxoBZBy/1.ZkzsoBuBkw PsxkxJox Exn foBCsmroBExq ) contains invalid trailing character.
    

    Is that problematic in a case of restore?



  • @necrevistonnezr What rclone backend are you using? It looks like rclone is complaining that the backend does not like having files with a trailing whitespace.



  • @girish I'm using the Onedrive backend via the crypt backend (https://rclone.org/crypt/) and obfuscated file names.



  • @girish I also realized that the mysqldump for the TT-RSS app is huge (679 MB in my case). Could you implement some compession in the database dumps (and use PostgreSQL as recommended by the author)?