Cloudron Forum

@nebulon said in Confused about a failed backup being listed in backups: @jdaviescoates if you hover over the 5 hours ago you should see the exact time to validate this. It shows 05:54:18 so I guess your theory was correct given the logs I pasted above about the failed backup show 04:00:01 - thanks!

@thoresson yes, exactly.

@rollermy said in Backups: I'd like to limit app backups to 3 total for the apps i choose. Maybe create a feature request post about it?

The db dumps are atomic (it's a feature of the databases). What's not atomic is if an app does not make database changes in a transaction. Or if it tracks state outside of the database. For example, if it writes some media file to filesystem and tracks something else in database. Outside of disk snapshots, there is no way to snapshot a database and filesystem at the moment in time. Disk snapshot of a database is not very portable and in most cases on cloud servers disk snapshots of specific paths are not an option. I used to worry about this a lot back in the day But hundreds of thousand of installation later, I can tell you that I have never hit this problem (the atomicity aspect).

@necrevistonnezr said in Delete Backup Button: @girish Or add a requirement to enter your password for such deletion? I think that's how I'd do it, like Nextcloud does with app updates etc.

@CBCUN any decent hoster can upload with a speed of 10MB/s so for a 600GB backup it should take 16-18 hours. My Cloudron backup is ~80GB TGZ and it takes 35-45 minutes to backup from a Netcup RS to a Hetzner storage box. Either your source/target system is slow as hell or something else is bottlenecking. What method do you use? I found TGZ to be way faster because of the many many small files. If you have larger files, maybe RSYNC is the way to go. A good solution would be a (maybe self hosted) S3 Storage together with RSYNC. I use Minio for one of my backup instances and the backup from Cloudron is blazing fast as most of the work is done by the target machine.

Managing backups like we mange mailboxes does sound like a good idea, and can have checkboxes for daily, full, etc. per app, and more.

@girish So the problem was really with the encryption. Now the backup goes through Rsync without problems. Thank you very much for your help, I think the thread is solved

@d19dotca I can't believe I missed that. Literally read right past it. Thank you!

Hello guys, everything is back online (thanks to Cloudron’s out-of-this-world backup feature). I am grateful for all your help.

@perler Wow, that is a very good catch! The kind of; "huh, why have I not thought about this one before, yet it seems obvious"... As you say it, the idea comes from an instant need once in front of a specific situation which requires a solution that no one seems to have a previous need. And while reading how you describe it, in pops in mind like; "yeah, that would be master piece to be able to restore the files only, in an app as Nextcloud". So true. There could be others apps as well, but at first thought NC is the very first candidate for such desirable feature, because of the very nature of the app which holds files, and potentially team communications and email boxes as well. And this is where we can see that restoring the whole pack at once, especially for a well active NC app, could produce unexpected outcomes. Depending of course on how the app is used inside an organization. I don't think it would be a required feature for all apps. But then, if it's easier to implement as a general backup feature then why not. I would vote for this. Thanks for the heads-up.

@girish done

There is a bug in the current release that the code crashes when trying to send a notification if a backup failed. This is fixed . I think in the coming releases we can explore more notification options but atleast now you should get an email.

@girish said in Backup size: Thanks, I deleted files in the Nextcloud recycle bin. Now, after a reboot, Cloudron System Info shows 4.3 GB for the Nextcloud instance. (I had to delete the nginx config of a stopped app to get the system to reboot.) Thanks, I'll keep both folders. I have no particular goal to remove Discourse or its backups. I measured /var/backups size by adding up the three separate folders that FileZilla showed me, but I now understand that some files are hardlinks. And the Backup data shows only 4.87 GB now, so my disk is small enough for me to move on. Thank you!

@scooke I went to each individual app and pointed to the fileshare with the full path "/media/fileshare/2020-07-01-0500/app_backup.tar.gz.enc" and restored those backups. As for the second part, Azure adds the following "actimeo=30" switch to the cifs share that goes in your /etc/fstab file that causes the connection to time out if the backup takes too long. Once that is removed, reboot the server and the new backups will complete without issues.

The doc actually says "The Backup Cleaner checks if entries in the database exist in the storage backend and removes stale entries from the database automatically." I will fix the progress message to match this.

@girish Ah I didn't see this until too late, sorry. I had tried to start over to a degree by destroying the current backup disk and mounting a new disk instead then clearing out the backups history and seeing if that starts working better for me. So far so good, but if the issue comes back I'll certainly send the email out and enable remote support, as I agree there seems like some odd issue for sure.

So I tried mounting the folder from the Synology NAS and then the storagebox again and everything is working fine. I have misnamed the remote directory. Sorry for the unnecessary topic.

@girish said in Delete Local Backups: Documented at https://docs.cloudron.io/backups/#old-local-backups small typo there s/snapshots/snapshot

@girish Ah, thank you. Found them. That freed up 22GB for me