Cloudron Forum

@nebulon : interesting about Nextcloud I used to have 4 x Nextcloud instances in my Cloudron server (different projects). 3 of them about 10Gb of files (other smaller). My backups were working but slow. Even after switching to 'better' VPS provider. So after testing Seafile for a while, I have moved 2 of the Nextcloud instances over to a single Seafile VPS (with different libraries for segregation). The other 2 Nextcloud instances will follow. I have nothing against Nextcloud and been very happy for it for long time. But if it is really only being used for file collaboration and device syncing, and you don't actually NEED the extra facilities it provides, my personal view is that Seafile is a better solution. So would be awesome to get Seafile onto Cloudron. But I'm quite happy running it on a separate VPS.

@girish Thanks!

@girish I haven't done the steps you suggested yet, I just reverted back to my Scaleway backups. But I will try again shortly. Thanks for checking in.

@timconsidine said in Moving Cloudron to new server : stop apps?: that I didn't set the PTR record in the new VPS provider until I started the migration I ran into exactly this problem the last time as well

To conclude this, it was a memory issue. The instance as a whole was a bit overcommited. If the backup task is idle, it won't consume any memory. Also Cloudron does not reserve memory based on the limits set, neither for backup nor for apps. The limit is just to avoid rouge apps or the backup task to bring kill other apps.

@leggias hm getting a SIGSEGV is odd here. If you like you can enable remote SSH support and send us a mail to support@cloudron.io mentioning your dashboard domain. Then we can take a direct look at your setup to get down to the issue.

@fbartels said in Backup Preference: Snapshot vs S3?: Hi @jordanurbs, the viability of snapshots for backup has for example been discussed in https://forum.cloudron.io/topic/4161/disc-snapshots?_=1628139201934. Yes, and to quote what @nebulon pointed out there: @nebulon said in Disc snapshots: Disk snapshots or VPS snapshots don't work well with Cloudron, since backups are per-app and not per-server on Cloudron. This is to be able to rollback/restore individual apps without interfering with the system or other apps running on it. Still for a secondary fallback backup solution this can still be recommended. That's what I do. I do Cloudron backups to a Hetzner Storage Box, plus pay Hetzner for their automated backups, plus occasionally do a snapshot too. Although really I ought to backup to another provider too, to avoid the potential issues @girish once had with DO. I'll probably choose another eco VPS provider to do that at some point https://ud.coop/ecovps

@michaelf I put some notes on how to read the logs at https://docs.cloudron.io/backups/#cleanup-backups and also replied to your support ticket. Do you see any backups in linode object storage that are not listed in the logs? Otherwise, the logs do look fine to me.

@robi there is a already bunch of "workarounds" for rsync. Empty directories, executable bit of files cannot be stored in most object storage. So, there is fsmetadata.json file that stores this information outside of the files. When restoring, we use that file to restore back the state. I guess we can extend that file to also save and restore timestamps. If anyone wants this leave a note and I can look into it in the future.

@rmdes I ended up setting up a local backup for Cloudron and use RClone to handle the backup. I've used RClone for years with no issue, and since going this route, no issues with my Cloudron backup.

Thanks a bunch @girish worked like a charm

@girish Ahhh I see. Thankfully right now backups only take 3-4 hours. I'm hoping once I'm at gigabit I can speed that up. My network is definitely a bottleneck rn.

@mazarian that's correct, the permission is the thing I fixed in 6.3.5. Glad it's working now and thanks for reporting back!

@girish do you need anything from me or can you replicate that by yourself?

@girish that worked. Thanks

@d19dotca said in Backups failing on same app each time: By the way, since there's a ton of backup crashing that seem memory related... is it possible to improve the logging so that there's something in there saying "OutOfMemory" or something like that so poeple know why it's crashing? Yeah, I would love this as well. Sadly, there seems to be no way on linux to know this reliably. A process just gets killed unceremoniously with SIGKILL and that's that If anyone know how this can be detected would be great.

We are using minIO for it. s3 compatible. the Service on our side was down… and then we also have a problem with backup size. but now it works! thx!

@dylightful if you click the 'cleanup backups' button in the Backups view, is there anything interesting in the logs?

@nebulon you would need a list of app backups that are allowed to fail (app store apps) and ones that aren't (system services). Partial backups are only ok if an app store app gets an error.

@privsec Note, just because it's "running" doesn't mean it's running well.