Cloudron 9.0.5 doesn't show backups from version 8?

[ekevu123]

I see two backups here, both with version 9.0.5 according to schedule since the upgrade. The command doesn't tell me anything else.

I can't say if they were gone immediately or after the cleanup job.

[nebulon]

Then at least there are no dangling ones in the database, so the migration script was working for a start.

What is the retention setting you have on that backup site?

[ekevu123]

One week, so some of the backups should be covered still.

[nebulon]

Alright and have checked the eventlog, yet? If you filter by backup.cleanup events you should see which one triggered the cleanup, it will show in the eventlog entry details. If that is the case at least we know it came from there and not some migration issue.

Ideally then the logs for that run are still available to further get down to the issue.

[ekevu123]

What exactly am I looking for in the logs? They are too long to read them all, obviously. I didn't find anything searching for "backup.cleanup", and searching for either "backup" or "cleanup" doesn't seem to yield any suitable information.

[nebulon]

so there is the system -> eventlog view which has those backup.cleanup events which would also show if and what it cleaned up. There is also a log button in that view for the event, which should then have more info on why it cleaned up those backups. Once we have that we can check if there is a bug or not.

[ekevu123]

There is no entry when I search for that event. However, I have just ran the backup cleaner manually, and then went to the logs and tried to find the event. It appears as the first line, but I can't find it with any of these terms:
"Backup cleaner"
"backup.cleaner"
"backupcleaner" (although this one appears in the logs inside)
So, I wonder if the search works properly.

By manually going through the event logs, I can find the backup cleaner running regularly, but it never removed anything (except for one app I uninstalled, but that's unrelated).

Also, the backups seem to exist still in storage, but they aren't recognised by Cloudron. New backups are being created and recognised on schedule.

I also downloaded the task-specific logs for that upgrade.

[svtx]

If one is to actually look into one's S3 storage one will find a LOT of orphaned backup files that Cloudron allegedly doesn't have anymore. The backup system is DEFUNCT on ALL my installations. So much so, I've simply disabled it.

[ekevu123]

@svtx I wouldn't say that, I have successfully restored a couple of times and that went smoothly.

[girish]

@ekevu123 there was a bug in 9.0.4 that if you had multiple backup sites, it was cleaning up old backups incorrectly. I have fixed this in 9.0.5 . But if your server probably ever had 9.0.4 and multiple backup sites, it would have hit this bug (i.e removing valid backups from the database.. they are not removed from the storage itself though). Is this is the case with yours?

[jdaviescoates]

@svtx said in Cloudron 9.0.5 doesn't show backups from version 8?:

The backup system is DEFUNCT on ALL my installations.

TBH this sounds like a problem with your systems, not Cloudron. I've been using Cloudron for years, in part because the backups Just Work. I've used them to migrate my whole server and all the apps a number of times with zero issues. I have also restored backups of apps lots of times too. Again, it's always just worked seamlessly. The backup system is definitely not defunct in general.

[ekevu123]

@girish No, I upgraded directly to 9.0.5 from the 8-series and never set up multiple backup sites.

[girish]

@ekevu123 oh, that's not good then. Can you please contact me on support@cloudron.io , I will have to read the log files to figure what is going on.

[svtx]

@jdaviescoates If by "my systems" you mean the Hetzner Cloud and S3 Buckets then yeah, sure.

[jdaviescoates]

@svtx I mean perhaps you've got some non standard configuration, or maybe other stuff on the same server, that sort of thing.

But if you mean Hetzner S3 buckets they are very new so I guess it could be that.

TBH I've only ever used Scaleway S3 buckets and only for PeerTube, Mastodon and Pixelfed data, not backups. I've always just used Hetzner Storage Boxes for backups.

But whatever your setup, the main point is that for the vast majority of us Cloudron backups are not defunct, they work brilliantly.