Backup uploading stalls

[nichu42]

Hi there,

Have there been any changes to the backup system recently?
Since about two weeks ago, Cloudron backups regularly fail to complete.

Everything starts OK, but then at some time, the upload just stalls. I only see something like
"Uploading backup 46702M@0MBps"
but it doesn't move on anymore.

I have a Hetzner Storage Box which I usually access via SSHFS. The storage format is tgz. I have changed to CIFS yesterday, but this doesn't solve the problem.

Any ideas?

[BrutalBirdie]

I have the same problem very often with Hetzner Storage boxes. No matter if CIFS or SSHFS.

[p44]

dear all, I've almost same configuration and all works fine... @nichu42 where do you host data? Where is hosted your storage box? I mean, wich Hetzner data-center? (they have three in Europe)

[nichu42]

@p44 I could choose between Germany and Finland, and went for the one in Germany.
Backups failed every once in a while in the past, but now it's almost every day.

[jdaviescoates]

@BrutalBirdie said in Backup uploading stalls:

I have the same problem very often with Hetzner Storage boxes. No matter if CIFS or SSHFS.

I'm another Hetzner Storage Box user. I very occasionally have this problem too. I use CIFS. Anecdotally in most case it has been instances of PeerTube that it seems to get stuck on. I've no idea why. But running a backup of the app by itself has, I think, sometimes made the next backup work again.

Have you got PeerTube installed @nichu42? If so, perhaps try that? (or if not, try running a singular app backup on whatever app it is stalling on)

[nichu42]

@jdaviescoates In my case it's Mastodon. It's by far the biggest file in my backup list, so it's no wonder.
The installation is 175 GB, the tarball is 2.6 GB. It also happens when doing a Mastodon-only backup.

[p44]

@nichu42 thank's for your anwser. To be more accurate, you selected Germany for VPS (or server), and also for Box, right? So both are in the same data-center? Hetzner they have Nuremberg and Falkenstein/Vogtland. Both (Vps) and Box are in the same data-center Eg. both are in Nuremberg?

In my case, server is in Nuremberg and Box is in Helsinki, Finland (to keep backups in different infrastructures), and everything is fine. Data to backup is near to 100Gb, twice a day.

[nichu42]

@p44 No, I don't have a Hetzner VPS. I wanted to keep the VPS and backup service completely separated. My Cloudron is in Windcloud's data center, which is also in Germany.

[p44]

@nichu42 thank's a lot. So this could explain issue? I mean, maybe Windcloud's servers sometime have problems to see Hetzner servers? Just to be sure, in "Box", did you enabled allow "External reachability" setting?

[nichu42]

Yes, the box is reachable. The connectivity test in Cloudron's backup setting also shows no errors.

However, it looks like my VPS was hitting 100% CPU quite often. Maybe that was the reason for the upload to stop. I will check again once the upgrade was done. Thanks for your help so far.

[p44]

@nichu42 This could be a reason... I think source causes should be outside of Cloudron.

Let us know