Synchronizing Cloudron Backups to Hetzner Storage Box
-
I am currently backing up Cloudron data to a local HDD using rsync, and I want to synchronize these backups to a Hetzner Storage Box as well. However, I encountered an issue where the backup size significantly increases during the transfer. A backup that is 300 GB on the HDD becomes 1.1 TB on the Storage Box. I need help optimizing this process.
rsync Commandrsync -avz --delete -e "ssh -p 23" /mnt/backup/backup u@u.your-storagebox.de:home/
Problem
The backups on the HDD are approximately 300 GB, but when synchronized to the Hetzner Storage Box, they balloon to 1.1 TB.
Does anyone know how to solve this problem. I would be grateful for any advice. Thank you very much. -
Are you using hardlinks on the Cloudron backup side? rsync to hetzner storage box will not create hardlinks but copies of the files. Maybe this could explain the exceeding size?
Not sure what your exact use-case here is, but just to let you know, Cloudron v8.1 will have a fix improving the backup to storage box including hardlink support by a lot.
-
@nebulon Thank you for your response. Yes, it seems the issue is indeed with hardlinks. I have them enabled. I will try to wait for the Cloudron update, or I might consider using Borg for backups to the Storage Box. That should probably resolve the issue. Another option is using rsync with the -H switch, but I haven't tested it yet. Thank you very much for your help.