Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

Cloudron Forum

Apps | Demo | Docs | Install

Backup size growing

Scheduled Pinned Locked Moved Solved Support
backblazebackup
25 Posts 6 Posters 1.2k Views
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • christiaanC Offline
    christiaanC Offline
    christiaan
    wrote on last edited by girish
    #1

    I'm backing up to Backblaze using rsync with a retention policy of effectively one backup. But the bucket keeps growing in size. One backup is about 2-3 GB but the bucket is now at 12.4 GB.

    Is this correct behaviour?

    nebulonN girishG 2 Replies Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to christiaan on last edited by
    #2

    @christiaan is there anything unusual show in the backup logs, if you trigger a backup cleanup from the backups view of your Cloudron dashboard manually?

    1 Reply Last reply
    1
  • girishG Offline
    girishG Offline
    girish Staff
    replied to christiaan on last edited by
    #3

    @christiaan IIRC, there is a tricky setup in backblaze where "delete" doesn't actually delete but b2 keeps it around for a while and there is some setting to disable this behavior. I recall someone else ran into this as well (maybe it was @marcusquinn)

    marcusquinnM 1 Reply Last reply
    1
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to girish on last edited by
    #4

    @girish @christiaan Yes, that's part of their business model I guess.

    Naughty of them not to offer the setting when creating the Bucket, but I guess that's providing significant profits from the amount of times I've seen otherwise smart and prudent people caught out by it.

    It's under "Lifecycle Settings", you need to select "Keep only the last version of the file", given it is already versioned backups, there are no other versions you would need.

    I also recommend that if your host takes daily snapshots and you have a lot of data, you probably only need weekly offsite backups on your quietest day of the week.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    christiaanC 1 Reply Last reply
    1
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to marcusquinn on last edited by christiaan
    #5

    @marcusquinn oh right. I did see that setting but I was following Cloudron instructions not to use it:
    https://docs.cloudron.io/backups/

    Screenshot 2021-06-29 at 20.09.32.png

    marcusquinnM 1 Reply Last reply
    0
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to christiaan on last edited by
    #6

    @christiaan Ahh, that's even more confusing then as Backblaze is using the same word; "lifecycle", to mean something different to Amazon's. Devil is in the detail on these platforms, where they mostly rely on lack of user calculation or reading for the most profitable features.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    christiaanC 1 Reply Last reply
    1
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to marcusquinn on last edited by
    #7

    @marcusquinn ha, okay thanks.

    I've also just clocked that I was quoting Amazon instructions instead Backblaze! Just to add to the general confusion, lol.

    I turned on Backblaze's Lifecycle Settings to use 'Keep only the last version of the file' and the bucket size has reduced, thanks 👌🏼

    So this won't corrupt my rsync files then?

    marcusquinnM D 2 Replies Last reply
    1
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to christiaan on last edited by
    #8

    @christiaan Nope, Cloudron handles the component parts that make up a whole Backup to restore from. You just don't need multiple copies of those parts.

    Yeah, that should reduce your storage usage with Backblaze a lot.

    You can try a test restore if you're not confident but I'm pretty confident from what you've explained.

    As much as I wanted Rsync to work for us, I've moved to a weekly Tarball instead, relying instead on the daily host VPS snapshots as a low-resource cost version of the most recent data, with the Cloudron backups just as a secondary location backup for that redundancy.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    1 Reply Last reply
    1
  • D Offline
    D Offline
    dylightful
    replied to christiaan on last edited by
    #9

    @christiaan said in Backup size growing:

    I turned on Backblaze's Lifecycle Settings to use 'Keep only the last version of the file' and the bucket size has reduced, thanks

    Is this a permanent fix? Or does this just delete the occasional backup?

    christiaanC 1 Reply Last reply
    0
  • girishG Offline
    girishG Offline
    girish Staff
    wrote on last edited by
    #10

    @christiaan @marcusquinn thanks for note. I have updated the b2 docs accordingly - https://docs.cloudron.io/backups/#backblaze-b2

    1 Reply Last reply
    2
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to dylightful on last edited by
    #11

    @dylightful permanent fix

    @girish no prob, thanks

    1 Reply Last reply
    1
  • christiaanC Offline
    christiaanC Offline
    christiaan
    wrote on last edited by
    #12

    Actually I'm not sure that was a permanent fix. It appears to be storing an additional copy each time there's an upgrade.

    Screenshot 2021-07-17 at 13.46.18.png

    jdaviescoatesJ 1 Reply Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to christiaan on last edited by
    #13

    @christiaan I think it's normal for those to be retained

    I use Cloudron with Gandi & Hetzner

    christiaanC 1 Reply Last reply
    1
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to jdaviescoates on last edited by
    #14

    @jdaviescoates how do I remove them safely? Can I manually delete any of these folders without corrupting the backup?

    Screenshot 2021-07-19 at 11.21.50.png

    jdaviescoatesJ girishG 2 Replies Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to christiaan on last edited by
    #15

    @christiaan I'm not sure, but I think you could probably delete all of them apart from the two at the bottom (the most up to date backup and the snapshots) but I wouldn't proceed without getting further clarity from @Staff 🙂

    I use Cloudron with Gandi & Hetzner

    1 Reply Last reply
    1
  • girishG Offline
    girishG Offline
    girish Staff
    replied to christiaan on last edited by girish
    #16

    @christiaan yes, you can safely delete any single timestamped directory safely. The snapshot directory should be left alone. If you click inside a timestamped directory and only find a single app_xx file, it means that backup was created as part of an app upgrade or backup. If you find many app_ files and a box_ file inside it, it was created as part of a Cloudron upgrade or backup.

    christiaanC 1 Reply Last reply
    2
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to girish on last edited by
    #17

    @girish Great, thanks. Would it be possible for you to automate this in Cloudron (i.e. deleting old versions)?

    jdaviescoatesJ 1 Reply Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to christiaan on last edited by jdaviescoates
    #18

    @christiaan they would've been deleted eventually. I think maybe after 3 weeks.

    But yeah, would be nice for the to be a UI where they could be deleted too. I think that there might even be another post about that

    I use Cloudron with Gandi & Hetzner

    girishG christiaanC 2 Replies Last reply
    2
  • girishG Offline
    girishG Offline
    girish Staff
    replied to jdaviescoates on last edited by girish
    #19

    @jdaviescoates I am always wary about adding that feature because a compromised cloudron would then mean that backups can also be deleted. In many backup providers, you can create storage credentials with permissions so that objects cannot be deleted. Then again maybe just like auto-deletion, we can have a button to delete which may or may not work...

    christiaanC 1 Reply Last reply
    2
  • christiaanC Offline
    christiaanC Offline
    christiaan
    replied to jdaviescoates on last edited by
    #20

    @jdaviescoates said in Backup size growing:

    @christiaan they would've been deleted eventually. I think maybe after 3 weeks.

    Oh right. There was one there that was a month old. Is there anywhere in Cloudron documentation that explains this?

    girishG 1 Reply Last reply
    0

  • Login

  • Don't have an account? Register

  • Login or register to search.
  • First post
    Last post
0
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Login

  • Don't have an account? Register

  • Login or register to search.