Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

Cloudron Forum

Apps | Demo | Docs | Install

Limit CPU Usage to S3

Scheduled Pinned Locked Moved Support
backupsawscpu
11 Posts 5 Posters 591 Views
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • D Offline
    D Offline
    dylightful
    wrote on last edited by girish
    #1

    Hey all,

    Trying to downgrade my server to 1 CPU core. Although i have noticed when S3 backups up daily, 100% CPU is utilized for 2-3 hours while it backups.

    On the other side, 2 CPU cores uses around 50% CPU usage.

    Any ideas?

    Thanks 🙂

    marcusquinnM 1 Reply Last reply
    0
  • girishG Offline
    girishG Offline
    girish Staff
    wrote on last edited by
    #2

    I guess it's consuming CPU because gzip of the backup does consume some CPU. I guess one way to disable gzip is switching to rsync which will try to upload files without zipping them. But note that S3 charges per HTTP request and depending on how many files you have this can be expensive. An easy fix to that might be to choose some other S3 backup service like say DO Spaces which doesn't charge per request.

    1 Reply Last reply
    0
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to dylightful on last edited by marcusquinn
    #3

    @dylightful I can recommend rsync to Wasabi, tried all the rest and this works best for something you probably won't have to ever think about again. AWS used to be good but I don't recommend them nowadays.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    BrutalBirdieB 1 Reply Last reply
    1
  • BrutalBirdieB Offline
    BrutalBirdieB Offline
    BrutalBirdie Staff
    replied to marcusquinn on last edited by
    #4

    @marcusquinn said in Limit CPU Usage to S3:

    @dylightful I can recommend rsync to Wasabi, tried all the rest and this works best for something you probably won't have to ever think about again. AWS used to be good but I don't recommend them nowadays.

    Do you have a speed and/or performance difference in mind between storage format tarball and rsync to wasabi?

    I want to switch to wasabi from google cloud storage and now asked my self, after reading your comment, if I should go with tarball or rsync.

    Like my work? Consider donating a drink drink. Cheers!

    marcusquinnM 1 Reply Last reply
    0
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to BrutalBirdie on last edited by
    #5

    @BrutalBirdie I'm happy with rsync. I tested Tarball for interest but then you're paying in full with CPUs & bandwidth every day with that. Whichever you choose I'm sure you'll be happy with Wasabi (I should get an affiliate link 🙂 ).

    Anything else I think is a separate debate for rsync vs tarball vs both vs multi-cloud backups etc.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    BrutalBirdieB 1 Reply Last reply
    0
  • BrutalBirdieB Offline
    BrutalBirdieB Offline
    BrutalBirdie Staff
    replied to marcusquinn on last edited by
    #6

    @marcusquinn said in Limit CPU Usage to S3:

    @BrutalBirdie I'm happy with rsync. I tested Tarball for interest but then you're paying in full with CPUs & bandwidth every day with that. Whichever you choose I'm sure you'll be happy with Wasabi (I should get an affiliate link 🙂 ).

    Anything else I think is a separate debate for rsync vs tarball vs both vs multi-cloud backups etc.

    Nice idea, does wasabi even have something like affiliate links?

    Like my work? Consider donating a drink drink. Cheers!

    marcusquinnM 1 Reply Last reply
    0
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to BrutalBirdie on last edited by marcusquinn
    #7

    @BrutalBirdie I don't see a standard affiliate referral scheme but MSP seems the closest on their partners page

    • https://wasabi.com/partners/

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    BrutalBirdieB 1 Reply Last reply
    1
  • BrutalBirdieB Offline
    BrutalBirdieB Offline
    BrutalBirdie Staff
    replied to marcusquinn on last edited by
    #8

    @marcusquinn said in Limit CPU Usage to S3:

    @BrutalBirdie I don't see a standard affiliate referral scheme but MSP seems the closest on their partners page

    • https://wasabi.com/partners/

    Looks like this is more for companies / businesses. Now some questions:

    • what benefit does a company have when being a partner with wasabi?
    • Do the customers of said partner have to pay less?
    • Would it be beneficial for Cloudron to have (or to be) a partner at wasabi to offer their customers a better price or service? Bundle like idea, Cloudron Premium + 5$ with wasabi already preconfigured?

    I don't know. Only if this would be optional.

    I can imagine a new premium customer would like the option for a plug'n'play backup solution.
    But then GDPR/DSGVO yada yada.

    Is this even a good idea?

    Like my work? Consider donating a drink drink. Cheers!

    marcusquinnM 1 Reply Last reply
    0
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to BrutalBirdie on last edited by
    #9

    @BrutalBirdie it's a good idea as an option. they offer US & EU regions.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    1 Reply Last reply
    0
  • mehdiM Offline
    mehdiM Offline
    mehdi App Dev
    wrote on last edited by
    #10

    Now that the Privacy Shield has been repelled, it's very much in question whether or not any US-based provider can be GDPR-compliant, even if they offer EU regions, because of the Cloud Act.

    marcusquinnM 1 Reply Last reply
    1
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to mehdi on last edited by
    #11

    @mehdi Very much interested in this topic. I love my American friends, but the EU certainly isn't without capability to respond to the data-mining free-for-all antics of the last decade. I share occasional posts on Twitter on these subjects if anyone's interested.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    1 Reply Last reply
    0

  • Login

  • Don't have an account? Register

  • Login or register to search.
  • First post
    Last post
0
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Login

  • Don't have an account? Register

  • Login or register to search.