Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


    Cloudron Forum

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular

    Limit CPU Usage to S3

    Support
    backups aws cpu
    5
    11
    521
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • D
      dylightful last edited by girish

      Hey all,

      Trying to downgrade my server to 1 CPU core. Although i have noticed when S3 backups up daily, 100% CPU is utilized for 2-3 hours while it backups.

      On the other side, 2 CPU cores uses around 50% CPU usage.

      Any ideas?

      Thanks 🙂

      marcusquinn 1 Reply Last reply Reply Quote 0
      • girish
        girish Staff last edited by

        I guess it's consuming CPU because gzip of the backup does consume some CPU. I guess one way to disable gzip is switching to rsync which will try to upload files without zipping them. But note that S3 charges per HTTP request and depending on how many files you have this can be expensive. An easy fix to that might be to choose some other S3 backup service like say DO Spaces which doesn't charge per request.

        1 Reply Last reply Reply Quote 0
        • marcusquinn
          marcusquinn @dylightful last edited by marcusquinn

          @dylightful I can recommend rsync to Wasabi, tried all the rest and this works best for something you probably won't have to ever think about again. AWS used to be good but I don't recommend them nowadays.

          We're not here for a long time - but we are here for a good time :)
          Jersey/UK
          Work & Ecommerce Advice: https://brandlight.org
          Personal & Software Tips: https://marcusquinn.com

          BrutalBirdie 1 Reply Last reply Reply Quote 1
          • BrutalBirdie
            BrutalBirdie Staff @marcusquinn last edited by

            @marcusquinn said in Limit CPU Usage to S3:

            @dylightful I can recommend rsync to Wasabi, tried all the rest and this works best for something you probably won't have to ever think about again. AWS used to be good but I don't recommend them nowadays.

            Do you have a speed and/or performance difference in mind between storage format tarball and rsync to wasabi?

            I want to switch to wasabi from google cloud storage and now asked my self, after reading your comment, if I should go with tarball or rsync.

            Like my work? Consider donating a beer 🍻 Cheers!

            marcusquinn 1 Reply Last reply Reply Quote 0
            • marcusquinn
              marcusquinn @BrutalBirdie last edited by

              @BrutalBirdie I'm happy with rsync. I tested Tarball for interest but then you're paying in full with CPUs & bandwidth every day with that. Whichever you choose I'm sure you'll be happy with Wasabi (I should get an affiliate link 🙂 ).

              Anything else I think is a separate debate for rsync vs tarball vs both vs multi-cloud backups etc.

              We're not here for a long time - but we are here for a good time :)
              Jersey/UK
              Work & Ecommerce Advice: https://brandlight.org
              Personal & Software Tips: https://marcusquinn.com

              BrutalBirdie 1 Reply Last reply Reply Quote 0
              • BrutalBirdie
                BrutalBirdie Staff @marcusquinn last edited by

                @marcusquinn said in Limit CPU Usage to S3:

                @BrutalBirdie I'm happy with rsync. I tested Tarball for interest but then you're paying in full with CPUs & bandwidth every day with that. Whichever you choose I'm sure you'll be happy with Wasabi (I should get an affiliate link 🙂 ).

                Anything else I think is a separate debate for rsync vs tarball vs both vs multi-cloud backups etc.

                Nice idea, does wasabi even have something like affiliate links?

                Like my work? Consider donating a beer 🍻 Cheers!

                marcusquinn 1 Reply Last reply Reply Quote 0
                • marcusquinn
                  marcusquinn @BrutalBirdie last edited by marcusquinn

                  @BrutalBirdie I don't see a standard affiliate referral scheme but MSP seems the closest on their partners page

                  • https://wasabi.com/partners/

                  We're not here for a long time - but we are here for a good time :)
                  Jersey/UK
                  Work & Ecommerce Advice: https://brandlight.org
                  Personal & Software Tips: https://marcusquinn.com

                  BrutalBirdie 1 Reply Last reply Reply Quote 1
                  • BrutalBirdie
                    BrutalBirdie Staff @marcusquinn last edited by

                    @marcusquinn said in Limit CPU Usage to S3:

                    @BrutalBirdie I don't see a standard affiliate referral scheme but MSP seems the closest on their partners page

                    • https://wasabi.com/partners/

                    Looks like this is more for companies / businesses. Now some questions:

                    • what benefit does a company have when being a partner with wasabi?
                    • Do the customers of said partner have to pay less?
                    • Would it be beneficial for Cloudron to have (or to be) a partner at wasabi to offer their customers a better price or service? Bundle like idea, Cloudron Premium + 5$ with wasabi already preconfigured?

                    I don't know. Only if this would be optional.

                    I can imagine a new premium customer would like the option for a plug'n'play backup solution.
                    But then GDPR/DSGVO yada yada.

                    Is this even a good idea?

                    Like my work? Consider donating a beer 🍻 Cheers!

                    marcusquinn 1 Reply Last reply Reply Quote 0
                    • marcusquinn
                      marcusquinn @BrutalBirdie last edited by

                      @BrutalBirdie it's a good idea as an option. they offer US & EU regions.

                      We're not here for a long time - but we are here for a good time :)
                      Jersey/UK
                      Work & Ecommerce Advice: https://brandlight.org
                      Personal & Software Tips: https://marcusquinn.com

                      1 Reply Last reply Reply Quote 0
                      • mehdi
                        mehdi App Dev last edited by

                        Now that the Privacy Shield has been repelled, it's very much in question whether or not any US-based provider can be GDPR-compliant, even if they offer EU regions, because of the Cloud Act.

                        marcusquinn 1 Reply Last reply Reply Quote 1
                        • marcusquinn
                          marcusquinn @mehdi last edited by

                          @mehdi Very much interested in this topic. I love my American friends, but the EU certainly isn't without capability to respond to the data-mining free-for-all antics of the last decade. I share occasional posts on Twitter on these subjects if anyone's interested.

                          We're not here for a long time - but we are here for a good time :)
                          Jersey/UK
                          Work & Ecommerce Advice: https://brandlight.org
                          Personal & Software Tips: https://marcusquinn.com

                          1 Reply Last reply Reply Quote 0
                          • First post
                            Last post
                          Powered by NodeBB