Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


    Cloudron Forum

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular

    Best aws s3 backup storage class

    Discuss
    backups glacier aws
    6
    15
    397
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      CarbonBee last edited by girish

      Hi!

      I'm new to aws and I wonder what would be the best storage class for cloudron backup? Would S3 Glacier Deep Archive be too slow?

      Thanks for your advices.

      marcusquinn 1 Reply Last reply Reply Quote 0
      • C
        CarbonBee last edited by

        Other questions linked to this:

        • What is the difference, from the Cloudron point of view, between s3 buckets and glacier vaults?
        • Does Cloudron support Glacier?
        1 Reply Last reply Reply Quote 0
        • nebulon
          nebulon Staff last edited by

          I don't really have experience with the S3 Glacier class, however from the outside it seems to be a good fit actually. It certainly is not tested from our side yet, but if the API is S3 then it should work I would assume.

          Since restore may be up to hours, this might incur longer downtimes in case a restore is needed, also maybe some restore timeout values would need to be changed, but as said so far this is not really tested.

          Would be great to hear some use-case feedback though 🙂

          C 1 Reply Last reply Reply Quote 0
          • marcusquinn
            marcusquinn @CarbonBee last edited by

            @CarbonBee If it's just costs you're thinking about for Glacier, then I can recommend Wasabi & Backblaze as both lower cost S3 compatible options.

            We're not here for a long time - but we are here for a good time :)
            Jersey/UK
            Work & Ecommerce Advice: https://brandlight.org
            Personal & Software Tips: https://marcusquinn.com

            1 Reply Last reply Reply Quote 0
            • C
              CarbonBee @nebulon last edited by

              @nebulon Well, when I try to save my backup storage, I've got an error "The specified bucket does not exist". So it seems that it is not that compatible.

              Any chance to fix that?

              1 Reply Last reply Reply Quote 0
              • luckow
                luckow translator last edited by

                my 2 cents for this topic:
                for backups you need fast save & restore options. The "normal" S3 buckets are fine. Some for backup solutions from your hoster. And same for snapshops. They all are fast enough to get a full recovery in a short time.
                IMHO solutions like glacier are more or less something for archives. If you need to save your data longer as your typical backup periode is, you need an archive solution. Especially if you are in a business and your government tells you to store your business "papers" for at least 10 years. In that case it's more an archive topic than a backup topic.

                Pronouns: he/him | Primary language: German

                C 1 Reply Last reply Reply Quote 1
                • C
                  CarbonBee @luckow last edited by

                  @luckow I understand your point, which I find really interesting. However, my point of view is slightly different: I've been running Cloudron on 2 servers for more than 4 years now and I have never nedded backup restoration. The event is rare enough to cost half a day or more if it happens. The second point is the price. With Glacier Deep Archive, a To cost ~1$/month.

                  marcusquinn 1 Reply Last reply Reply Quote 0
                  • marcusquinn
                    marcusquinn @CarbonBee last edited by

                    @CarbonBee How much are you storing? AWS pricing in general is rarely competitive:

                    • https://www.backblaze.com/b2/cloud-storage-pricing.html
                    • https://wasabi.com/cloud-storage-pricing/

                    We're not here for a long time - but we are here for a good time :)
                    Jersey/UK
                    Work & Ecommerce Advice: https://brandlight.org
                    Personal & Software Tips: https://marcusquinn.com

                    C robi 3 Replies Last reply Reply Quote 0
                    • C
                      CarbonBee @marcusquinn last edited by

                      @marcusquinn These are the basic s3 plan prices. The Glacier Deep Archive is 0.0018$/Go : https://aws.amazon.com/fr/s3/pricing/.
                      Moreover we will use this solution for other needs (which require aws) and I would like to use the same service for all our applications, which includes cloudron backups.

                      1 Reply Last reply Reply Quote 0
                      • robi
                        robi @marcusquinn last edited by

                        @marcusquinn said in Best aws s3 backup storage class:

                        @CarbonBee How much are you storing? AWS pricing in general is rarely competitive:

                        this is the right question, how many GB do you need?

                        There are free options under certain limits such as hooking up to Google Drive or Scaleway Object Storage (recommended).

                        Life of Advanced Technology

                        1 Reply Last reply Reply Quote 1
                        • C
                          CarbonBee @marcusquinn last edited by

                          @marcusquinn said in Best aws s3 backup storage class:

                          How much are you storing?

                          Relevent question indeed, I missed it sorry.
                          Well, my servers backups wieght 145Go and 190Go respectively. I backup them daily and I would like to have at least one week of backup history.
                          That means a bit more than 2To.

                          1 Reply Last reply Reply Quote 0
                          • robi
                            robi last edited by

                            I have been thinking about how to aggregate across multiple object storage backends via a single entry point, to which one can connect multiple different systems with varying capacities.

                            Aids in security splitting up the archives as well as resiliency via differing providers. A kind of coarse error-correction code (Reed-Solomon) across many nodes.

                            I wonder if such is doable with an a hierarchy of Minio instances with different backends.

                            Life of Advanced Technology

                            C 1 Reply Last reply Reply Quote 0
                            • C
                              CarbonBee @robi last edited by

                              @robi That would be interesting, but that does not solve my current problem, which is: "How to backup Cloudron on s3 glacier deep archive".

                              One solution would be to backup on a regular s3 and then use aws lifecycle rule to put them in glacier. But then, it would not be accessible through Glacier API, only s3's, and it would be costly to do the transition from s3 to Glacier.

                              In a near future, could it be possible to integrate Glacier API?

                              1 Reply Last reply Reply Quote 0
                              • mehdi
                                mehdi App Dev last edited by

                                My 2 cents here (disclamer: I am by no means an expert on cloudron backups, nor on AWS).

                                I do not think Glacier would be currently integrable with the Cloudron backups. They expect an API to download stuff on demand, whereas Glacier expects you to request stuff in advance, and it's then made available later.

                                Cloudron backups could potentially be made to work with Glacier, but it would be a much bigger project than just adding an integration.

                                robi 1 Reply Last reply Reply Quote 3
                                • robi
                                  robi @mehdi last edited by

                                  Good points @mehdi

                                  @CarbonBee
                                  See if you can find another project that already integrates with Glacier and how they handle it.

                                  If it's OSS, the code will be reusable, easing integration for devs.

                                  Life of Advanced Technology

                                  1 Reply Last reply Reply Quote 0
                                  • First post
                                    Last post
                                  Powered by NodeBB