Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


    Cloudron Forum

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular

    Garage, an open-source distributed storage service you can self-host to fullfill many needs

    App Wishlist
    6
    11
    284
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ruihildt
      ruihildt last edited by girish

      https://garagehq.deuxfleurs.fr/

      Alternative to Minio, specially made for selfhosting setup.

      See: https://garagehq.deuxfleurs.fr/blog/2022-introducing-garage/
      Code: https://git.deuxfleurs.fr/Deuxfleurs/garage

      jdaviescoates L 2 Replies Last reply Reply Quote 6
      • jdaviescoates
        jdaviescoates @ruihildt last edited by

        @ruihildt this sounds absolutely brilliant, thanks for sharing!

        I use Cloudron with Gandi & Hetzner

        1 Reply Last reply Reply Quote 1
        • robi
          robi last edited by

          Too bad this is only replicated storage. (from what I can tell with a look of the front page)

          Minio can use error correcting codes instead of replication.

          Life of Advanced Technology

          infogulch jdaviescoates 2 Replies Last reply Reply Quote 1
          • infogulch
            infogulch @robi last edited by

            @robi Yeah unfortunately.

            Non-goals include:

            • ...
            • Erasure coding (our replication model is simply to copy the data as is on several nodes, in different datacenters if possible)
            1 Reply Last reply Reply Quote 1
            • jdaviescoates
              jdaviescoates @robi last edited by

              @robi said in Garage, an open-source distributed storage service you can self-host to fullfill many needs:

              Too bad this is only replicated storage. (from what I can tell with a look of the front page)

              Minio can use error correcting codes instead of replication.

              @infogulch said in Garage, an open-source distributed storage service you can self-host to fullfill many needs:

              @robi Yeah unfortunately.

              Non-goals include:

              • ...
              • Erasure coding (our replication model is simply to copy the data as is on several nodes, in different datacenters if possible)

              What's the difference? or advantage of error correcting / erasure codiing?

              I use Cloudron with Gandi & Hetzner

              robi 1 Reply Last reply Reply Quote 0
              • robi
                robi @jdaviescoates last edited by

                @jdaviescoates You can read about it in many places online comparing the two architectures and implementations.

                EC is more space efficient, especially at large scale (Petabyte, Exabyte, etc), while replication always uses 100% more per replica and doesn't guarantee bit flip protection, etc. hence it doesn't scale well.

                EC can always compute any missing pieces and self-heal or regenerate.

                That's why you can hear all the words speaking with someone on the phone from across the planet, as many lost packets are recomputed to fill in gaps instead of long retransmits.

                This applies to huge storage on continuously failing hardware under it too.

                Life of Advanced Technology

                L 1 Reply Last reply Reply Quote 3
                • L
                  LoudLemur @robi last edited by

                  @robi said in Garage, an open-source distributed storage service you can self-host to fullfill many needs:

                  @jdaviescoates You can read about it in many places online comparing the two architectures and implementations.

                  EC is more space efficient, especially at large scale (Petabyte, Exabyte, etc), while replication always uses 100% more per replica and doesn't guarantee bit flip protection, etc. hence it doesn't scale well.

                  EC can always compute any missing pieces and self-heal or regenerate.

                  That's why you can hear all the words speaking with someone on the phone from across the planet, as many lost packets are recomputed to fill in gaps instead of long retransmits.

                  This applies to huge storage on continuously failing hardware under it too.

                  You have a gift for explaining things.

                  1 Reply Last reply Reply Quote 1
                  • L
                    LoudLemur @ruihildt last edited by

                    @ruihildt said in Garage, an open-source distributed storage service you can self-host to fullfill many needs:

                    https://garagehq.deuxfleurs.fr/

                    Alternative to Minio, specially made for selfhosting setup.

                    See: https://garagehq.deuxfleurs.fr/blog/2022-introducing-garage/
                    Code: https://git.deuxfleurs.fr/Deuxfleurs/garage

                    I haven't checked out this suggestion yet, but if it like what I have in mind, it could be brilliant for Cloudron.

                    Cloudron is all about self-hosting. and there are a huge number of games with outdated gaming systems that could be repurposed to Cloudron self-hosting. These machines would have large amounts of RAM (for games), a very fast SSD (for running the system) and also a large storage drive (to hold the games).

                    That sort of legacy hardware is, I think, absolutely ripe for Cloudron! The Garage software could make those old storage disks have a new life!

                    MooCloud_Matt 1 Reply Last reply Reply Quote 0
                    • MooCloud_Matt
                      MooCloud_Matt @LoudLemur last edited by

                      @LoudLemur

                      Garage still doesn't support 100% the s3 protocol.
                      And due to how is written, modern NVMe will not get a BIG boost if you don't have a powerful CPU (it CPU intensive for big files like cloudron Backup, and is still not well-performing if you have small files like in a Nextcloud with small docs.)

                      MooCloud is testing Garage, and we have an agreement with Garage leading developer to publish the data collected using garage in a modern cloud environment.

                      Matteo. R.
                      Founder and Tech-Support Manager.
                      MooCloud MSP
                      Swiss Managed Service Provider

                      robi 1 Reply Last reply Reply Quote 3
                      • robi
                        robi @MooCloud_Matt last edited by

                        @MooCloud_Matt Have you looked at SeaweedFS yet?

                        Life of Advanced Technology

                        MooCloud_Matt 1 Reply Last reply Reply Quote 0
                        • MooCloud_Matt
                          MooCloud_Matt @robi last edited by

                          @robi
                          We did, but i don't recall the reason we excluded as an alternate to ceph(that we are using in prod currently)

                          Matteo. R.
                          Founder and Tech-Support Manager.
                          MooCloud MSP
                          Swiss Managed Service Provider

                          1 Reply Last reply Reply Quote 1
                          • First post
                            Last post
                          Powered by NodeBB