Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. App Packaging & Development
  3. Addon request: blob storage (s3)

Addon request: blob storage (s3)

Scheduled Pinned Locked Moved App Packaging & Development
13 Posts 4 Posters 2.5k Views 5 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • robiR Offline
      robiR Offline
      robi
      wrote on last edited by
      #4

      I think gateway mode by default is best, which can then point to any local or remote S3 endpoint as needed.

      Again, MultiCloudron will make this very useful.

      The apps will come once the capability is available, even NextCloud in S3 only mode.

      Conscious tech

      infogulchI MooCloud_MattM 2 Replies Last reply
      0
      • robiR robi

        I think gateway mode by default is best, which can then point to any local or remote S3 endpoint as needed.

        Again, MultiCloudron will make this very useful.

        The apps will come once the capability is available, even NextCloud in S3 only mode.

        infogulchI Offline
        infogulchI Offline
        infogulch
        wrote on last edited by infogulch
        #5

        Nice thanks for the Nextcloud example. I added it to the list in the OP.

        Gateway mode would be wonderful but it also adds some complications, in particular if done incorrectly it could throw a spanner into the currently very clean backup/restore system which is actually my favorite Cloudron feature. With that in mind I would be happy to get a version-1 implementation that only supports the local filesystem configuration.

        robiR 1 Reply Last reply
        0
        • infogulchI infogulch

          Nice thanks for the Nextcloud example. I added it to the list in the OP.

          Gateway mode would be wonderful but it also adds some complications, in particular if done incorrectly it could throw a spanner into the currently very clean backup/restore system which is actually my favorite Cloudron feature. With that in mind I would be happy to get a version-1 implementation that only supports the local filesystem configuration.

          robiR Offline
          robiR Offline
          robi
          wrote on last edited by
          #6

          @infogulch It's an additional capability, not a replacement of what already works brilliantly. 😉

          Conscious tech

          infogulchI 1 Reply Last reply
          0
          • robiR robi

            @infogulch It's an additional capability, not a replacement of what already works brilliantly. 😉

            infogulchI Offline
            infogulchI Offline
            infogulch
            wrote on last edited by
            #7

            I would say what works brilliantly in Cloudron is the tight, seamless integration between the different components which enables admins to not have to think about huge problems like taking backups.

            1 Reply Last reply
            0
            • robiR robi

              I think gateway mode by default is best, which can then point to any local or remote S3 endpoint as needed.

              Again, MultiCloudron will make this very useful.

              The apps will come once the capability is available, even NextCloud in S3 only mode.

              MooCloud_MattM Offline
              MooCloud_MattM Offline
              MooCloud_Matt
              wrote on last edited by
              #8

              @robi said in Addon request: blob storage (s3):

              gateway

              Yes but in that case, cloudron will have to provide support for multiple NIC, 1 Gbit's NIC can't offer good performance with remote s3 + nextcloud + fire redundancy for minio for example.

              Matteo. R.
              Founder and Tech-Support Manager.
              MooCloud MSP
              Swiss Managed Service Provider

              infogulchI 1 Reply Last reply
              0
              • MooCloud_MattM MooCloud_Matt

                @robi said in Addon request: blob storage (s3):

                gateway

                Yes but in that case, cloudron will have to provide support for multiple NIC, 1 Gbit's NIC can't offer good performance with remote s3 + nextcloud + fire redundancy for minio for example.

                infogulchI Offline
                infogulchI Offline
                infogulch
                wrote on last edited by infogulch
                #9

                @moocloud_matt I'm confused how "multiple Network Interface Card (NIC)" support is relevant here. Are you familiar with the minio gateways? They are orthogonal to networking configuration.

                https://docs.min.io/docs/minio-gateway-for-s3.html

                MooCloud_MattM 1 Reply Last reply
                0
                • infogulchI infogulch

                  @moocloud_matt I'm confused how "multiple Network Interface Card (NIC)" support is relevant here. Are you familiar with the minio gateways? They are orthogonal to networking configuration.

                  https://docs.min.io/docs/minio-gateway-for-s3.html

                  MooCloud_MattM Offline
                  MooCloud_MattM Offline
                  MooCloud_Matt
                  wrote on last edited by MooCloud_Matt
                  #10

                  @infogulch
                  what I mean, is that you need more than 1 gbit's connection for 1 server, and not always 2.5/10gbits are available.
                  Because Minio Gateway, and Minio Backend if it's used they still pass through data, and a lot of it, especially if you have a big install of NextCloud.

                  We need to be able to support multiple NIC, so that we can dedicate one for Minio, or other backend file transfer without impacting the second connection that is dedicated for Apps.

                  Matteo. R.
                  Founder and Tech-Support Manager.
                  MooCloud MSP
                  Swiss Managed Service Provider

                  infogulchI 1 Reply Last reply
                  0
                  • MooCloud_MattM MooCloud_Matt

                    @infogulch
                    what I mean, is that you need more than 1 gbit's connection for 1 server, and not always 2.5/10gbits are available.
                    Because Minio Gateway, and Minio Backend if it's used they still pass through data, and a lot of it, especially if you have a big install of NextCloud.

                    We need to be able to support multiple NIC, so that we can dedicate one for Minio, or other backend file transfer without impacting the second connection that is dedicated for Apps.

                    infogulchI Offline
                    infogulchI Offline
                    infogulch
                    wrote on last edited by
                    #11

                    @moocloud_matt The number of servers that use a 1GB NIC and could saturate it because using a gateway doubles the bandwidth used to serve minio requests would probably fit on one hand if there are any at all. This concern is like a third or fourth level extrapolation, I don't think it's worth anyone's time to consider this eventuality right now.

                    MooCloud_MattM 1 Reply Last reply
                    0
                    • infogulchI infogulch

                      @moocloud_matt The number of servers that use a 1GB NIC and could saturate it because using a gateway doubles the bandwidth used to serve minio requests would probably fit on one hand if there are any at all. This concern is like a third or fourth level extrapolation, I don't think it's worth anyone's time to consider this eventuality right now.

                      MooCloud_MattM Offline
                      MooCloud_MattM Offline
                      MooCloud_Matt
                      wrote on last edited by MooCloud_Matt
                      #12

                      @infogulch

                      for experience with CEPH, and reading how Minio works, and their requirement.

                      Multi NICs, are needed or highly performant one, like 2.5 at least, for decent installation with Gateway or Minio storage cluster.
                      https://docs.min.io/minio/vsphere/reference/production-recommendations.html

                      A normal NextCloud server on one single SSD, not NVMe; can saturate easily one single Gbit's NIC.

                      That without considering that with Minio Gateway you have to split the 1Gbits NIC in incoming S3 traffic and outgoing WebDAV traffic.
                      I know that NICs are duplex, but they don't perform full capacity if used to the max.

                      It will not be for everyone but is needed for those who use Cloudron for heavily used Server.

                      Matteo. R.
                      Founder and Tech-Support Manager.
                      MooCloud MSP
                      Swiss Managed Service Provider

                      infogulchI 1 Reply Last reply
                      0
                      • MooCloud_MattM MooCloud_Matt

                        @infogulch

                        for experience with CEPH, and reading how Minio works, and their requirement.

                        Multi NICs, are needed or highly performant one, like 2.5 at least, for decent installation with Gateway or Minio storage cluster.
                        https://docs.min.io/minio/vsphere/reference/production-recommendations.html

                        A normal NextCloud server on one single SSD, not NVMe; can saturate easily one single Gbit's NIC.

                        That without considering that with Minio Gateway you have to split the 1Gbits NIC in incoming S3 traffic and outgoing WebDAV traffic.
                        I know that NICs are duplex, but they don't perform full capacity if used to the max.

                        It will not be for everyone but is needed for those who use Cloudron for heavily used Server.

                        infogulchI Offline
                        infogulchI Offline
                        infogulch
                        wrote on last edited by infogulch
                        #13

                        @moocloud_matt As soon as someone comes in reporting a real case that their NIC is saturated and it's slowing down their server I'd be interested in pursuing a solution. I've never seen such a real case on these forums (though I may just be misinformed) so I'd have to tilt towards YAGNI until one appears.

                        Object storage is not magic, it's just data like everything else. If it's just used to serve file attachments for an app with 25 users I wouldn't expect it to be a bottleneck.

                        1 Reply Last reply
                        1
                        • infogulchI infogulch referenced this topic on
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                          • Login

                          • Don't have an account? Register

                          • Login or register to search.
                          • First post
                            Last post
                          0
                          • Categories
                          • Recent
                          • Tags
                          • Popular
                          • Bookmarks
                          • Search