Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Feature Requests
  3. [Backups] Ability to add multiple storage provider/location

[Backups] Ability to add multiple storage provider/location

Scheduled Pinned Locked Moved Feature Requests
44 Posts 14 Posters 7.4k Views 18 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • MooCloud_MattM MooCloud_Matt

    @robi said in [Backups] Ability to add multiple storage provider/location:

    For example, when your data is sprinkled across 8 places and you only need 5 to restore any file/object.

    True, that's why we are using ceph, but it's not efficient (storage speaking) to protect the files we need to use snapshot or versioning in ceph too, because if the access of the bucket is compromised on the cloudron side all files even if they are slit into multiple nodes can still be deleted/encrypted, so that made the all advantage of using Software Define Storage/ Distributed storage = to a normal NAS offer by the datacenter over NFS.

    I really would like to analyze better what push proxmox to build a dedicated Client for their Storage Server. And what I have understood un till now is that they want maximal protection made easy which means that the ssh key used by their hypervisor server is not able to access the 2 and 1 copy of the backup.

    I really don't care about what software/ stack Cloudron will use, I just want to get out of Ceph for the backup and use a better setup that is not less safe.

    robiR Offline
    robiR Offline
    robi
    wrote on last edited by
    #26

    @moocloud_matt proper object storage will have versioning and dedup too.

    If you have source compromise you have other issues, however aspects of the push to store can be flipped in a pull to archive manner provided you have a mechanism to detect compromise and stop the pull or avoid overwrites.

    Conscious tech

    MooCloud_MattM 1 Reply Last reply
    0
    • robiR robi

      @moocloud_matt proper object storage will have versioning and dedup too.

      If you have source compromise you have other issues, however aspects of the push to store can be flipped in a pull to archive manner provided you have a mechanism to detect compromise and stop the pull or avoid overwrites.

      MooCloud_MattM Offline
      MooCloud_MattM Offline
      MooCloud_Matt
      wrote on last edited by MooCloud_Matt
      #27

      @robi

      @robi said in [Backups] Ability to add multiple storage provider/location:

      will have versioning and dedup too

      True, but dedup is a "raid" equivalent feature but scaled to multi-node.
      And versioning is not efficient if combined with backup tools, because most of them don't take advantage of s3 versioning API.

      So we are back on the idea that the main server if it's is compromised you want your backup to be safe, so many ransomware those days.

      Yes, that's possible to do it with S3 but is not easy and requires a lot of coding from the cloudron side and is just 1 protocol, no sftp or nfs or samba, if you don't want to use a proxy s3 to nfs or like we use Ceph to smd.

      Supporting 1 protocol is not what backups are in cloudron, you see more and more protocol support over time, I just help add SMB3 (with encrypt) to that list.

      And I think that is amazing for cloudron users that are not geeks or professionals and want to keep their local Synology or qnap NAS as a backup.

      A solution that would fit users like many that are commenting on this post is not enough. The idea I hope is to find a solution that can scale from a classic rsync stile to a 3-2-1 systems like proxmox backup or Borg.

      Matteo. R.
      Founder and Tech-Support Manager.
      MooCloud MSP
      Swiss Managed Service Provider

      robiR 1 Reply Last reply
      1
      • MooCloud_MattM MooCloud_Matt

        @robi

        @robi said in [Backups] Ability to add multiple storage provider/location:

        will have versioning and dedup too

        True, but dedup is a "raid" equivalent feature but scaled to multi-node.
        And versioning is not efficient if combined with backup tools, because most of them don't take advantage of s3 versioning API.

        So we are back on the idea that the main server if it's is compromised you want your backup to be safe, so many ransomware those days.

        Yes, that's possible to do it with S3 but is not easy and requires a lot of coding from the cloudron side and is just 1 protocol, no sftp or nfs or samba, if you don't want to use a proxy s3 to nfs or like we use Ceph to smd.

        Supporting 1 protocol is not what backups are in cloudron, you see more and more protocol support over time, I just help add SMB3 (with encrypt) to that list.

        And I think that is amazing for cloudron users that are not geeks or professionals and want to keep their local Synology or qnap NAS as a backup.

        A solution that would fit users like many that are commenting on this post is not enough. The idea I hope is to find a solution that can scale from a classic rsync stile to a 3-2-1 systems like proxmox backup or Borg.

        robiR Offline
        robiR Offline
        robi
        wrote on last edited by
        #28

        @moocloud_matt for your Ceph replacment you should look at Cleversafe from IBM. They also have some partners that make it even better on the user side. Komprise comes to mind.

        For Cloudron, a nice rclone integration would handle most of those options nicely.

        Conscious tech

        1 Reply Last reply
        1
        • d19dotcaD Offline
          d19dotcaD Offline
          d19dotca
          wrote on last edited by
          #29

          Definitely having a need for this now as I look to further improve my DR plan. What I’m hoping to achieve… faster local backups to an external block storage disk daily (possibly even multiple times given criticality of email for some users), and perhaps once a week or every 2-5 days would be an external backup to something like Wasabi to avoid any complete disasters in a single datacentre.

          --
          Dustin Dauncey
          www.d19.ca

          1 Reply Last reply
          3
          • girishG Offline
            girishG Offline
            girish
            Staff
            wrote on last edited by
            #30

            Yes, this is high on our list. Just finishing up the backup async rewrite! Almost there with 7.2.

            P 1 Reply Last reply
            5
            • girishG girish

              Yes, this is high on our list. Just finishing up the backup async rewrite! Almost there with 7.2.

              P Offline
              P Offline
              p44
              translator
              wrote on last edited by
              #31

              @girish Hello Girish, any updates on this feature? Thank's πŸ™

              girishG 1 Reply Last reply
              2
              • P p44

                @girish Hello Girish, any updates on this feature? Thank's πŸ™

                girishG Offline
                girishG Offline
                girish
                Staff
                wrote on last edited by
                #32

                @p44 probably the next release, this release is already a bit packed (and delayed)

                P 2 Replies Last reply
                4
                • girishG girish

                  @p44 probably the next release, this release is already a bit packed (and delayed)

                  P Offline
                  P Offline
                  p44
                  translator
                  wrote on last edited by
                  #33

                  @girish Thank's, take care

                  1 Reply Last reply
                  1
                  • d19dotcaD d19dotca referenced this topic on
                  • girishG girish

                    @p44 probably the next release, this release is already a bit packed (and delayed)

                    P Offline
                    P Offline
                    p44
                    translator
                    wrote on last edited by
                    #34

                    @girish Hello Girish, any news on this feature? Many thank's πŸ™

                    1 Reply Last reply
                    2
                    • girishG girish referenced this topic on
                    • J Offline
                      J Offline
                      jayonrails
                      translator
                      wrote on last edited by
                      #35

                      I can only agree with the previous speaker. I would be very happy about an implementation. For me it is not foreseeable how much effort it can be.

                      1 Reply Last reply
                      4
                      • marcusquinnM Offline
                        marcusquinnM Offline
                        marcusquinn
                        wrote on last edited by
                        #36

                        Might be a case of packaging the Rclone Web GUI as an app, then people can duplicate their main S3 backups anywhere else as a secondary routine.

                        • https://forum.cloudron.io/topic/7159/rclone-web-gui

                        Web Design https://www.evergreen.je
                        Development https://brandlight.org
                        Life https://marcusquinn.com

                        P 1 Reply Last reply
                        5
                        • marcusquinnM marcusquinn

                          Might be a case of packaging the Rclone Web GUI as an app, then people can duplicate their main S3 backups anywhere else as a secondary routine.

                          • https://forum.cloudron.io/topic/7159/rclone-web-gui
                          P Offline
                          P Offline
                          p44
                          translator
                          wrote on last edited by
                          #37

                          @marcusquinn This could be an alternative solution but I hope that a second backup can be configured directly in Cloudron.

                          1 Reply Last reply
                          4
                          • d19dotcaD Offline
                            d19dotcaD Offline
                            d19dotca
                            wrote on last edited by
                            #38

                            Any update on this, @staff? Hopefully this will be coming soon. Multiple backup methods is important especially as businesses grow.

                            --
                            Dustin Dauncey
                            www.d19.ca

                            P 1 Reply Last reply
                            3
                            • d19dotcaD d19dotca

                              Any update on this, @staff? Hopefully this will be coming soon. Multiple backup methods is important especially as businesses grow.

                              P Offline
                              P Offline
                              p44
                              translator
                              wrote on last edited by
                              #39

                              @d19dotca Totally agree with this point of view: multiple backup methods are important. I hope that this feature can be added soon, so we can use different methods to store data also on multiple datacenter.

                              1 Reply Last reply
                              3
                              • P p44 referenced this topic on
                              • T Offline
                                T Offline
                                threetrees3
                                wrote on last edited by
                                #40

                                Was surprised to find that this was not already a feature built into Cloudron today.
                                +1

                                Is the concern essentially consistently between backups?

                                girishG 1 Reply Last reply
                                3
                                • T threetrees3

                                  Was surprised to find that this was not already a feature built into Cloudron today.
                                  +1

                                  Is the concern essentially consistently between backups?

                                  girishG Offline
                                  girishG Offline
                                  girish
                                  Staff
                                  wrote on last edited by
                                  #41

                                  @threetrees3 there's no concern as such, just haven't gotten around to implementing it.

                                  When we implement it, it will be implemented as a remote copy and not creating another backup, I imagine. If we create yet another backup, I imagine the consistency problem you brought up will be a problem.

                                  1 Reply Last reply
                                  7
                                  • marcusquinnM Offline
                                    marcusquinnM Offline
                                    marcusquinn
                                    wrote on last edited by
                                    #42

                                    @Sarahclark Links spam injected in a edited quote. Reported.

                                    Web Design https://www.evergreen.je
                                    Development https://brandlight.org
                                    Life https://marcusquinn.com

                                    girishG 1 Reply Last reply
                                    3
                                    • marcusquinnM marcusquinn

                                      @Sarahclark Links spam injected in a edited quote. Reported.

                                      girishG Offline
                                      girishG Offline
                                      girish
                                      Staff
                                      wrote on last edited by
                                      #43

                                      @marcusquinn yes, thanks for reporting. I deleted that account.

                                      1 Reply Last reply
                                      3
                                      • SansGuidonS Offline
                                        SansGuidonS Offline
                                        SansGuidon
                                        wrote on last edited by
                                        #44

                                        I'm also highly interested in such features, to the light of all backup failures faced by few folks including me recently and reported in the support and discussion forums. Could be indeed something as simple as using rclone.

                                        About me / Now

                                        1 Reply Last reply
                                        3
                                        Reply
                                        • Reply as topic
                                        Log in to reply
                                        • Oldest to Newest
                                        • Newest to Oldest
                                        • Most Votes


                                        • Login

                                        • Don't have an account? Register

                                        • Login or register to search.
                                        • First post
                                          Last post
                                        0
                                        • Categories
                                        • Recent
                                        • Tags
                                        • Popular
                                        • Bookmarks
                                        • Search