Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Matrix (Synapse/Element)
  3. Request: Include S3 Storage Module

Request: Include S3 Storage Module

Scheduled Pinned Locked Moved Solved Matrix (Synapse/Element)
14 Posts 7 Posters 2.7k Views 7 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • macawsM Offline
    macawsM Offline
    macaws
    wrote on last edited by
    #1

    Given that a lot of Cloudron servers might be set up on VMs with limited space, having the option to store on S3/S3 compatible would make a lot of sense for this app.

    The official module can be found here:
    https://github.com/matrix-org/synapse-s3-storage-provider

    I do not believe this will add too much to the package size, and the module is maintained by the upstream project, so this addition should keep the package clean.

    girishG 1 Reply Last reply
    5
    • girishG Offline
      girishG Offline
      girish
      Staff
      wrote on last edited by
      #2

      There's some related interesting information in https://github.com/matrix-org/synapse/pull/7272 and https://github.com/matrix-org/synapse/blob/master/docs/media_repository.md

      1 Reply Last reply
      1
      • macawsM macaws

        Given that a lot of Cloudron servers might be set up on VMs with limited space, having the option to store on S3/S3 compatible would make a lot of sense for this app.

        The official module can be found here:
        https://github.com/matrix-org/synapse-s3-storage-provider

        I do not believe this will add too much to the package size, and the module is maintained by the upstream project, so this addition should keep the package clean.

        girishG Offline
        girishG Offline
        girish
        Staff
        wrote on last edited by
        #3

        @macaws It's included in the latest package.

        scookeS 1 Reply Last reply
        4
        • nebulonN nebulon marked this topic as a question on
        • nebulonN nebulon has marked this topic as solved on
        • girishG girish

          @macaws It's included in the latest package.

          scookeS Offline
          scookeS Offline
          scooke
          wrote on last edited by
          #4

          @girish There it is!!
          e51d2514-5baa-4f59-a9f4-edea1638ed48-image.png

          A life lived in fear is a life half-lived

          humptydumptyH 1 Reply Last reply
          4
          • scookeS scooke

            @girish There it is!!
            e51d2514-5baa-4f59-a9f4-edea1638ed48-image.png

            humptydumptyH Offline
            humptydumptyH Offline
            humptydumpty
            wrote on last edited by humptydumpty
            #5

            @scooke said in Request: Include S3 Storage Module:

            @girish There it is!!

            Just want to point out that your domain is visible in the screenshot, in case that wasn't intended.

            scookeS 1 Reply Last reply
            0
            • humptydumptyH humptydumpty

              @scooke said in Request: Include S3 Storage Module:

              @girish There it is!!

              Just want to point out that your domain is visible in the screenshot, in case that wasn't intended.

              scookeS Offline
              scookeS Offline
              scooke
              wrote on last edited by scooke
              #6

              @humptydumpty Thank you. It wasn't intended, but oh well.

              A life lived in fear is a life half-lived

              A 1 Reply Last reply
              0
              • scookeS scooke

                @humptydumpty Thank you. It wasn't intended, but oh well.

                A Offline
                A Offline
                ApplegateR
                wrote on last edited by ApplegateR
                #7

                @scooke hahaha, happen to me too when I am exciting to screenshot also and post it

                Richard Applegate
                Anthem Coffee and Tea
                Joe Coffee
                IT/Administrator Server/Network

                scookeS 1 Reply Last reply
                1
                • A ApplegateR

                  @scooke hahaha, happen to me too when I am exciting to screenshot also and post it

                  scookeS Offline
                  scookeS Offline
                  scooke
                  wrote on last edited by
                  #8

                  @ApplegateR I think I have it set to not allow sign ups, but maybe I'll open it for Cloudronians.

                  A life lived in fear is a life half-lived

                  1 Reply Last reply
                  0
                  • scookeS Offline
                    scookeS Offline
                    scooke
                    wrote on last edited by
                    #9

                    Since I'm on a Minio/object storage kick, I tried setting this up. But it didn't work using the linked info. I tried setting it up just as path style, rather than domain style (as in, I didn't make a new A Record using the bucket name in use). I'll try later.

                    A life lived in fear is a life half-lived

                    nichu42N 1 Reply Last reply
                    1
                    • scookeS scooke

                      Since I'm on a Minio/object storage kick, I tried setting this up. But it didn't work using the linked info. I tried setting it up just as path style, rather than domain style (as in, I didn't make a new A Record using the bucket name in use). I'll try later.

                      nichu42N Offline
                      nichu42N Offline
                      nichu42
                      wrote on last edited by nichu42
                      #10

                      Has anyone made this work? Care to share your steps?
                      I made the entries for IDrive e2 in homeserver.yaml, but I keep getting an "invalid enpoint" error:

                      Jan 08 13:18:56 File "/app/code/env/lib/python3.10/site-packages/botocore/endpoint.py", line 402, in create_endpoint
                      Jan 08 13:18:56 raise ValueError("Invalid endpoint: %s" % endpoint_url)
                      Jan 08 13:18:56 ValueError: Invalid endpoint: xxxx.fra.idrivee2-42.com

                      I double-checked with rclone: All data was entered correctly.

                      Matrix: @nichu42:blueplanet.social

                      nichu42N 1 Reply Last reply
                      1
                      • nichu42N nichu42

                        Has anyone made this work? Care to share your steps?
                        I made the entries for IDrive e2 in homeserver.yaml, but I keep getting an "invalid enpoint" error:

                        Jan 08 13:18:56 File "/app/code/env/lib/python3.10/site-packages/botocore/endpoint.py", line 402, in create_endpoint
                        Jan 08 13:18:56 raise ValueError("Invalid endpoint: %s" % endpoint_url)
                        Jan 08 13:18:56 ValueError: Invalid endpoint: xxxx.fra.idrivee2-42.com

                        I double-checked with rclone: All data was entered correctly.

                        nichu42N Offline
                        nichu42N Offline
                        nichu42
                        wrote on last edited by nichu42
                        #11

                        @nichu42
                        OK, I found the error. The config file is expecting the endpoint URL to start with https://
                        I have the S3 storage up and running now. If anyone needs help, please feel free to reach out to me.

                        Matrix: @nichu42:blueplanet.social

                        jdaviescoatesJ 1 Reply Last reply
                        2
                        • nichu42N nichu42

                          @nichu42
                          OK, I found the error. The config file is expecting the endpoint URL to start with https://
                          I have the S3 storage up and running now. If anyone needs help, please feel free to reach out to me.

                          jdaviescoatesJ Online
                          jdaviescoatesJ Online
                          jdaviescoates
                          wrote on last edited by
                          #12

                          @nichu42 great, thanks!

                          If you document your process/ set-up here, you or someone else might also be able to add the details to the docs via https://git.cloudron.io/cloudron/docs 🙂

                          I use Cloudron with Gandi & Hetzner

                          nichu42N 1 Reply Last reply
                          0
                          • jdaviescoatesJ jdaviescoates

                            @nichu42 great, thanks!

                            If you document your process/ set-up here, you or someone else might also be able to add the details to the docs via https://git.cloudron.io/cloudron/docs 🙂

                            nichu42N Offline
                            nichu42N Offline
                            nichu42
                            wrote on last edited by nichu42
                            #13

                            @jdaviescoates

                            Sure! It is quite easy, once you know what you are doing. 😜

                            Take the following code and replace the <S3...> boxes with your S3 compatible storage's data.

                            media_storage_providers:
                            - module: s3_storage_provider.S3StorageProviderBackend
                              store_local: True
                              store_remote: True
                              store_synchronous: True
                              config:
                                bucket: <S3_BUCKET_NAME>
                                region_name: <S3_REGION_NAME>
                                endpoint_url: <S3_LIKE_SERVICE_ENDPOINT_URL>
                                access_key_id: <S3_ACCESS_KEY_ID>
                                secret_access_key: <S3_SECRET_ACCESS_KEY>
                            

                            Make sure the endpoint URL starts with https://
                            Copy the code to your clipboard.

                            Open the file manager of your Synapse App in Cloudron Dashboard. Navigate to configs and open the homeserver.yaml file. Paste the code from your clipboard at the end of the configuration file.
                            Save and restart the app.

                            Matrix: @nichu42:blueplanet.social

                            jdaviescoatesJ 1 Reply Last reply
                            4
                            • nichu42N nichu42

                              @jdaviescoates

                              Sure! It is quite easy, once you know what you are doing. 😜

                              Take the following code and replace the <S3...> boxes with your S3 compatible storage's data.

                              media_storage_providers:
                              - module: s3_storage_provider.S3StorageProviderBackend
                                store_local: True
                                store_remote: True
                                store_synchronous: True
                                config:
                                  bucket: <S3_BUCKET_NAME>
                                  region_name: <S3_REGION_NAME>
                                  endpoint_url: <S3_LIKE_SERVICE_ENDPOINT_URL>
                                  access_key_id: <S3_ACCESS_KEY_ID>
                                  secret_access_key: <S3_SECRET_ACCESS_KEY>
                              

                              Make sure the endpoint URL starts with https://
                              Copy the code to your clipboard.

                              Open the file manager of your Synapse App in Cloudron Dashboard. Navigate to configs and open the homeserver.yaml file. Paste the code from your clipboard at the end of the configuration file.
                              Save and restart the app.

                              jdaviescoatesJ Online
                              jdaviescoatesJ Online
                              jdaviescoates
                              wrote on last edited by
                              #14

                              @nichu42 great, thanks! 🙏

                              I use Cloudron with Gandi & Hetzner

                              1 Reply Last reply
                              1
                              Reply
                              • Reply as topic
                              Log in to reply
                              • Oldest to Newest
                              • Newest to Oldest
                              • Most Votes


                              • Login

                              • Don't have an account? Register

                              • Login or register to search.
                              • First post
                                Last post
                              0
                              • Categories
                              • Recent
                              • Tags
                              • Popular
                              • Bookmarks
                              • Search