Request: Include S3 Storage Module
-
Since I'm on a Minio/object storage kick, I tried setting this up. But it didn't work using the linked info. I tried setting it up just as path style, rather than domain style (as in, I didn't make a new A Record using the bucket name in use). I'll try later.
Has anyone made this work? Care to share your steps?
I made the entries for IDrive e2 in homeserver.yaml, but I keep getting an "invalid enpoint" error:Jan 08 13:18:56 File "/app/code/env/lib/python3.10/site-packages/botocore/endpoint.py", line 402, in create_endpoint
Jan 08 13:18:56 raise ValueError("Invalid endpoint: %s" % endpoint_url)
Jan 08 13:18:56 ValueError: Invalid endpoint: xxxx.fra.idrivee2-42.comI double-checked with rclone: All data was entered correctly.
Matrix: @nichu42:blueplanet.social
-
Has anyone made this work? Care to share your steps?
I made the entries for IDrive e2 in homeserver.yaml, but I keep getting an "invalid enpoint" error:Jan 08 13:18:56 File "/app/code/env/lib/python3.10/site-packages/botocore/endpoint.py", line 402, in create_endpoint
Jan 08 13:18:56 raise ValueError("Invalid endpoint: %s" % endpoint_url)
Jan 08 13:18:56 ValueError: Invalid endpoint: xxxx.fra.idrivee2-42.comI double-checked with rclone: All data was entered correctly.
-
@nichu42
OK, I found the error. The config file is expecting the endpoint URL to start with https://
I have the S3 storage up and running now. If anyone needs help, please feel free to reach out to me.@nichu42 great, thanks!
If you document your process/ set-up here, you or someone else might also be able to add the details to the docs via https://git.cloudron.io/cloudron/docs
-
@nichu42 great, thanks!
If you document your process/ set-up here, you or someone else might also be able to add the details to the docs via https://git.cloudron.io/cloudron/docs
Sure! It is quite easy, once you know what you are doing.
Take the following code and replace the <S3...> boxes with your S3 compatible storage's data.
media_storage_providers: - module: s3_storage_provider.S3StorageProviderBackend store_local: True store_remote: True store_synchronous: True config: bucket: <S3_BUCKET_NAME> region_name: <S3_REGION_NAME> endpoint_url: <S3_LIKE_SERVICE_ENDPOINT_URL> access_key_id: <S3_ACCESS_KEY_ID> secret_access_key: <S3_SECRET_ACCESS_KEY>Make sure the endpoint URL starts with https://
Copy the code to your clipboard.Open the file manager of your Synapse App in Cloudron Dashboard. Navigate to configs and open the homeserver.yaml file. Paste the code from your clipboard at the end of the configuration file.
Save and restart the app.Matrix: @nichu42:blueplanet.social
-
Sure! It is quite easy, once you know what you are doing.
Take the following code and replace the <S3...> boxes with your S3 compatible storage's data.
media_storage_providers: - module: s3_storage_provider.S3StorageProviderBackend store_local: True store_remote: True store_synchronous: True config: bucket: <S3_BUCKET_NAME> region_name: <S3_REGION_NAME> endpoint_url: <S3_LIKE_SERVICE_ENDPOINT_URL> access_key_id: <S3_ACCESS_KEY_ID> secret_access_key: <S3_SECRET_ACCESS_KEY>Make sure the endpoint URL starts with https://
Copy the code to your clipboard.Open the file manager of your Synapse App in Cloudron Dashboard. Navigate to configs and open the homeserver.yaml file. Paste the code from your clipboard at the end of the configuration file.
Save and restart the app.@nichu42 great, thanks!
-
Sure! It is quite easy, once you know what you are doing.
Take the following code and replace the <S3...> boxes with your S3 compatible storage's data.
media_storage_providers: - module: s3_storage_provider.S3StorageProviderBackend store_local: True store_remote: True store_synchronous: True config: bucket: <S3_BUCKET_NAME> region_name: <S3_REGION_NAME> endpoint_url: <S3_LIKE_SERVICE_ENDPOINT_URL> access_key_id: <S3_ACCESS_KEY_ID> secret_access_key: <S3_SECRET_ACCESS_KEY>Make sure the endpoint URL starts with https://
Copy the code to your clipboard.Open the file manager of your Synapse App in Cloudron Dashboard. Navigate to configs and open the homeserver.yaml file. Paste the code from your clipboard at the end of the configuration file.
Save and restart the app. -
@nichu42 What about the cleanup script and pushing existing media to s3? Did you ever set that up?
-
@andreasdueren Synapse is on S3, yes.
My other project was Mastodon. It's still to be done.@nichu42 But what did you do with these? Are these scripts already installed in the package somewhere and can be called with a cron job?
-
This post is deleted!
-
@nichu42 But what did you do with these? Are these scripts already installed in the package somewhere and can be called with a cron job?
@andreasdueren It's been a while since I did this so I don't know 100% but I am pretty sure that I did not install anything, I just made the config as mentioned above and I have a cronjob for cleaning up the local space.
Matrix: @nichu42:blueplanet.social
-
@andreasdueren It's been a while since I did this so I don't know 100% but I am pretty sure that I did not install anything, I just made the config as mentioned above and I have a cronjob for cleaning up the local space.
@nichu42 Would you mind sharing the cronjob? What is it calling?
