Backing up media cache

[jdaviescoates]

@archos good luck!

[jdaviescoates]

@archos Note, you also have to do the CORS stuff on Scaleway too, so it won't work without doing that as well,

see:

https://www.scaleway.com/en/docs/storage/object/api-cli/setting-cors-rules/

But before you can do that you need to set-up the AWS CLI stuff, see:

https://www.scaleway.com/en/docs/storage/object/api-cli/object-storage-aws-cli/

And before you can do that you need API Keys:

https://www.scaleway.com/en/docs/identity-and-access-management/iam/how-to/create-api-keys/

Good luck!

[archos]

Thank you very much, it doesn't look very easy but I will try and let you know. Thanks again for your help.

[archos]

@jdaviescoates I didn't really understand the instructions, so I tried Wasabi and Idrive again. The logs show this error.

Aws::S3::Errors::InvalidAccessKeyId (The AWS Access Key Id you provided does not exist in our records.):

I tried to re-create the keys, but to no avail.

[jdaviescoates]

@archos said in Backing up media cache:

@jdaviescoates I didn't really understand the instructions, so I tried Wasabi and Idrive again. The logs show this error.

Aws::S3::Errors::InvalidAccessKeyId (The AWS Access Key Id you provided does not exist in our records.):

I tried to re-create the keys, but to no avail.

The logs where? Which provider?

[archos]

@jdaviescoates This is the log from Mastodon when I try to post a photo. It's on every provider I've tried. Yesterday I tried following this exact procedure and created a bucket on AWS and the result was the same.

[archos]

I followed the joinmastodon instructions, on the Scaleway repository. Now I'm getting this error in the logs in the application.

Aws::S3::Errors::AuthorizationHeaderMalformed (The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'fr-par'):

I chose Paris as the region for the bucket and in env.production. So I really don't know what I'm doing wrong :-(.

# Store data using S3 object
S3_ENABLED=true
S3_BUCKET=mastcz
AWS_ACCESS_KEY_ID=ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY=SECRET_ACCESS_KEY
#S3_REGION=fr-par
S3_PROTOCOL=https
S3_HOSTNAME=s3.fr-par.scw.cloud
S3_ENDPOINT=https://mastcz.s3.fr-par.scw.cloud

[jdaviescoates]

@archos looks like your S3_ENDPOINT is wrong. For me at least it's just https://s3.fr-par.scw.cloud without the bucket name at the beginning.

[archos]

Yes I tried that first and the same result

[archos]

Hi, I managed to set up the S3 repository according to this guide. Now the photos are uploading to the storage. I just have a problem with avatars and pictures that were previously uploaded. Even custom emoji are not visible now. Does anyone else have any ideas on how to fix this please?
I shouldn't have added the sync command. I am very grateful for your advice and information. Thank you very much.

[nebulon]

Presumably the app does not automatically re-upload the assets. Maybe upstream has a storage migration script for this? But I haven't seen that so far at least.

[archos]

@nebulon Thank you for your reply. In the instructions it says that first you have to run the command

cd /home/mastodon/live
aws s3 sync --acl public-read public/system/ s3://instance-media --endpoint=https://s3.fr-par.scw.cloud

To synchronize local data, cache Mastodon media to the S3 bucket.
I guess that would have to be a different command here on Cloudron.
Now my images load, but the local avatars, server image have disappeared from the instance and the remote images and avatars are not loading. Is it possible that the remote images will load gradually, I don't know.
I've been really struggling with this for a few days now and the result is still not good.