Installing awscli to move media to S3

[nichu42]

Splitting from thread https://forum.cloudron.io/post/105859

I'm trying to install awscli in order to copy the local media files to S3.
Following the instructions found at https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html, I end up with the following error when trying to start the installation:

mkdir: cannot create directory ‘/usr/local/aws-cli’: Read-only file system

Seems logic. But I'm running in circles. How do I get the files out of the container? Is there another way?

[robi]

Where are you installing them to?

You can't just let it do what it wants in a Cloudron secure environment.

It says you can specify the bin and install dir, why not do that?

[nebulon]

@nichu42 all apps run in a mostly read-only container environment. Since I assume the job is a one-time job to use the aws cli for you. You could put the app in recovery mode after that mastodon does not run, but the container gets a transient read-write filesystem. You can then install aws-cli safely and copy the media cache to S3. Afterwards disable recovery mode and your filesystem changes will be undone and the app would startup in read-only mode again.

[nichu42]

@nebulon That would mean putting my public instance offline for a whole working day. Can you think of another way to solve this?
I am currently thinking if I could rsync the files to a Hetzner Storage Box volume and then rclone them from there to S3.
Once to prepare, then move, then repeat to sync any missing file.

[nebulon]

How much media data do you have in that instance to expect a whole day?

But that is an option to download the data via other means (maybe even with the cloudron cli) to some temporary location. But then again if you have that much data, it may not be feasible.

You could also (but at your own risk) try to install aws-sdk on the host ubuntu system and perform the upload/sync there.