Move storage to S3

[MichaelF]

I have seen a couple of posts on this.

I have an installation of Nextcloud using the Linode VPS service.

I would like to setup S3 storage on Linode and move my data to it.

Under the storage section you can add a link and click Move Data

Looking for some feedback and guidance on doing this.

If you have any questions please let me know.

Thanks!

[nebulon]

I am not sure how Nextcloud's S3 backend has evolved, but last time I tried it, it was not really suitable, causing a lot of S3 requests and thus costs.
At least back then Nextcloud was treating S3 (which is an object store) as a file storage.

[MichaelF]

I see.

Do you have any recommendations for expanding storage to accommodate users?

I know there is Volume storage but that doesn't seem very cost effective.

I look forward to your reply and thanks!

Michael

[nebulon]

This is more like an app specific topic. Given that volumes or regular filesystems are vastly different than object storage, it very much depends on how the app treats them.

To give one simple example, if an app like Nextcloud supports editing files and you would change a single character in a text file, then a normal filesystem can use seek and update on the file node itself, while an object storage would need to upload the whole file (unless the files are split up in small chunks as objects, but that vastly increases overall S3 object count). This missing feature in object storage to perform random access object updates is partly why the cost difference is there. So there is always a bit of a tradeoff between those two storage types.

I think for your Nextcloud case, you have to consult the Nextcloud project directly on what they recommend in which case.

[jdaviescoates]

@MichaelF said in Move storage to S3:

I know there is Volume storage but that doesn't seem very cost effective.

Hetzner storage boxes are pretty cost effective volumes imho:

https://www.hetzner.com/storage/storage-box

Saying that, I've not tried using them with Nextcloud (in part because Nextcloud is so slow for me it's worth paying more for Hetzner cloud volumes)

[MichaelF]

Ok then, thank you for your help!

[potemkin_ai]

@MichaelF have you been able to try on things? If so, is there something you could share from your findings, please?