Colocated secondary backup

[yusf]

Hosting Cloudron on a VPS and backups on a remote object storage I want some backup redundancy. But how?

[yusf]

Come to think of it, this should have nothing to do with Cloudron. I can just connect to the primary object storage directly and mirror it.

[jdaviescoates]

@yusf I'd like to do something similar but have never used minio so would be interested in exactly how you at this up

[yusf]

@jdaviescoates I'm not sure minio is necessary. If not then I suppose setting up a cronjob on the local machine that periodically runs

s3cmd get --recursive s3://my-production/top-dir/ local-dir

would work. Not sure about how a restoration process would work in this case.

Looking into Minio documentation, there actually is a mirror feature of sorts. In that case, running

mc mirror -w remotebucket localdir

sounds according to the documentation that it would continously watch the remote object storage bucket and mirror all changes to the local directory.

[jdaviescoates]

@yusf thanks I'll see if I can see up something similar too

[yusf]

So I’ve tried using Minio’s CLI application, mc, to mirror between object storage. The CLI interfaces well with Minio, naturally.

I’ve run into problems on the other end however. I use Digital Ocean’s object storage solution called Spaces which should be S3 compatible. I don’t know if the shortcoming is because of mc or DO though, just that the tool can’t get complete directory listing and thus can’t proceed.

I’ll post the error messages here later.

Maybe someone else with a different storage provider can try mc?

[girish]

@yusf Maybe you can also try the aws cli tool which has different s3 options.

[yusf]

@girish Yes, I will test it. I’m trying to stay clear of Amazon products but it’s hard. Heck, DO is built on AWS iirc.

[girish]

DO is not on AWS, they build their own. Their co-founder replies here - https://www.quora.com/Does-DigitalOcean-have-its-own-datacenters-1

[yusf]

Oh, I’m glad to hear it. Either they did rely on AWS at one point or I got it backwards completely. Either is fine if they now have their own infra.