Colocated secondary backup
-
wrote on Mar 29, 2020, 9:28 AM last edited by yusf Mar 30, 2020, 10:50 AM
Hosting Cloudron on a VPS and backups on a remote object storage I want some backup redundancy. But how?
-
wrote on Mar 29, 2020, 9:31 PM last edited by
Come to think of it, this should have nothing to do with Cloudron. I can just connect to the primary object storage directly and mirror it.
-
Come to think of it, this should have nothing to do with Cloudron. I can just connect to the primary object storage directly and mirror it.
wrote on Mar 30, 2020, 9:11 AM last edited by@yusf I'd like to do something similar but have never used minio so would be interested in exactly how you at this up
-
@yusf I'd like to do something similar but have never used minio so would be interested in exactly how you at this up
wrote on Mar 30, 2020, 9:32 AM last edited by yusf Mar 30, 2020, 10:51 AM@jdaviescoates I'm not sure minio is necessary. If not then I suppose setting up a cronjob on the local machine that periodically runs
s3cmd get --recursive s3://my-production/top-dir/ local-dirwould work. Not sure about how a restoration process would work in this case.
Looking into Minio documentation, there actually is a mirror feature of sorts. In that case, running
mc mirror -w remotebucket localdirsounds according to the documentation that it would continously watch the remote object storage bucket and mirror all changes to the local directory.
-
@jdaviescoates I'm not sure minio is necessary. If not then I suppose setting up a cronjob on the local machine that periodically runs
s3cmd get --recursive s3://my-production/top-dir/ local-dirwould work. Not sure about how a restoration process would work in this case.
Looking into Minio documentation, there actually is a mirror feature of sorts. In that case, running
mc mirror -w remotebucket localdirsounds according to the documentation that it would continously watch the remote object storage bucket and mirror all changes to the local directory.
wrote on Mar 30, 2020, 11:41 AM last edited by@yusf thanks I'll see if I can see up something similar too
-
wrote on Mar 31, 2020, 3:36 PM last edited by
So I’ve tried using Minio’s CLI application, mc, to mirror between object storage. The CLI interfaces well with Minio, naturally.
I’ve run into problems on the other end however. I use Digital Ocean’s object storage solution called Spaces which should be S3 compatible. I don’t know if the shortcoming is because of mc or DO though, just that the tool can’t get complete directory listing and thus can’t proceed.
I’ll post the error messages here later.
Maybe someone else with a different storage provider can try mc?
-
DO is not on AWS, they build their own. Their co-founder replies here - https://www.quora.com/Does-DigitalOcean-have-its-own-datacenters-1
-
wrote on Apr 1, 2020, 5:42 PM last edited by
Oh, I’m glad to hear it. Either they did rely on AWS at one point or I got it backwards completely. Either is fine if they now have their own infra.
