Hack a custom backup Retention and Schedule

Reply to Hack a custom backup Retention and Schedule on Fri, 01 Jul 2022 15:12:30 GMT

robi — Fri, 01 Jul 2022 15:12:30 GMT

@fbartels Yes, hence the ask for a single place to
set it, so it's in use until changed and the change survives updates.

Reply to Hack a custom backup Retention and Schedule on Fri, 01 Jul 2022 05:19:17 GMT

fbartels — Fri, 01 Jul 2022 05:19:17 GMT

@robi retention by time you could already set through keepWithinSecs i would say.

For the rest (although i would rather recommend to work on the storage limitations) maybe it would be an alternative to backup the Cloudron to disk and have another application pick up the moving to storage and rotation/retention part. There was a restic how to here recently that could help.

Reply to Hack a custom backup Retention and Schedule on Thu, 30 Jun 2022 21:42:38 GMT

robi — Thu, 30 Jun 2022 21:42:38 GMT

@fbartels

o Happyness level 1 - custom static retention
o Happyness level 2 - custom dynamic retention based on backup size, yes
o Happyness level 3 - custom dynamic retention based on level 2 with thresholds AND different destinations (of different sizes, including local)

Reply to Hack a custom backup Retention and Schedule on Thu, 30 Jun 2022 20:08:34 GMT

fbartels — Thu, 30 Jun 2022 20:08:34 GMT

@robi so the change you need is rather a retention based on backup size?

Reply to Hack a custom backup Retention and Schedule on Thu, 30 Jun 2022 18:44:12 GMT

robi — Thu, 30 Jun 2022 18:44:12 GMT

@fbartels Thanks for this.. the two main things are retention beyond the options available and a possibly more dynamic schedule (thanks to your API example).

One system we have is doing hourly local backups to keep important content from being lost, which is a lot, however there isn't a retention config that fits the needs. Hence a custom setting would be peachy.

Once remote backups begin, some of those destinations have storage limitations and again the retention needs adjusting to keep within those limits w/o doubling costs, etc..

The only other thing that would be missing is more data on size of backups directly so it doesn't have to be figured out via other indirect means (like looking back from remote backup sources how much is used, we should know how much is intended to be written.)

Reply to Hack a custom backup Retention and Schedule on Thu, 30 Jun 2022 18:12:10 GMT

fbartels — Thu, 30 Jun 2022 18:12:10 GMT

Hi @robi,

what kind of settings do you want to change? I would always discourage changing source files, simply because any update could potentially overwrite the custom changes.

Even if retention and schedule patterns
are not part of the documentation, looking in the browser console they still can be set with a simple curl request.

curl 'https://my.xxx/api/v1/settings/backup_config' \
  -H 'authorization: Bearer xxx' \
  --data-raw '{"provider":"minio","format":"tgz","bucket":"xxx-9wdeu","prefix":"","accessKeyId":"xxx","secretAccessKey":"●●●●●●●●","endpoint":"https://xxx","region":"us-east-1","acceptSelfSignedCerts":false,"s3ForcePathStyle":true,"retentionPolicy":{"keepWithinSecs":2592000},"schedulePattern":"00 00 23 * * *","memoryLimit":8589934592,"uploadPartSize":20971520,"password":"●●●●●●●●"}' \
  --compressed