Recommended settings for backup

[ekevu123]

When I choose rsync backup, I can configure these settings:

• Memory Limit
• Upload Part Size
• Upload Concurrency
• Download Concurrency
• Copy Concurrency

I wonder if it would be a good idea if Cloudron suggested suitable values based on my server settings. I came across these problems, for example:

• The memory limit can be set higher than what the server has available.
• The memory limit can also be set higher than the memory I have realistically available according to my system monitoring
• When setting the values too high or too low, it seems like this can cause additional issues. For example, when I set the concurrency very low, my backup takes 14 hours. When I set them too high, my backup task crashed frequently. It takes me time to figure out how I need to set them to achieve frequent backup success.

I find it hard to understand which upload part size and concurrency level to choose anyway and I am currently doing some trial-and-error to figure this out. Perhaps Cloudron could highlight some recommended values based on some settings of my server.

[girish]

We haven't figured out what is the best way to determine this. In fact, I don't like the fact that these geeky values are configurable in the first place. It was made configurable only because we haven't been able to figure out values for various services and various user configurations and data sizes.

[ekevu123]

Well, I thought you would say that.

But how about at least make some suitable limits? E.g. the memory limit shouldn't be higher than what I can afford based on my usage. Also, if I can only upload up to three parts simultaneously that require as much memory, why can the memory limit and the upload part size differ? Wouldn't it make more sense to have one setting for both?