What's coming in 4.5
-
@jdaviescoates Mailpile has both those features: https://www.mailpile.is/
Might be a good app request.
@iamthefij said in What's coming in 4.5:
Mailpile has both those features
so does Kopano: https://kopano.com/
-
@mehdi said in What's coming in 4.5:
I'm intrigued with "Per-app backup format." I have no idea what it could mean ^^
We are trying to figure a solution on how to backup & restore the large amounts of data people store in nextcloud style apps. For most other apps, tgz format works just fine. But for nextcloud, people are storing upwards of 100G and we get a support request every 3-4 days about some backup/restore issue. This usually happens whenever we do a nextcloud update. One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain. If others have a better suggestions, would be good to hear them. We considered only backing up db and not the files but I am not sure what the value of this is. It's really hard to 'restore' from a partial backup.
Also, I'm not very clear on the firewall thing
Yes, all ports unless explicitly opened are blocked. A common feature request is to whitelist/blacklist IP/geoip blocks on apps. Another is to block specific pages from being (ab)used too quickly - like login pages. For example, maybe we can add hints in CloudronManifest.json to say
/login.phpis the URL or something. So, this is more an application firewall. -
@mehdi said in What's coming in 4.5:
I'm intrigued with "Per-app backup format." I have no idea what it could mean ^^
We are trying to figure a solution on how to backup & restore the large amounts of data people store in nextcloud style apps. For most other apps, tgz format works just fine. But for nextcloud, people are storing upwards of 100G and we get a support request every 3-4 days about some backup/restore issue. This usually happens whenever we do a nextcloud update. One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain. If others have a better suggestions, would be good to hear them. We considered only backing up db and not the files but I am not sure what the value of this is. It's really hard to 'restore' from a partial backup.
Also, I'm not very clear on the firewall thing
Yes, all ports unless explicitly opened are blocked. A common feature request is to whitelist/blacklist IP/geoip blocks on apps. Another is to block specific pages from being (ab)used too quickly - like login pages. For example, maybe we can add hints in CloudronManifest.json to say
/login.phpis the URL or something. So, this is more an application firewall.@girish using something like Restic for backups instead would offer encrypted block based backups. It's great for things like this where you would have lots of potentially duplicate backup data.
I know I suggested this on another thread, but using an existing backup engine would allow you to offload the complexities of efficient backups, integrity checks, and restoration as well as add support for loads more backup destinations (like B2).
-
@iamthefij said in What's coming in 4.5:
Mailpile has both those features
so does Kopano: https://kopano.com/
@fbartels said in What's coming in 4.5:
so does Kopano: https://kopano.com/
Does it?!? I had a quick look at the demo a while ago, specifically to see if this was the case but the impression I got was that the email client was very basic and didn't have these features.... I shall have to go back and investigate further...
-
@fbartels said in What's coming in 4.5:
so does Kopano: https://kopano.com/
Does it?!? I had a quick look at the demo a while ago, specifically to see if this was the case but the impression I got was that the email client was very basic and didn't have these features.... I shall have to go back and investigate further...
@fbartels I had another little play with the Kopano demo (which looked different from how I remembered it, so maybe I was thinking about some other demo I used recently) but nevertheless couldn't see any way of organising mail using virtual folders/ labels/ whatever you want to call them (the demo was that useful as a demo as so little mail there to try anything with - nothing in the inbox - and email doesn't actually seem to get sent - but I clicked on and/ or hovered over everything and didn't appear to have these features as far as I could tell)
-
@mehdi said in What's coming in 4.5:
I'm intrigued with "Per-app backup format." I have no idea what it could mean ^^
We are trying to figure a solution on how to backup & restore the large amounts of data people store in nextcloud style apps. For most other apps, tgz format works just fine. But for nextcloud, people are storing upwards of 100G and we get a support request every 3-4 days about some backup/restore issue. This usually happens whenever we do a nextcloud update. One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain. If others have a better suggestions, would be good to hear them. We considered only backing up db and not the files but I am not sure what the value of this is. It's really hard to 'restore' from a partial backup.
Also, I'm not very clear on the firewall thing
Yes, all ports unless explicitly opened are blocked. A common feature request is to whitelist/blacklist IP/geoip blocks on apps. Another is to block specific pages from being (ab)used too quickly - like login pages. For example, maybe we can add hints in CloudronManifest.json to say
/login.phpis the URL or something. So, this is more an application firewall.@girish said in What's coming in 4.5:
One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain.
I like this idea and don't find it particularly complex either
I'd use rsync for Nexcloud and Surfer and tgz for everything else.
-
@mehdi said in What's coming in 4.5:
I'm intrigued with "Per-app backup format." I have no idea what it could mean ^^
We are trying to figure a solution on how to backup & restore the large amounts of data people store in nextcloud style apps. For most other apps, tgz format works just fine. But for nextcloud, people are storing upwards of 100G and we get a support request every 3-4 days about some backup/restore issue. This usually happens whenever we do a nextcloud update. One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain. If others have a better suggestions, would be good to hear them. We considered only backing up db and not the files but I am not sure what the value of this is. It's really hard to 'restore' from a partial backup.
Also, I'm not very clear on the firewall thing
Yes, all ports unless explicitly opened are blocked. A common feature request is to whitelist/blacklist IP/geoip blocks on apps. Another is to block specific pages from being (ab)used too quickly - like login pages. For example, maybe we can add hints in CloudronManifest.json to say
/login.phpis the URL or something. So, this is more an application firewall.@girish said in What's coming in 4.5:
But for nextcloud, people are storing upwards of 100G
Even if a more suitable backup format is found for this usecase, working with those apps in terms of cloning for staging etc will be a pain.
I’m currently looking into external object storage for content, offloading it compleyely from Cloudron.
-
-
@yusf Doesn't nextcloud already support external object storage (SFTP/S3/Dropbox etc)? What do you need from Cloudron ? Or do you want to mount an external disk into nextcloud with the external storage app ? That is indeed not possible today.
-
@fbartels I had another little play with the Kopano demo (which looked different from how I remembered it, so maybe I was thinking about some other demo I used recently) but nevertheless couldn't see any way of organising mail using virtual folders/ labels/ whatever you want to call them (the demo was that useful as a demo as so little mail there to try anything with - nothing in the inbox - and email doesn't actually seem to get sent - but I clicked on and/ or hovered over everything and didn't appear to have these features as far as I could tell)
Yes, I won't claim the web client is perfect, but basic also does not seem to be the right word for it.
@jdaviescoates said in What's coming in 4.5:
but nevertheless couldn't see any way of organising mail using virtual folders/ labels/ whatever you want to call them
You can do searches and "store" these to easily rerun them later. Its similar to how the the Outlook fat client is doing it.
-
@mehdi said in What's coming in 4.5:
I'm intrigued with "Per-app backup format." I have no idea what it could mean ^^
We are trying to figure a solution on how to backup & restore the large amounts of data people store in nextcloud style apps. For most other apps, tgz format works just fine. But for nextcloud, people are storing upwards of 100G and we get a support request every 3-4 days about some backup/restore issue. This usually happens whenever we do a nextcloud update. One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain. If others have a better suggestions, would be good to hear them. We considered only backing up db and not the files but I am not sure what the value of this is. It's really hard to 'restore' from a partial backup.
Also, I'm not very clear on the firewall thing
Yes, all ports unless explicitly opened are blocked. A common feature request is to whitelist/blacklist IP/geoip blocks on apps. Another is to block specific pages from being (ab)used too quickly - like login pages. For example, maybe we can add hints in CloudronManifest.json to say
/login.phpis the URL or something. So, this is more an application firewall.@girish said in What's coming in 4.5:
One idea was maybe to let people choose rsync just for nextcloud (so per-app backup format). I prefer not to add options like this, it's too complex to explain.
I now support this too. rsync makes sense for some apps, but not for others.
-
Yes, I won't claim the web client is perfect, but basic also does not seem to be the right word for it.
@jdaviescoates said in What's coming in 4.5:
but nevertheless couldn't see any way of organising mail using virtual folders/ labels/ whatever you want to call them
You can do searches and "store" these to easily rerun them later. Its similar to how the the Outlook fat client is doing it.
@fbartels said in What's coming in 4.5:
Yes, I won't claim the web client is perfect, but basic also does not seem to be the right word for it.
When I went back to try the demo again it wasn't how I remembered it, so I think I was mis-remembering and confusing it with some other product/ suite I've demoed recently too
(either that or the demo changed quite a lot in the intervening period, but I think more likely the former)@fbartels said in What's coming in 4.5:
You can do searches and "store" these to easily rerun them later. Its similar to how the the Outlook fat client is doing it.
Ah, I see.
I haven't used Outlook anything since I started running Linux about 20 years ago!
I used to use Thunderbird with IMAP servers run by geeky friends (for free). But my friends never really got spam filtering in place (they had SpamAssassin installed, but it was never trained well enough - fair enough given they were offering a completely free service) and eventually spam drove me to Gmail (I was getting about 1000 a day!).
But I (and many many others) now expect to be able to very simply add labels to emails in order to easily organise them into virtual folders. Given the domination of Gmail it surprises me that more open source webmail projects don't try to more to clone more of some of Gmail's "basic" features. I guess it's just a matter of lack of resources in the open source world
-
Group-/sub- admin accounts remain high on my list and I certainly look forward to seeing that in 4.5. Overall, this is a really good list of features that is clearly being developed and prioritized with a lot of weight to community feedback, which I think deserves some major applause!
-
Group-/sub- admin accounts remain high on my list and I certainly look forward to seeing that in 4.5. Overall, this is a really good list of features that is clearly being developed and prioritized with a lot of weight to community feedback, which I think deserves some major applause!
@jimcavoli Agree, here here! 3 cheers for Cloudron devs!
-
@girish said in What's coming in 4.5:
Roundcube got a facelift recently, check it out!
I have. Nice, but I can't live without virtual folders/ label based folders/ saved searches/ whatever you want to call them.
I note, however, that "Virtual folders (aka saved searches)" are one of their planned features, so hopefully they'll be available sooner rather than later!
Edit: I'd also really miss being able to search my Email like I can search Gmail, e.g. in:sent has:attachment etc - so I guess Mail fts search would be big a step in that direction?
@jdaviescoates said in What's coming in 4.5:
@girish said in What's coming in 4.5:
Roundcube got a facelift recently, check it out!
I have. Nice, but I can't live without virtual folders/ label based folders/ saved searches/ whatever you want to call them.
I note, however, that "Virtual folders (aka saved searches)" are one of their planned features, so hopefully they'll be available sooner rather than later!
There's a new Roundcube Plugin available for message labels:
https://plugins.roundcube.net/packages/kreapptivo/message_label
https://github.com/kreapptivo/message_labelIntroduction
This is plugin for roundcube to add labels like Google labels.
- manually and filter way add labels
- manually remove filter find labels
- multilabels support
- drag and drop to add label support
- remove label on one click on label in subject
- search all labels in all folder on one click (manual select folder search on filter search label)
- display label list on left panel under folder list*
-
@jdaviescoates said in What's coming in 4.5:
@girish said in What's coming in 4.5:
Roundcube got a facelift recently, check it out!
I have. Nice, but I can't live without virtual folders/ label based folders/ saved searches/ whatever you want to call them.
I note, however, that "Virtual folders (aka saved searches)" are one of their planned features, so hopefully they'll be available sooner rather than later!
There's a new Roundcube Plugin available for message labels:
https://plugins.roundcube.net/packages/kreapptivo/message_label
https://github.com/kreapptivo/message_labelIntroduction
This is plugin for roundcube to add labels like Google labels.
- manually and filter way add labels
- manually remove filter find labels
- multilabels support
- drag and drop to add label support
- remove label on one click on label in subject
- search all labels in all folder on one click (manual select folder search on filter search label)
- display label list on left panel under folder list*
@necrevistonnezr excellent, will have to try out, thanks!
-
For the coming weeks, our focus is simply to get more of the apps out. bitwardern/jitsi/matrix etc are in various states and we want to get those out asap.
We are working on some ideas on the Cloudron side:
- Mail fts search - This will be optional since the dovecot+solr integration takes a lot of memory.
- Mail server queue and reports - This is just a UI to get an insight into what emails are incoming and outgoing on the mail server
- Mail spam controls - This will tackle the popular "Spams are still getting through" reports
- CPU resource allocation - Currently, you can control memory per app. This will allow you to control the CPU allocation as well.
- Firewall API
- This will allow setting up basic application firewall rules. This is not clear yet but we will build on top of modsecurity/fail2ban potentially.
- For email, this will have whitelist/blacklist
- Backup - listing, download and remove API and UI (for box and the apps).
- Per-app backup format.
- Group admins - The idea here is to create "sub admins" who can invite users but cannot control server level settings like backups.
- Whitelabel the footer/404
- App specific passwords
BTW, if you have comments/suggestions, feel free to open a thread in the Discuss section or comment here for any clarification
@girish said in What's coming in 4.5:
Per-app backup format.
This didn't seem to make it into "4.5" aka 5.0 nor yet into 5.1.1 - hoping it's still on the roadmap?
Would love to be able to use rsync for e.g. Nextcloud and Surfer (where I'd like to upload many GBs of mostly PDFs) whilst continuing to use tgz for most other apps.
-
@jdaviescoates Won't make it to 5.1, we have to revisit this for 5.2. Currently, we just want to get the video meet apps out + bitwarden.
@girish said in What's coming in 4.5:
Won't make it to 5.1, we have to revisit this for 5.2.
No worries.
@girish said in What's coming in 4.5:
Currently, we just want to get the video meet apps out + bitwarden.
Excellent plan, sounds good to me
