Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


    Cloudron Forum

    • Register
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular

    Mailpiler - self hosted email archive

    App Wishlist
    14
    75
    12450
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • girish
      girish Staff @vladimir.d last edited by

      @vladimir-d Oh, interesting. Don't think an app can ever expose port 25 since the mail server requires port 25. Do you know why it requires port 25? Maybe I don't understand how the archiver works. I though it's pulling in all email via IMAP? Or is it that we should redirect all mail to mailpiler?

      luckow 1 Reply Last reply Reply Quote 1
      • luckow
        luckow translator @girish last edited by

        @girish According to my understanding of a mail archive solution, every incoming and outgoing mail must be forwarded to the archive solution. This is the only way to fulfil the requirements of the law. https://en.wikipedia.org/wiki/Email_archiving
        The mailpiler docs tells us:
        Postfix
        Add the following to main.cf then issue the postfix reload command:

        always_bcc = uuid@smtp.example.com

        For historical mails there is the import option
        https://docs.google.com/document/d/15F0fyb07etMqEXRJnMZcYc016UN-WDds-6zrZNjF6aU/edit#heading=h.58uixy8guf9y

        https://docs.google.com/document/d/1YK7zVbcohFWf2w8BpYhCcsAY6Q61JKXa8pqUDrU7nn4/edit#

        Both docs are for the enterprise edition. But the oss edition has similar docs.
        https://www.mailpiler.org/wiki/current:installation

        Pronouns: he/him | Primary language: German

        timconsidine 1 Reply Last reply Reply Quote 2
        • timconsidine
          timconsidine App Dev @luckow last edited by

          @luckow this makes sense ... except I don't understand why an archive solution would need SMTP for sending. It just needs its own incoming email capability, and the always_bcc means it will get a copy of all inbound and outbound emails from the primary 'working' email server.
          But maybe (as is often the case) I am not understanding the full picture.

          luckow 1 Reply Last reply Reply Quote 0
          • luckow
            luckow translator @timconsidine last edited by

            @timconsidine as I understand it, the smtp port of the archive solution is only relevant for receiving the bcc mails. The user uses the "normal" (in this case the Cloudron) smtp server for sending emails via webmail or the local mail client. And Cloudron smtp forwards/sends any incoming or outgoing mail via smtp to the archive solution. That is the magic in my understanding 🙂

            Pronouns: he/him | Primary language: German

            timconsidine 1 Reply Last reply Reply Quote 0
            • timconsidine
              timconsidine App Dev @luckow last edited by

              @luckow thank you
              I just didn't know inbound can even be done via SMTP. Either my bad knowledge, or non-standard config.

              luckow 1 Reply Last reply Reply Quote 0
              • luckow
                luckow translator @timconsidine last edited by

                @timconsidine worth reading https://en.wikipedia.org/wiki/Simple_Mail_Transfer_Protocol 😉

                Pronouns: he/him | Primary language: German

                1 Reply Last reply Reply Quote 1
                • timconsidine
                  timconsidine App Dev @vladimir.d last edited by timconsidine

                  @vladimir-d whoop whoop ! 🍾
                  Just built, pushed and installed your updated package of Mailpiler.
                  All went smoothly.
                  Now I have to set it up and learn it.
                  Thank you so much ! 👍

                  marcusquinn 1 Reply Last reply Reply Quote 4
                  • marcusquinn
                    marcusquinn @timconsidine last edited by

                    @timconsidine Nice, more the merrier!

                    It's definitely another app that can help win mindshare for Cloudron as an enterprise considerate solution with this sort of auditing. Especially when it can be setup as a separate Cloudron instance too for further risk spreading.

                    We're not here for a long time - but we are here for a good time :)
                    Jersey/UK
                    Work & Ecommerce Advice: https://brandlight.org
                    Personal & Software Tips: https://marcusquinn.com

                    timconsidine 1 Reply Last reply Reply Quote 3
                    • timconsidine
                      timconsidine App Dev @marcusquinn last edited by

                      @marcusquinn agreed.
                      I totally agree. Have tried some archiving solutions previously and mailpiler looks nice.
                      But I having a "thick" morning :

                      • looking through app and their online docs, I can't what address emails should be BCC'ed to. Is it staring me in the face and I can't see it? Do I have to set it up ?

                      • importing from a server doesn't specify a port number to access IMAP on, so test connection always fails, and it doesn't specify SSL/STARTTLS

                      I'm embarrassed by these basic questions, but if someone can nudge me in the right direction, I'd appreciate it.

                      marcusquinn 1 Reply Last reply Reply Quote 1
                      • marcusquinn
                        marcusquinn @timconsidine last edited by

                        @timconsidine We haven't got to out setup and migration yet, working on 6 things at once, as always! Will bear in mind and answer when we do get to it.

                        We're not here for a long time - but we are here for a good time :)
                        Jersey/UK
                        Work & Ecommerce Advice: https://brandlight.org
                        Personal & Software Tips: https://marcusquinn.com

                        timconsidine 1 Reply Last reply Reply Quote 1
                        • timconsidine
                          timconsidine App Dev @marcusquinn last edited by

                          @marcusquinn no problem, stumbling through it
                          Testing some configs
                          Another Q for later : what is a "mapped domain" when setting up a domain? Can't find any references to it.
                          No rush.

                          1 Reply Last reply Reply Quote 0
                          • marcusquinn
                            marcusquinn last edited by

                            @jsuto You still with us here? Maybe someone can email him if the forum doesn't?

                            We're not here for a long time - but we are here for a good time :)
                            Jersey/UK
                            Work & Ecommerce Advice: https://brandlight.org
                            Personal & Software Tips: https://marcusquinn.com

                            necrevistonnezr 1 Reply Last reply Reply Quote 1
                            • necrevistonnezr
                              necrevistonnezr @marcusquinn last edited by

                              @marcusquinn
                              BTW does Mailpiler have any sort of compression? I recently tried to switch from the gold standard MailStore Home to another solution (in an attempt to ditch my Windows VM for good) - and my 30 GB MailStore Archive went up to 110 GB(!) in mbox files!

                              marcusquinn 1 Reply Last reply Reply Quote 1
                              • marcusquinn
                                marcusquinn @necrevistonnezr last edited by

                                @necrevistonnezr Don't know yet but will post some stats when I get to it. The project I have with it is for years of company email archives, so will have some good stats to compare from source to destination.

                                I might research file-system level deduplication, as I imagine there's a lot of duplicate files from email threads.

                                We're not here for a long time - but we are here for a good time :)
                                Jersey/UK
                                Work & Ecommerce Advice: https://brandlight.org
                                Personal & Software Tips: https://marcusquinn.com

                                necrevistonnezr 1 Reply Last reply Reply Quote 0
                                • M
                                  mazarian last edited by

                                  Just thought I'd chime in and say I'm very interested in a mail archive solution.

                                  1 Reply Last reply Reply Quote 4
                                  • Referenced by  luckow luckow 
                                  • necrevistonnezr
                                    necrevistonnezr @marcusquinn last edited by

                                    @marcusquinn said in Mailpiler - self hosted email archive:

                                    @necrevistonnezr Don't know yet but will post some stats when I get to it. The project I have with it is for years of company email archives, so will have some good stats to compare from source to destination.

                                    I might research file-system level deduplication, as I imagine there's a lot of duplicate files from email threads.

                                    Is this still in the works or in a beta stage to be installed?

                                    marcusquinn 1 Reply Last reply Reply Quote 1
                                    • Referenced by  necrevistonnezr necrevistonnezr 
                                    • marcusquinn
                                      marcusquinn @necrevistonnezr last edited by

                                      @necrevistonnezr Hey, we have it working, need to ask @vladimir-d to commit to Cloudron's GitLab and let the team verify it's good to go for App Store inclusion.

                                      We're not here for a long time - but we are here for a good time :)
                                      Jersey/UK
                                      Work & Ecommerce Advice: https://brandlight.org
                                      Personal & Software Tips: https://marcusquinn.com

                                      1 Reply Last reply Reply Quote 5
                                      • Referenced by  necrevistonnezr necrevistonnezr 
                                      • Referenced by  scooke scooke 
                                      • N
                                        Neiluj last edited by

                                        Hi all,
                                        I am wondering if we are far away from an addition of mailpiler to the Cloudron app repository. It would be of great help in a couple of the situation I am facing atm.
                                        @vladimir-d Maybe you have had the chance to commit the working app version to Clourdon's GitLab already

                                        If I can help (within the remit of my abilities) or contribute in making this happen, I would be happy to do so.

                                        1 Reply Last reply Reply Quote 4
                                        • girish
                                          girish Staff last edited by

                                          I am happy to include this if we have something basic going . @marcusquinn @vladimir-d do you have any initial work here ?

                                          vladimir.d 1 Reply Last reply Reply Quote 1
                                          • vladimir.d
                                            vladimir.d @girish last edited by vladimir.d

                                            @girish here is some initial work.
                                            https://git.cloudron.io/vladimir.d/mailpiler

                                            TBH I didn't have a chance to complete it yet, I think the issue described here still needs to be addressed.

                                            S 1 Reply Last reply Reply Quote 1
                                            • S
                                              savity @vladimir.d last edited by

                                              @vladimir-d Would be awesome to get this working... Since the LAW in austria and germany for this hase been activate now for i think 2 Years. That you need a Mail Archive where you can proof the Mail is not changed....

                                              https://www.bfdi.bund.de/DE/Buerger/Inhalte/Finanzen-Steuern/ABC_GoBD.html

                                              marcusquinn 1 Reply Last reply Reply Quote 1
                                              • marcusquinn
                                                marcusquinn @savity last edited by

                                                @savity As an alternative, you can achieve pretty-much the same thing with EspoCRM, as that will import emails to give you the same duplicate data in an alternative place.

                                                We're not here for a long time - but we are here for a good time :)
                                                Jersey/UK
                                                Work & Ecommerce Advice: https://brandlight.org
                                                Personal & Software Tips: https://marcusquinn.com

                                                necrevistonnezr S 2 Replies Last reply Reply Quote 1
                                                • necrevistonnezr
                                                  necrevistonnezr @marcusquinn last edited by

                                                  @marcusquinn said in Mailpiler - self hosted email archive:

                                                  @savity As an alternative, you can achieve pretty-much the same thing with EspoCRM, as that will import emails to give you the same duplicate data in an alternative place.

                                                  With full text search of mails and attachments? Can this be used for continuous backup?

                                                  marcusquinn 1 Reply Last reply Reply Quote 1
                                                  • marcusquinn
                                                    marcusquinn @necrevistonnezr last edited by marcusquinn

                                                    @necrevistonnezr full text search of emails, yes. Attachment searching I don't think so but it could be possible as we're using this full-time for 100+ users, so there's some value in us developing anything that isn't there. Sure, just add connection details and it will keep importing emails regardless of if you login or not.

                                                    We're not here for a long time - but we are here for a good time :)
                                                    Jersey/UK
                                                    Work & Ecommerce Advice: https://brandlight.org
                                                    Personal & Software Tips: https://marcusquinn.com

                                                    1 Reply Last reply Reply Quote 1
                                                    • S
                                                      savity @marcusquinn last edited by

                                                      @marcusquinn does it import automaticly ? have to check it

                                                      marcusquinn 1 Reply Last reply Reply Quote 0
                                                      • marcusquinn
                                                        marcusquinn @savity last edited by

                                                        @savity Yes, and it's already an Cloudron packaged and maintained app. I recommend it in many ways.

                                                        We also have Mailpiler packaged but not yet adopted by the Cloudron team, but have not pursued it further, since Espo is covering our needs.

                                                        We're not here for a long time - but we are here for a good time :)
                                                        Jersey/UK
                                                        Work & Ecommerce Advice: https://brandlight.org
                                                        Personal & Software Tips: https://marcusquinn.com

                                                        1 Reply Last reply Reply Quote 2
                                                        • jsuto
                                                          jsuto last edited by

                                                          Hello, I'm glad to see that there was an initial work adding piler to the app store.
                                                          I've got a request recently from a Cloudron user that he wanted to use piler archiving. Can you update me about the current status about this initiative? Whether it's still relevant, or you need some help from my side, etc.

                                                          1 Reply Last reply Reply Quote 3
                                                          • marcusquinn
                                                            marcusquinn last edited by

                                                            • https://git.cloudron.io/vladimir.d/mailpiler

                                                            It works for us, just need adopting by Cloudron with tests and app store inclusion.

                                                            We're not here for a long time - but we are here for a good time :)
                                                            Jersey/UK
                                                            Work & Ecommerce Advice: https://brandlight.org
                                                            Personal & Software Tips: https://marcusquinn.com

                                                            jsuto 1 Reply Last reply Reply Quote 2
                                                            • L
                                                              LoudLemur @jsuto last edited by

                                                              @jsuto Thanks for mailpiler. What is the password for the demo? This ought to be written somewhere... more obvious...

                                                              jsuto 1 Reply Last reply Reply Quote 0
                                                              • jsuto
                                                                jsuto @LoudLemur last edited by

                                                                @LoudLemur When you visit https://demo.mailpiler.com/ you may find several account in the username:password format, eg.

                                                                admin@local:pilerrocks
                                                                auditor@local:auditor
                                                                fedora@redhat.com:redhat
                                                                external@local:external

                                                                Let me know if you have any further questions.

                                                                1 Reply Last reply Reply Quote 1
                                                                • jsuto
                                                                  jsuto @marcusquinn last edited by

                                                                  @marcusquinn It's great news! Can you tell me whom should I contact to progress further?

                                                                  marcusquinn jdaviescoates 2 Replies Last reply Reply Quote 1
                                                                  • marcusquinn
                                                                    marcusquinn @jsuto last edited by marcusquinn

                                                                    @jsuto I think that'll be the @appdev Group for community assistance finishing this, or @girish if he's interested in adding it to the App Store.

                                                                    We're not here for a long time - but we are here for a good time :)
                                                                    Jersey/UK
                                                                    Work & Ecommerce Advice: https://brandlight.org
                                                                    Personal & Software Tips: https://marcusquinn.com

                                                                    girish 1 Reply Last reply Reply Quote 2
                                                                    • jdaviescoates
                                                                      jdaviescoates @jsuto last edited by

                                                                      @jsuto said in Mailpiler - self hosted email archive:

                                                                      @marcusquinn It's great news! Can you tell me whom should I contact to progress further?

                                                                      I guess @staff would just need to give you access to https://git.cloudron.io/vladimir.d/mailpiler

                                                                      I use Cloudron with Gandi & Hetzner

                                                                      1 Reply Last reply Reply Quote 0
                                                                      • girish
                                                                        girish Staff @marcusquinn last edited by

                                                                        @marcusquinn @vladimir-d I have missed this one. Shall I move this to cloudron namespace and publish as unstable?

                                                                        marcusquinn 1 Reply Last reply Reply Quote 3
                                                                        • marcusquinn
                                                                          marcusquinn @girish last edited by

                                                                          @girish Sure, it's relatively simple and appears to work as intended. Testing from others would help.

                                                                          We're not here for a long time - but we are here for a good time :)
                                                                          Jersey/UK
                                                                          Work & Ecommerce Advice: https://brandlight.org
                                                                          Personal & Software Tips: https://marcusquinn.com

                                                                          girish 1 Reply Last reply Reply Quote 3
                                                                          • girish
                                                                            girish Staff @marcusquinn last edited by

                                                                            @marcusquinn thanks, I can get this published. @vladimir-d can you please put a license?

                                                                            timconsidine vladimir.d M 3 Replies Last reply Reply Quote 6
                                                                            • timconsidine
                                                                              timconsidine App Dev @girish last edited by

                                                                              @girish yay ! Thank you.

                                                                              1 Reply Last reply Reply Quote 2
                                                                              • vladimir.d
                                                                                vladimir.d @girish last edited by

                                                                                @girish the License has been added to the repository.
                                                                                Please feel free to change anything if needed.

                                                                                1 Reply Last reply Reply Quote 7
                                                                                • Referenced by  necrevistonnezr necrevistonnezr 
                                                                                • M
                                                                                  m-si @girish last edited by

                                                                                  @girish First of of all, a huge thank you to all participants. This is huge step for seriuos mail providing especially in germany.... but, maybe I don't see the obvious. As it is published... am I able to install it via the appstore? Or do I have to use the cli route mentioned in vladimirs readme?

                                                                                  1 Reply Last reply Reply Quote 3
                                                                                  • L
                                                                                    LoudLemur @necrevistonnezr last edited by LoudLemur

                                                                                    @necrevistonnezr and @jsuto Thanks for this.

                                                                                    1. Mailpiler and ordinary people
                                                                                      Mailpiler seems needed for corporations but I wonder how it might be useful to an ordinary person who self-hosts their email instead of using a proprietary service?

                                                                                    The archiving there would be just leaving mail on the server and/or downloading your mail too and keeping it locally with something like Thunderbird.

                                                                                    1. Importing Dumps of Mail

                                                                                    Sometimes, people grow fedup with proprietary solutions for mail and want to migrate to a self-hosted solution. Services like e.g. Gmail allow you to dump your entire accounts email and save it offline. Is Mailpiler able to "one-click" import a dump like that, so we could search it easily offline?

                                                                                    Anyway, thanks for your help on logging in and being able to see how pretty the archived mail looks in Mailpiler. It was funny looking through the Broadcom wireless issues in the Fedora archive. 🙂 Why do they do it, really? Couldn't they just Free their drivers?!

                                                                                    M 1 Reply Last reply Reply Quote 1
                                                                                    • M
                                                                                      m-si @LoudLemur last edited by m-si

                                                                                      @LoudLemur in germany there is a legal requirement for almost all businesses according to different laws and regulations to archive without the user haveing the option to modify, delete…so before it get‘s in the inbox. Additionally you have to find mechanisms to not archive personal information due to regulations of the GDPR/DSGVO. Very hairy therefore a solution like mailpiler was developed…

                                                                                      Mailpiler is a software to archive not to backup so a different usecase

                                                                                      L 1 Reply Last reply Reply Quote 1
                                                                                      • L
                                                                                        LoudLemur @m-si last edited by

                                                                                        @m-si said in Mailpiler - self hosted email archive:

                                                                                        @LoudLemur in germany there is a legal requirement for almost all businesses according to different laws and regulations to archive without the user haveing the option to modify, delete…so before it get‘s in the inbox. Additionally you have to find mechanisms to not archive personal information due to regulations of the GDPR/DSGVO. Very hairy therefore a solution like mailpiler was developed…

                                                                                        Mailpiler is a software to archive not to backup so a different usecase

                                                                                        Wow! That is pretty much George Orwell / 1984 / Police State legislation right there. Was there much objection when it was being discussed/introduced?

                                                                                        necrevistonnezr M 2 Replies Last reply Reply Quote 0
                                                                                        • necrevistonnezr
                                                                                          necrevistonnezr @LoudLemur last edited by

                                                                                          @LoudLemur
                                                                                          @m-si was not very precise: There's a requirement for businesses to archive business-related letters, emails etc. for a certain time (usually 5 years, up to 10 years) - for compliance, tax, and audit reasons.

                                                                                          1 Reply Last reply Reply Quote 1
                                                                                          • M
                                                                                            m-si @LoudLemur last edited by m-si

                                                                                            @necrevistonnezr you are absolutely right. @LoudLemur as the same legislative rules already applied to the paper-based business communication for a long time before already... from the surveillance perspective you are right, but it is not the government but the business owners, that are collecting the information and need too anyway to fulfill the business. When I look from different angles on it, I even sort of can understand it.

                                                                                            • As a business owner it makes you safe in legal cases (HGB) or financial audits (AO, GoBD)...

                                                                                            • As an end-user/citizen I like the regulation because, that way it is a bit more difficult to mess around with taxes (I think taxes are fair as long as all of us pay them) and with the GDPR rules we in Europe are always able to ask for deletion, change and handing out of at least any personal information...

                                                                                            IMHO So there is as always a fine line between surveillance and the security/freedom we as a community deserve and rely on and in my eyes we as the technical enablers have to consult at that point wisely...

                                                                                            But I'm neither a judge nor a lawyer anyway

                                                                                            1 Reply Last reply Reply Quote 2
                                                                                            • First post
                                                                                              Last post
                                                                                            Powered by NodeBB