<![CDATA[v7.10.3 / 1.75.1 lost/erased all files from S3]]>I have Mattermost configured against SOS storage at Exoscale and all - all - my files get lost there.

As support didn't get back to me, I started googling and only found a known issue in that release in the focal boards: https://mattermost.atlassian.net/browse/MM-53240 - which seems to have a fix https://github.com/mattermost/focalboard/pull/4785/commits/8f97fedad7cb14a14a198f805fbf2602231e76bf

At the same time Mattermost lost connection to S3 and I can't bring it back.

I wonder if anyone has any related experience?
I'm not sure if it's happened exactly after update, it might be day before the update and I wouldn't expect update to remove all files from S3 bucket...

]]>https://forum.cloudron.io/topic/9465/v7-10-3-1-75-1-lost-erased-all-files-from-s3RSS for NodeTue, 16 Jun 2026 05:50:07 GMTThu, 22 Jun 2023 20:46:47 GMT60<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Mon, 26 Jun 2023 17:57:04 GMT]]>@scooke yes, the files were stored locally all of the time, despite my settings were quite opposite (S3)

]]>https://forum.cloudron.io/post/68998https://forum.cloudron.io/post/68998Mon, 26 Jun 2023 17:57:04 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 14:51:25 GMT]]>So, where did your files go?? They just stayed local, but appeared as remote?

]]>https://forum.cloudron.io/post/68820https://forum.cloudron.io/post/68820Fri, 23 Jun 2023 14:51:25 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 10:22:39 GMT]]>In my specific case, Exoscale's support was quite helpful - they checked the logs of the script that calculates the bucket size and they pointed out that the bucket was always empty.

After additional checks, I realized that Mattermost doesn't respect file's storage settings and doesn't upload files to s3, even if S3 connection works; I believe something goes wrong with using those settings which leads Mattermost to silently default to work with local storage. I understand it shall be reported upstream, but I have no capacity for that right now, so just leaving this note here for now - in case if someone will encounter this issue as well.

]]>https://forum.cloudron.io/post/68807https://forum.cloudron.io/post/68807Fri, 23 Jun 2023 10:22:39 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 07:23:52 GMT]]>@robi who cares about backups, right? 🙂
I would appreciate though if you could share (here or any other way) the providers names; not a problem if not, but I would feel better knowing what to avoid.

]]>https://forum.cloudron.io/post/68798https://forum.cloudron.io/post/68798Fri, 23 Jun 2023 07:23:52 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 05:43:15 GMT]]>@potemkin_ai nope just regular backups

]]>https://forum.cloudron.io/post/68794https://forum.cloudron.io/post/68794Fri, 23 Jun 2023 05:43:15 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 05:18:36 GMT]]>@robi I understand… 😕
Is it something you had with Mattermost as well? Or it was something completely different?

I’m just trying to figure out the dangerous use case.

@girish thank you! I did!

]]>https://forum.cloudron.io/post/68792https://forum.cloudron.io/post/68792Fri, 23 Jun 2023 05:18:36 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 01:17:57 GMT]]>I would also consider contacting Exoscale about it and asking them if they have any audit logs of who deleted the files. Maybe the originating IP and such.

]]>https://forum.cloudron.io/post/68788https://forum.cloudron.io/post/68788Fri, 23 Jun 2023 01:17:57 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Fri, 23 Jun 2023 00:50:42 GMT]]>@potemkin_ai nah, too much drama 🙂

]]>https://forum.cloudron.io/post/68787https://forum.cloudron.io/post/68787Fri, 23 Jun 2023 00:50:42 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Thu, 22 Jun 2023 21:38:54 GMT]]>@robi wtf😳 ?!
Could possibly share the providers names? And how on earth could it be that s3 content can get lost because of the version’s update?!

]]>https://forum.cloudron.io/post/68784https://forum.cloudron.io/post/68784Thu, 22 Jun 2023 21:38:54 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Thu, 22 Jun 2023 21:35:31 GMT]]>I had something similar happen at a different S3 provider, and after 2 months, the solution was to delete that bucket and create a new one, as their infrastructure has upgraded past the support for the original bucket code version, heh.

]]>https://forum.cloudron.io/post/68782https://forum.cloudron.io/post/68782Thu, 22 Jun 2023 21:35:31 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Thu, 22 Jun 2023 21:27:13 GMT]]>@girish both - the bucket is empty and S3 connection is broken.

Yeah - I don’t consider that could be Cloudron issue in any way - I’ve seen the only thing that’s changed on the packaging - it’s a patch version update.

Retention policy - not on Mattermost side, but I didn’t think of that, thanks for a new vector of thoughts!

]]>https://forum.cloudron.io/post/68781https://forum.cloudron.io/post/68781Thu, 22 Jun 2023 21:27:13 GMT<![CDATA[Reply to v7.10.3 / 1.75.1 lost/erased all files from S3 on Thu, 22 Jun 2023 21:05:50 GMT]]>Are the files removed from S3 itself? Or are the links just not working from mattermost ?

The cloudron package itself of course has no code to delete files. And that too it has no S3 access. Does mattermost have any S3 file retention settings? Just wondering why it would even have code to delete files.

]]>https://forum.cloudron.io/post/68780https://forum.cloudron.io/post/68780Thu, 22 Jun 2023 21:05:50 GMT