<![CDATA[Shaarli app crashing constantly due to indexing bots (Yandex & co)]]>My Shaarli app on Cloudron has been crashing for the past hour, but it seems I'm unable to make use of iptables in the container nor configure apache rules to block those bots.
I've of course blocked the user-agent via the Security config of Shaarli but it does not seem enough.
How to mitigate this? I can't use Shaarli because of that or only for a couple seconds after restarting it. My Shaarli is a small instance.
Workarounds exist https://sublimecoding.com/blocking-bots-in-apache-using-htaccess/ or https://github.com/mitchellkrogza/apache-ultimate-bad-bot-blocker/blob/master/Apache_2.4/README.md but require access to the configuration (apache/.htaccess...).

Any idea? For now it's Shaarli, tomorrow it could be another web app on my instance, and I'm unsure to want to maintain my own block list and risk blocking myself by accident, even if that seem to be a viable solution? https://docs.cloudron.io/networking/#blocklist

How do you mitigate this kind of spam?

]]>https://forum.cloudron.io/topic/13233/shaarli-app-crashing-constantly-due-to-indexing-bots-yandex-coRSS for NodeWed, 13 May 2026 03:16:15 GMTMon, 03 Feb 2025 23:46:28 GMT60<![CDATA[Reply to Shaarli app crashing constantly due to indexing bots (Yandex & co) on Wed, 05 Feb 2025 08:56:10 GMT]]>@SansGuidon I guess I should have completely reread your initial post before dropping the link 😅

]]>https://forum.cloudron.io/post/101204https://forum.cloudron.io/post/101204Wed, 05 Feb 2025 08:56:10 GMT<![CDATA[Reply to Shaarli app crashing constantly due to indexing bots (Yandex & co) on Tue, 04 Feb 2025 18:02:40 GMT]]>@fbartels in that case that's good as it's the option I've already tried as mentioned at the end of original post. It took me a while to find about it's existence though because it's the first time I had to face such an spam on my instance, usually blocking user agents was enough 😜

]]>https://forum.cloudron.io/post/101191https://forum.cloudron.io/post/101191Tue, 04 Feb 2025 18:02:40 GMT<![CDATA[Reply to Shaarli app crashing constantly due to indexing bots (Yandex & co) on Tue, 04 Feb 2025 17:25:51 GMT]]>Maybe he meant https://docs.cloudron.io/networking/#blocklist instead

]]>https://forum.cloudron.io/post/101189https://forum.cloudron.io/post/101189Tue, 04 Feb 2025 17:25:51 GMT<![CDATA[Reply to Shaarli app crashing constantly due to indexing bots (Yandex & co) on Tue, 04 Feb 2025 17:15:26 GMT]]>@joseph thanks! how to make use of the linked change for my shaarli instance? I'm not fully grasping how they relate.

Regarding CF I'd prefer to avoid them, I'll never give them credit nor let their bloated modern firewall interfer with my stuff. They already ruin the web enough. So I prefer blocking by IP I guess.... 🤔🙏🏼

]]>https://forum.cloudron.io/post/101187https://forum.cloudron.io/post/101187Tue, 04 Feb 2025 17:15:26 GMT<![CDATA[Reply to Shaarli app crashing constantly due to indexing bots (Yandex & co) on Thu, 06 Feb 2025 17:34:45 GMT]]>If the bots are from fixed known IPs , then just block them using https://docs.cloudron.io/networking/#blocklist

If the bots are all over, then this is like a DDoS. You will need to use some service like cloudflare to counteract this.

edit: fixed link

]]>https://forum.cloudron.io/post/101180https://forum.cloudron.io/post/101180Thu, 06 Feb 2025 17:34:45 GMT