<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0"><channel><title><![CDATA[External source for robots.txt]]></title><description><![CDATA[<p dir="auto">Hi!</p>
<p dir="auto">I would love to be able to enter a git repository or an URL to a file which are pulled regularly to manage my robots.txt</p>
<p dir="auto">It is a little bit pain to update every running app when there is a new crawler which need to be blocked. I maintain a repository for myself but need to copypaste manually into cloudron.</p>
<p dir="auto">Bonus would be if you could merge two external files to one robots.txt</p>
<p dir="auto">Thanks for considering this <img src="https://forum.cloudron.io/assets/plugins/nodebb-plugin-emoji/emoji/android/1f642.png?v=c34f2a691b3" class="not-responsive emoji emoji-android emoji--slightly_smiling_face" style="height:23px;width:auto;vertical-align:middle" title=":)" alt="🙂" /></p>
]]></description><link>https://forum.cloudron.io/topic/12219/external-source-for-robots-txt</link><generator>RSS for Node</generator><lastBuildDate>Mon, 20 Apr 2026 15:46:46 GMT</lastBuildDate><atom:link href="https://forum.cloudron.io/topic/12219.rss" rel="self" type="application/rss+xml"/><pubDate>Mon, 05 Aug 2024 06:55:44 GMT</pubDate><ttl>60</ttl></channel></rss>