External source for robots.txt
-
Hi!
I would love to be able to enter a git repository or an URL to a file which are pulled regularly to manage my robots.txt
It is a little bit pain to update every running app when there is a new crawler which need to be blocked. I maintain a repository for myself but need to copypaste manually into cloudron.
Bonus would be if you could merge two external files to one robots.txt
Thanks for considering this