Add default setting for robots.txt

[ekevu123]

Every app has in its settings under Security a button called "Disable indexing".

I would suggest that Cloudron should include a setting in its general settings to "automatically disable indexing" for every newly installed app (assuming that changes will only be applied to all apps installed after that change or perhaps there is a separate setting to bulk-edit existing apps.

People might use Cloudron differently, but the majority of my apps is internal only, so wouldn't it make sense to make this a default setting for this use case, but optional, of course, so that others can make a different choice if needed?

[nebulon]

The default is actually to let the app handle this. If the setting is changed via the Cloudron dashboard, only then we basically overwrite whatever the app itself is serving up at /robots.txt

[micmc]

DON'T touch me websites /robot.txt lol

[ekevu123]

@nebulon said in Add default setting for robots.txt:

The default is actually to let the app handle this. If the setting is changed via the Cloudron dashboard, only then we basically overwrite whatever the app itself is serving up at /robots.txt

This sounds like there is a setting already to manage this centralised?

[jdaviescoates]

@ekevu123 said in Add default setting for robots.txt:

centralised

I think it's just on an app by app basis see https://docs.cloudron.io/apps/#robotstxt

[nebulon]

Yes there is no generic setting, but I was just explaining the default case for apps where the setting was not manually changed.