@james awesome, if you run out of pages and need a bump, let me know
I thought about open-sourcing the thing from the start, but after a bit of testing I realized how many websites are tunneling through services like Cloudflare - which would instantly block traffic from bots like this one.
It was quite an ordeal to get a "signed agent" approved by CF, but I managed to get that done eventually (wrong category, but hey, it's in there ). This means every request is signed with a special signature deriving from a host key in /.well-known/...
So you would either have a lot of self-hosted bots that can't do a lot or you would swamp Cloudflares bot directory - both not ideal, that's why I opted to keep it closed and offered a generous free tier instead. Revenue is not the priority, I wanted to get it out so people can have fun with it.
The runners idea is interesting though, currently they all share the same internal API key for auth between each other, that would probably require some fiddling around. Lets iron out all the kinks first and see where we go from there