Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A possible pragmatic solution would be to track the site and spot ownership changes and freeze the robots.txt when it happens.

Reliable ownership change detection can be tricky though, but it's doable IMHO.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: