Whitehouse.gov
Whitehouse.gov
Out of context: Reply #2
- Started
- Last post
- 7 Responses
- jamble0
I don't think you can hide robots.txt as it needs to be called that so search engines can read it and know what they're supposed to not index although I have my doubts as to how many respect it anyway.
If you've got folders on your server you don't want people/bots to see, you're probably better off ditching robots.txt anyway and just protecting them with a .htaccess file/password.
There's plenty of info via google about setting it up and this is a good starter.