I have a robots.txt file in one of my sharepoint sites.
I want it to allow only google and sharepoint itself to crawl this site.
I have a
at the top and
at the bottom.
The last part supposedly stops the sharepoint crawl as well as the other
Does anybody know how to allow only
Google and sharepoint in your robots.txt file.