Link to home
Start Free TrialLog in
Avatar of piotrmikula108
piotrmikula108Flag for United States of America

asked on

How to remove Google, Bing and Yahoo cached pages

We had a website that search engines were able to index some of the content that was supposed be private only, so we had to use IIS-Mod-Rewrite tool to block some of them. So the links are not accessible now but the cached version are still there. How do I go about requesting to clear the cache from at least Google, Bing and Yahoo but still having them index the public websites

Thank you
ASKER CERTIFIED SOLUTION
Avatar of Dave Baldwin
Dave Baldwin
Flag of United States of America image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
If it is meant to be private, put it behind a password, otherwise it will end up on the web anyway as there are so many bots that scrape content.

For cache removal you will also probably have to block folders in robots.txt as well so they can see that is a wildcard, whereas htaccess they can't.
Avatar of cwiedmann
cwiedmann

Have you tried surrounding those lines with <Directory /> and </Directory>?  I think that should make all other directories inherit the configuration.