Star79
asked on
Unsearchable in Google,Yahoo and Bing.
Hello All,
I need immediate help to ensure my website doesn't show up in Google,Yahoo and Bing. As i was googling i found robot.txt file which can help but anyone/any help will be highly appreciated.
Thanks,
Rithesh
I need immediate help to ensure my website doesn't show up in Google,Yahoo and Bing. As i was googling i found robot.txt file which can help but anyone/any help will be highly appreciated.
Thanks,
Rithesh
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
You can use 'robots.txt' to prevent your site from being indexed directly. But you can not prevent listings if they are coming from someone else's site.
The only way to positively ensure that your website won't be indexed is to ensure that it's URL cannot be found as a link in any other page... in other words, it needs to be hidden.
Yes, for search engines that play nice, robots.txt will work, but this assumes that the crawlers honor your no search request and not all of them will.
If you want to be hidden, switch to a domain/URL that has never been used before, better yet, an IP address. Only those people to whom you send the URL will be able to view.
Yes, for search engines that play nice, robots.txt will work, but this assumes that the crawlers honor your no search request and not all of them will.
If you want to be hidden, switch to a domain/URL that has never been used before, better yet, an IP address. Only those people to whom you send the URL will be able to view.
Instead of trying to hide the site, you could just password-protect the site.
ASKER
Thank you.
Just be aware that not all search engines honor the robots.txt file. Google may not index your URL but if another engine does, Google will find that index.