Want to win a PS4? Go Premium and enter to win our High-Tech Treats giveaway. Enter to Win


Is it possible to block the google site from indexing my site while allowing Yahoo to do so.

Posted on 2004-10-31
Medium Priority
Last Modified: 2010-04-27
A little background.  It appears as though I've had a site banned from Yahoo.  The whole thing is very mysterious.  It is a good site, it does have affiliate links, but is content, information and article rich.  I have been able to get it into the Yahoo shopping directory without any problems.  It is also very popular in Google.  It has also had recommendations in articles and features on MSNmoney, CNNmoney, and CNBCTV.  I had been the victim of marketing .com that went out and made duplicate home pages of my sites and those pages were getting picked up by yahoo as well.  Since Yahoo does not allow mirror sites, I may have gotten in trouble for those duplicate pages even though I had nothing to do with them.  Fortunately, it appears as though that .com that made the duplicates has since themselves also been banned from the yahoo index, and they will hopefully not pose a problem to me or anyone else for a while.  But the damage is done.

Anyway, the potential reasons for the ban is not my question here, but rather I thought the background information would help explain my reason for this question.  Anyway the quesion here is ....

I'd like to create a duplicate site with a new url and IP and have that site picked up by
the Yahoo Search index.  The other one had placed high in the listings for over a year, so I suppose this one would too, eventually.

However, in the Google index it would be considered a duplicate to the one they are currently indexing and I do not want to get in trouble with Google too, so I do not want the new site in their index at all.

Is there a way to have this duplicate, yet new url, spidered/indexed  by Yahoo but not by Google.  If so what would be the html to do so and would this also protect me from google indexing via backlinks from other sites.  

The whole key is to avoid trouble with Google, while still getting a good site back into the Yahoo search index.

Thank you in advance for your consideration.
Question by:ontrackprofessionals
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
LVL 33

Assisted Solution

humeniuk earned 500 total points
ID: 12458736
First of all, I don't really agree with your approach.  I think it creates more problems than it resolves in addition to being a real hassle for you to manage.  If you have done everything properly and the problem has been resolved, things should return to normal eventually.

However, if this is what you would ike to do, you can use a robots.txt file to exclude Google.  You can see more details on how this works here: www.robotstxt.org/wc/norobots.html.  Essentially, what you have to do is save a text file called 'robots.txt' in the root directory of your website.  The contents should be as follows:

User-agent: Googlebot
Disallow: /

Another option would be to include the following meta tag on all pages of the website:
Of course, this is more labor intensive and in general robots.txt files are preferred because they are more widely accepted by SE crawlers, though Google claims to accept both.
LVL 24

Accepted Solution

duz earned 500 total points
ID: 12460644
ontrackprofessionals -

What you are thinking of doing is quite a common procedure after a Yahoo "ban".

1. Ensure the new domain has a completely different whois entry.

2. Host the domain on a server with a completely different IP block.

3. As well as Googlebot include other all the other popular bots like msn's in your robots.txt disallow list.

4. Do not submit the new domain to any search engines or directories.

5. Let Yahoo find the new domain naturally (buy a few links from sites crawled regularly by Yahoo).

6. Under no circumstances link to the new site from your existing site.

- duz
LVL 33

Expert Comment

ID: 12462766
<< What you are thinking of doing is quite a common procedure after a Yahoo "ban".  >>
If this is the case, and duz's word is enough to convince me that it is, then I withdraw my objection.  Tread carefully, though, and follow the instructions precisely to avoid problems.

Featured Post

Enhanced Intelligibility Without Cable Clutter

Challenge: The ESA office in Brussels wanted a reliable audio conference system for video conferences. Their requirement - No participant must be left out from the conference and the audio quality must not be compromised.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this blog, I will share you some basic tips for content marketing and to rank your website on Google.
Read on to get a few ideas on how to promote your next corporate event.
Viewers will get an overview of the benefits and risks of using Bitcoin to accept payments. What Bitcoin is: Legality: Risks: Benefits: Which businesses are best suited?: Other things you should know: How to get started:
This Micro Tutorial will demonstrate how to add subdomains to your content reports. This can be very importing in having a site with multiple subdomains.
Suggested Courses

610 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question