Solved

Robots.txt Exclude URL's

Posted on 2011-03-05
1
388 Views
Last Modified: 2012-05-11
I have links like this:

www.domain.com/add_cart.php?ID=5430

I want to keep these links from being included in anything that creates a sitemap and I want to keep Google from following them.  I tried to add the add_cart.php to the robots.txt but I'm still seeing them when I generate a site map. Would a no follow rule on the link work?
0
Comment
Question by:cstormer
1 Comment
 
LVL 4

Accepted Solution

by:
AlanNMMX earned 500 total points
ID: 35043959
Hi, you could add the following meta tag to the head section of the add_cart.php file. This would stop bots from indexing this page.
<meta name="robots" content="noindex" />

Open in new window

0

Featured Post

Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Although it can be difficult to imagine, someday your child will have a career of his or her own. He or she will likely start a family, buy a home and start having their own children. So, while being a kid is still extremely important, it’s also …
Any business that wants to seriously grow needs to keep the needs and desires of an international audience of their websites in mind. Making a website friendly to international users isn’t prohibitively expensive and can provide an incredible return…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Any person in technology especially those working for big companies should at least know about the basics of web accessibility. Believe it or not there are even laws in place that require businesses to provide such means for the disabled and aging p…

680 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question