Solved

Robots.txt Exclude URL's

Posted on 2011-03-05
1
390 Views
Last Modified: 2012-05-11
I have links like this:

www.domain.com/add_cart.php?ID=5430

I want to keep these links from being included in anything that creates a sitemap and I want to keep Google from following them.  I tried to add the add_cart.php to the robots.txt but I'm still seeing them when I generate a site map. Would a no follow rule on the link work?
0
Comment
Question by:cstormer
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
1 Comment
 
LVL 4

Accepted Solution

by:
AlanNMMX earned 500 total points
ID: 35043959
Hi, you could add the following meta tag to the head section of the add_cart.php file. This would stop bots from indexing this page.
<meta name="robots" content="noindex" />

Open in new window

0

Featured Post

Report: Liquid Web beats Amazon, Rackspace & More

A study by performance analyst firm Cloud Spectator finds that Liquid Web beats rivals Amazon, Rackspace and DigitalOcean when it comes to website and cloud application performance.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Google Tag Manager - Add Trigger Using Div class 22 98
MediaWiki - Move a site 4 55
help thx 6 34
PDF Turn Look 7 34
Because your company can’t afford for you to make SEO mistakes, you’ll want to ensure you’re taking the right steps each and every time you post a new piece of content. This list of optimization do’s and don’ts can help you become an SEO wizard.
This article will inform Clients about common and important expectations from the freelancers (Experts) who are looking at your Gig.
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
This tutorial demonstrates how to identify and create boundary or building outlines in Google Maps. In this example, I outline the boundaries of an enclosed skatepark within a community park.  Login to your Google Account, then  Google for "Google M…

732 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question