We help IT Professionals succeed at work.

Robot.txt

NTGrE
NTGrE asked
on
231 Views
Last Modified: 2008-04-24
Hello.
I m trying to understand How robot.txt sould be ..
I n my casse i m using links like...
http://localhost/index.php?p=homebody <<<< My Home page
http://localhost/index.php?p=display&cid=2  <<<<One of my categories...cid can be from 1 to 9
http://localhost/index.php?p=display&cid=2&pid=98 <<< Item inside the category
http://localhost/index.php?p=loghead <<< My Log-in /Register/..etc..

How my robor txt sould be to allow index my first 3 lik examples BUT NOT my 4th(Login..etc..) ???
Thnx..
Comment
Watch Question

Top Expert 2007
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
Kiran Paul VJComputer Engineer
CERTIFIED EXPERT
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION

Author

Commented:
Hmm..thnx both for your comments.
What if i set something like..
<meta name="robots" content="noindex,nofollow">
dynamicly depending of the page??
$page1 = $_GET['p'];

if ($page==loghead)
echo "<meta name=\"robots\" content=\"noindex,nofollow \"/>";

This will work????
Kiran Paul VJComputer Engineer
CERTIFIED EXPERT

Commented:
hmm... that should work........

Author

Commented:
Thnx....
Kiran Paul VJComputer Engineer
CERTIFIED EXPERT

Commented:
hi NTGrE,

thanks for the points.

these links may be useful to you
http://www.unimelb.edu.au/webcentre/topics/hide.html
http://www.seroundtable.com/archives/006993.html

kiranvj
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.