Link to home
Create AccountLog in
Avatar of NTGrE
NTGrE

asked on

Robot.txt

Hello.
I m trying to understand How robot.txt sould be ..
I n my casse i m using links like...
http://localhost/index.php?p=homebody <<<< My Home page
http://localhost/index.php?p=display&cid=2  <<<<One of my categories...cid can be from 1 to 9
http://localhost/index.php?p=display&cid=2&pid=98 <<< Item inside the category
http://localhost/index.php?p=loghead <<< My Log-in /Register/..etc..

How my robor txt sould be to allow index my first 3 lik examples BUT NOT my 4th(Login..etc..) ???
Thnx..
ASKER CERTIFIED SOLUTION
Avatar of hernst42
hernst42
Flag of Germany image

Link to home
membership
Create a free account to see this answer
Signing up is free and takes 30 seconds. No credit card required.
See answer
SOLUTION
Avatar of Kiran Paul VJ
Kiran Paul VJ
Flag of India image

Link to home
membership
Create a free account to see this answer
Signing up is free and takes 30 seconds. No credit card required.
Avatar of NTGrE
NTGrE

ASKER

Hmm..thnx both for your comments.
What if i set something like..
<meta name="robots" content="noindex,nofollow">
dynamicly depending of the page??
$page1 = $_GET['p'];

if ($page==loghead)
echo "<meta name=\"robots\" content=\"noindex,nofollow \"/>";

This will work????
hmm... that should work........
Avatar of NTGrE

ASKER

Thnx....
hi NTGrE,

thanks for the points.

these links may be useful to you
http://www.unimelb.edu.au/webcentre/topics/hide.html
http://www.seroundtable.com/archives/006993.html

kiranvj