using robots.txt on subdomain
How do I set up a robots.txt on a subdomain for Google, Bing, Yahoo? I set up the subdomain outside the htdocs folder. I'm on a Linux server. So where htdocs is set at:
/htdocs
I set the subdomain at:
/subdomain-test
Do I simply place the robots.txt at:
/subdomain-test
Thanks,
Vkimura
/htdocs
I set the subdomain at:
/subdomain-test
Do I simply place the robots.txt at:
/subdomain-test
Thanks,
Vkimura
You are correct, just place the robots.txt in the root folder of the subdomain and you are all set.
ASKER
Hi, thanks.
So do I use this code:
User-agent: *
Disallow: /
or this one:
User-agent: *
Disallow: /subdomain-test
So do I use this code:
User-agent: *
Disallow: /
or this one:
User-agent: *
Disallow: /subdomain-test
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
So could we use a path name like?
User-agent: *
Disallow: http://subdomain.testdomain.com/testpage.html
User-agent: *
Disallow: http://subdomain.testdomain.com/testpage.html
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Thanks, PortableTech. Yes, that makes sense. =)