googlebot

how can I visit a site and see exactly what googlebot sees

there is a robots.txt file that is hidden from regular users and visible to only googlebot
LVL 1
jerseyguy0Asked:
Who is Participating?
 
EarshelCommented:
Well, this tool is available if you'd like to view a page as a web robot. It's a pretty straight forward and easy tool to use.

http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/index.htm
0
 
parevkezCommented:
you can point your browser to http://www.anysite.com/robots.txt
and see robots.txt content

or download this add on to your firefox browser

http://www.quirk.biz/searchstatus/

you will be able to see all the SEO info like nofollow,robots.txt,meta tags,...
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.