• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 341
  • Last Modified:

googlebot

how can I visit a site and see exactly what googlebot sees

there is a robots.txt file that is hidden from regular users and visible to only googlebot
0
jerseyguy0
Asked:
jerseyguy0
1 Solution
 
EarshelCommented:
Well, this tool is available if you'd like to view a page as a web robot. It's a pretty straight forward and easy tool to use.

http://www.smart-it-consulting.com/internet/google/googlebot-spoofer/index.htm
0
 
parevkezCommented:
you can point your browser to http://www.anysite.com/robots.txt
and see robots.txt content

or download this add on to your firefox browser

http://www.quirk.biz/searchstatus/

you will be able to see all the SEO info like nofollow,robots.txt,meta tags,...
0

Featured Post

What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now