Posted on 2009-02-23
Last Modified: 2013-12-08
how can I visit a site and see exactly what googlebot sees

there is a robots.txt file that is hidden from regular users and visible to only googlebot
Question by:jerseyguy0
    LVL 3

    Accepted Solution

    Well, this tool is available if you'd like to view a page as a web robot. It's a pretty straight forward and easy tool to use.
    LVL 2

    Expert Comment

    you can point your browser to
    and see robots.txt content

    or download this add on to your firefox browser

    you will be able to see all the SEO info like nofollow,robots.txt,meta tags,...

    Featured Post

    Maximize Your Threat Intelligence Reporting

    Reporting is one of the most important and least talked about aspects of a world-class threat intelligence program. Here’s how to do it right.

    Join & Write a Comment

    Foreword (July, 2015) Since I first wrote this article, years ago, a great many more people have begun using the internet.  They are coming online from every part of the globe, learning, reading, shopping and spending money at an ever-increasing ra…
    Part of the Global Positioning System A geocode ( is the major subset of a GPS coordinate (, the other parts being the altitude and t…
    This video teaches users how to migrate an existing Wordpress website to a new domain.
    The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.

    754 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    21 Experts available now in Live!

    Get 1:1 Help Now