Google SEO Index/URL/Sitemaps

Posted on 2011-04-22
Last Modified: 2013-11-18
Hi Experts,

Over a week ago I submitted my site map to google via webmaster tools and so far it has only indexed 2 of the 7 in my sitemap.  There are no messages or reported crawl errors.

Robots.txt doesn't exclude any of the submitted URLs or related folders.

Is there something that I should check to make sure my config isn't screwing up the googlebot?

Any tips?


Question by:HelpNearMe
    LVL 8

    Expert Comment

    by:Matthew Nguyen
    Well, first, sitemaps don't guarantee that your content/pages will be indexed.  All a sitemap does is tell Google which pages are available to be crawled, providing one doesn't make Google crawl your site faster, just tells Google how to crawl your site.

    With that said, sometimes you just have to be patient with it, sometimes sites can be indexed within days, sometimes week.  Some factors to consider to help Google crawl/index your site:

    1. Your site structure and if Googlebot can easily get to and crawl your pages

    2. If your pages are even crawlable (make sure your pages aren't restricted in the robots.txt file and/or meta tag is not set to noindex)

    3. Popularity of the site (links from other related sites will help this)

    Hope this helps


    Author Comment

    One thing that I have noticed is that the 2 URLS that are indexed only have one instance of an H2 tag.  The un-indexed pages have multiple H2 tags throughout the article body.  What do you think...could this cause a problem?


    LVL 8

    Accepted Solution

    No, how you set your H tags doesn't have anything to do with how Googlebot crawls/indexes your site.  Also, something to remember is that Google Webmaster Tools may not be completely accurate.  Go to Google and perform the search with the "Site:" parameter. (Example:  This search parameter will pull all pages that are indexed in Google, maybe that will give your different results.  The other thing is to make sure there is content (actual text) on the page that is unique and worthy to be indexed.  

    Note:  I set a blog/website for a friend of mine with about 20ish pages of content and it took a few weeks for Google to index the content, so sometimes it just takes time.  

    Author Closing Comment

    yep you are right, all of the pages appear to be indexed when I prefix the URL with 'site:' in a google search

    so I'll let it cook for a while and see what webmaster tools say in a couple weeks.



    Featured Post

    Threat Intelligence Starter Resources

    Integrating threat intelligence can be challenging, and not all companies are ready. These resources can help you build awareness and prepare for defense.

    Join & Write a Comment

    This story has been written with permission from the scammed victim, a valued client of mine – identity protected by request.
    Read about why website design really matters in today's demanding market.
    Viewers will get an overview of the benefits and risks of using Bitcoin to accept payments. What Bitcoin is: Legality: Risks: Benefits: Which businesses are best suited?: Other things you should know: How to get started:
    The viewer will learn how to count occurrences of each item in an array.

    755 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    21 Experts available now in Live!

    Get 1:1 Help Now