I've already done this. It's been three weeks and Google is still not indexing them.
Main Topics
Browse All TopicsIt has been three weeks since I used this service to create and post a Google Sitemap:
http://www.autositemap.com
I just updated the file this evening. It is located here:
http://www.n2trailhiking.c
Nonetheless, Google doesn't seem to be indexing my .asp and .aspx files. Can anyone tell me why?
Thanks,
BirdShooter
This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
From what I can tell, none of these have been indexed:
http://www.n2trailhiking.c
http://www.n2trailhiking.c
http://www.n2trailhiking.c
This seems to be the case for many of these database generated links. That's why I created the Google sitemap but from what I can tell it's not working. Any thoughts?
Your internal linking structure and your sitemap both make those pages available to Google, so they are working. As far as I can see, there is nothing blocking Google from crawling/indexing those pages. In fact, a number of HikePage.aspx?HikeID=x pages have been indexed, so you should be encouraged.
The other consideration, though, is that Google makes its own determination as to how deeply to crawl/index any given site. To a large degree, this depends on how much weight/importance Google gives your site and its pages. If you continue to add fresh content to the site and continue to promote your site (ie. your ongoing link-building campaign), you will probably find that those pages are indexed before too long.
User-agent: *
Disallow: /sitemap.xml
Disallow: /sitemap.php
Disallow: /premium.html
Why do you disallow sitemap.xml?
I took this from the goole sitemaps FAQ:
( https://www.google.com/web
Q: 10. How does Google treat pages that are both in the Sitemap and protected by a robots.txt file?
Google respects robots.txt for all pages, whether the protected files are found through crawling or through a submitted Sitemap. You can use the Sitemap Generator to create a complete mapping of all pages on your site and rely on robots.txt to care of specific exclusions.
So humeniuk, have I done my sitemap.xml correctly? I agree with your comments and the fact that maybe Google has chosen not to index that deeply. But I thought that was the entire point of the sitemap.xml file - to get these pages indexed in the first place. After a month, you'd think these pages would have been picked up even if they have a low PageRank.
Comment from humeniuk
Date: 09/26/2005 12:11PM EDT
I see this
User-agent: *
Disallow:
when I pull up this
http://www.n2trailhiking.c
http://www.autositemap.com
Hmmmm. Now I'm really confused. I used this website to build the sitemap.xml file:
http://www.autositemap.com
So where does the robots.txt file come from? It appears that autositemap is creating it too. Right? Why would autositemap create the sitemap.xml file and also deny it with the robots.txt file?
Thanks,
BirdShooter
When I pull up your robots.txt I see:
User-agent: *
Disallow: /sitemap.xml
Disallow: /sitemap.php
Disallow: /premium.html
That WOULD be a problem ... but I can't see it either. Where is it?
"So humeniuk, have I done my sitemap.xml correctly? I agree with your comments and the fact that maybe Google has chosen not to index that deeply. But I thought that was the entire point of the sitemap.xml file - to get these pages indexed in the first place. After a month, you'd think these pages would have been picked up even if they have a low PageRank."
It looks correct to me. In general you are correct, but with any large site (esp with similar dynamic URL's), Google will choose how deeply to index and then stop.
http://www.autositemap.com
That is the robots.txt file for www.autositemap.com, not your site.
looks to me as thought the http://www.n2trailhiking.c
Guys, that said does that take us back to the fact that the sitemap at
http://www.n2trailhiking.c
is done correctly, and I just need to wait for Google to index it?
Thanks,
That's right. But continue to add original content and build links (as here - http:#14960018). You're on the right track (and have made good progress), so just keep moving forward.
Business Accounts
Answer for Membership
by: mcse20002000Posted on 2005-09-26 at 00:55:35ID: 14956987
if u see the file it says that i will index those pages that were visited when thier script was inplace
make sure that thier script is on their pages , visit those pages and re generate your site map