Go Premium for a chance to win a PS4. Enter to Win

x
?
Solved

Will google index pages that are not linked within my website?

Posted on 2007-12-05
6
Medium Priority
?
527 Views
Last Modified: 2013-12-08
Hi- I am trying to improve SEO, but I've hit a roadblock on one issue. I have about thirty terms for which I added specific new pages. They are in a folder off the root called info_pages. They are not linked from any of my other web pages. In other words, I thought that the googlebot would search my site and see these pages, then index them along with the rest of my site.

But google hasn't indexed these pages. If I go to google.com and type in the url of one of the pages, I ge results not found. We've been indexed several times since I added these pages.

I added a sitemap today and included the URLS of those pages. Can anyone tell me if that will likely cause google to index those pages? (I know there are no certainties). Or do I actually need to add a link to each of those pages in my footer in order for them to be seen? Thanks!
0
Comment
Question by:mel200
  • 3
  • 2
6 Comments
 
LVL 29

Accepted Solution

by:
coreybryant earned 1400 total points
ID: 20413679
>>Can anyone tell me if that will likely cause google to index those pages? (
Yes it should.  You should also put:
Sitemap: http://www.example.com/sitemap.xml

in your robots.txt file so Yahoo, MSN and other search engines will find your XML sitemap.

-Corey
0
 

Author Comment

by:mel200
ID: 20413734
ah! Great idea, I'll add that. Thanks!  I only have exclusions in my robots.txt file-I'm not sure how to add it, can you advise?

E.G. I have:

User-agent: *
Disallow:   /buttons/
Disallow:   /CUSTOM/
Disallow:   /cgi/

etc.

0
 
LVL 1

Assisted Solution

by:speedyskis
speedyskis earned 600 total points
ID: 20414241
Yes it will and no, you do not need to link from any where in the site provided you have the links in the site map.

If you don't have one yet, go to google and sign up for webmaster tools.
http://www.google.com/accounts/NewAccount
then
www.google.com/webmasters/tools

Frm the dashboard, add your site. Be sure to have the URL you add match your XML file. The URL's should all have the WWW or not have www, just be consistent. You can also designate this preference permanently for indexing.  You'll see a link for site maps. After you upload it will tell you if there are any problems with the file too. Put it on your calendar to update 1X per month, and make sure you modify something in the body of your site and other pages so it sees the date change.

There is no need to put anything in the robots.txt file about what files to index, just what to block.
0
What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.

 

Author Closing Comment

by:mel200
ID: 31412912
thanks- I gave more points to coreybryant because it was the first answer- hope that's ok!
0
 
LVL 29

Expert Comment

by:coreybryant
ID: 20414598
See http://www.sitemaps.org/protocol.php#informing and http://blog.ask.com/2007/04/sitemaps_autodi.html re: adding adding the XML sitemap to your robots.txt - this will help some of the search engines to autodiscover the XML sitemap

-Corey
0
 

Author Comment

by:mel200
ID: 20414706
Thanks!
0

Featured Post

[Webinar] Cloud and Mobile-First Strategy

Maybe you’ve fully adopted the cloud since the beginning. Or maybe you started with on-prem resources but are pursuing a “cloud and mobile first” strategy. Getting to that end state has its challenges. Discover how to build out a 100% cloud and mobile IT strategy in this webinar.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Read on to get a few ideas on how to promote your next corporate event.
Read this article and get to know some best tips for outsourcing client PPC work to a white label PPC agency.
Any person in technology especially those working for big companies should at least know about the basics of web accessibility. Believe it or not there are even laws in place that require businesses to provide such means for the disabled and aging p…
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.
Suggested Courses

877 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question