Solved

Will google index pages that are not linked within my website?

Posted on 2007-12-05
6
522 Views
Last Modified: 2013-12-08
Hi- I am trying to improve SEO, but I've hit a roadblock on one issue. I have about thirty terms for which I added specific new pages. They are in a folder off the root called info_pages. They are not linked from any of my other web pages. In other words, I thought that the googlebot would search my site and see these pages, then index them along with the rest of my site.

But google hasn't indexed these pages. If I go to google.com and type in the url of one of the pages, I ge results not found. We've been indexed several times since I added these pages.

I added a sitemap today and included the URLS of those pages. Can anyone tell me if that will likely cause google to index those pages? (I know there are no certainties). Or do I actually need to add a link to each of those pages in my footer in order for them to be seen? Thanks!
0
Comment
Question by:mel200
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 2
6 Comments
 
LVL 29

Accepted Solution

by:
coreybryant earned 350 total points
ID: 20413679
>>Can anyone tell me if that will likely cause google to index those pages? (
Yes it should.  You should also put:
Sitemap: http://www.example.com/sitemap.xml

in your robots.txt file so Yahoo, MSN and other search engines will find your XML sitemap.

-Corey
0
 

Author Comment

by:mel200
ID: 20413734
ah! Great idea, I'll add that. Thanks!  I only have exclusions in my robots.txt file-I'm not sure how to add it, can you advise?

E.G. I have:

User-agent: *
Disallow:   /buttons/
Disallow:   /CUSTOM/
Disallow:   /cgi/

etc.

0
 
LVL 1

Assisted Solution

by:speedyskis
speedyskis earned 150 total points
ID: 20414241
Yes it will and no, you do not need to link from any where in the site provided you have the links in the site map.

If you don't have one yet, go to google and sign up for webmaster tools.
http://www.google.com/accounts/NewAccount
then
www.google.com/webmasters/tools

Frm the dashboard, add your site. Be sure to have the URL you add match your XML file. The URL's should all have the WWW or not have www, just be consistent. You can also designate this preference permanently for indexing.  You'll see a link for site maps. After you upload it will tell you if there are any problems with the file too. Put it on your calendar to update 1X per month, and make sure you modify something in the body of your site and other pages so it sees the date change.

There is no need to put anything in the robots.txt file about what files to index, just what to block.
0
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

 

Author Closing Comment

by:mel200
ID: 31412912
thanks- I gave more points to coreybryant because it was the first answer- hope that's ok!
0
 
LVL 29

Expert Comment

by:coreybryant
ID: 20414598
See http://www.sitemaps.org/protocol.php#informing and http://blog.ask.com/2007/04/sitemaps_autodi.html re: adding adding the XML sitemap to your robots.txt - this will help some of the search engines to autodiscover the XML sitemap

-Corey
0
 

Author Comment

by:mel200
ID: 20414706
Thanks!
0

Featured Post

Resolve Critical IT Incidents Fast

If your data, services or processes become compromised, your organization can suffer damage in just minutes and how fast you communicate during a major IT incident is everything. Learn how to immediately identify incidents & best practices to resolve them quickly and effectively.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you don’t want your company's site to fail on the web, you’d do well to observe these best web design practices and make sure you implement them when applicable.
Because your company can’t afford for you to make SEO mistakes, you’ll want to ensure you’re taking the right steps each and every time you post a new piece of content. This list of optimization do’s and don’ts can help you become an SEO wizard.
An overview of how to create reports in Adobe Analytics (formerly Omniture Site Catalyst) using pageNames, events, eVars and props. This video will show you how to install the Omniture Debugger tool so can see (and test) what is being passed int…
Use Wufoo, an online form creation tool, to make powerful forms. Learn how to selectively show certain fields based on user input using rules to gather relevant information and data from your forms. The rules feature provides you with an opportunity…

740 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question