Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

google listing

Posted on 2006-06-16
3
237 Views
Last Modified: 2012-05-05
On my website its showing the about.html in google before its showing the index html file. What can I do about this? i want the bots to crawl the whole site, but only list the index.
0
Comment
Question by:poweraddict
3 Comments
 
LVL 29

Accepted Solution

by:
fibo earned 50 total points
ID: 16920527
- check that your about.html has a link to index.html, so thta the bots will also spot this page
- the bots have no reason to crawl your site if they cannot index it; usually people are begging to be crawled and indexed...
- you may however restrict your site by using a robots.txt file see http://www.robotstxt.org/wc/robots.html
Experiment with using something like
  allow:index.html
  disallow:*
Not sure of the result, so I would probably test it using the testing facility of Google sitemaps, see below
- you can have SOM control over what Google indexes using sitemaps: if you do not have a gmail account, open one then go to https://www.google.com/webmasters/sitemaps/ and register
0
 
LVL 12

Expert Comment

by:ShaneJones
ID: 16921532
Submit a sitemap to the google sitemaps program

www.google.com/webmasters/sitemaps

This helps google spider your site because you tell it what pages are there.

ShaneJones
0
 
LVL 10

Expert Comment

by:desertcities
ID: 16931327
1. Look at both the HTML code for your about.html and index.html and see if there are any major differences like advertising code or flash that might be inhibiting the search engine spiders.  

2. As fibo suggested, make sure you have internal text links on all of your web pages linking to each other.  I'm not entirely sure if you mean your about.html page is being displayed when you search for your site: mysite.com ??

3. Make sure there is no meta refresh going from your index.html to your about.html or any other script that might be misdirecting the spiders and passing up your index.html page.

4. Check your robots.txt file and also make sure you have one along with a sitemap for Google.  A very good free online sitemap generator can be found here: <http://www.auditmypc.com/free-sitemap-generator.asp>

Mark
0

Featured Post

Active Directory Webinar

We all know we need to protect and secure our privileges, but where to start? Join Experts Exchange and ManageEngine on Tuesday, April 11, 2017 10:00 AM PDT to learn how to track and secure privileged users in Active Directory.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This code takes an Excel list of URL’s and adds a header titled “URL List”. It then searches through all URL’s in column “A”, looking for duplicates. When a duplicate is found, it is moved to the top of the list. The duplicate URL’s are then highlig…
In this blog, I will share you some basic tips for content marketing and to rank your website on Google.
Use Wufoo, an online form creation tool, to make powerful forms. Learn how to choose which pages of your form are visible to your users based on their inputs. The page rules feature provides you with an opportunity to create if:then statements for y…
Learn how to set-up custom confirmation messages to users who complete your Wufoo form. Include inputs from fields in your form, webpage redirects, and more with Wufoo’s confirmation options.

829 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question