search listing GOOGLE

Posted on 2003-02-27
Medium Priority
Last Modified: 2010-04-27
How long does it take for googlebot to get your site listed / indexed ?

The bot has been 4 (apparently) times but never gone further than the index page. The site is dynamicallty driven PHP = MySQL and I have been reading a lot of informatuion regarding OTHER bots not searching URL strings containing ? and  or &

Can anyone provide any help on this.

Greatly appreciated.

Question by:j1mlondon
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions

Accepted Solution

crosenblum earned 150 total points
ID: 8046867
For all the fastest information on Search Engine Optimization and google. It is best to go to http://www.webmasterworld.com

They are the world's best forum for experts in SEO and Search Engines to meet and discuss everything from Google, to Overture and all that.

Also searchenginewatch.com is a great resource as well.

Yes it depends, on a how many variables you have on the url.

There are ways around it depending on the web server you have, and your language.

The trend is to go away from index.php?x=2&y=3
towards index.php/x/2/y/3 or index.php/x=2/y=3
depends on the code used.

and how it can interact with the web server in terms of what data is available.


Expert Comment

ID: 8069752
Google will index page.php?argument quite well... But won't go into too much details for page.php?argument=something&another=whatever.

Example can be seen here (for my site):

I get that result only after clicking view all similar pages. So basically it proves that Google does cache dynamic pages very well, however it chokes on the more important pages with more than two arguments (eg.: file.php?arg1=something&arg2=whatever&arg3=stuff won't get indexed - 3 arguments).

A good way to still index your PHP pages with more than two arguments is to use mod_rewrite to simulate a static page to the client. Most hosts enable mod_rewrite.

Documentation on mod_rewrite can be obtained here:

Expert Comment

ID: 8142354
There are three popular methods for changing your URL's to help search engines which are all discussed at the following site:

Expert Comment

ID: 8200995
What I have once read, is that Google will not follow links from those dynamically generated pages. This is quite logical since Session-IDs and such stuff would cause an endless amount of pages.

Because of this I have one "non-dynamic" page as my start page (/index.html) which redirects normal browsers to the real start page via "meta"-command, javascript or (if both noth available) a click of the user. This page is rather small (about 1k) and does not affect normal users that much (anyway, they normally start at "subpages", coming from search engines - so that's okay). Normally you don't even see that page (check out http://www.4cheaters.de/index.html to see that). This page contains links to some other "hardcoded" pages. These are automatically generated every night and contain links to all dynamically generates subpages of my site (http://www.4cheaters.de/games.html - note that this page also contains the redirect, so don't really expect something else to show up ;).

These pages will not confuse any search engine (even if they try to access it with another Browser-ID (to find out if I'm spamming)) and they will redirect them to every subpage.

I'm quite successful with this.

Expert Comment

ID: 8403654
Hello Jim,

I have a site also that is written entirely with php and have looked up a lot of information on the subject. In regards to Google, the session id is the main issue from what I have found. You will find a lot of information in regards to rewriting the url string, but I have never done this myself and have never had a problem with Google crawling my entire site, which is only about 1,400 pages.

For a bigger example of this you might want to search google for phpbb.com, which is a php forum and the entire site is dynamic and the url is not rewritten. At google search for allinurl:phpbb.com and this will list all pages indexed by google. You will notice the results are over 19,000 pages, which would be more than most sites would ever need indexed. I would suggest looking into removing the session id's and seeing if that fixes the problem. An excellent resource I found was also on the phpbb site. It details how to allow sessions for regular users but exclude them for search bots. I use this framework to remove the id's from the other scripts I have running.

I hope this helps!

Featured Post

New feature and membership benefit!

New feature! Upgrade and increase expert visibility of your issues with Priority Questions.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Because your company can’t afford for you to make SEO mistakes, you’ll want to ensure you’re taking the right steps each and every time you post a new piece of content. This list of optimization do’s and don’ts can help you become an SEO wizard.
Online promotion is consistently becoming more important for all types of businesses. From Facebook ads to search engines to YouTube videos, there are all sorts of channels that can effectively be used to promote a business or product. But how shoul…
Learn how to set-up custom confirmation messages to users who complete your Wufoo form. Include inputs from fields in your form, webpage redirects, and more with Wufoo’s confirmation options.
Learn how to set-up PayPal payment integration in your Wufoo form. Allow your users to remit payment through PayPal upon completion of your online form. This is helpful for collecting membership payments, customer payments, donations, and more.
Suggested Courses
Course of the Month14 days, 7 hours left to enroll

770 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question