Solved

Google unable to index certain (javascript generated) Dynamic pages

Posted on 2004-08-31
8
196 Views
Last Modified: 2010-04-06
Hi,
I use JavaScript to return values from a database to a number of web pages.  The problem is that these pages (and only these pages) do not get indexed by google due to their dynamic nature.  I was wondering what the best solution would be to enabling these pages to be indexed (and still returning certain content from the database).  Cheers,
        everton690
0
Comment
Question by:everton690
  • 3
  • 3
8 Comments
 
LVL 2

Expert Comment

by:Epistemo
ID: 11948058
Google 1 on 1 ...

Javascript generated links wont work ... they just don't.
But you can create an archived link section or have links to the main section within the main page.

Create a stylesheet and put the following style in there.

h1 {display: none;}

Then right after the <body> tag start your page by adding
<h1> put all you links in here. and some info about the site.</h1>

Browsers won't see this at all, yet Google will see this and spiders the links.
Make sure you have at least a little logic in your url's and tada ... within a few weeks you'll see that your site is there with multiple sections.
Another tip ... name your pages! So don't use a generic header without modifying the title.

And ... submit to Google only once if you have a small site ... It will then pick up your site from it's database ....
One more thing. Google does not crawl your whole site in one time ... it keeps coming back to spider more content on a regular basis.

Larger sites that are linked from here and beyond ... don't even bother to submit. Google will pick you up from the links.
The more links towards your site ... the higher the ranking of your site. There are other factors, yet this is the most common one.

Laters and good luck.

Epistemo -> works with stand alone Google Search Appliance.
0
 

Author Comment

by:everton690
ID: 11950122
Cheers Epistemo,
Thamks for the tips.  However I think you misunderstood me slightly.  The links to the pages themselves are not generated by javascript, it is the content on the pages that is returned from the database.  I was wondering if there is any simply way to return results from the database and enable google to see them.  For example we have a page with called 'publications' that contains the names of over 100 people and links to their publications.  From time to time this publications list is updated.  This information is stored in a database and we use javascript to return it to our webpage.  The page basically only contains these names and links (to pdf files etc).  Google is aware of the page but does not index it because of the dynamic nature of its content.  Is it possible to enable google to see these results returned from the database?  Can this be done through some means similar to the method mentioned above (or is there a method for creating a dynamic page and then converting it to a static page) ?.        
 
0
 
LVL 2

Expert Comment

by:Epistemo
ID: 11950218
Only if you can display the links through server side coding.
Googlebot can't read javascript.
You have an example page?
0
Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

 

Author Comment

by:everton690
ID: 11950302
0
 
LVL 2

Accepted Solution

by:
Epistemo earned 150 total points
ID: 11953538
First of all ... these links are not created through javascript on the clientside. So in theory you should not have a problem.
Yet I noticed you use a javascript to do the frames and the data of the actual page is not located on the AE: "http://www.hamilton.ie/people.htm"
because this page will pull it's self inside a frame set. So yes ... then Google can't run a bot and find you links.

You made basicly it to difficult for any robot to even find the links. So I guess your out of luck.
That is .... and what if ...

See the code?
<html>
<head>
<title>Hamilton Institute</title>
</head>

<script>
document.writeln("<frameset rows='36,511*' cols=* frameborder=NO>");
document.writeln("<frame src=navbar.htm name=navbar scrolling=NO frameborder=NO>");
document.writeln("<frameset cols='217,646*' rows=* bordercolor=#003366 frameborder=NO>");
document.writeln("<frame src=leftbar.htm name=leftbar frameborder=NO scrolling=no>");
document.writeln("<frame src="+location.search.substring(1)+'.htm'+" name=main>");
document.writeln(" </frameset></frameset><noframes><body></body></noframes>");
</script>

</html>

That is your frameset ....

What if you throw in the hidden div in here and start creating a list of links in this file?
Googlebot would see them then ...

0
 

Author Comment

by:everton690
ID: 11961658
Epistemo,
This seems like a reasonable solution to the problem.  Before I set about making the changes I would like to clarify the situation as my knowledge of javascrpt to date is limited at best (to be honest nill).  So when I insert the 'hidden div' into the code (after I have researched its function) would I in effect have to 'hard code' the names and links into the script or not?.  Thanks again.
                everton690.
                 
0
 
LVL 14

Assisted Solution

by:ziffgone
ziffgone earned 50 total points
ID: 11987409
Actually everton690, simply place a small static link on your main page: "Site Map". Have this link point to a single static page with links to all of your pages. The search engine bots will follow the site map link to your site map page and then follow each link from there, indexing the pages.

Hope that helps.

Regards...
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Shoutout to Emily Plummer (http://www.experts-exchange.com/members/eplummer26.html) for giving me this article! She did most of it, I just finished it up and posted it for her :)    Introduction In a previous article (http://www.experts-exchang…
Styling your websites can become very complex. Here I'll show how SASS can help you better organize, maintain and reuse your CSS code.
The viewer will learn how to count occurrences of each item in an array.
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.

867 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now