Loading really large tables times out

Posted on 2004-09-08
Last Modified: 2010-04-06

I have a website that has some really large tables. When trying to load these really large tables sometimes the brouser timesout. To see an example go to, scroll down to Cesium_137_unfil and click on 13335.

Is there anything I can do in my code to prevent this from happening? The end user will not always know how to change any settings.

Question by:lorikellyr
  • 4
LVL 53

Accepted Solution

COBOLdinosaur earned 125 total points
ID: 12008027
I don't know why you would think a transfer of that much data would not result in some timeouts.  The application is not appropriate for a web page.  If you actually have to transfer that much data you should be putting it in a compressed .zip format and download the files.

There are three factors at play here contributing to the problem.  The number one problem is the size of the download.  I have a very fast connection and the download time is unacceptable.  Anyone using anything but a high speed connection is going to get some timeouts no matter what you do, unless you reduce the volume of the transfer. So you need to assess the design requirements to see what MUST be transfered what SHOULD be transfered and what is being transfered because it is there.

The second part of this is the database acquisition.  I can't see how the queries are written, but you should analyse those to see if there is any optimization possible.  This has to be using a huge number of cycles and memory on the server.

Finally the HTML.  Using that single large table is going to cause fits for some browsers, and some of the timeouts may be the result of low memory availablility so the cleint is doing a lot of swapping. All browsers have efficiency problems when rendering tables but the most commonly used browser, IE is the slowest. Breaking it up would help, but the setting of the background localy for every row is also going to slow it down, using CSS class, might impove it slightly.

If it was my task to get it working I would re-organize to reduce the granularity of such huge transfers.  I notice in the data that a very large number of rows will have may fields in common.  Such as the pdf link.  If you group on the common factors and download a list of summaries then the user can select a summary fo delivery of the detail.

In the end unless you reduce the number of rows returned, you are not going to get it significantly faster; there is just too much data being transfered to make it practical on a web page.

LVL 15

Expert Comment

ID: 12008922
I couldn't see the data but it might help if you just passed the data then used javascript to output the <tr>'s and <td>'s etc.
LVL 53

Expert Comment

ID: 12009783
If this was an intranet app you could use a hidden frame and block the data by using XMLHTTP GETs. That would let you do initial rendering for the first block of rows and then let you dynamically expand the table as additional blocks came in and the user would be able to start working as soon as the first block was loaded.  I'm not sure it would be practical across the Internet. User with a slow connection might ended up crashing instead of timeing out; from the look of the table code, the dynamic growing of the table would present some coding challenges.

Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.


Author Comment

ID: 12045587
I wanted to thank you for your responses. I had something big come up and am working on it. I just wanted to let you know I had not forgotten about this and I will get back to it as soon as possible.
LVL 53

Expert Comment

ID: 12049553
No problem.  Thanks for letting us know there will be a time lag. :^)

LVL 53

Expert Comment

ID: 12165440
Thanks for the A. :^)


Featured Post

What Is Threat Intelligence?

Threat intelligence is often discussed, but rarely understood. Starting with a precise definition, along with clear business goals, is essential.

Join & Write a Comment

When you work with shopping cart / ecommerce relates web sites, you need to pass the certain form post details to the payment gateway process page with required details for the products items you give to order. Also you may need to track the ordered…
Preface In the first article: A Better Website Login System ( I introduced the EE Collaborative Login System and its intended purpose. In this article I will discuss some of the design consideratio…
Viewers will learn about if statements in Java and their use The if statement: The condition required to create an if statement: Variations of if statements: An example using if statements:
The viewer will learn the benefit of using external CSS files and the relationship between class and ID selectors. Create your external css file by saving it as style.css then set up your style tags: (CODE) Reference the nav tag and set your prop…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now