Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people, just like you, are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
Solved

What is proper architecture for my website (1000+ concurrent users)

Posted on 2007-03-22
14
356 Views
Last Modified: 2013-12-24
I have a social networking site with 100000 members and around 1000 concurrent users.

I am looking for architecture recomendations as my servers keep crashing.

The site is build in Coldfusion 7 and MS SQL (all sql is in stored procedures).

4 Windows 2003 servers.
One is for the db and has 2 procs with 4gigs ram.
Two web servers with 2 procs and 2 gigs ram
One server that stores and serves the members photos (this in particular gets really slow) Same specs as web servers.

Would this be an issue of IIS 6? Can it be the application pool? Web garden?

Please let me know what do you think is the proper architecture for this site. Keep in mind the traffic is increasing by 3-5% daily, so i need room for growth.

Thanks
0
Comment
Question by:Tsoukias
  • 7
  • 5
  • 2
14 Comments
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18773439
How many requests per second is the image server handling and are the image files local to that server or is it pulling them from a different location?

Not likely to be an issue with IIS - more likely a bandwidth problem.

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18773547
I have been surprised by the traffic increase and I'm saying this because I will have to ask some novice questions.

How do I check the per second requests of the image server?

PS. The image files are local to the server yes.

Thanks
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18773645
One way is to look at the w3svc logs and count the number of requests that are handled in one second, although this wouldn't account for spikes and drops in the requests if you picked a slow/busy time.

Best bet would be to use PerfMon - under the Web Service object is a counter "Get Requests/sec" that would probably do the trick.  If you go this route track the "Bytes Sent/sec" as well so we can tell how much data you're pushing out.

Dave Dietz

 
0
NAS Cloud Backup Strategies

This article explains backup scenarios when using network storage. We review the so-called “3-2-1 strategy” and summarize the methods you can use to send NAS data to the cloud

 

Author Comment

by:Tsoukias
ID: 18773724
Dave, as I am doing what you mentioned last, i just want to also note that the effect i get is the X box when the image cannot be found. After a long wait they load.

Another note here is that as the images are not loaded the progress bar of the browser does not complete.

Thanks
0
 

Author Comment

by:Tsoukias
ID: 18773878
First finding is that something called Avg. Disk Queue Length is always 100% (its scale is 100.000 - dont know what all this means just giving you more info)

Get Requests/sec:
Maximum: 142.636
Avg: 95.512

Bytes Sent/sec
Maximum: 3595918.812
Avg: 324645.648

Third finding is that
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18774102
How fast is the network connection of the web server and how fast is your pipe to the internet?

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18774229
Sorry for this, but how can i check these two things? My host is aplus.net.
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18777833
If you have remote access to the servers you can simply look at the network adapter to see how fast it's local area connection is.

You might need to contact your hoster to see what your available bandwidth is.  It is possible that they may be capping your bandwidth at a level that isn't high enough for the traffic you are serving.

Dave Dietz
0
 

Expert Comment

by:rbbrownlee
ID: 18780537
What server is crashing?  
Is it freezing up or is is restarting automatically?
Is it the Web Server or is it the SQL server?
0
 

Author Comment

by:Tsoukias
ID: 18792680
Dave, I found out that I am on 100mb, and that there are no restrictions from them (although it might be a lie, its what they told me).

Its doing it again atm http://www.fatsa.gr/new_members.cfm while the rest of the site is loading very fast.

its killing my traffic, what can i do? help!! :(
0
 

Author Comment

by:Tsoukias
ID: 18794169
this is my hosts findings:

I have checked into your server and as the previous technician said I have confirmed, your server is essentially running out of memory. The process jrun.exe which is associated with coldfusion is using up a large amount of memory forcing your server to start using the windows pagefile. Now the pagefile is being used and the hardrive is being used so much that the hardrive write queue gets filled up to 100% and ccauses a really severe bottleneck on the server.

Do you agree it can be this? The server has 2gb ram currenctly
0
 

Expert Comment

by:rbbrownlee
ID: 18795039
Hi Dave,
I have found our server to occasionally do the same thing.  

Do you use this server for any PDF generation?  

Is the photo server behind a firewall?

The combination of these two things can cause the jrun.exe file to run out of control if you are not careful.

0
 
LVL 34

Accepted Solution

by:
Dave_Dietz earned 500 total points
ID: 18798031
There have been documented memory leaks in jrun in the past - what version of jrun are you using?

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18801346
I am using 1.4.2_11 which is the latest one officially supported by Coldfusion. Adobe (macromedia)

leaks such as?
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

this article is a guided solution for most of the common server issues in server hardware tasks we are facing in our routine job works. the topics in the following article covered are, 1) dell hardware raidlevel (Perc) 2) adding HDD 3) how t…
If you don't have the right permissions set for your WordPress location in IIS, you won't be able to perform automatic updates. Here's how to fix the problem.
Two types of users will appreciate AOMEI Backupper Pro: 1 - Those with PCIe drives (and haven't found cloning software that works on them). 2 - Those who want a fast clone of their boot drive (no re-boots needed) and it can clone your drive wh…

790 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question