Want to protect your cyber security and still get fast solutions? Ask a secure question today.Go Premium

x
?
Solved

What is proper architecture for my website (1000+ concurrent users)

Posted on 2007-03-22
14
Medium Priority
?
377 Views
Last Modified: 2013-12-24
I have a social networking site with 100000 members and around 1000 concurrent users.

I am looking for architecture recomendations as my servers keep crashing.

The site is build in Coldfusion 7 and MS SQL (all sql is in stored procedures).

4 Windows 2003 servers.
One is for the db and has 2 procs with 4gigs ram.
Two web servers with 2 procs and 2 gigs ram
One server that stores and serves the members photos (this in particular gets really slow) Same specs as web servers.

Would this be an issue of IIS 6? Can it be the application pool? Web garden?

Please let me know what do you think is the proper architecture for this site. Keep in mind the traffic is increasing by 3-5% daily, so i need room for growth.

Thanks
0
Comment
Question by:Tsoukias
  • 7
  • 5
  • 2
14 Comments
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18773439
How many requests per second is the image server handling and are the image files local to that server or is it pulling them from a different location?

Not likely to be an issue with IIS - more likely a bandwidth problem.

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18773547
I have been surprised by the traffic increase and I'm saying this because I will have to ask some novice questions.

How do I check the per second requests of the image server?

PS. The image files are local to the server yes.

Thanks
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18773645
One way is to look at the w3svc logs and count the number of requests that are handled in one second, although this wouldn't account for spikes and drops in the requests if you picked a slow/busy time.

Best bet would be to use PerfMon - under the Web Service object is a counter "Get Requests/sec" that would probably do the trick.  If you go this route track the "Bytes Sent/sec" as well so we can tell how much data you're pushing out.

Dave Dietz

 
0
Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 

Author Comment

by:Tsoukias
ID: 18773724
Dave, as I am doing what you mentioned last, i just want to also note that the effect i get is the X box when the image cannot be found. After a long wait they load.

Another note here is that as the images are not loaded the progress bar of the browser does not complete.

Thanks
0
 

Author Comment

by:Tsoukias
ID: 18773878
First finding is that something called Avg. Disk Queue Length is always 100% (its scale is 100.000 - dont know what all this means just giving you more info)

Get Requests/sec:
Maximum: 142.636
Avg: 95.512

Bytes Sent/sec
Maximum: 3595918.812
Avg: 324645.648

Third finding is that
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18774102
How fast is the network connection of the web server and how fast is your pipe to the internet?

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18774229
Sorry for this, but how can i check these two things? My host is aplus.net.
0
 
LVL 34

Expert Comment

by:Dave_Dietz
ID: 18777833
If you have remote access to the servers you can simply look at the network adapter to see how fast it's local area connection is.

You might need to contact your hoster to see what your available bandwidth is.  It is possible that they may be capping your bandwidth at a level that isn't high enough for the traffic you are serving.

Dave Dietz
0
 

Expert Comment

by:rbbrownlee
ID: 18780537
What server is crashing?  
Is it freezing up or is is restarting automatically?
Is it the Web Server or is it the SQL server?
0
 

Author Comment

by:Tsoukias
ID: 18792680
Dave, I found out that I am on 100mb, and that there are no restrictions from them (although it might be a lie, its what they told me).

Its doing it again atm http://www.fatsa.gr/new_members.cfm while the rest of the site is loading very fast.

its killing my traffic, what can i do? help!! :(
0
 

Author Comment

by:Tsoukias
ID: 18794169
this is my hosts findings:

I have checked into your server and as the previous technician said I have confirmed, your server is essentially running out of memory. The process jrun.exe which is associated with coldfusion is using up a large amount of memory forcing your server to start using the windows pagefile. Now the pagefile is being used and the hardrive is being used so much that the hardrive write queue gets filled up to 100% and ccauses a really severe bottleneck on the server.

Do you agree it can be this? The server has 2gb ram currenctly
0
 

Expert Comment

by:rbbrownlee
ID: 18795039
Hi Dave,
I have found our server to occasionally do the same thing.  

Do you use this server for any PDF generation?  

Is the photo server behind a firewall?

The combination of these two things can cause the jrun.exe file to run out of control if you are not careful.

0
 
LVL 34

Accepted Solution

by:
Dave_Dietz earned 2000 total points
ID: 18798031
There have been documented memory leaks in jrun in the past - what version of jrun are you using?

Dave Dietz
0
 

Author Comment

by:Tsoukias
ID: 18801346
I am using 1.4.2_11 which is the latest one officially supported by Coldfusion. Adobe (macromedia)

leaks such as?
0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Lync server 2013 or Skype for business Backup Service Error ID 4049 – After File Share Migration
Meet the world's only “Transparent Cloud™” from Superb Internet Corporation. Now, you can experience firsthand a cloud platform that consistently outperforms Amazon Web Services (AWS), IBM’s Softlayer, and Microsoft’s Azure when it comes to CPU and …
In this video, Percona Director of Solution Engineering Jon Tobin discusses the function and features of Percona Server for MongoDB. How Percona can help Percona can help you determine if Percona Server for MongoDB is the right solution for …
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB. To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses

564 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question