Solved

Just how much can an apache server handle with only direct requests (no php/mysql etc)?

Posted on 2006-07-06
6
264 Views
Last Modified: 2010-04-26
I want to separate out our user photo storage to a dedicated server (or servers).  This new server will only run linux/apache 2 and host all jpg files.  The question I have is where will the bottleneck come first?  The disk drives, processing power, or bandwidth?  The files are stored in a hashed directory scheme so they can be spread out over multiple servers easily using DNS (and also to keep the number of files in a directory small).

I was thinking of the following possible scenarios:
Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage

Poweredge 1850 with Dual 2.8GHz Xeon, with direct attached SCSI PowerVault NAS, 14x36G 15K SCSI U320 drives in RAID 5 configuration for a total for 332G storage

Four Poweredge 1650s Dual 1.4GHz with 3x36 10K U160 in Raid 5 for a total of 285GB storage (with all 4 servers combined)

It will need to serve up about 16 million jpg files ranging in size from 8K to 70K at the rate of about 1600 per secound.

So just how much storage can I can get on a server under this kind of load without overloading the seek rate/throughput on the disk drives?
Thanks.
0
Comment
Question by:burnsj2
6 Comments
 
LVL 5

Expert Comment

by:enfz
ID: 17048995
This depends on the PCI bus being used, will you be using 32bit/64bit/33MHz/66MHz?? Having so many drives will probably saturate the bus, depending on which one you have. Also the RAID controller, make sure you can add memory to improve the caching. Another important factor is the stripe/cluster size of your RAID setup, as since they are images..you have to optimise the size to best match up with the image sizes.

eg. PCI 32bit 33MHz Bushas the bandwidth of around 133MB/sec, while most modern drives can have a sustained speed of around 40 - 50MB/sec. So take that into consideration as well.
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17049115
These servers would use a Perc 4I/Di Raid card 256MB cache, using a 64bit PCI slot
0
 
LVL 2

Accepted Solution

by:
monkeyjr earned 500 total points
ID: 17049132
In this case the bottleneck will appear in bandwidth, disk drivers or RAM size.

In most cases the bottleneck will fall on storage devices. Check is your RAID card using PCI X or not. (This is the fastest PCI bus as I know)

Also for serving web services, RAM size should also consider, as the web server will serve one connection by one instant, means more connections to the server, more web instant copies create on your server.

For most corrective answer, you'd better to run system analysis tools to analysis which device is the slowest part for your server.
0
 

Expert Comment

by:hardwared
ID: 17049231
I find Dell & Linux sometimes just dont mix , especially allot of the Raid Adapters ...

Make sure that if your are getting bundled Raid Soloution(s) in your Server(s) from Dell
 
Ensure you check Google and Manufactures Website about Stable / Mature Driver Support ...

(unlike Dell PowerEdge 2650's /w Adaptec AACRaid  ---> http://lkml.org/lkml/2005/1/6/76 )


Good Fast Ram is a Must ... try get really high quality low latecny ecc memory  e.g.   Corsair  

But in your case that may not work with a Dell Manufactured Mainboard.  Either way get plenty of it.

Depending on how much Space you actually need  Vs  Cost , something like a Apple XServRaid or

something equivilent with SCSI 360 15K RPM Drives and  FibreChannel Connectivity that is external.


AMD Opteron's Are Certainly Very Powerfull and may even give you overall better Performace with there

HyperTransport and Defently Highspeed Interconnect Architechture. Very Low Latency Memory Controller  =)

And not to mention you can most likley would get a better deal with another brand rather than Dell in that case.

Maybee even Design & Build your own using SuperMicro or Tyan Mainboards /w AMD Opteron Dual Core CPU's  


Either way i would like to see how you go ...  


Cyas
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17214412
Turns out that its quite a bit.  The disk drives will be the limitation.  

Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage will be enough.

When using a server that only needs to serve simple requests thttpd has a signifcant performance boost over apache so we are going to try that as well.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In this article we have discussed the manual scenarios to recover data from Windows 10 through some backup and recovery tools which are offered by it.
What do we know about Legacy Video Conferencing? - Full IT support needed! - Complicated systems at outrageous prices! - Intense training required! Highfive believes we need to embrace a new alternative.
This Micro Tutorial hows how you can integrate  Mac OSX to a Windows Active Directory Domain. Apple has made it easy to allow users to bind their macs to a windows domain with relative ease. The following video show how to bind OSX Mavericks to …
Windows 10 is mostly good. However the one thing that annoys me is how many clicks you have to do to dial a VPN connection. You have to go to settings from the start menu, (2 clicks), Network and Internet (1 click), Click VPN (another click) then fi…

896 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now