Solved

Just how much can an apache server handle with only direct requests (no php/mysql etc)?

Posted on 2006-07-06
6
263 Views
Last Modified: 2010-04-26
I want to separate out our user photo storage to a dedicated server (or servers).  This new server will only run linux/apache 2 and host all jpg files.  The question I have is where will the bottleneck come first?  The disk drives, processing power, or bandwidth?  The files are stored in a hashed directory scheme so they can be spread out over multiple servers easily using DNS (and also to keep the number of files in a directory small).

I was thinking of the following possible scenarios:
Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage

Poweredge 1850 with Dual 2.8GHz Xeon, with direct attached SCSI PowerVault NAS, 14x36G 15K SCSI U320 drives in RAID 5 configuration for a total for 332G storage

Four Poweredge 1650s Dual 1.4GHz with 3x36 10K U160 in Raid 5 for a total of 285GB storage (with all 4 servers combined)

It will need to serve up about 16 million jpg files ranging in size from 8K to 70K at the rate of about 1600 per secound.

So just how much storage can I can get on a server under this kind of load without overloading the seek rate/throughput on the disk drives?
Thanks.
0
Comment
Question by:burnsj2
6 Comments
 
LVL 5

Expert Comment

by:enfz
ID: 17048995
This depends on the PCI bus being used, will you be using 32bit/64bit/33MHz/66MHz?? Having so many drives will probably saturate the bus, depending on which one you have. Also the RAID controller, make sure you can add memory to improve the caching. Another important factor is the stripe/cluster size of your RAID setup, as since they are images..you have to optimise the size to best match up with the image sizes.

eg. PCI 32bit 33MHz Bushas the bandwidth of around 133MB/sec, while most modern drives can have a sustained speed of around 40 - 50MB/sec. So take that into consideration as well.
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17049115
These servers would use a Perc 4I/Di Raid card 256MB cache, using a 64bit PCI slot
0
 
LVL 2

Accepted Solution

by:
monkeyjr earned 500 total points
ID: 17049132
In this case the bottleneck will appear in bandwidth, disk drivers or RAM size.

In most cases the bottleneck will fall on storage devices. Check is your RAID card using PCI X or not. (This is the fastest PCI bus as I know)

Also for serving web services, RAM size should also consider, as the web server will serve one connection by one instant, means more connections to the server, more web instant copies create on your server.

For most corrective answer, you'd better to run system analysis tools to analysis which device is the slowest part for your server.
0
 

Expert Comment

by:hardwared
ID: 17049231
I find Dell & Linux sometimes just dont mix , especially allot of the Raid Adapters ...

Make sure that if your are getting bundled Raid Soloution(s) in your Server(s) from Dell
 
Ensure you check Google and Manufactures Website about Stable / Mature Driver Support ...

(unlike Dell PowerEdge 2650's /w Adaptec AACRaid  ---> http://lkml.org/lkml/2005/1/6/76 )


Good Fast Ram is a Must ... try get really high quality low latecny ecc memory  e.g.   Corsair  

But in your case that may not work with a Dell Manufactured Mainboard.  Either way get plenty of it.

Depending on how much Space you actually need  Vs  Cost , something like a Apple XServRaid or

something equivilent with SCSI 360 15K RPM Drives and  FibreChannel Connectivity that is external.


AMD Opteron's Are Certainly Very Powerfull and may even give you overall better Performace with there

HyperTransport and Defently Highspeed Interconnect Architechture. Very Low Latency Memory Controller  =)

And not to mention you can most likley would get a better deal with another brand rather than Dell in that case.

Maybee even Design & Build your own using SuperMicro or Tyan Mainboards /w AMD Opteron Dual Core CPU's  


Either way i would like to see how you go ...  


Cyas
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17214412
Turns out that its quite a bit.  The disk drives will be the limitation.  

Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage will be enough.

When using a server that only needs to serve simple requests thttpd has a signifcant performance boost over apache so we are going to try that as well.
0

Featured Post

New! My Passport Wireless Pro Wi-Fi Mobile Storage

Portable wireless storage to offload, edit, and stream anywhere.

High-capacity, wireless mobile storage designed to accompany professional photographers and videographers in the field to easily offload, edit and stream captured photos and high-definition videos.

Join & Write a Comment

Suggested Solutions

Upper back Pain: My back hurt for months. Upper back, mostly my neck, spine and across my shoulder blades. I was getting headaches too, that felt like they were caused by tension in my shoulders, but now I feel fine! I'm sharing this hoping someone…
We recently endured a series of broadcast storms that caused our ISP to shut us down for brief periods of time. After going through a multitude of tests, we determined that the issue was related to Intel NIC drivers on some new HP desktop computers …
It is a freely distributed piece of software for such tasks as photo retouching, image composition and image authoring. It works on many operating systems, in many languages.
Access reports are powerful and flexible. Learn how to create a query and then a grouped report using the wizard. Modify the report design after the wizard is done to make it look better. There will be another video to explain how to put the final p…

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

24 Experts available now in Live!

Get 1:1 Help Now