Solved

Just how much can an apache server handle with only direct requests (no php/mysql etc)?

Posted on 2006-07-06
6
265 Views
Last Modified: 2010-04-26
I want to separate out our user photo storage to a dedicated server (or servers).  This new server will only run linux/apache 2 and host all jpg files.  The question I have is where will the bottleneck come first?  The disk drives, processing power, or bandwidth?  The files are stored in a hashed directory scheme so they can be spread out over multiple servers easily using DNS (and also to keep the number of files in a directory small).

I was thinking of the following possible scenarios:
Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage

Poweredge 1850 with Dual 2.8GHz Xeon, with direct attached SCSI PowerVault NAS, 14x36G 15K SCSI U320 drives in RAID 5 configuration for a total for 332G storage

Four Poweredge 1650s Dual 1.4GHz with 3x36 10K U160 in Raid 5 for a total of 285GB storage (with all 4 servers combined)

It will need to serve up about 16 million jpg files ranging in size from 8K to 70K at the rate of about 1600 per secound.

So just how much storage can I can get on a server under this kind of load without overloading the seek rate/throughput on the disk drives?
Thanks.
0
Comment
Question by:burnsj2
6 Comments
 
LVL 5

Expert Comment

by:enfz
ID: 17048995
This depends on the PCI bus being used, will you be using 32bit/64bit/33MHz/66MHz?? Having so many drives will probably saturate the bus, depending on which one you have. Also the RAID controller, make sure you can add memory to improve the caching. Another important factor is the stripe/cluster size of your RAID setup, as since they are images..you have to optimise the size to best match up with the image sizes.

eg. PCI 32bit 33MHz Bushas the bandwidth of around 133MB/sec, while most modern drives can have a sustained speed of around 40 - 50MB/sec. So take that into consideration as well.
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17049115
These servers would use a Perc 4I/Di Raid card 256MB cache, using a 64bit PCI slot
0
 
LVL 2

Accepted Solution

by:
monkeyjr earned 500 total points
ID: 17049132
In this case the bottleneck will appear in bandwidth, disk drivers or RAM size.

In most cases the bottleneck will fall on storage devices. Check is your RAID card using PCI X or not. (This is the fastest PCI bus as I know)

Also for serving web services, RAM size should also consider, as the web server will serve one connection by one instant, means more connections to the server, more web instant copies create on your server.

For most corrective answer, you'd better to run system analysis tools to analysis which device is the slowest part for your server.
0
 

Expert Comment

by:hardwared
ID: 17049231
I find Dell & Linux sometimes just dont mix , especially allot of the Raid Adapters ...

Make sure that if your are getting bundled Raid Soloution(s) in your Server(s) from Dell
 
Ensure you check Google and Manufactures Website about Stable / Mature Driver Support ...

(unlike Dell PowerEdge 2650's /w Adaptec AACRaid  ---> http://lkml.org/lkml/2005/1/6/76 )


Good Fast Ram is a Must ... try get really high quality low latecny ecc memory  e.g.   Corsair  

But in your case that may not work with a Dell Manufactured Mainboard.  Either way get plenty of it.

Depending on how much Space you actually need  Vs  Cost , something like a Apple XServRaid or

something equivilent with SCSI 360 15K RPM Drives and  FibreChannel Connectivity that is external.


AMD Opteron's Are Certainly Very Powerfull and may even give you overall better Performace with there

HyperTransport and Defently Highspeed Interconnect Architechture. Very Low Latency Memory Controller  =)

And not to mention you can most likley would get a better deal with another brand rather than Dell in that case.

Maybee even Design & Build your own using SuperMicro or Tyan Mainboards /w AMD Opteron Dual Core CPU's  


Either way i would like to see how you go ...  


Cyas
0
 
LVL 1

Author Comment

by:burnsj2
ID: 17214412
Turns out that its quite a bit.  The disk drives will be the limitation.  

Poweredge 2850 with Dual 2.8GHz Xeon, 6 x 73G 15K SCSI U320 drives in RAID 5 configuration for about 289G total storage will be enough.

When using a server that only needs to serve simple requests thttpd has a signifcant performance boost over apache so we are going to try that as well.
0

Featured Post

Simplifying Server Workload Migrations

This use case outlines the migration challenges that organizations face and how the Acronis AnyData Engine supports physical-to-physical (P2P), physical-to-virtual (P2V), virtual to physical (V2P), and cross-virtual (V2V) migration scenarios to address these challenges.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Thoroughly Clean Mac Pro Mid 2012 8 77
Mouse and Trackpad issue 6 45
Determine exact dimensions of screen 5 45
NCR Printer 7156 1 26
Is it worth it to buy an Echo? In a word, yes! For me it was definitely worth it. I use mine on a daily basis. Prologue & Privacy At first, I was very skeptical about the Amazon Echo. In general, I don't like voice assistants. I don't li…
In the modern office, employees tend to move around the workplace a lot more freely. Conferences, collaborative groups, flexible seating and working from home require a new level of mobility. Technology has not only changed the behavior and the expe…
This Micro Tutorial will teach you how to censor certain areas of your screen. The example in this video will show a little boy's face being blurred. This will be demonstrated using Adobe Premiere Pro CS6.
This video shows how to use Hyena, from SystemTools Software, to bulk import 100 user accounts from an external text file. View in 1080p for best video quality.

773 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question