Solved

A Million Client Server

Posted on 2013-02-03
7
162 Views
Last Modified: 2013-02-13
I've managed sites that were hosted on a shared server, but now I'm launching a site that could conceivably have a million  clients, and I'm wondering the best way to host it.

It seems that I need some kind of a cloud solution, where I can just keep bringing in more servers as the load increases, without changing anything in my software.

Does anyone have any thoughts on this, and perhaps some suggestions for where I should host this? Maybe some books that are best in the field.

I certainly don't want to set up my own server.  The virtual hardware has to keep running, no matter what, and the database can never go away.  I can't worry about my dog pulling out the power cord when I'm not home.

Thanks for any ideas,
Steve
0
Comment
Question by:steva
  • 3
  • 2
  • 2
7 Comments
 
LVL 82

Accepted Solution

by:
Dave Baldwin earned 250 total points
Comment Utility
A million clients?  How many do you think would be trying to simultaneously access the site?

"without changing anything in my software."  No.

Realistically, you can't start at 1,000,000 clients.  If it were a really busy site, you would be talking 200 or more servers.  And that would fill some data centers.  And at that scale, the software has to change to share the load.

No, you have to start with something that works and let it pay it's way into becoming bigger.  Unless you have a whole lot more money than we thought...

For comparison, Facebook has about 180,000 servers to handle 900,000,000 users and Google has an estimated 2,000,000+ servers.  They have thousands of employees to keep things running and fix the code and make changes.
0
 

Author Comment

by:steva
Comment Utility
A million clients?  How many do you think would be trying to simultaneously access the site?
I don't know. By  "million" I mean "a really heavy load."   Other people doing what I'm about to do talk about  500,000+ clients.

"without changing anything in my software."  No.
Why should the server delivering my application care what my application does?   I know hosting providers have solutions that let you go to your control panel add CPUs and memory to your server - without changing your application.  It seems that this is, or could be, extended to multiple physical servers, with the load sharing handled automatically between the iron boxes - at the hosting provider.  There should be just one virtual server that grows as you check more boxes on a form.

Realistically, you can't start at 1,000,000 clients.
Of course.  I just want to make sure that I start with a solution that scales easily to a million.

For comparison, Facebook has about 180,000 servers to handle 900,000,000 users and Google has an estimated 2,000,000+ servers.
Interesting numbers.  Thanks
0
 
LVL 82

Expert Comment

by:Dave Baldwin
Comment Utility
As soon as you find that 'automagic' you're looking for, let the rest of us know because it just doesn't work that way for us.
0
Backup Your Microsoft Windows Server®

Backup all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

 
LVL 17

Assisted Solution

by:Dushan911
Dushan911 earned 250 total points
Comment Utility
- Web traffic and storage will handle from the hosting place.
- HTTP requests/responses will balance from the web server.
- HTTP requests/responses will call application server and load balancing should hadle from the web(php,asp,jsp)  programming level
- Application will call the database and database load balancing should handle via db.
0
 

Author Comment

by:steva
Comment Utility
Dushan,

So if I understand you, you're saying that it is indeed possible to find a hosting solution that can be scaled up to meet growing load, without me changing my application. Right?

But I know that this doesn't always happen.  I have sites now, for example, that are on a shared server (at Hostway) where something like twenty of us are locked in one server sharing the resources, and the busier the other 19 people get the longer I wait for service (or so it seems).

Could you perhaps recommend a couple of hosting providers that you like, that will scale well as my business grows? I'd like to stay with Apache.

Thanks,
Steve
0
 
LVL 17

Expert Comment

by:Dushan911
Comment Utility
No, large loads can not manage only with hosting. As I stated above you should consider application programming level(multi threading), DB level load balancing.
0
 

Author Comment

by:steva
Comment Utility
Multi threading my application would reduce the time it took to service a single client request.  I don't think I need to do that.  I'm happy with the time a request takes - once it's gets into the server, and as long as there aren't too many request from other web sites taking cycles from the CPU I'm running in.  So if I contract for a dedicated server then no one else is using it and now I'm happy with the service time for a request.  But with heavy loads the queues will grow and the queue time will kill me, i.e., the time each request sits in a queue waiting for service. So what I need is a hosting provider that will bring in another server when my queue exceeds some threshold, say 10.  With no queue longer than this I should be getting good service for all my requests no matter how many are coming in, though I may have a lot of servers.

Isn't this sort of arrangement available?
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Over the last year I have answered a couple of basic URL rewriting questions several times so I thought I might as well have a stab at: explaining the basics, providing a few useful links and consolidating some of the most common queries into a sing…
In Solr 4.0 it is possible to atomically (or partially) update individual fields in a document. This article will show the operations possible for atomic updating as well as setting up your Solr instance to be able to perform the actions. One major …
Excel styles will make formatting consistent and let you apply and change formatting faster. In this tutorial, you'll learn how to use Excel's built-in styles, how to modify styles, and how to create your own. You'll also learn how to use your custo…
Access reports are powerful and flexible. Learn how to create a query and then a grouped report using the wizard. Modify the report design after the wizard is done to make it look better. There will be another video to explain how to put the final p…

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now