How can I configure mysql server or design a solution to handle 1million concurrent connections

Hi all,
I have a project to design a solution for mysql 5.1 to handle up to 1million concurrent connections. Looking into mysql variable settings, I see that max_connections accept maximum value of 100000.

How can I set or design mysql to handle this concurrent connections?

Thanks
CCVOIPAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

ste5anSenior DeveloperCommented:
Don't know, where you have found that. But the maximum is 4G. See max_user_connections.

But I guess, you will run out of resources like memory long before reaching it.

Having this much concurrent connections, mean that you need 10 or 100 time more concurrent users in an application or website.

Pretty cool.

You should evaluate a cluster solution like Percona.
CCVOIPAuthor Commented:
What is the difference between max_connections and     max_user_connections.
ste5anSenior DeveloperCommented:
Interesting, seems to be a different limit value.

But I guess you will still run out of memory:

B.5.2.7 Too many connections

and as many as 10,000 connections if you have many gigabytes of RAM available and the workload from each is low or the response time target undemanding
Determine the Perfect Price for Your IT Services

Do you wonder if your IT business is truly profitable or if you should raise your prices? Learn how to calculate your overhead burden with our free interactive tool and use it to determine the right price for your IT services. Download your free eBook now!

madunix (Fadi SODAH)Chief Information Security Officer Commented:
You could check out Galera Cluster, MariaDB Galera Cluster and Percona XtraDB Cluster.
https://downloads.mariadb.org/mariadb-galera/
https://www.percona.com/software/percona-xtradb-cluster
http://galeracluster.com/products/
CCVOIPAuthor Commented:
this is a live project that I am working on and need to deliver a draft soon!!!

We will get up to 10M users and opting to up 1 million concurrent connections.
the application type is Video on Demand site with subscription
Now I have up to 5000 concurrent connections and we're launching a new app for a larger number of user. We're not considering cloud solution, we want first to see if we can scale out mysql to handle the load before considering any new technology .

Thank you.
ste5anSenior DeveloperCommented:
You should also ask one of the content delivery networks like Akamai.
gheistCommented:
Please use connection pooling in user-facing web application. Since most of million connections sit idle when users do not load pages that will rise the capacity 100x
e.g postgresql has server-side connection pool that does 100-folding via extra connection brokeron the SQL server.
CCVOIPAuthor Commented:
we're considering to split our schemata on multiple hosts depending on the load that each schema gets.
want to turn on a metrics on Mysql to measure how our current server is behaving and which schema gets more loads than other.

how can I do that?

thanks
gheistCommented:
scripts like mysqltuner.pl can help to get in control.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
MySQL Server

From novice to tech pro — start learning today.