How can I configure mysql server or design a solution to handle 1million concurrent connections

Hi all,
I have a project to design a solution for mysql 5.1 to handle up to 1million concurrent connections. Looking into mysql variable settings, I see that max_connections accept maximum value of 100000.

How can I set or design mysql to handle this concurrent connections?

Thanks
CCVOIPAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

ste5anSenior DeveloperCommented:
Don't know, where you have found that. But the maximum is 4G. See max_user_connections.

But I guess, you will run out of resources like memory long before reaching it.

Having this much concurrent connections, mean that you need 10 or 100 time more concurrent users in an application or website.

Pretty cool.

You should evaluate a cluster solution like Percona.
1
CCVOIPAuthor Commented:
What is the difference between max_connections and     max_user_connections.
0
ste5anSenior DeveloperCommented:
Interesting, seems to be a different limit value.

But I guess you will still run out of memory:

B.5.2.7 Too many connections

and as many as 10,000 connections if you have many gigabytes of RAM available and the workload from each is low or the response time target undemanding
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

madunixCommented:
You could check out Galera Cluster, MariaDB Galera Cluster and Percona XtraDB Cluster.
https://downloads.mariadb.org/mariadb-galera/
https://www.percona.com/software/percona-xtradb-cluster
http://galeracluster.com/products/
0
CCVOIPAuthor Commented:
this is a live project that I am working on and need to deliver a draft soon!!!

We will get up to 10M users and opting to up 1 million concurrent connections.
the application type is Video on Demand site with subscription
Now I have up to 5000 concurrent connections and we're launching a new app for a larger number of user. We're not considering cloud solution, we want first to see if we can scale out mysql to handle the load before considering any new technology .

Thank you.
0
ste5anSenior DeveloperCommented:
You should also ask one of the content delivery networks like Akamai.
0
gheistCommented:
Please use connection pooling in user-facing web application. Since most of million connections sit idle when users do not load pages that will rise the capacity 100x
e.g postgresql has server-side connection pool that does 100-folding via extra connection brokeron the SQL server.
1
CCVOIPAuthor Commented:
we're considering to split our schemata on multiple hosts depending on the load that each schema gets.
want to turn on a metrics on Mysql to measure how our current server is behaving and which schema gets more loads than other.

how can I do that?

thanks
0
gheistCommented:
scripts like mysqltuner.pl can help to get in control.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
MySQL Server

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.