Solved

Databases now and in the future

Posted on 2011-09-17
7
546 Views
Last Modified: 2012-06-27
Dear all,

I'm working on a project that needs a solid base for future growth.
It's currently build in PHP with MySQL, its a very simple registration system in itself.
But we foresee large transactional load for the system, like a few million users doing one or more transactions per day.
The details of the transactions are not complex more like 40 or something items on a form.

Now what i know is that my current setup is not able to handle this profile and i need some information based on research or experience

How can a NoSQL database help me in this respect if at all?
How can a NewSQL Database help me in this respect if at all?
If I stay with the current solution how should i go about this?

I ask this because it looks like a NoSQL db is very attractive for my setup, every form could be a single complete item in the db instead of having it linked throughout the table set that marks a relational db. But i just have been looking on the surface and would like to have a few more informed opinions on this topic.

Thanks
Brian
0
Comment
Question by:bruintje
  • 3
7 Comments
 
LVL 82

Assisted Solution

by:Dave Baldwin
Dave Baldwin earned 375 total points
ID: 36554972
Here is a discussion of Wordpress for high traffic sites that addresses some of your concerns.  http://codex.wordpress.org/High_Traffic_Tips_For_WordPress
0
 
LVL 82

Assisted Solution

by:Dave Baldwin
Dave Baldwin earned 375 total points
ID: 36554976
Notice that they are talking about 100,000 hits a day and you're talking about 40 times that.  When you have that kind of traffic, you may need more servers in a well-connected data center, not a 'better' database.
0
 
LVL 44

Author Comment

by:bruintje
ID: 36555919
>>you may need more servers in a well-connected data center, not a 'better' database.

i read up a bit on the alternatives and high traffic low complexity databases

and yes i realize that we need more servers to spread the load, databases will be split up by group of users and run on their own server

i'm starting to believe that a nosql database are delivering to a specific need and it comes very close to the requirements we have

but then i still would like to know what kind of database and how to implement them on the hardware as we plan for our own servers it's easy to configure them per our requirements
0
 
LVL 82

Assisted Solution

by:Dave Baldwin
Dave Baldwin earned 375 total points
ID: 36555940
I looked up "NoSQL" and it describes a number of different databases and "NewSQL" is not a database but a scripting language to access existing databases.  You probably need to set up some test servers with some of the databases you're looking at.  You need to make sure you can get the interfaces running with the code you have.  Companies like Google have very large resources to create their own database systems.  Most others don't.
0
 
LVL 3

Accepted Solution

by:
Duboux earned 125 total points
ID: 36556573
You should first have a look at your code and db structure...
Usually this is the largest area wherein you can win on speed and saving resources.

Have as little queries as possible, optimize your queries, recheck your indexes.
Take a good look at queries that take longer than a second or half a second, and fix those issues.
Use MySql only for fetching and inserting data. Don't sort. Use PHP for all the rest.

If still needed, 2nd step could be "rsyncing" ur db with every insert/update/delete query (there's a general function/setting for this in MySql) on another server which u'll only use for selects for ur own.


If u're just talking abt inserting a 40 field form into a db, then there's not much to do for a MySql process...

U could also create "archive" tables... Duplicates of the table(s) u use, but with data that won't be used by the visitors, so u can keep ur live tables as small as possible, so your selection queries won't have to go through so many records.
0

Featured Post

What Should I Do With This Threat Intelligence?

Are you wondering if you actually need threat intelligence? The answer is yes. We explain the basics for creating useful threat intelligence.

Join & Write a Comment

SQL Command Tool comes with APEX under SQL Workshop. It helps us to make changes on the database directly using a graphical user interface. This helps us writing any SQL/ PLSQL queries and execute it on the database and we can create any database ob…
I annotated my article on ransomware somewhat extensively, but I keep adding new references and wanted to put a link to the reference library.  Despite all the reference tools I have on hand, it was not easy to find a way to do this easily. I finall…
Wufoo.com provides powerful tools for surveying targeted groups, and utilizing data from completed surveys to find trends, discover areas of demand or customer expectation, and make business decisions on products or services.
Learn how to set-up PayPal payment integration in your Wufoo form. Allow your users to remit payment through PayPal upon completion of your online form. This is helpful for collecting membership payments, customer payments, donations, and more.

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now