Hall of Fame

1. ushastry636,235
2. cxr572,263
3. angelIII501,679
4. Ray_Pas...375,707
5. nemws1271,196
6. mwvisa1208,698
7. racek206,543
8. snoyes_jw190,899
9. theGhost...186,004
10. routinet101,275
11. NerdsOfT...95,575
12. flob994,037
13. rrjegan1791,280
14. gamebits80,935
15. Sharath_...78,989
16. wuff1uk76,652
17. Kdo74,151
18. yodercm73,608
19. hielo68,404
20. mahome64,543
21. DanielWilson63,080
22. k_murli_...62,206
23. logudotcom57,167
24. leakim97156,339
25. oobayly56,124

1. angelIII2,759,519
2. todd_far...1,724,617
3. ushastry1,238,309
4. snoyes_jw956,407
5. cxr732,381
6. Raynard7704,144
7. hernst42623,649
8. Squeebee555,077
9. hielo550,290
10. Ray_Pas...538,898
11. leannonn537,683
12. routinet494,477
13. yodercm391,475
14. NovaDeni...389,149
15. racek387,674
16. psadac355,445
17. virmaior353,139
18. fibo345,039
19. akshah123330,218
20. AdrianSRU321,878
21. mankowitz321,286
22. nemws1271,196
23. theGhost...270,327
24. mwvisa1266,434
25. gamebits259,971

	[x] Posted via EE Mobile
	Search, ask, and monitor your questions on the go with EE Mobile. Visit Experts Exchange from your mobile device and never be out of touch again.

Question

	[x] Attachment Details

[x]

The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

The Grade of the Solution
The Zone Rank of the Expert Providing the Solution
The Number of Author and Expert Comments
The Number of Experts Contributing
The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

6.8

MySQL - 15 million rows or 300,000 tables : Which is a better choice?

Asked by 1_21gigawatts in MySQL Server

Tags: mysql, rows

I am working with a mysql database of stock market transactions. I currently have a table for each day's ticks. There are approximately 14 million ticls per day, hence each table has about 14 million rows.

I have indexes on SerialNumber (bigint unique) and Symbol (varchar 20).

Executing a simple query like
Select datetime FROM ticks WHERE symbol='ibm';
returns about 6000 rows, but can take up to 20 seconds to execute. Running the same query again executes almost instantly, suggesting that the results are buffered.

What can I do to make this faster?

I have considered separating the more active symbols into a separate database, or even using a table per symbol. This would almost certainly make the queries faster, but at the expense of having a huge number of tables - there are, including futures and options, some 300,000 symbols. Most of them have little or no data, but all of them have to be accomodated.

I suppose I could have a table with pointers to which table contains the actual data, only having entries for the more active issues which would be stored in separate tables. If a symbol doesn't have an entry in this index, then its data is stored in the main table.

I guess a question that needs to be answered is how many tables is too many tables?

This, by the way is running on Windows XP with a Raid 0 array. Core 2 Duo Processor, 2G ram, and the computer is not doing much other than running this database and collecting data from our service.

These are, by the way, MyISAM tables.

It just seems to me that this should run faster.

Any suggestions? And, while we're at it, would this work better in MS SQL server?

View the Solution FREE for 30 Days

MySQL - 15 million rows or 300,000 tables : Which is a better choice?

Asked by 1_21gigawatts in MySQL Server

Tags: mysql, rows

About this solution