Submit an article about your scariest tech experience—and the solution—and you’ll be automatically entered to win one of 4 fantastic tech gadgets.
Solved
Problems with large MySQL table using ORDER BY and LIMIT
Posted on 2010-09-23
I have a MySQL table that is pretty huge. There are 21 columns and (at this point) about 3 million rows. The interface I'm writing in C# to display data from this table will obviously need the ability to break results into pages. The way I was going to do this was using LIMIT. All results would be sorted by date. So the query for the first page would look like this:
SELECT * FROM BigTable ORDER BY ItemDate ASC LIMIT 0,250;
This takes forever though, because before it applies the limit it goes through and orders the entire table by the date field. So I'm not really sure how to speed this up and make it work efficiently. Any recommendations?
SELECT * FROM BigTable ORDER BY ItemDate ASC LIMIT 0,250;
This takes forever though, because before it applies the limit it goes through and orders the entire table by the date field. So I'm not really sure how to speed this up and make it work efficiently. Any recommendations?
[X]
Welcome to Experts Exchange
Add your voice to the tech community where 5M+ people just like you are talking about what matters.
- Help others & share knowledge
- Earn cash & points
- Learn & ask questions
2
3 Comments
Active today
Hi elorc,
There are a couple of ways. :)
Is there an Identity column on the table? That's an easy solution.
Is the ItemDate column indexed? Assuming so, try the code below.
Kent
There are a couple of ways. :)
Is there an Identity column on the table? That's an easy solution.
Is the ItemDate column indexed? Assuming so, try the code below.
Kent
SELECT *
FROM
(
SELECT ItemDate
FROM BigTable
ORDER BY ItemDate ASC
LIMIT 0,250
) t0
LEFT JOIN BigTable
ON t0.ItemDate = BigTable.ItemDate;
Featured Post
Question has a verified solution.
If you are experiencing a similar issue, please ask a related question
Real-time is more about the business, not the technology. In day-to-day life, to make real-time decisions like buying or investing, business needs the latest information(e.g. Gold Rate/Stock Rate). Unlike traditional days, you need not wait for a fe…
This post contains step-by-step instructions for setting up alerting in Percona Monitoring and Management (PMM) using Grafana.
- Software-Other
- Databases
- MySQL Server
- MongoDB
- NoSQL Databases
- Percona, *Monitoring tool
In this video, Percona Solution Engineer Rick Golba discuss how (and why) you implement high availability in a database environment.
To discuss how Percona Consulting can help with your design and architecture needs for your database and infrastr…
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB.
To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses
Course of the Month13 days, 9 hours left to enroll
656 members asked questions and received personalized solutions in the past 7 days.
Join the community of 500,000 technology professionals and ask your questions.