Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

Troubleshooting
Research
Professional Opinions
Ask a Question
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE

troubleshooting Question

Best way to find needle in a haystack for large number of similar records

Avatar of DanielAttard
DanielAttardFlag for Canada asked on
PHPAJAXjQuery
3 Comments1 Solution541 ViewsLast Modified:
I am looking for some guidance as to what would be the most ideal method to code this particular search that I will describe below.  Here are the some of the details of the search functionality that I am trying to accomplish:

- my goal is to locate a unique 15-digit number among, amount 5 million uniques;
- search box allows numbers only;
- search box should require a minimum number of digits before searching;

Here is a sample of what the data looks like:

190410020030100
190410020030200
190410020030300
190410020041000
190410020042000

Currently, I am using a blend of Ajax, PHP and jQuery autocomplete to achieve some other search functionality on my page.  Everything is working fine because the data involves smaller numbers of fairly distinct records.  Now, however, I am dealing with a massive amount of highly similar records.  For example, until the user enters 13 of the 15 required digits, there would be too many records retrieved by the search to be able to display them meaningfully to the user.

Does anyone have any ideas to share?  Thanks.

UPDATE:  The comments here seem relevant to this question:
http://forum.jquery.com/topic/jquery-ui-autocomplete-plugin-very-large-dataset
ASKER CERTIFIED SOLUTION
Avatar of EMB01
EMB01Flag of United States of America image

Our community of experts have been thoroughly vetted for their expertise and industry experience.

Commented:
This problem has been solved!
Unlock 1 Answer and 3 Comments.
See Answers