troubleshooting Question

Best way to find needle in a haystack for large number of similar records

Avatar of DanielAttard
DanielAttardFlag for Canada asked on
PHPAJAXjQuery
3 Comments2 Solutions541 ViewsLast Modified:
I am looking for some guidance as to what would be the most ideal method to code this particular search that I will describe below.  Here are the some of the details of the search functionality that I am trying to accomplish:

- my goal is to locate a unique 15-digit number among, amount 5 million uniques;
- search box allows numbers only;
- search box should require a minimum number of digits before searching;

Here is a sample of what the data looks like:

190410020030100
190410020030200
190410020030300
190410020041000
190410020042000

Currently, I am using a blend of Ajax, PHP and jQuery autocomplete to achieve some other search functionality on my page.  Everything is working fine because the data involves smaller numbers of fairly distinct records.  Now, however, I am dealing with a massive amount of highly similar records.  For example, until the user enters 13 of the 15 required digits, there would be too many records retrieved by the search to be able to display them meaningfully to the user.

Does anyone have any ideas to share?  Thanks.

UPDATE:  The comments here seem relevant to this question:
http://forum.jquery.com/topic/jquery-ui-autocomplete-plugin-very-large-dataset
ASKER CERTIFIED SOLUTION
EMB01

Our community of experts have been thoroughly vetted for their expertise and industry experience.

Join our community to see this answer!
Unlock 2 Answers and 3 Comments.
Start Free Trial
Learn from the best

Network and collaborate with thousands of CTOs, CISOs, and IT Pros rooting for you and your success.

Andrew Hancock - VMware vExpert
See if this solution works for you by signing up for a 7 day free trial.
Unlock 2 Answers and 3 Comments.
Try for 7 days

”The time we save is the biggest benefit of E-E to our team. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange.

-Mike Kapnisakis, Warner Bros