Querying a 16 GB Text File..
I have a text file that is 16 GB that I need to query against. I tried to link the file to an Access Database, but the database would not link to it, at least not for me. Is this too large for Access to query against, and if so, can someone help me with some other options? Thanks.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
As a long shot, try opening it in Excel 2007 or newer.
...Then filtering it.
If it is less than 1 million rows, you might have a shot...
...Then filtering it.
If it is less than 1 million rows, you might have a shot...
It might be helpful to know "what type of file" this 16Gb monster is. Perhaps there are other ways to assist that don't require sql?
e.g.TextAnalysisTool.NET
e.g.TextAnalysisTool.NET
ASKER
It is a text file..
:-) yes, most probably constructed from characters...
ok, not quite what I was seeking. How is the file generated? (e.g. is it some sort of log file)
Was it generated on a Linux machine? Windows?
What type of data does it contain e.g. "all rows have the same columns", or, "no 2 rows are the same layout", something in between)
basically more background on the file, its purpose, and what you intend to do with the contents of that file
ok, not quite what I was seeking. How is the file generated? (e.g. is it some sort of log file)
Was it generated on a Linux machine? Windows?
What type of data does it contain e.g. "all rows have the same columns", or, "no 2 rows are the same layout", something in between)
basically more background on the file, its purpose, and what you intend to do with the contents of that file
ASKER
Not sure I can answer your questions, but it is well structured. It is a tab-delimited text file. Probably generated on a Windows machine, but I am not sure. All records (rows) have the same columns. It is a transactional file.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
I understand. The data is historical, and will not change in the number of records. I actually have three files (different years) that are about 16 GB. Thanks.
ASKER
There is no real easy solution here, but your ideas were helpful.
ASKER
Thanks.
I would think that you should be able to read the file line by line using either basic text file file commands or maybe ADO code.