We help IT Professionals succeed at work.
Get Started

C# Read Large ASCII-based Data Files one row at a time.

680 Views
Last Modified: 2012-08-19
I have a sequential file, where a series of numbers, 1 per row, are about 250 digits long.

Each file has over 60,000 rows.  Some has over 120,000 rows.

Each row will look like this:
01234567889901397819837490187341908734190837419083741902837491087583458934  (this is a string).

What I need to do is read the file one row at a time, without overloading memory and processing power.  I will be processing the whole file at once.

I have the script to do with what it needs to do once I have it, but I need the best way on reading the file one row at a time without overloading memory.

I plan on splitting the row up into parts, then saving the parts into various tables and spreadsheets.

Any help would be greatly appreciated, thanks.
Comment
Watch Question
High School Computer Science, Computer Applications, Digital Design, and Mathematics Teacher
CERTIFIED EXPERT
Top Expert 2009
Commented:
This problem has been solved!
Unlock 1 Answer and 2 Comments.
See Answer
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE