Solved

vb.net - merge files

Posted on 2013-05-16
2
300 Views
Last Modified: 2013-05-30
Hello,
I have about 30 txt files, each file is about 5GB in size.
these text files are basically huge percause they are not compressed and they contains records line by line like this

name1560
name16598
name89865

I would like to know what would be the best approach to merge all these files into one?
0
Comment
Question by:XK8ER
2 Comments
 
LVL 69

Expert Comment

by:Éric Moreau
Comment Utility
to get a 15 gb file? isn't it too big?
0
 
LVL 15

Accepted Solution

by:
angus_young_acdc earned 500 total points
Comment Utility
That's going to be a massive file!  

Anyway what I would do is split the files down further so that any reads can manage the load.  Then, read each of the smaller files using a StreamReader and write the contents to a single file using StreamWriter (append true).  

It may struggle somewhat as it gets into the 10's of GB, but I've never had to create a text file so large so I can't confirm that.
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Suggested Solutions

Creating an analog clock UserControl seems fairly straight forward.  It is, after all, essentially just a circle with several lines in it!  Two common approaches for rendering an analog clock typically involve either manually calculating points with…
The ECB site provides FX rates for major currencies since its inception in 1999 in the form of an XML feed. The files have the following format (reducted for brevity) (CODE) There are three files available HERE (http://www.ecb.europa.eu/stats/exch…
Internet Business Fax to Email Made Easy - With eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, fr…
In this seventh video of the Xpdf series, we discuss and demonstrate the PDFfonts utility, which lists all the fonts used in a PDF file. It does this via a command line interface, making it suitable for use in programs, scripts, batch files — any pl…

763 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now