Solved

Reading a text file into a DataTable

Posted on 2010-08-31
3
901 Views
Last Modified: 2012-05-10
What is the easiest way to LOAD a text file into a DataTable?  I have a windows form application that read in a comma delimited text file.  I want to load this text file into a datatable so what is the easiest way to do this.

Here is how I am reading the text file now.
 try
     {
          using (StreamReader sr = new StreamReader(strFileName.ToString()))
           {
              while ((line = sr.ReadLine()) != null)
                    {
                            Values = line.Split(Convert.ToChar(FileMapWindow.SelectedDelimiter));

I want to read this file into a DataTable dt = new DataTable() instead.
0
Comment
Question by:Hojoformo
3 Comments
 
LVL 8

Accepted Solution

by:
TheMozz earned 500 total points
Comment Utility
Basically the process is:

1. Get the number of columns you need for the table - you can get that from the text file on the fly if needed.
2. Create the DataTable
3. Add the columns to the table
4. Iterate the rows of the text file and add new rows to the table

So.....

If you don't know the exact number of columns, or care what they are called you could do something like:

....
Values = line.Split(Convert.ToChar(FileMapWindow.SelectedDelimiter));

DataTable dt = new DataTable();
int columnCount = 1;
for(int columnCount = 0; columnCount < Values.Length; columnCount++)
{
     dt.Columns.Add(new DataColumn("Column" + columnCount.ToString(), typeof(System.String)));
}


That should build up your data table - or you can build it up in code with strongly typed columns if you know the exact columns you'll need.

Then to populate the table, each time through your loop you can do:

int columnCount = 0;
foreach(string value in Values)
{
     // call the data table to get a new row
     DataRow newRow = dt.NewRow();

     // Assign the value for the current column
     newRow[columnCount] = value;

     // don't forget to add the row to the table else it won't be there
     dt.Rows.Add(newRow);

     columnCount++;
}

That is what is needed to load a text file into a DataTable. And looking back at what i typed, i noticed i put the table creation inside a while loop - you will want to change that a bit or you'll end up with a new DataTable for each row in your text file....

Let me know if that doesn't work out.
0
 
LVL 29

Expert Comment

by:anarki_jimbel
Comment Utility
I believe there are LOT of references around how to import a file into a grid.

Just have a look:
http://www.netomatix.com/development/ImportCSVIntoGrid.aspx
http://forums.devx.com/showthread.php?t=148498

The second link is VB.Net code so you may want to convert it to C# -see converted.

I used the http://www.developerfusion.com/tools/convert/vb-to-csharp/ converter and didn't test the code.
private void Button3_Click(System.Object sender, System.EventArgs e)

{

	if (OpenFileDialog1.ShowDialog(this) == DialogResult.OK) {

		FileInfo fi = new FileInfo(OpenFileDialog1.FileName);

		string sConnectionString = "Provider=Microsoft.Jet.OLEDB.4.0;Extended Properties=Text;Data Source=" + fi.DirectoryName;

		OleDbConnection objConn = new OleDbConnection(sConnectionString);

		objConn.Open();

		OleDbCommand objCmdSelect = new OleDbCommand("SELECT * FROM " + fi.Name, objConn);

		OleDbDataAdapter objAdapter1 = new OleDbDataAdapter();

		objAdapter1.SelectCommand = objCmdSelect;

		DataSet objDataset1 = new DataSet();

		objAdapter1.Fill(objDataset1, "test");

		DataGrid1.DataSource = objDataset1.Tables[0].DefaultView;

		objConn.Close();

	}



}

Open in new window

0
 
LVL 6

Expert Comment

by:nipunu
Comment Utility
//Namespace reference
using System.IO;
using System.Data;

#region BuildDataSet
/// <summary>
/// method to read a text file into a DataSet
/// </summary>
/// <param name="file">file to read from</param>
/// <param name="tableName">name of the DataTable we want to add</param>
/// <param name="delimeter">delimiter to split on</param>
/// <returns>a populated DataSet</returns>
public DataSet BuildDataSet(string file,string tableName,string delimeter)
{
    //create our DataSet
    DataSet domains = new DataSet();
    //add our table
    domains.Tables.Add(tableName);
    try
    {
        //first make sure the file exists
        if (File.Exists(file))
        {
            //create a StreamReader and open our text file
            StreamReader reader = new StreamReader(file);
            //read the first line in and split it into columns
            string[] columns = reader.ReadLine().Split(delimeter.ToCharArray());
            //now add our columns (we will check to make sure the column doesnt exist before adding it)
            foreach (string col in columns)
            {
                //variable to determine if a column has been added
                bool added = false;
                string next = "";
                //our counter
                int i = 0;
                while (!(added))
                {
                    string columnName = col;
                    //now check to see if the column already exists in our DataTable
                    if (!(domains.Tables[tableName].Columns.Contains(columnName)))
                    {
                        //since its not in our DataSet we will add it
                        domains.Tables[tableName].Columns.Add(columnName, typeof(string));
                        added = true;
                    }
                    else
                    {
                        //we didnt add the column so increment out counter
                        i++;
                    }
                }
            }
            //now we need to read the rest of the text file
            string data = reader.ReadToEnd();
            //now we will split the file on the carriage return/line feed
            //and toss it into a string array
            string[] rows = data.Split("\r".ToCharArray());
            //now we will add the rows to our DataTable
            foreach (string r in rows)
            {
                string[] items = r.Split(delimeter.ToCharArray());
                //split the row at the delimiter
                domains.Tables[tableName].Rows.Add(items);
            }
        }
        else
        {
            throw new FileNotFoundException("The file " + file + " could not be found");
        }
       
    }
    catch (FileNotFoundException ex)
    {
        _message = ex.Message;
        return null;
    }
    catch (Exception ex)
    {
        _message = ex.Message;
        return null;
    }
   
    //now return the DataSet
    return domains;
}
#endregion


//Sample usage

//for a Windows application
DataSet data = BuildDataSet("C:\MyFile.txt","MyTable",",");

//For an ASP.Net application
DataSet data = BuildDataSet(Server.MapPath("MyFile.txt"),"MyTable",",");


// Convert DataSet to DataTable by getting DataTable at first zero-based index of DataTableCollection
DataTable myDataTable = data.Tables[0];
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

A long time ago (May 2011), I have written an article showing you how to create a DLL using Visual Studio 2005 to be hosted in SQL Server 2005. That was valid at that time and it is still valid if you are still using these versions. You can still re…
Exception Handling is in the core of any application that is able to dignify its name. In this article, I'll guide you through the process of writing a DRY (Don't Repeat Yourself) Exception Handling mechanism, using Aspect Oriented Programming.
This video discusses moving either the default database or any database to a new volume.
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now