Solved

Reading a text file into a DataTable

Posted on 2010-08-31
3
903 Views
Last Modified: 2012-05-10
What is the easiest way to LOAD a text file into a DataTable?  I have a windows form application that read in a comma delimited text file.  I want to load this text file into a datatable so what is the easiest way to do this.

Here is how I am reading the text file now.
 try
     {
          using (StreamReader sr = new StreamReader(strFileName.ToString()))
           {
              while ((line = sr.ReadLine()) != null)
                    {
                            Values = line.Split(Convert.ToChar(FileMapWindow.SelectedDelimiter));

I want to read this file into a DataTable dt = new DataTable() instead.
0
Comment
Question by:Hojoformo
3 Comments
 
LVL 8

Accepted Solution

by:
TheMozz earned 500 total points
ID: 33573389
Basically the process is:

1. Get the number of columns you need for the table - you can get that from the text file on the fly if needed.
2. Create the DataTable
3. Add the columns to the table
4. Iterate the rows of the text file and add new rows to the table

So.....

If you don't know the exact number of columns, or care what they are called you could do something like:

....
Values = line.Split(Convert.ToChar(FileMapWindow.SelectedDelimiter));

DataTable dt = new DataTable();
int columnCount = 1;
for(int columnCount = 0; columnCount < Values.Length; columnCount++)
{
     dt.Columns.Add(new DataColumn("Column" + columnCount.ToString(), typeof(System.String)));
}


That should build up your data table - or you can build it up in code with strongly typed columns if you know the exact columns you'll need.

Then to populate the table, each time through your loop you can do:

int columnCount = 0;
foreach(string value in Values)
{
     // call the data table to get a new row
     DataRow newRow = dt.NewRow();

     // Assign the value for the current column
     newRow[columnCount] = value;

     // don't forget to add the row to the table else it won't be there
     dt.Rows.Add(newRow);

     columnCount++;
}

That is what is needed to load a text file into a DataTable. And looking back at what i typed, i noticed i put the table creation inside a while loop - you will want to change that a bit or you'll end up with a new DataTable for each row in your text file....

Let me know if that doesn't work out.
0
 
LVL 29

Expert Comment

by:anarki_jimbel
ID: 33573625
I believe there are LOT of references around how to import a file into a grid.

Just have a look:
http://www.netomatix.com/development/ImportCSVIntoGrid.aspx
http://forums.devx.com/showthread.php?t=148498

The second link is VB.Net code so you may want to convert it to C# -see converted.

I used the http://www.developerfusion.com/tools/convert/vb-to-csharp/ converter and didn't test the code.
private void Button3_Click(System.Object sender, System.EventArgs e)

{

	if (OpenFileDialog1.ShowDialog(this) == DialogResult.OK) {

		FileInfo fi = new FileInfo(OpenFileDialog1.FileName);

		string sConnectionString = "Provider=Microsoft.Jet.OLEDB.4.0;Extended Properties=Text;Data Source=" + fi.DirectoryName;

		OleDbConnection objConn = new OleDbConnection(sConnectionString);

		objConn.Open();

		OleDbCommand objCmdSelect = new OleDbCommand("SELECT * FROM " + fi.Name, objConn);

		OleDbDataAdapter objAdapter1 = new OleDbDataAdapter();

		objAdapter1.SelectCommand = objCmdSelect;

		DataSet objDataset1 = new DataSet();

		objAdapter1.Fill(objDataset1, "test");

		DataGrid1.DataSource = objDataset1.Tables[0].DefaultView;

		objConn.Close();

	}



}

Open in new window

0
 
LVL 6

Expert Comment

by:nipunu
ID: 33575061
//Namespace reference
using System.IO;
using System.Data;

#region BuildDataSet
/// <summary>
/// method to read a text file into a DataSet
/// </summary>
/// <param name="file">file to read from</param>
/// <param name="tableName">name of the DataTable we want to add</param>
/// <param name="delimeter">delimiter to split on</param>
/// <returns>a populated DataSet</returns>
public DataSet BuildDataSet(string file,string tableName,string delimeter)
{
    //create our DataSet
    DataSet domains = new DataSet();
    //add our table
    domains.Tables.Add(tableName);
    try
    {
        //first make sure the file exists
        if (File.Exists(file))
        {
            //create a StreamReader and open our text file
            StreamReader reader = new StreamReader(file);
            //read the first line in and split it into columns
            string[] columns = reader.ReadLine().Split(delimeter.ToCharArray());
            //now add our columns (we will check to make sure the column doesnt exist before adding it)
            foreach (string col in columns)
            {
                //variable to determine if a column has been added
                bool added = false;
                string next = "";
                //our counter
                int i = 0;
                while (!(added))
                {
                    string columnName = col;
                    //now check to see if the column already exists in our DataTable
                    if (!(domains.Tables[tableName].Columns.Contains(columnName)))
                    {
                        //since its not in our DataSet we will add it
                        domains.Tables[tableName].Columns.Add(columnName, typeof(string));
                        added = true;
                    }
                    else
                    {
                        //we didnt add the column so increment out counter
                        i++;
                    }
                }
            }
            //now we need to read the rest of the text file
            string data = reader.ReadToEnd();
            //now we will split the file on the carriage return/line feed
            //and toss it into a string array
            string[] rows = data.Split("\r".ToCharArray());
            //now we will add the rows to our DataTable
            foreach (string r in rows)
            {
                string[] items = r.Split(delimeter.ToCharArray());
                //split the row at the delimiter
                domains.Tables[tableName].Rows.Add(items);
            }
        }
        else
        {
            throw new FileNotFoundException("The file " + file + " could not be found");
        }
       
    }
    catch (FileNotFoundException ex)
    {
        _message = ex.Message;
        return null;
    }
    catch (Exception ex)
    {
        _message = ex.Message;
        return null;
    }
   
    //now return the DataSet
    return domains;
}
#endregion


//Sample usage

//for a Windows application
DataSet data = BuildDataSet("C:\MyFile.txt","MyTable",",");

//For an ASP.Net application
DataSet data = BuildDataSet(Server.MapPath("MyFile.txt"),"MyTable",",");


// Convert DataSet to DataTable by getting DataTable at first zero-based index of DataTableCollection
DataTable myDataTable = data.Tables[0];
0

Featured Post

DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Real-time is more about the business, not the technology. In day-to-day life, to make real-time decisions like buying or investing, business needs the latest information(e.g. Gold Rate/Stock Rate). Unlike traditional days, you need not wait for a fe…
Performance in games development is paramount: every microsecond counts to be able to do everything in less than 33ms (aiming at 16ms). C# foreach statement is one of the worst performance killers, and here I explain why.
Windows 10 is mostly good. However the one thing that annoys me is how many clicks you have to do to dial a VPN connection. You have to go to settings from the start menu, (2 clicks), Network and Internet (1 click), Click VPN (another click) then fi…
This is used to tweak the memory usage for your computer, it is used for servers more so than workstations but just be careful editing registry settings as it may cause irreversible results. I hold no responsibility for anything you do to the regist…

920 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now