[Webinar] Streamline your web hosting managementRegister Today

x
  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 421
  • Last Modified:

Processing delimited file into a database

I have several semicolon-delimited files which contain hundreds of thousands of records in each. My objective is to reliably import them into a MS SQL database that I set up. I figured the easiest way to do this was to write a simple VB.NET application to process it.

The tricky part is that the values in the columns are not contained in quotes, and the last column has values that actually contain semicolons. There are a total of 5 columns.

Does anyone have recommendations on how I can best import these files into MS SQL?
0
elorc
Asked:
elorc
  • 2
2 Solutions
 
ladarlingCommented:
If you know that columns 1 through 4 will not contain semicolons, you can reliably use the Split() function on the semicolon to break the rows down into values, since you will know that the first 4 members of the array will map to columns 1 through 4, and that all indexes after 3 (the fourth index in the array) need to be concatenated back into column5, below is a prototype of that scenario....
 

        Dim sr As New IO.StreamReader("c:\somefile.txt")

        While Not sr.EndOfStream
            Dim values() As String = Split(sr.ReadLine, ";")
            For i = 0 To 3 'These are the first 4 columns
                'Do something values(i)
            Next
            Dim col5 As String = String.Empty
            For i = 3 To UBound(values) ' These will all be parts of column 5
                col5 &= values(i)
            Next
            'Do something with col5 here then move on to the next row
        End While

Open in new window

0
 
ladarlingCommented:
Oops... that should actually be:
For i = 4 To UBound(values) ' These will all be parts of column 5
                col5 &= values(i)
Next
 
0
 
käµfm³d 👽Commented:
Can you not use the Import/Export wizard?
0
 
elorcAuthor Commented:
Kaufmed: I can't. The import/export wizard is unreliable. I tried it initially but as expected it failed with cryptic error messages.
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now