• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 514
  • Last Modified:

Read part of file...

I need some VB code to read only part of a file, it's been a while since I worked with VB but I know it can be done, just don't know how anymore.

Example, I know the last time I imported a file it was 77,600 kb upon current import I know the file is 78,777 kb so I know I only want to read the difference ie. 1,177 kb

How to read the 1,177 kb last part of a file in VB?

FYI: I will be using this in a DTS package.

Then how to loop over this 1,177 kb of data within the DTS package? I need to do the following comparison for each line

IF LEFT(currentRow, 3) IS "***"
Then do something here
Just import the row.
3 Solutions
Mike TomlinsonMiddle School Assistant TeacherCommented:
You can use the seek functin to move the file pointer once the file is open.

Seek #1, 77600

Tacobell777Author Commented:
That means I need to read the whole 80 Mb or in some cases 300 Mb...
'seek' will get u to the position u want. So u wont have to read the whole 80Mb or so as u say.
After doing a seek, jus read in the rest of the file.
Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

Tacobell777Author Commented:
Would any code samples be possible? Maybe I did not make it clear, but I am no VB programmer, I used it for a little while and now I need to use it in a DTS package...
This will do what you want...

Const FileName As String = "C:\test.txt" 'path and name of your file
Const ReadFrom As Long = 77600  ' this can be changed as needed
Dim DTSFile As Integer
Dim LatestData As String
Dim sBuffer As String
Dim arrData() As String
Dim iCurrentLine As Long

'open the file & import the data you want
DTSFile = FreeFile
Open FileName For Input As DTSFile
Seek #DTSFile, ReadFrom
While Not EOF(DTSFile)
    Line Input #DTSFile, sBuffer
    LatestData = LatestData & sBuffer & vbCrLf
Close #DTSFile

'place the data into an array for easy looping
arrData = Split(LatestData, vbCrLf)

'loop thro the data getting what you want
For iCurrentLine = LBound(arrData) To UBound(arrData)
    If Left$(arrData(iCurrentLine), 3) = "***" Then
        'found the line you want - your code here
        Debug.Print arrData(iCurrentLine)
        'discard unwanted data or save to file here
    End If

or this
You could use this to go through the file
    Dim MyRecord As Byte ' or whatever. You may already have an appropriate user type defined in a module
    'Dim MyRecord as String * 10 if you use a string type, it's best to fix its size
    Dim Start As Long
    Dim l As Long
    Dim f As Integer
    Start = 100
    f = FreeFile
    Open "c:\scandisk.log" For Binary As #f
        l = Start
        Do Until EOF(f)
        Get #f, l, MyRecord ' Read l'th record
        'Process the record
        l = l + 1
    Close #f
Tacobell777Author Commented:

I have been trying and trying but none of these scripts work within a MS SQL DTS package....
It looks as if the syntax needs to be different...
Exactly--the above examples are VB.  Why don't you add a text file connection to your DTS package and you can tell it what row to start on.

If you want more control than that, you can setup an ActiveX script task to read in the data using the file system object.  Yet another option, if you configure the Microsoft Text Driver, you can even process queries against the text file to look at the "LEFT()" characters...

You would have got better DTS responses if you posted this in SQL Server topic group...

Tacobell777Author Commented:
I did post this in the MS SQL Server area, but nothing at all there. At least here I am getting somewhere ;-))

What your saying sounds interesting...... but....
How to do that? I mean I worked with DTS before and created connections to text files but have not seenw hat you are refering to, unless you mean "Skip rows"? If so, how do I know which row I last imported?
Ya, I was talking about skip rows.  You could write the last row imported to a text file (ini file) and then use the dynamic properties task to read it and update your "skip rows" property.

Also, sounds like the Microsoft Text file driver could be a good option.  I'd set it up with the format of your file and try it.

Sorry didn't see your original post in SQL Server group....

You deleted your question in the SQL group--how long did you leave it open???
Tacobell777Author Commented:
I did not get what I was after (which could have been my own fault, not asking the question in the right category) I split the points up anyway.

You could follow up on the above suggestions and note that you didn't get what you wanted.  We can't read minds and know you're not getting what you want....

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Tackle projects and never again get stuck behind a technical roadblock.
Join Now