Solved

Normal read/write "routine"

Posted on 2001-07-11
9
156 Views
Last Modified: 2010-04-06
What is the standard "routine" for reading a file, modifying it, and saving it to disk again?

Currently, my simple app reads in a text file line by line.  For each line, it simply does a writeln to a temporary output file.  When the program sees the line that needs to be changed, it writes the correct line to the temp file instead.  All the other lines in the file are then read and written to and from the original and temp files, respectively.  When this is complete, both files are closed, the original is deleted, and the temp one gets the old file's name.

The problem is that the new file loses the old file's attributes, such as its creation date and possibly its permissions.  What is the best way to make a change to a file, WITHOUT reading it all into one string, modifying the string, and writing the string back to the original?
0
Comment
Question by:Pummel
9 Comments
 
LVL 1

Accepted Solution

by:
bnemmers earned 44 total points
ID: 6273300
The reason that the new file loses the attributes is
because you have created a new file and not just used the
old one.

Why don't you use TStringList.LoadFromFile(FileName)
load the complete file then search through the StringList
for the string that needs to be changed then call
TStringList.SaveToFile(FileName)

The Modified date will changed along with the last access date but the created date should remain the same.

If this doesn't work for you then try FileSetAttr function.

Bill.
0
 

Author Comment

by:Pummel
ID: 6273873
That sounds like a good idea.  But what do you do when the file is really, really big and the change you need to add text in the middle of the file.  Is there a memory-efficient way to do that?  This is kind of the focus of my question, but I can see that I didn't say it.
0
 
LVL 3

Expert Comment

by:VSF
ID: 6273973
Check this homepage for some ideas on read and write using strings:
http://delphi.does.it/

If u have a big file u should think about some patch technics:
Maybe this sample can give you some ideas:

PATCH FILES
procedure TForm1.Button1Click(Sender: TObject);
var
 f: file;
 l: longint;
 datei, altstring, neustring, s: string;
begin
  altstring := 'Windows 95';
  neustring := 'BadWindows';
  datei := 'C:\kopie von io.sys';

  s := altstring;
  assignFile(f, datei);
  reset(f,1);
  for l := 0 to filesize(f)-length(altstring)-1 do
  begin
   Application.ProcessMessages;
   seek(f,l);
   blockread(f,altstring[1],length(altstring));
   if altstring = s then
   begin
    seek(f,l);
    blockwrite(f,neustring[1],length(neustring));
    label1.caption := 'Status: String found and patched!';
   end;
   Application.ProcessMessages;
  end;
  closeFile(f);
end;


This samples opens a file seeks for a given string and then modyfies the string if found!

VSF
www.victory.hpg.com.br
UIN:14016999
www.enge.cjb.net
0
 
LVL 1

Expert Comment

by:bnemmers
ID: 6274244
Hi,

You didn?t say how big is big 1000kb, 10,000kb etc..
You might want to look at TFileStream.
You could breakup the file into lets say
3 pieces and use Seek(SomeOffset) for your starting position.

Is the file organized is some fashion?
If so you could use this read large chunks of data.
Could you post an example of the file or send me copy?
Are the changes always in the middle of the file?

Bill ;)
billnemmers@csi.com
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 
LVL 3

Expert Comment

by:Sabre
ID: 6275567
Just a thought, but if it is the created date, last modified date, permissions etc that you want to maintain - why not read them first then reset them back when you have changed the file.
0
 
LVL 3

Expert Comment

by:rondi
ID: 6279756
This is a straightforward problem.

1. Just read the file however you like
   If you're worried about efficiency then either use
   VSF's BlockRead suggestion (only if the strings are
   of fixed & equal length) or use TFileStream (best)
   This way you've got direct file read/write access.

2. Use FileSetAttr to change the file's attributes if you
   really don't want anyone to know about your little
   patch operation ;)

If you wanna do line-by-line processing then using TFileStream may be a bit tricky, unless you write a
TFileStream descendant whose read/write methods only handle
lines.
You could ofcourse use the TextFile readln and writeln routines. From experience, TextFile's readln routine doesn't work properly with blank lines and you'll probably
need to increase the buffer size.

Just read up on all this in the help file and you should
be OK.

rondi.
0
 

Author Comment

by:Pummel
ID: 6286560
bnemmers comments were the most helpful.  I didn't include a file size because the file I'm working with is really small.  But I was just curious what I would do if my project involved a large file.  So it was kind of a what-if scenario.

Rondi and Sabre seemed to sum up what bnemmers said and rondi was right about the restrictions imposed by the patch techniques.  Maybe in the future I'll be a good enough programmer to confidently write a descendant class from TFileStream.

Thank you everyone for your time in helping me understand this concept more.
0
 
LVL 1

Expert Comment

by:bnemmers
ID: 6286848
Hi,

One last thing

This is the simplest way to load and locate the string.
You might want to place each operation in a new thread.

procedure TForm1.FormCreate(Sender: TObject);
begin
  fStringList := TStringList.Create;
end;

procedure TForm1.FormDestroy(Sender: TObject);
begin
  fStringList.Free;
end;

procedure TForm1.btnLoadClick(Sender: TObject);
begin
  if dlgOpen.Execute then
  begin
    fFileName := dlgOpen.FileName;
    //The file size was 124mb and it took 128 sec to open on a pentIII w/128mb
    fStringList.LoadFromFile(fFileName);  
  end;
end;

procedure TForm1.btnSearchClick(Sender: TObject);
begin
  //The bad string was located in the middle of the file
  //and it took 27 sec to find the string
  fIndex := fStringList.IndexOf(StringToSearchFor);
  if Index > 0 then
  begin
    fTheCorrectString := fStringList.Strings[Index];
  end;
end;

procedure TForm1.btnSaveClick(Sender: TObject);
begin
  if ((fStringList.Count > 0) and (fFileName <> '')) then
  begin
    fStringList.Strings[fIndex] := fTheCorrectString; //Edit string first
    //Took 191 sec to save back to disk.
    fStringList.SaveToFile(fFileName);
  end;
end;
0
 

Author Comment

by:Pummel
ID: 6287226
Why thank you.

About that SaveToFile command--Does the creation date really stay the same, along with the permissions, like you said in your first comment?
0

Featured Post

Maximize Your Threat Intelligence Reporting

Reporting is one of the most important and least talked about aspects of a world-class threat intelligence program. Here’s how to do it right.

Join & Write a Comment

Suggested Solutions

Have you ever had your Delphi form/application just hanging while waiting for data to load? This is the article to read if you want to learn some things about adding threads for data loading in the background. First, I'll setup a general applica…
Introduction Raise your hands if you were as upset with FireMonkey as I was when I discovered that there was no TListview.  I use TListView in almost all of my applications I've written, and I was not going to compromise by resorting to TStringGrid…
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…
Polish reports in Access so they look terrific. Take yourself to another level. Equations, Back Color, Alternate Back Color. Write easy VBA Code. Tighten space to use less pages. Launch report from a menu, considering criteria only when it is filled…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

17 Experts available now in Live!

Get 1:1 Help Now