omcr
asked on
Extract lines based on date from log file.
I have a logfile (log.txt) that is stored in this format:
OfficeAAA.txt
ON 02/16/06 12:17:03 OFF 02/16/06 12:18:03 RUNTIME 00:01:00
ON 02/16/06 12:23:37 OFF 02/16/06 12:23:50 RUNTIME 00:00:13
ON 02/20/06 08:53:36 OFF 02/20/06 09:35:25 RUNTIME 00:41:49
ON 02/27/06 08:53:15 OFF 02/27/06 09:26:05 RUNTIME 00:32:50
ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeBBB.txt
ON 02/02/06 12:04:59 OFF 02/02/06 12:05:06 RUNTIME 00:00:07
ON 02/02/06 12:07:05 OFF 02/02/06 12:07:43 RUNTIME 00:00:38
ON 02/13/06 10:30:17 OFF 02/13/06 11:10:02 RUNTIME 00:39:45
ON 02/20/06 10:30:20 OFF 02/20/06 11:10:06 RUNTIME 00:39:46
OfficeCCC.txt
ON 02/16/06 12:19:41 OFF 02/16/06 12:19:47 RUNTIME 00:00:06
ON 02/16/06 12:23:37 OFF 02/16/06 12:23:50 RUNTIME 00:00:13
ON 02/20/06 08:53:36 OFF 02/20/06 09:35:25 RUNTIME 00:41:49
ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
This log file is appended daily (if there was any activity) and I plan to run a script each night after midnight and create a report showing just the previous days activity. So if we say today is 3/7/06, my report should look like this:
OfficeAAA.txt
ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeCCC.txt
ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
I'm starting my efforts on it now and expect to have a problem with having the script search for the correct date (it will always be today - 1 day) and looping through the file and keeping the proper office name associated with the lines I extract. I think I have an old question I'll lookup that may help me keep the names and data extract correct. But I need this one working quickly and I'm open to any ideas.
Also just for clarity, I want to extract the data based on the date associated with the ON date, and I do not care about the ON time or OFF date and time.
OfficeAAA.txt
ON 02/16/06 12:17:03 OFF 02/16/06 12:18:03 RUNTIME 00:01:00
ON 02/16/06 12:23:37 OFF 02/16/06 12:23:50 RUNTIME 00:00:13
ON 02/20/06 08:53:36 OFF 02/20/06 09:35:25 RUNTIME 00:41:49
ON 02/27/06 08:53:15 OFF 02/27/06 09:26:05 RUNTIME 00:32:50
ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeBBB.txt
ON 02/02/06 12:04:59 OFF 02/02/06 12:05:06 RUNTIME 00:00:07
ON 02/02/06 12:07:05 OFF 02/02/06 12:07:43 RUNTIME 00:00:38
ON 02/13/06 10:30:17 OFF 02/13/06 11:10:02 RUNTIME 00:39:45
ON 02/20/06 10:30:20 OFF 02/20/06 11:10:06 RUNTIME 00:39:46
OfficeCCC.txt
ON 02/16/06 12:19:41 OFF 02/16/06 12:19:47 RUNTIME 00:00:06
ON 02/16/06 12:23:37 OFF 02/16/06 12:23:50 RUNTIME 00:00:13
ON 02/20/06 08:53:36 OFF 02/20/06 09:35:25 RUNTIME 00:41:49
ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
This log file is appended daily (if there was any activity) and I plan to run a script each night after midnight and create a report showing just the previous days activity. So if we say today is 3/7/06, my report should look like this:
OfficeAAA.txt
ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeCCC.txt
ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
I'm starting my efforts on it now and expect to have a problem with having the script search for the correct date (it will always be today - 1 day) and looping through the file and keeping the proper office name associated with the lines I extract. I think I have an old question I'll lookup that may help me keep the names and data extract correct. But I need this one working quickly and I'm open to any ideas.
Also just for clarity, I want to extract the data based on the date associated with the ON date, and I do not care about the ON time or OFF date and time.
ASKER
Sorry, the code below-
while (<FINAL>){
print if /\.gen|$today/;
print FINISH if /\.gen|$today/;
}
Should be-
while (<FINAL>){
print if /\.gen|$yesterday/;
print FINISH if /\.gen|$yesterday/;
}
while (<FINAL>){
print if /\.gen|$today/;
print FINISH if /\.gen|$today/;
}
Should be-
while (<FINAL>){
print if /\.gen|$yesterday/;
print FINISH if /\.gen|$yesterday/;
}
ASKER
Yet another mistake in my post- .gen should be .txt
Here is the whole thing one more time CORRECTED:
#!/usr/bin/perl -w
open FINAL, "log.txt" or die "Cannot open file $!";
open FINISH, ">daily.txt" or die "Cannot open file $!";
my($dd,$mm,$yy,$day) = (localtime)[3,4,5,6];
my $yesterday = join '/', map sprintf("%02d", $_), ($mm+1,$dd-1,$yy%100);
print "$yesterday\n";
while (<FINAL>){
print if /\.txt|$yesterday/;
print FINISH if /\.txt|$yesterday/;
}
Here is the whole thing one more time CORRECTED:
#!/usr/bin/perl -w
open FINAL, "log.txt" or die "Cannot open file $!";
open FINISH, ">daily.txt" or die "Cannot open file $!";
my($dd,$mm,$yy,$day) = (localtime)[3,4,5,6];
my $yesterday = join '/', map sprintf("%02d", $_), ($mm+1,$dd-1,$yy%100);
print "$yesterday\n";
while (<FINAL>){
print if /\.txt|$yesterday/;
print FINISH if /\.txt|$yesterday/;
}
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Oops, cut/paste goof
print FINISH if /\.txt|$yesterday/;
should have been
print FINISH;
print FINISH if /\.txt|$yesterday/;
should have been
print FINISH;
ASKER
FishMonger,
Any ideas on how to keep the Offices which had no activity from showing up in my final report,
or a way to print the office name and activity information on the same line in the report, which would cause my current data to print out like this:
OfficeAAA.txt ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeBBB.txt
OfficeCCC.txt ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
And then I could loop through it and extract the offices with data into another file.
Any ideas on how to keep the Offices which had no activity from showing up in my final report,
or a way to print the office name and activity information on the same line in the report, which would cause my current data to print out like this:
OfficeAAA.txt ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeBBB.txt
OfficeCCC.txt ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
And then I could loop through it and extract the offices with data into another file.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
#!/usr/bin/perl -w
open FINAL, "log.txt" or die "Cannot open file $!";
open FINISH, ">daily.txt" or die "Cannot open file $!";
my($dd,$mm,$yy,$day) = (localtime)[3,4,5,6];
my $yesterday = join '/', map sprintf("%02d", $_), ($mm+1,$dd-1,$yy%100);
print "$yesterday\n";
while (<FINAL>){
print if /\.gen|$today/;
print FINISH if /\.gen|$today/;
}
The output looks like this:
OfficeAAA.txt
ON 03/06/06 08:52:56 OFF 03/06/06 09:34:42 RUNTIME 00:41:46
OfficeBBB.txt
OfficeCCC.txt
ON 03/06/06 10:32:29 OFF 03/06/06 11:12:13 RUNTIME 00:39:44
So it does what I needed but I don't want OfficeBBB.txt to show up since there is no recent data associated with it (I will be checking 70 offices).