Solved

Find newest file in directory and then search it

Posted on 2004-04-15
10
749 Views
Last Modified: 2007-12-19
I have a batch job that i run about 3 to 4 times a day. It creates a log of format 1262002-1000 am.log i want to find the newest log file and then grep its results. I have the grep part written but am struggling with how to do the opendir and use a array to find the newest file and then run my grep against that.
0
Comment
Question by:gdmacmillan
  • 5
  • 4
10 Comments
 
LVL 7

Expert Comment

by:fim32
ID: 10836320
why use perl?

if you already have your grep:

grep "searchstring" `ls -tr | tail -1`

tho, if you wanted, you could put that backtick command into perl, too...
0
 

Author Comment

by:gdmacmillan
ID: 10836341
Sorry forgot to mention im doing this on a windows system thats why im using perl.
0
 
LVL 20

Accepted Solution

by:
jmcg earned 440 total points
ID: 10836357
We have been asked something very much like this before:

http://www.experts-exchange.com/Q_20845254.html

For your case, I think it might work if you started out with something like the following:

use strict;
use File::stat;

my $newest = [ undef, 0 ];

for ( <*.log> ) {
    my $st = stat($_) or next; # should warn here?
    my $mtime = $st->mtime;

    $newest = [ $_, $mtime] if $mtime > newest->[1] ;
    }

print "most recent file is: ", $newest->[0], "\n";

This should be reasonably efficient and I think I've avoided the typos that plagued that other question. With $newest->[0] in hand as your filename, you can then apply whatever grep code you had already worked out.



0
 
LVL 7

Expert Comment

by:fim32
ID: 10836386
ugh.

and your log name leaves a little to be desired... is your example from jan 26th? or from dec 6th?

you could scan the filenames into an array and use sort, but only after you did some magic on the names. specifically, you need to alter all the filenames so they can be compared... like using YYYYMMDDHHMM.log instead of what you got with the am's and all...
0
 
LVL 7

Expert Comment

by:fim32
ID: 10836389
or, use File::stat as jmcg suggests :P
0
Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 

Author Comment

by:gdmacmillan
ID: 10836669
Hi Jcmp,
          yep ive been looking at those other awnsers but i am quite a newbie to perl. The last programming i did was pascal back in college in 90.  I understand we are creating a array which is undefined and then searching through the files to find the newest.  The stat function is used to get info from the flie. What i get stuck at is how do i tell it which directory to go search.
0
 
LVL 7

Assisted Solution

by:fim32
fim32 earned 60 total points
ID: 10837127
that's in the for part:

for ( <.*log> ) {

the <.*log> part says search the local directory for all files names .*log, it's a shortcut to using the opendir and such.
0
 

Author Comment

by:gdmacmillan
ID: 10837161
Doh. So if i run it from that directory it will search that directory? What if i wanted to use it to go search another one?
0
 
LVL 7

Expert Comment

by:fim32
ID: 10837330
you could as easily wrap that for loop in a opendir/closedir:

opendir D,"/newdir";
for (readdir D) {
  other stuffs here
}
closedir D;

or, if you wanted to make sure it was only *log files you were getting, change the abovre for (readdir) to:
for (grep { /.*log/ } readdir D) {
0
 

Author Comment

by:gdmacmillan
ID: 10843632
Hi fim32 & Jmcg thanks for all your help on this. I have the program working now.
0

Featured Post

Why You Should Analyze Threat Actor TTPs

After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

Join & Write a Comment

Suggested Solutions

Many time we need to work with multiple files all together. If its windows system then we can use some GUI based editor to accomplish our task. But what if you are on putty or have only CLI(Command Line Interface) as an option to  edit your files. I…
I have been pestered over the years to produce and distribute regular data extracts, and often the request have explicitly requested the data be emailed as an Excel attachement; specifically Excel, as it appears: CSV files confuse (no Red or Green h…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Internet Business Fax to Email Made Easy - With eFax Corporate (http://www.enterprise.efax.com), you'll receive a dedicated online fax number, which is used the same way as a typical analog fax number. You'll receive secure faxes in your email, fr…

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now