Find newest file in directory and then search it

Posted on 2004-04-15
Last Modified: 2007-12-19
I have a batch job that i run about 3 to 4 times a day. It creates a log of format 1262002-1000 am.log i want to find the newest log file and then grep its results. I have the grep part written but am struggling with how to do the opendir and use a array to find the newest file and then run my grep against that.
Question by:gdmacmillan
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 4

Expert Comment

ID: 10836320
why use perl?

if you already have your grep:

grep "searchstring" `ls -tr | tail -1`

tho, if you wanted, you could put that backtick command into perl, too...

Author Comment

ID: 10836341
Sorry forgot to mention im doing this on a windows system thats why im using perl.
LVL 20

Accepted Solution

jmcg earned 440 total points
ID: 10836357
We have been asked something very much like this before:

For your case, I think it might work if you started out with something like the following:

use strict;
use File::stat;

my $newest = [ undef, 0 ];

for ( <*.log> ) {
    my $st = stat($_) or next; # should warn here?
    my $mtime = $st->mtime;

    $newest = [ $_, $mtime] if $mtime > newest->[1] ;

print "most recent file is: ", $newest->[0], "\n";

This should be reasonably efficient and I think I've avoided the typos that plagued that other question. With $newest->[0] in hand as your filename, you can then apply whatever grep code you had already worked out.

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!


Expert Comment

ID: 10836386

and your log name leaves a little to be desired... is your example from jan 26th? or from dec 6th?

you could scan the filenames into an array and use sort, but only after you did some magic on the names. specifically, you need to alter all the filenames so they can be compared... like using YYYYMMDDHHMM.log instead of what you got with the am's and all...

Expert Comment

ID: 10836389
or, use File::stat as jmcg suggests :P

Author Comment

ID: 10836669
Hi Jcmp,
          yep ive been looking at those other awnsers but i am quite a newbie to perl. The last programming i did was pascal back in college in 90.  I understand we are creating a array which is undefined and then searching through the files to find the newest.  The stat function is used to get info from the flie. What i get stuck at is how do i tell it which directory to go search.

Assisted Solution

fim32 earned 60 total points
ID: 10837127
that's in the for part:

for ( <.*log> ) {

the <.*log> part says search the local directory for all files names .*log, it's a shortcut to using the opendir and such.

Author Comment

ID: 10837161
Doh. So if i run it from that directory it will search that directory? What if i wanted to use it to go search another one?

Expert Comment

ID: 10837330
you could as easily wrap that for loop in a opendir/closedir:

opendir D,"/newdir";
for (readdir D) {
  other stuffs here
closedir D;

or, if you wanted to make sure it was only *log files you were getting, change the abovre for (readdir) to:
for (grep { /.*log/ } readdir D) {

Author Comment

ID: 10843632
Hi fim32 & Jmcg thanks for all your help on this. I have the program working now.

Featured Post

[Webinar] Learn How Hackers Steal Your Credentials

Do You Know How Hackers Steal Your Credentials? Join us and Skyport Systems to learn how hackers steal your credentials and why Active Directory must be secure to stop them. Thursday, July 13, 2017 10:00 A.M. PDT

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Email validation in proper way is  very important validation required in any web pages. This code is self explainable except that Regular Expression which I used for pattern matching. I originally published as a thread on my website : http://www…
There are many situations when we need to display the data in sorted order. For example: Student details by name or by rank or by total marks etc. If you are working on data driven based projects then you will use sorting techniques very frequently.…
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
Six Sigma Control Plans

634 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question