Solved

PowerShell script to copy and rename log files

Posted on 2015-01-16
10
328 Views
Last Modified: 2015-01-26
I have a script written for copying our BES-5 log files to a compliance software package. I need help modifying this script to work with the log files BES-10 produces. Currently our logs look like this:

smslog_yyyymmdd.csv
pinlog_yyyymmdd.csv
PhoneCallLog_yyyymmdd.csv

This is the naming convention our compliance software wants it in.... BUT our new log files look like this:

New BES-10 logs:
BES-10_sms_1.0_20150102_0001.csv
BES-10_Phone_1.0_20150102_0001.csv
BES-10_bbmmessage_1.0_20150102_0001.csv

So in short I need this:
BES-10_sms_1.0_20150102_0001.csv ---> smslog_20150104.csv then copied to a queue folder and an archive folder renaming the file to:
BES-10_smslog_20150104.processed

Here is the code that works with our BES-5 environment:

$emailServer = 'email_server_address' #smtp server
$yesterday = (get-date).AddDays(-1)
$yesterdayString = $yesterday.tostring('yyyyMMdd')
$datepath = $yesterday.ToString('yyyy\\MM\\dd')
$pathVal = "Z:\$yesterdayString"
$archivePath = "D:\Scripttest\BBlogs\archive\$datepath"
$smsfile="smslog_$yesterdayString.csv"
$pinfile="pinlog_$yesterdayString.csv"
$phoneFile="PhoneCallLog_$yesterdayString.csv"

if (-not (test-path $archivePath)) {mkdir $archivePath}

foreach ($file in ('smslog','pinlog','PhoneCallLog')) {
    $source = "$pathval\$($file)_$yesterdayString.csv"
    $targets = "D:\Scripttest\BBlogs\queue\$($file)_$yesterdayString.csv","$archivePath\$($file)_$yesterdayString.processed"
    foreach ($target in $targets) {
#write-host "Copying $source to $target"
        copy-item -Path $source -Destination $target -ErrorAction SilentlyContinue
        if (-not (Test-Path $target)) {$failure += 1} else {write-host "Copy successful"}
    }
}

$msg = "SUCCEEDED" ; $priority = 'normal'
if ($failure -gt 1) { $msg = "FAILED" ; $priority = 'high'} 

Send-MailMessage -SmtpServer $emailServer -To alerts@domain.com -From alerts@domain.com  -Subject "BESLOG's Transfer to ZL : $msg " -Body  "BESLOG's Transfer $msg"  -Priority $priority

Open in new window

0
Comment
Question by:USGLOBAL
  • 6
  • 4
10 Comments
 
LVL 67

Expert Comment

by:sirbounty
Comment Utility
BES-10_sms_1.0_20150102_0001.csv will always be
BES-10_sms_1.0_<DATE>_0001.csv??
0
 
LVL 67

Expert Comment

by:sirbounty
Comment Utility
Think I'm still a bit confused...
Original source file is BES-10_sms_1.0_20150102_0001.csv
You need that copied to the queue folder as smslog_20150104.csv
and then copied to the archive folder as BES-10_smslog_20150104.processed?

How did we get from _sms_ to _smslog_ ?
0
 

Author Comment

by:USGLOBAL
Comment Utility
one is BES-5 (the original script) and the new file is from BES-10 the new one I need.
0
 
LVL 67

Expert Comment

by:sirbounty
Comment Utility
Can you clarify tho?  Are there 3 versions of the same file?
BES-10_sms_1.0_20150102_0001.csv  (original)
smslog_20150104.csv (queued)
BES-10_smslog_20150104.processed (archive)
0
 

Author Comment

by:USGLOBAL
Comment Utility
Yes that would be correct. the file would change names twice. once to be ingested by the compliance software. (smslog_20150104.csv ) and again in the archive folder (BES-10_smslog_20150104.processed)
0
Why You Should Analyze Threat Actor TTPs

After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

 

Author Comment

by:USGLOBAL
Comment Utility
The issue is the compliance software will only ingest a certain format:

for instance the SMS logs need to be smslog_yyyymmdd.csv. They cannot or will not accommodate another naming convention. Blackberry with version 10 changed the format of the log files, they also state that this is not configurable. So since both sets of logs have to have the same name I am force with running 2 scripts staggering the time they run to allow ingestion of the previous server's log files before the next set are put into the queue folder.
0
 
LVL 67

Accepted Solution

by:
sirbounty earned 500 total points
Comment Utility
Having a bit more trouble getting my head wrapped around this one, but give this a shot and let me know...

$emailServer = 'email_server_address' #smtp server
$yesterday = (get-date).AddDays(-1)
$yesterdayString = $yesterday.tostring('yyyyMMdd')
$datepath = $yesterday.ToString('yyyy\\MM\\dd')
$pathVal = "z:\$yesterdayString"
$archivePath = "d:\Scripttest\BBlogs\archive\$datepath"
if (-not (test-path $archivePath)) {mkdir $archivePath}

$files = foreach ($file in 'sms','Phone','bbmmessage') {"BES-10_$($file)_1.0_$($yesterdayString)_0001.csv"}

foreach ($file in $files) {
    $source = "$pathVal\$file"
    $targets = "D:\Scripttest\BBlogs\queue\$($file)".Replace("BES-10_","").Replace("_1.0_","_").Replace("_0001",""),"$archivePath\$($file).processed".Replace("_sms_","_smslog_").Replace("_1.0_","_").Replace("_0001.csv","")
    foreach ($target in $targets) {
        copy-item -Path $source -Destination $target -ErrorAction SilentlyContinue
        if (-not (Test-Path $target)) {$failure += 1} else {write-host "Copy successful"}
    }
}

$msg = "SUCCEEDED" ; $priority = 'normal'
if ($failure -gt 1) { $msg = "FAILED" ; $priority = 'high'} 

Send-MailMessa

Open in new window

0
 

Author Comment

by:USGLOBAL
Comment Utility
Wow that almost worked on the first try! Here is what happened.. the sms file copied to the queue folder was "sms_20150119.csv" it needed to be "smslog_20150119.csv" the archive file created was correct "BES-10_smslog_20150119.processed".
0
 
LVL 67

Expert Comment

by:sirbounty
Comment Utility
So, z:\20150119\BES-10_sms_1.0_20150119_0001.csv
should be copied as:
d:\Scripttest\BBlogs\queue\smslog_20150119.csv
d:\Scripttest\BBlogs\archive\2015\01\19\BES-10_smslog_20150119.processed

?
0
 
LVL 67

Assisted Solution

by:sirbounty
sirbounty earned 500 total points
Comment Utility
$emailServer = 'email_server_address' #smtp server
$yesterday = (get-date).AddDays(-1)
$yesterdayString = $yesterday.tostring('yyyyMMdd')
$datepath = $yesterday.ToString('yyyy\\MM\\dd')
$pathVal = "c:\testfolder\z\$yesterdayString"
$archivePath = "c:\testfolder\d\Scripttest\BBlogs\archive\$datepath"
if (-not (test-path $archivePath)) {mkdir $archivePath}

$files = foreach ($file in 'sms','Phone','bbmmessage') {"BES-10_$($file)_1.0_$($yesterdayString)_0001.csv"}

foreach ($file in $files) {
    $source = "$pathVal\$file"
    $targets = "c:\testfolder\d\Scripttest\BBlogs\queue\$($file)".replace("_sms_","_smslog_").Replace("BES-10_","").Replace("_1.0_","_").Replace("_0001",""),"$archivePath\$($file).processed".Replace("_sms_","_smslog_").Replace("_1.0_","_").Replace("_0001.csv","")
    foreach ($target in $targets) {
        copy-item -Path $source -Destination $target -ErrorAction SilentlyContinue
        if (-not (Test-Path $target)) {$failure += 1} else {write-host "Copy successful"}
    }
}

$msg = "SUCCEEDED" ; $priority = 'normal'
if ($failure -gt 1) { $msg = "FAILED" ; $priority = 'high'} 

Open in new window

0

Featured Post

Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

Join & Write a Comment

"Migrate" an SMTP relay receive connector to a new server using info from an old server.
Restoring deleted objects in Active Directory has been a standard feature in Active Directory for many years, yet some admins may not know what is available.
This tutorial will walk an individual through configuring a drive on a Windows Server 2008 to perform shadow copies in order to quickly recover deleted files and folders. Click on Start and then select Computer to view the available drives on the se…
This tutorial will show how to configure a single USB drive with a separate folder for each day of the week. This will allow each of the backups to be kept separate preventing the previous day’s backup from being overwritten. The USB drive must be s…

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

6 Experts available now in Live!

Get 1:1 Help Now