Solved

Compare CSV files using Powershell

Posted on 2013-11-13
4
480 Views
Last Modified: 2013-11-13
I have two very large CSV files both with the following headings 'Name', FullName','Length'.
What I am looking for is a way to compare these CSV files in Powershell.

I need to know...

1) What files are unique to each set (Based purely on Name).
2) What files exist in both but whos lengths are different (Based on Name and Length).

Basically a report on what changes are represented between the two CSV files... If the results could be output to seperate files representing each type of difference that would be ideal?

This is to solve a problem where a new version of software has grown rapidly in size but the cause of the growth is unknown.
0
Comment
Question by:Blowfelt82
  • 2
  • 2
4 Comments
 
LVL 39

Expert Comment

by:footech
Comment Utility
Let me know how the below works for you.  The output files only include the file names.  If you need it to be something else, let me know if you need help making the adjustment to the code.  Hope that all files names are unique in each .CSV, otherwise this won't work.
$file1 = Import-CSV file1.csv
$file2 = Import-CSV file2.csv
Compare-Object $file1 $file2 -Property Name | Select -ExpandProperty Name | Out-File UniqueFiles.txt
($file1 + $file2) | Group -Property Name |
 ? { $_.count -eq 2 } |
 % { Compare-Object ($_.group)[0] ($_.group)[1] -property Name,Length -passthru } |
 Select -ExpandProperty Name -ExcludeProperty SideIndicator -Unique |
 Out-File ChangedSize.txt

Open in new window

0
 

Author Comment

by:Blowfelt82
Comment Utility
Its basically a comparison of a c:\ drive exported from a wim file, so there may well be duplicated names... Perhaps using the fullpath field would give greater acuracy?
0
 
LVL 39

Accepted Solution

by:
footech earned 500 total points
Comment Utility
Using the fullname would avoid errors.  All you would have to do to modify the script is change each instance of "Name" to "FullName".
0
 

Author Closing Comment

by:Blowfelt82
Comment Utility
Thanks again for your help
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Hi all.   The other day I had to change the passwords for a bunch of users on the fly. Because they were so many, I decided to do it in an automated way and I would like to share it with you all.   If you are not doing it directly in a Domain Co…
This article will show, step by step, how to integrate R code into a R Sweave document
Learn the basics of modules and packages in Python. Every Python file is a module, ending in the suffix: .py: Modules are a collection of functions and variables.: Packages are a collection of modules.: Module functions and variables are accessed us…
The viewer will learn how to dynamically set the form action using jQuery.

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

6 Experts available now in Live!

Get 1:1 Help Now