[Last Call] Learn about multicloud storage options and how to improve your company's cloud strategy. Register Now


Comparing files between two different hard drives: Finding files that are not duplicated

Posted on 2010-08-23
Medium Priority
Last Modified: 2012-06-21
I have an external hard drive that contains a bunch of old back-up files.  I also have an internal hard drive in my Windows XP box.  Is there some utility that will allow me to find out which files (if any) on the EXTERNAL drive are not also present on the INTERNAL hard drive?

Note that this is the opposite of duplicate-checking -- I'm looking for a list of files that are NOT duplicated.  My expectation is that all (or almost all) of the files on the external drive are also present on the internal drive.  A list of duplicates would be horribly long.

I've heard that a utility called Total Commander can do all sorts of fancy file comparisons, but I'm really looking for any solution (freeware is better, obviously).

Question by:chernavsky
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions

Expert Comment

ID: 33502219
You can use an application named winmerge, http://winmerge.org/index.php. it allows you to compare two paths, and tell you about the differences between folders, and files also.

Expert Comment

ID: 33502292
You could also use Beyond Compare from http://www.scootersoftware.com.
This tool will also list any differences in the files matched. And others as new.
Use Folder comparison than File comparison. Beyond compare could used in full 30 trial days.
LVL 35

Expert Comment

ID: 33502510
You already talked about Total Commander: it's one of the very few commercial tools I ever bought and never resented buying. But you can use the evaluation version without any restriction as well: http://www.ghisler.com/download.htm

I recently discovered a free clone of Total Commander that is almost as good as the original: Free Commander - http://www.freecommander.com/
It also has an option Folder > Compare folders and Folder > Synchronize folders.
What does it mean to be "Always On"?

Is your cloud always on? With an Always On cloud you won't have to worry about downtime for maintenance or software application code updates, ensuring that your bottom line isn't affected.


Expert Comment

ID: 33506659
Heatsoft has 2 products that may suit your needs. Clone Cleaner Pro or Heatsoft ACDS. Both feature tools for locating and compare files with powerful filtering.

You can download at http://www.heatsoft.com

Good luck and post your updated comments.
LVL 11

Accepted Solution

ocanada_techguy earned 1000 total points
ID: 33508810
Some excellent suggestions.  I have another:
If you run SyncBack by http://www.2brightsparks.com you can run a job in SIMULATE mode and it will show which files would be copied.  It has numerous options for choosing to copy from A to B, B to A, or sync A and B, and looking at size and timestamps, and what to do if something's on A not B, whether to prompt etc.  I think you'll find it's pretty nice and free.  One thing though, the free version, the logfile (it's multiple html pages actually) is in the program folder but it gets overwritten the next time you run the job so you'll want to copy and paste the logfiles.

Robocopy, included in windows, and an update with a GIU front end free to download from Microsoft, has one teeny advantage IF/when you go to do the actual copying.  See, most every program, oh sure they copy the datetime of the files, but not the folders.  When you copy, when it has to create folders in the target tree to accomodate files the datetimestamp on the folders gets "now" on the target instead of the same datetime as the same folder on the source.  robocopy actually has command-line switches/options to copy the datetimes of folders too.  And, a big plus is robocopy can copy ACLs, the complex permissions set on files and folders too.  One bit of advice, save your output to a logfile, and adjust the number of attempts/retry timeout on fails to copy or you'll be wasting many many minutes on each and every file it has a problem copying such that when there is problems the job could take a day.

Author Comment

ID: 33509966
Thanks for all the tips.  Looks like some interesting tools there!  I won't be able to test any of them for a few days.  I'll report back by the end of the week, if not earlier.

Thanks again.

Expert Comment

ID: 33510352
Hi Chernavsky.

Here is something that is free:

2. Copy the code below and paste it onto NOTEPAD.EXE.
3. Save the text file to C:\WINDOWS\CHKDIR.BAT

To use the above utility, open a command prompt and type the following command:


You can also create a text file out of the resulting list:

CHKDIR "C:\DIR1" "D:\DIR2" > mylist.txt

This will create a list on the current folder that can be examined further using NOTEPAD.EXE or any text editor.

Hope this helps.

Feel free to change the batch file if you wish a more detailed list (like date/time, size, etc.).
@echo off
if "%1" == "" goto :usage
if "%2" == "" goto :usage
if "%3" == "" ( SET FILEPAT=*.* ) ELSE ( SET FILEPAT=%~3 )
if "%CHKDIR1:~-1%" NEQ "\" SET CHKDIR1=%CHKDIR1%\
if "%CHKDIR2:~-1%" NEQ "\" SET CHKDIR2=%CHKDIR2%\

echo Files found in %CHKDIR1% that are missing in %CHKDIR2%
for /r %CHKDIR1% %%f in (%FILEPAT%) DO CALL :CHKEXISTS "%%f"
GOTO :end

SET __DISP=%~1
SET __DIR1=%CHKDIR1:~0,-1%
SET __DIR2=%CHKDIR2:~0,-1%
GOTO :eof

echo Usage: CHKDIR [drive1:]path1 [drive2:]path2 [file pattern]
echo   Ex.: CHKDIR "C:\DIR1" "F:\"
echo   Ex.: CHKDIR "C:\Users\My Name\My Documents" "D:\My Documents" *.docx


Open in new window


Expert Comment

ID: 33510409
P.S. No need to install anything other than writing a batch file.

Author Closing Comment

ID: 33620238
Thanks for all the tips, and sorry about the delay in replying.  Some of the other solutions might have worked as well, but I chose the SyncBack option, as posted by "ocanada techguy".  Thanks again for all the help.

Featured Post

Independent Software Vendors: We Want Your Opinion

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

More or less everybody in the IT market understands the basics of Networking, however when we start talking about Storage Networks, things get a bit dizzier, and this is where I would like to help.
this article is a guided solution for most of the common server issues in server hardware tasks we are facing in our routine job works. the topics in the following article covered are, 1) dell hardware raidlevel (Perc) 2) adding HDD 3) how t…
Two types of users will appreciate AOMEI Backupper Pro: 1 - Those with PCIe drives (and haven't found cloning software that works on them). 2 - Those who want a fast clone of their boot drive (no re-boots needed) and it can clone your drive wh…
Finding and deleting duplicate (picture) files can be a time consuming task. My wife and I, our three kids and their families all share one dilemma: Managing our pictures. Between desktops, laptops, phones, tablets, and cameras; over the last decade…

650 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question