Solved

Comparing files between two different hard drives: Finding files that are not duplicated

Posted on 2010-08-23
9
471 Views
Last Modified: 2012-06-21
I have an external hard drive that contains a bunch of old back-up files.  I also have an internal hard drive in my Windows XP box.  Is there some utility that will allow me to find out which files (if any) on the EXTERNAL drive are not also present on the INTERNAL hard drive?

Note that this is the opposite of duplicate-checking -- I'm looking for a list of files that are NOT duplicated.  My expectation is that all (or almost all) of the files on the external drive are also present on the internal drive.  A list of duplicates would be horribly long.

I've heard that a utility called Total Commander can do all sorts of fancy file comparisons, but I'm really looking for any solution (freeware is better, obviously).

Thanks.
0
Comment
Question by:chernavsky
9 Comments
 

Expert Comment

by:gleiwer
ID: 33502219
You can use an application named winmerge, http://winmerge.org/index.php. it allows you to compare two paths, and tell you about the differences between folders, and files also.
0
 
LVL 3

Expert Comment

by:loks
ID: 33502292
You could also use Beyond Compare from http://www.scootersoftware.com.
This tool will also list any differences in the files matched. And others as new.
Use Folder comparison than File comparison. Beyond compare could used in full 30 trial days.
0
 
LVL 35

Expert Comment

by:torimar
ID: 33502510
You already talked about Total Commander: it's one of the very few commercial tools I ever bought and never resented buying. But you can use the evaluation version without any restriction as well: http://www.ghisler.com/download.htm

I recently discovered a free clone of Total Commander that is almost as good as the original: Free Commander - http://www.freecommander.com/
It also has an option Folder > Compare folders and Folder > Synchronize folders.
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 4

Expert Comment

by:SJH01
ID: 33506659
Heatsoft has 2 products that may suit your needs. Clone Cleaner Pro or Heatsoft ACDS. Both feature tools for locating and compare files with powerful filtering.

You can download at http://www.heatsoft.com

Good luck and post your updated comments.
0
 
LVL 11

Accepted Solution

by:
ocanada_techguy earned 250 total points
ID: 33508810
Some excellent suggestions.  I have another:
If you run SyncBack by http://www.2brightsparks.com you can run a job in SIMULATE mode and it will show which files would be copied.  It has numerous options for choosing to copy from A to B, B to A, or sync A and B, and looking at size and timestamps, and what to do if something's on A not B, whether to prompt etc.  I think you'll find it's pretty nice and free.  One thing though, the free version, the logfile (it's multiple html pages actually) is in the program folder but it gets overwritten the next time you run the job so you'll want to copy and paste the logfiles.

Robocopy, included in windows, and an update with a GIU front end free to download from Microsoft, has one teeny advantage IF/when you go to do the actual copying.  See, most every program, oh sure they copy the datetime of the files, but not the folders.  When you copy, when it has to create folders in the target tree to accomodate files the datetimestamp on the folders gets "now" on the target instead of the same datetime as the same folder on the source.  robocopy actually has command-line switches/options to copy the datetimes of folders too.  And, a big plus is robocopy can copy ACLs, the complex permissions set on files and folders too.  One bit of advice, save your output to a logfile, and adjust the number of attempts/retry timeout on fails to copy or you'll be wasting many many minutes on each and every file it has a problem copying such that when there is problems the job could take a day.
0
 

Author Comment

by:chernavsky
ID: 33509966
Thanks for all the tips.  Looks like some interesting tools there!  I won't be able to test any of them for a few days.  I'll report back by the end of the week, if not earlier.

Thanks again.
0
 
LVL 2

Expert Comment

by:FEOX
ID: 33510352
Hi Chernavsky.

Here is something that is free:

1. Open NOTEPAD.EXE.
2. Copy the code below and paste it onto NOTEPAD.EXE.
3. Save the text file to C:\WINDOWS\CHKDIR.BAT

To use the above utility, open a command prompt and type the following command:

CHKDIR "C:\DIR1" "D:\DIR2"

You can also create a text file out of the resulting list:

CHKDIR "C:\DIR1" "D:\DIR2" > mylist.txt

This will create a list on the current folder that can be examined further using NOTEPAD.EXE or any text editor.

Hope this helps.

Feel free to change the batch file if you wish a more detailed list (like date/time, size, etc.).
@echo off
SETLOCAL
if "%1" == "" goto :usage
if "%2" == "" goto :usage
if "%3" == "" ( SET FILEPAT=*.* ) ELSE ( SET FILEPAT=%~3 )
SET CHKDIR1=%~f1
SET CHKDIR2=%~f2
SET CHKFILE=
if "%CHKDIR1:~-1%" NEQ "\" SET CHKDIR1=%CHKDIR1%\
if "%CHKDIR2:~-1%" NEQ "\" SET CHKDIR2=%CHKDIR2%\

echo.
echo Files found in %CHKDIR1% that are missing in %CHKDIR2%
for /r %CHKDIR1% %%f in (%FILEPAT%) DO CALL :CHKEXISTS "%%f"
GOTO :end

:CHKEXISTS
SET __FILE=%1
SET __DISP=%~1
SET __DIR1=%CHKDIR1:~0,-1%
SET __DIR2=%CHKDIR2:~0,-1%
CALL SET CHKFILE=%%__FILE:%__DIR1%=%__DIR2%%%
IF NOT EXIST %CHKFILE% echo %__DISP%
GOTO :eof

:usage
echo.
echo Usage: CHKDIR [drive1:]path1 [drive2:]path2 [file pattern]
echo   Ex.: CHKDIR "C:\DIR1" "F:\"
echo   Ex.: CHKDIR "C:\Users\My Name\My Documents" "D:\My Documents" *.docx

:end
ENDLOCAL

Open in new window

0
 
LVL 2

Expert Comment

by:FEOX
ID: 33510409
P.S. No need to install anything other than writing a batch file.
0
 

Author Closing Comment

by:chernavsky
ID: 33620238
Thanks for all the tips, and sorry about the delay in replying.  Some of the other solutions might have worked as well, but I chose the SyncBack option, as posted by "ocanada techguy".  Thanks again for all the help.
0

Featured Post

Back Up Your Microsoft Windows Server®

Back up all your Microsoft Windows Server – on-premises, in remote locations, in private and hybrid clouds. Your entire Windows Server will be backed up in one easy step with patented, block-level disk imaging. We achieve RTOs (recovery time objectives) as low as 15 seconds.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

I previously wrote an article addressing the use of UBCD4WIN and SARDU. All are great, but I have always been an advocate of SARDU. Recently it was suggested that I go back and take a look at Easy2Boot in comparison.
Storage devices are generally used to save the data or sometime transfer the data from one computer system to another system. However, sometimes user accidentally erased their important data from the Storage devices. Users have to know how data reco…
This video Micro Tutorial explains how to clone a hard drive using a commercial software product for Windows systems called Casper from Future Systems Solutions (FSS). Cloning makes an exact, complete copy of one hard disk drive (HDD) onto another d…
Two types of users will appreciate AOMEI Backupper Pro: 1 - Those with PCIe drives (and haven't found cloning software that works on them). 2 - Those who want a fast clone of their boot drive (no re-boots needed) and it can clone your drive wh…

831 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question