Looking for duplicate file finder solution

Posted on 2008-06-11
Last Modified: 2008-06-22
I'm looking for a software that can find duplicate files of all types either locally or remotely (network share). The app should be able to find files not just by name but by "signature" (something like MD5 hash). It should be able to find duplicates even if the filenames do not match but contents are the same (that's where other, more "intelligent" comparison mechanisms come into play).

Please don't post top 5 google searches - I can use google myself quite nicely. This will need to run on XP/2K3, free solution would be ideal, any solution that is licensed should be reasonably priced and if it is commercial solution, it has to be by an established compan, not by fly-by-night company that won't be there tomorrow to support the product.

Thanks in advance!
Question by:CynepMeH
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 2
LVL 26

Expert Comment

ID: 21765921
I use this freeware application and it does just about everything you want *including* search by signature using either SHA or MD5 hashing algorithms.

Duplicate Files Searcher is an application for searching and deleting duplicate files on your computer. It is a platform-independent application.

LVL 11

Author Comment

ID: 21770238
Thanks for the link. Looks like an interesting utility but it appears a bit sluggish, possibly due to it being java-dependent and since it requires java we may not be able to use it, as not every system has java installed. Let's see what else surfaces...
LVL 11

Author Comment

ID: 21771326
I just ran duplicatefilesearcher - ran for over an hour just trying to get a listing of folders on a 40GB volume. I'm afraid that won't work. So, I guess it's back to the drawing board with an added requirement:

The solution must be robust.
I'll close this request out and re-open it, as I think it landed in a wrong area. I also want more eyes to look at it. Thanks souseran, sorry it didn't work out.
SharePoint Admin?

Enable Your Employees To Focus On The Core With Intuitive Onscreen Guidance That is With You At The Moment of Need.

LVL 26

Expert Comment

ID: 21773441
Before you close it, try this one:

Easy Duplicate Finder

Faster than Duplicate Files Searcher. Not Java dependent, and does CRC32 Checksum +FileSize comparisons.

Oh, and it's freeware.
LVL 11

Author Comment

ID: 21774800
Thanks, looks promissing, I'll check it out tonight! Much obliged.
LVL 11

Accepted Solution

CynepMeH earned 0 total points
ID: 21787251
Thanks for your suggestion but it didn't work out - software crashed hard several times on different systems, esp. when it needs to enumerate large volumes. Can't use it. Thanks for your recommendation anyway.

Featured Post

NFR key for Veeam Backup for Microsoft Office 365

Veeam is happy to provide a free NFR license (for 1 year, up to 10 users). This license allows for the non‑production use of Veeam Backup for Microsoft Office 365 in your home lab without any feature limitations.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

I use more than 1 computer in my office for various reasons. Multiple keyboards and mice take up more than just extra space, they make working a little more complicated. Using one mouse and keyboard for all of my computers makes life easier. This co…
Many businesses neglect disaster recovery and treat it as an after-thought. I can tell you first hand that data will be lost, hard drives die, servers will be hacked, and careless (or malicious) employees can ruin your data.
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

733 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question