Solved

Locating Large, Duplicate and MP3 files on LAN

Posted on 2011-03-22
20
261 Views
Last Modified: 2013-12-07
Hello experts,

i am trying to find a way to scan our LAN for Large, duplicate and MP3 files. Is there a software or tool that can automate this? The endgame is to have output of folder name, created by and size so i can have a check on the LAN size.

Thanks in advance!
0
Comment
Question by:rohitsurya
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 10
  • 10
20 Comments
 
LVL 12

Accepted Solution

by:
FDiskWizard earned 250 total points
ID: 35192785
Go check out TreeSize Professional. Excellent tool. It will break it down, or filter by filetype, or groups like Audio, video, OfficeDocs, etc..

But, it would most likely have to be ran on the server. There is an option to do a  USB Install so you don't have to really do a server install. It will be portable via a folder on the server.

Some of our servers have millions of files so scanning over the LAN doesn't work so well.

There is a program called Easy Duplicate finder that is great at showing duplicates. Give file paths, and can export with links to those folders.
http://www.easyduplicatefinder.com/
They also have one specific for MP3 duplicates.


0
 

Author Comment

by:rohitsurya
ID: 35198764
Thanks! Is there anything that can be executed on the client side. i dont have access to run it on server. When i run it on client its not showing me who the owner is.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35201666
I can't recall for sure, but I think you have to set it to pull owner info. Maybe 'Author' attribute also.
Sometimes the owner is just administrator. But author will show you who created the document.
Folder location may point out the culprits also.

I don't think running it remotely makes a difference, just slower... I've tried it before, but I normally run from server because of the huge volume of data.

TreeSize is about the best thing out there... There are a couple of other comparable products.
0
Office 365 Training for IT Pros

Learn how to provision tenants, synchronize on-premise Active Directory, implement Single Sign-On, customize Office deployment, and protect your organization with eDiscovery and DLP policies.  Only from Platform Scholar.

 

Author Comment

by:rohitsurya
ID: 35202569
When i run it from my desktop for author it says it failed the trust relationship?

What are the other comparable products.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35206998
I think that's going to be a security issue, not an app issue. You are a local admin? Right?
Most "trust relationship" issues I've seen are a Computer trust problem, as in not a member of the domain, or computer account missing. Unless maybe you have multiple domains?

It should run remotely with local admin permissions; just slower than running locally. I normally have it seach the default drive share, like: \\server1\D$. But, it should work against any share\path that you have access to.

I'm running against a server from my PC now... it is a bit of a CPU hog.
It's maxing out my 3+ yr old dual-core CPU.
0
 

Author Comment

by:rohitsurya
ID: 35207076
No i am not the admin. What should i have the admin provide me?

You mentioned there are alternate solution. What are they?

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35207081
FYI: It took me around 12 mins to scan a server with 1.5 Million files, and 151,000 folders.

0
 

Author Comment

by:rohitsurya
ID: 35210094
I should say this tool is powerful...Is there a filter i can drop where i can scan every folder in a shared drive and make it give me the path,filename, last date used, size and the author?

It will really serve my need.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35214831
Yes... Two methods.

1st is for folders only, and it even creates hyper links to the Folders.
Just right click on a folder in the left pane, at any folder level you want...
By default it will export the folders you currently have expanded.
Go in to TOOLS > OPTIONS > 'Columns/Export' tab and you can change the export behavior.

2nd: you have to use the file search tool, and export results from that to get file listings.
That's a LOT of data BTW.. :)

Did you look through the tabs in the results pane on the right?
Like 'Extensions' and 'Age of Files' tabs? Good stuff!
Very good app.

I would suggest running it against a small share to play around with what it can do.
Or even a subfolder of a share like: \\server1\IT\Tools

0
 

Author Comment

by:rohitsurya
ID: 35318285
The treesize pro is a great tool but when i run scans on the top users hoggin space on our share drives it gives me a great report BUT if the users have files that are more than 1000 KB the tool splits the information into two columsn when i export it to a CSV.

Is there a setting that i can change so it does not export like this.

examples is 1234 kb.. it puts 1 on size column and 234kb on last saved column..

please advise.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35324736
I think your problem may be the comma separator in large numbers.
Can you export to TAB delimited?
Or just try changing the size display as MB (or maybe GB). There are buttons on the toolbar to switch. That should eliminate the commas. Unless you run into GBs...
There is also a 4th button AUTO (AU/TO) which will display a mixture of HB MB GB.
0
 

Author Comment

by:rohitsurya
ID: 35324859
Yes i have tried everything you have said here and i still have this issue. We love this tool but we would have to look for something else if we can fix this issue since its too much manual work which we simple dont have the time for.

Can you suggest me something that is better or relatively close to treesize. paid is find too..

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35327829
is there a reason you're using CSV instead of Saving as XLS (Excel)?
You're exporting from the USERS tab?
0
 

Author Comment

by:rohitsurya
ID: 35327930
yea there are too many files to be exported to excel. yea im exporting from users tab
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35328104
OH... Is it hitting the 65,000 row limit in older versions of XLS? Did you try specifying .XLSX as the extension?
I'm assuming you must be exporting a list of all of their files?
Or are you just exporting USERS with their overall stats?
Or what about Top 100 files report? It will still show owners.

 



0
 

Author Comment

by:rohitsurya
ID: 35328159
Yes i am exporting all the files of users. I am trying to determine how they are taking up so much space. And yes its hitting over 65000. I tried specifing .xlsx and its spilling data over.

i have changed the number of decimal on options to zero and set automatic as metric (gb,mb,kb)

its spills a few over still.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333019
This is what I would do...
Let the search run with the USERS tab open. Once complete, right click the top user and "Limit to this User". That will show only folders that contain that User's data.
You can then right-click again and Show All Users.
Then go to the next...
I usually do screenshots showing were the big lumps of data are.
I think by default folders are sorted by size... Most likely, a user or department will be users of the folders. Screenshot > email....
The Snipping tool in Vista/Win7 is great :)

0
 

Author Comment

by:rohitsurya
ID: 35333214
Yup thats what i am doing right now. But we are down to detailing haha.

We send people all the files they own so they can determine what they wanna keep or remove. i normally goup them by file type so we can eliminate unauthoirzed file types also mp3 etc.

When i limit to users on the left the tree updates but the file types on the main screen does not. i wish they bring that feature next release!
0
 

Author Comment

by:rohitsurya
ID: 35333243
Snipping tool is really cool :)
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333364
Well, as another approach you could go to the file Extensions tab and limit to AUDIO and show which folders have music and how much.. it might not show owners... but the folder names may show department or owner.
0

Featured Post

PeopleSoft Has Never Been Easier

PeopleSoft Adoption Made Smooth & Simple!

On-The-Job Training Is made Intuitive & Easy With WalkMe's On-Screen Guidance Tool.  Claim Your Free WalkMe Account Now

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

With the rising number of cyber attacks in recent years, keeping your personal data safe has become more important than ever. The tips outlined in this article will help you keep your identitfy safe.
This article is written by John Gates, CISSP. Gates, the SNUG President-Elect, currently holds the position of Manager of Information Systems at Lake Park High School in Roselle, Illinois.
Sending a Secure fax is easy with eFax Corporate (http://www.enterprise.efax.com). First, just open a new email message. In the To field, type your recipient's fax number @efaxsend.com. You can even send a secure international fax — just include t…
Are you ready to implement Active Directory best practices without reading 300+ pages? You're in luck. In this webinar hosted by Skyport Systems, you gain insight into Microsoft's latest comprehensive guide, with tips on the best and easiest way…
Suggested Courses

626 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question