Solved

Locating Large, Duplicate and MP3 files on LAN

Posted on 2011-03-22
20
256 Views
Last Modified: 2013-12-07
Hello experts,

i am trying to find a way to scan our LAN for Large, duplicate and MP3 files. Is there a software or tool that can automate this? The endgame is to have output of folder name, created by and size so i can have a check on the LAN size.

Thanks in advance!
0
Comment
Question by:rohitsurya
  • 10
  • 10
20 Comments
 
LVL 12

Accepted Solution

by:
FDiskWizard earned 250 total points
ID: 35192785
Go check out TreeSize Professional. Excellent tool. It will break it down, or filter by filetype, or groups like Audio, video, OfficeDocs, etc..

But, it would most likely have to be ran on the server. There is an option to do a  USB Install so you don't have to really do a server install. It will be portable via a folder on the server.

Some of our servers have millions of files so scanning over the LAN doesn't work so well.

There is a program called Easy Duplicate finder that is great at showing duplicates. Give file paths, and can export with links to those folders.
http://www.easyduplicatefinder.com/
They also have one specific for MP3 duplicates.


0
 

Author Comment

by:rohitsurya
ID: 35198764
Thanks! Is there anything that can be executed on the client side. i dont have access to run it on server. When i run it on client its not showing me who the owner is.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35201666
I can't recall for sure, but I think you have to set it to pull owner info. Maybe 'Author' attribute also.
Sometimes the owner is just administrator. But author will show you who created the document.
Folder location may point out the culprits also.

I don't think running it remotely makes a difference, just slower... I've tried it before, but I normally run from server because of the huge volume of data.

TreeSize is about the best thing out there... There are a couple of other comparable products.
0
 

Author Comment

by:rohitsurya
ID: 35202569
When i run it from my desktop for author it says it failed the trust relationship?

What are the other comparable products.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35206998
I think that's going to be a security issue, not an app issue. You are a local admin? Right?
Most "trust relationship" issues I've seen are a Computer trust problem, as in not a member of the domain, or computer account missing. Unless maybe you have multiple domains?

It should run remotely with local admin permissions; just slower than running locally. I normally have it seach the default drive share, like: \\server1\D$. But, it should work against any share\path that you have access to.

I'm running against a server from my PC now... it is a bit of a CPU hog.
It's maxing out my 3+ yr old dual-core CPU.
0
 

Author Comment

by:rohitsurya
ID: 35207076
No i am not the admin. What should i have the admin provide me?

You mentioned there are alternate solution. What are they?

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35207081
FYI: It took me around 12 mins to scan a server with 1.5 Million files, and 151,000 folders.

0
 

Author Comment

by:rohitsurya
ID: 35210094
I should say this tool is powerful...Is there a filter i can drop where i can scan every folder in a shared drive and make it give me the path,filename, last date used, size and the author?

It will really serve my need.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35214831
Yes... Two methods.

1st is for folders only, and it even creates hyper links to the Folders.
Just right click on a folder in the left pane, at any folder level you want...
By default it will export the folders you currently have expanded.
Go in to TOOLS > OPTIONS > 'Columns/Export' tab and you can change the export behavior.

2nd: you have to use the file search tool, and export results from that to get file listings.
That's a LOT of data BTW.. :)

Did you look through the tabs in the results pane on the right?
Like 'Extensions' and 'Age of Files' tabs? Good stuff!
Very good app.

I would suggest running it against a small share to play around with what it can do.
Or even a subfolder of a share like: \\server1\IT\Tools

0
 

Author Comment

by:rohitsurya
ID: 35318285
The treesize pro is a great tool but when i run scans on the top users hoggin space on our share drives it gives me a great report BUT if the users have files that are more than 1000 KB the tool splits the information into two columsn when i export it to a CSV.

Is there a setting that i can change so it does not export like this.

examples is 1234 kb.. it puts 1 on size column and 234kb on last saved column..

please advise.
0
Zoho SalesIQ

Hassle-free live chat software re-imagined for business growth. 2 users, always free.

 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35324736
I think your problem may be the comma separator in large numbers.
Can you export to TAB delimited?
Or just try changing the size display as MB (or maybe GB). There are buttons on the toolbar to switch. That should eliminate the commas. Unless you run into GBs...
There is also a 4th button AUTO (AU/TO) which will display a mixture of HB MB GB.
0
 

Author Comment

by:rohitsurya
ID: 35324859
Yes i have tried everything you have said here and i still have this issue. We love this tool but we would have to look for something else if we can fix this issue since its too much manual work which we simple dont have the time for.

Can you suggest me something that is better or relatively close to treesize. paid is find too..

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35327829
is there a reason you're using CSV instead of Saving as XLS (Excel)?
You're exporting from the USERS tab?
0
 

Author Comment

by:rohitsurya
ID: 35327930
yea there are too many files to be exported to excel. yea im exporting from users tab
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35328104
OH... Is it hitting the 65,000 row limit in older versions of XLS? Did you try specifying .XLSX as the extension?
I'm assuming you must be exporting a list of all of their files?
Or are you just exporting USERS with their overall stats?
Or what about Top 100 files report? It will still show owners.

 



0
 

Author Comment

by:rohitsurya
ID: 35328159
Yes i am exporting all the files of users. I am trying to determine how they are taking up so much space. And yes its hitting over 65000. I tried specifing .xlsx and its spilling data over.

i have changed the number of decimal on options to zero and set automatic as metric (gb,mb,kb)

its spills a few over still.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333019
This is what I would do...
Let the search run with the USERS tab open. Once complete, right click the top user and "Limit to this User". That will show only folders that contain that User's data.
You can then right-click again and Show All Users.
Then go to the next...
I usually do screenshots showing were the big lumps of data are.
I think by default folders are sorted by size... Most likely, a user or department will be users of the folders. Screenshot > email....
The Snipping tool in Vista/Win7 is great :)

0
 

Author Comment

by:rohitsurya
ID: 35333214
Yup thats what i am doing right now. But we are down to detailing haha.

We send people all the files they own so they can determine what they wanna keep or remove. i normally goup them by file type so we can eliminate unauthoirzed file types also mp3 etc.

When i limit to users on the left the tree updates but the file types on the main screen does not. i wish they bring that feature next release!
0
 

Author Comment

by:rohitsurya
ID: 35333243
Snipping tool is really cool :)
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333364
Well, as another approach you could go to the file Extensions tab and limit to AUDIO and show which folders have music and how much.. it might not show owners... but the folder names may show department or owner.
0

Featured Post

Control application downtime with dependency maps

Visualize the interdependencies between application components better with Applications Manager's automated application discovery and dependency mapping feature. Resolve performance issues faster by quickly isolating problematic components.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Find out what Office 365 Transport Rules are, how they work and their limitations managing Office 365 signatures.
A customer recently asked me about anti-malware and the different deployment options available for his business. Daily news about cyberattacks, zero-day vulnerabilities, and companies that suffered a security breach made him wonder if the endpoint a…
This tutorial will walk an individual through the process of transferring the five major, necessary Active Directory Roles, commonly referred to as the FSMO roles from a Windows Server 2008 domain controller to a Windows Server 2012 domain controlle…
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now