Solved

Locating Large, Duplicate and MP3 files on LAN

Posted on 2011-03-22
20
259 Views
Last Modified: 2013-12-07
Hello experts,

i am trying to find a way to scan our LAN for Large, duplicate and MP3 files. Is there a software or tool that can automate this? The endgame is to have output of folder name, created by and size so i can have a check on the LAN size.

Thanks in advance!
0
Comment
Question by:rohitsurya
  • 10
  • 10
20 Comments
 
LVL 12

Accepted Solution

by:
FDiskWizard earned 250 total points
ID: 35192785
Go check out TreeSize Professional. Excellent tool. It will break it down, or filter by filetype, or groups like Audio, video, OfficeDocs, etc..

But, it would most likely have to be ran on the server. There is an option to do a  USB Install so you don't have to really do a server install. It will be portable via a folder on the server.

Some of our servers have millions of files so scanning over the LAN doesn't work so well.

There is a program called Easy Duplicate finder that is great at showing duplicates. Give file paths, and can export with links to those folders.
http://www.easyduplicatefinder.com/
They also have one specific for MP3 duplicates.


0
 

Author Comment

by:rohitsurya
ID: 35198764
Thanks! Is there anything that can be executed on the client side. i dont have access to run it on server. When i run it on client its not showing me who the owner is.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35201666
I can't recall for sure, but I think you have to set it to pull owner info. Maybe 'Author' attribute also.
Sometimes the owner is just administrator. But author will show you who created the document.
Folder location may point out the culprits also.

I don't think running it remotely makes a difference, just slower... I've tried it before, but I normally run from server because of the huge volume of data.

TreeSize is about the best thing out there... There are a couple of other comparable products.
0
Are your AD admin tools letting you down?

Managing Active Directory can get complicated.  Often, the native tools for managing AD are just not up to the task.  The largest Active Directory installations in the world have relied on one tool to manage their day-to-day administration tasks: Hyena. Start your trial today.

 

Author Comment

by:rohitsurya
ID: 35202569
When i run it from my desktop for author it says it failed the trust relationship?

What are the other comparable products.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35206998
I think that's going to be a security issue, not an app issue. You are a local admin? Right?
Most "trust relationship" issues I've seen are a Computer trust problem, as in not a member of the domain, or computer account missing. Unless maybe you have multiple domains?

It should run remotely with local admin permissions; just slower than running locally. I normally have it seach the default drive share, like: \\server1\D$. But, it should work against any share\path that you have access to.

I'm running against a server from my PC now... it is a bit of a CPU hog.
It's maxing out my 3+ yr old dual-core CPU.
0
 

Author Comment

by:rohitsurya
ID: 35207076
No i am not the admin. What should i have the admin provide me?

You mentioned there are alternate solution. What are they?

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35207081
FYI: It took me around 12 mins to scan a server with 1.5 Million files, and 151,000 folders.

0
 

Author Comment

by:rohitsurya
ID: 35210094
I should say this tool is powerful...Is there a filter i can drop where i can scan every folder in a shared drive and make it give me the path,filename, last date used, size and the author?

It will really serve my need.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35214831
Yes... Two methods.

1st is for folders only, and it even creates hyper links to the Folders.
Just right click on a folder in the left pane, at any folder level you want...
By default it will export the folders you currently have expanded.
Go in to TOOLS > OPTIONS > 'Columns/Export' tab and you can change the export behavior.

2nd: you have to use the file search tool, and export results from that to get file listings.
That's a LOT of data BTW.. :)

Did you look through the tabs in the results pane on the right?
Like 'Extensions' and 'Age of Files' tabs? Good stuff!
Very good app.

I would suggest running it against a small share to play around with what it can do.
Or even a subfolder of a share like: \\server1\IT\Tools

0
 

Author Comment

by:rohitsurya
ID: 35318285
The treesize pro is a great tool but when i run scans on the top users hoggin space on our share drives it gives me a great report BUT if the users have files that are more than 1000 KB the tool splits the information into two columsn when i export it to a CSV.

Is there a setting that i can change so it does not export like this.

examples is 1234 kb.. it puts 1 on size column and 234kb on last saved column..

please advise.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35324736
I think your problem may be the comma separator in large numbers.
Can you export to TAB delimited?
Or just try changing the size display as MB (or maybe GB). There are buttons on the toolbar to switch. That should eliminate the commas. Unless you run into GBs...
There is also a 4th button AUTO (AU/TO) which will display a mixture of HB MB GB.
0
 

Author Comment

by:rohitsurya
ID: 35324859
Yes i have tried everything you have said here and i still have this issue. We love this tool but we would have to look for something else if we can fix this issue since its too much manual work which we simple dont have the time for.

Can you suggest me something that is better or relatively close to treesize. paid is find too..

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35327829
is there a reason you're using CSV instead of Saving as XLS (Excel)?
You're exporting from the USERS tab?
0
 

Author Comment

by:rohitsurya
ID: 35327930
yea there are too many files to be exported to excel. yea im exporting from users tab
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35328104
OH... Is it hitting the 65,000 row limit in older versions of XLS? Did you try specifying .XLSX as the extension?
I'm assuming you must be exporting a list of all of their files?
Or are you just exporting USERS with their overall stats?
Or what about Top 100 files report? It will still show owners.

 



0
 

Author Comment

by:rohitsurya
ID: 35328159
Yes i am exporting all the files of users. I am trying to determine how they are taking up so much space. And yes its hitting over 65000. I tried specifing .xlsx and its spilling data over.

i have changed the number of decimal on options to zero and set automatic as metric (gb,mb,kb)

its spills a few over still.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333019
This is what I would do...
Let the search run with the USERS tab open. Once complete, right click the top user and "Limit to this User". That will show only folders that contain that User's data.
You can then right-click again and Show All Users.
Then go to the next...
I usually do screenshots showing were the big lumps of data are.
I think by default folders are sorted by size... Most likely, a user or department will be users of the folders. Screenshot > email....
The Snipping tool in Vista/Win7 is great :)

0
 

Author Comment

by:rohitsurya
ID: 35333214
Yup thats what i am doing right now. But we are down to detailing haha.

We send people all the files they own so they can determine what they wanna keep or remove. i normally goup them by file type so we can eliminate unauthoirzed file types also mp3 etc.

When i limit to users on the left the tree updates but the file types on the main screen does not. i wish they bring that feature next release!
0
 

Author Comment

by:rohitsurya
ID: 35333243
Snipping tool is really cool :)
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333364
Well, as another approach you could go to the file Extensions tab and limit to AUDIO and show which folders have music and how much.. it might not show owners... but the folder names may show department or owner.
0

Featured Post

Watch Anatomy of a Wi-Fi Hack On-Demand

In less than a weekend, anyone with Internet access and some free time can become a Wi-Fi MitM to wreak havoc on your network. View our Wi-Fi Expert in an on-demand episode of our Secure Wi-Fi mini-series as he explores the motives, execution, and anatomy of a Wi-Fi hack.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If you are looking at this article, you have most likely been hit by some version of ransomware and are trying to find out if there is anything you can do, or what way you should react - READ ON!
Do you know what to look for when considering cloud computing? Should you hire someone or try to do it yourself? I'll be covering these questions and looking at the best options for you and your business.
Email security requires an ever evolving service that stays up to date with counter-evolving threats. The Email Laundry perform Research and Development to ensure their email security service evolves faster than cyber criminals. We apply our Threat…
With Secure Portal Encryption, the recipient is sent a link to their email address directing them to the email laundry delivery page. From there, the recipient will be required to enter a user name and password to enter the page. Once the recipient …

685 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question