Solved

Locating Large, Duplicate and MP3 files on LAN

Posted on 2011-03-22
20
255 Views
Last Modified: 2013-12-07
Hello experts,

i am trying to find a way to scan our LAN for Large, duplicate and MP3 files. Is there a software or tool that can automate this? The endgame is to have output of folder name, created by and size so i can have a check on the LAN size.

Thanks in advance!
0
Comment
Question by:rohitsurya
  • 10
  • 10
20 Comments
 
LVL 12

Accepted Solution

by:
FDiskWizard earned 250 total points
ID: 35192785
Go check out TreeSize Professional. Excellent tool. It will break it down, or filter by filetype, or groups like Audio, video, OfficeDocs, etc..

But, it would most likely have to be ran on the server. There is an option to do a  USB Install so you don't have to really do a server install. It will be portable via a folder on the server.

Some of our servers have millions of files so scanning over the LAN doesn't work so well.

There is a program called Easy Duplicate finder that is great at showing duplicates. Give file paths, and can export with links to those folders.
http://www.easyduplicatefinder.com/
They also have one specific for MP3 duplicates.


0
 

Author Comment

by:rohitsurya
ID: 35198764
Thanks! Is there anything that can be executed on the client side. i dont have access to run it on server. When i run it on client its not showing me who the owner is.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35201666
I can't recall for sure, but I think you have to set it to pull owner info. Maybe 'Author' attribute also.
Sometimes the owner is just administrator. But author will show you who created the document.
Folder location may point out the culprits also.

I don't think running it remotely makes a difference, just slower... I've tried it before, but I normally run from server because of the huge volume of data.

TreeSize is about the best thing out there... There are a couple of other comparable products.
0
 

Author Comment

by:rohitsurya
ID: 35202569
When i run it from my desktop for author it says it failed the trust relationship?

What are the other comparable products.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35206998
I think that's going to be a security issue, not an app issue. You are a local admin? Right?
Most "trust relationship" issues I've seen are a Computer trust problem, as in not a member of the domain, or computer account missing. Unless maybe you have multiple domains?

It should run remotely with local admin permissions; just slower than running locally. I normally have it seach the default drive share, like: \\server1\D$. But, it should work against any share\path that you have access to.

I'm running against a server from my PC now... it is a bit of a CPU hog.
It's maxing out my 3+ yr old dual-core CPU.
0
 

Author Comment

by:rohitsurya
ID: 35207076
No i am not the admin. What should i have the admin provide me?

You mentioned there are alternate solution. What are they?

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35207081
FYI: It took me around 12 mins to scan a server with 1.5 Million files, and 151,000 folders.

0
 

Author Comment

by:rohitsurya
ID: 35210094
I should say this tool is powerful...Is there a filter i can drop where i can scan every folder in a shared drive and make it give me the path,filename, last date used, size and the author?

It will really serve my need.

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35214831
Yes... Two methods.

1st is for folders only, and it even creates hyper links to the Folders.
Just right click on a folder in the left pane, at any folder level you want...
By default it will export the folders you currently have expanded.
Go in to TOOLS > OPTIONS > 'Columns/Export' tab and you can change the export behavior.

2nd: you have to use the file search tool, and export results from that to get file listings.
That's a LOT of data BTW.. :)

Did you look through the tabs in the results pane on the right?
Like 'Extensions' and 'Age of Files' tabs? Good stuff!
Very good app.

I would suggest running it against a small share to play around with what it can do.
Or even a subfolder of a share like: \\server1\IT\Tools

0
 

Author Comment

by:rohitsurya
ID: 35318285
The treesize pro is a great tool but when i run scans on the top users hoggin space on our share drives it gives me a great report BUT if the users have files that are more than 1000 KB the tool splits the information into two columsn when i export it to a CSV.

Is there a setting that i can change so it does not export like this.

examples is 1234 kb.. it puts 1 on size column and 234kb on last saved column..

please advise.
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35324736
I think your problem may be the comma separator in large numbers.
Can you export to TAB delimited?
Or just try changing the size display as MB (or maybe GB). There are buttons on the toolbar to switch. That should eliminate the commas. Unless you run into GBs...
There is also a 4th button AUTO (AU/TO) which will display a mixture of HB MB GB.
0
 

Author Comment

by:rohitsurya
ID: 35324859
Yes i have tried everything you have said here and i still have this issue. We love this tool but we would have to look for something else if we can fix this issue since its too much manual work which we simple dont have the time for.

Can you suggest me something that is better or relatively close to treesize. paid is find too..

Thanks!
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35327829
is there a reason you're using CSV instead of Saving as XLS (Excel)?
You're exporting from the USERS tab?
0
 

Author Comment

by:rohitsurya
ID: 35327930
yea there are too many files to be exported to excel. yea im exporting from users tab
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35328104
OH... Is it hitting the 65,000 row limit in older versions of XLS? Did you try specifying .XLSX as the extension?
I'm assuming you must be exporting a list of all of their files?
Or are you just exporting USERS with their overall stats?
Or what about Top 100 files report? It will still show owners.

 



0
 

Author Comment

by:rohitsurya
ID: 35328159
Yes i am exporting all the files of users. I am trying to determine how they are taking up so much space. And yes its hitting over 65000. I tried specifing .xlsx and its spilling data over.

i have changed the number of decimal on options to zero and set automatic as metric (gb,mb,kb)

its spills a few over still.
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333019
This is what I would do...
Let the search run with the USERS tab open. Once complete, right click the top user and "Limit to this User". That will show only folders that contain that User's data.
You can then right-click again and Show All Users.
Then go to the next...
I usually do screenshots showing were the big lumps of data are.
I think by default folders are sorted by size... Most likely, a user or department will be users of the folders. Screenshot > email....
The Snipping tool in Vista/Win7 is great :)

0
 

Author Comment

by:rohitsurya
ID: 35333214
Yup thats what i am doing right now. But we are down to detailing haha.

We send people all the files they own so they can determine what they wanna keep or remove. i normally goup them by file type so we can eliminate unauthoirzed file types also mp3 etc.

When i limit to users on the left the tree updates but the file types on the main screen does not. i wish they bring that feature next release!
0
 

Author Comment

by:rohitsurya
ID: 35333243
Snipping tool is really cool :)
0
 
LVL 12

Expert Comment

by:FDiskWizard
ID: 35333364
Well, as another approach you could go to the file Extensions tab and limit to AUDIO and show which folders have music and how much.. it might not show owners... but the folder names may show department or owner.
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

This paper addresses the security of Sennheiser DECT Contact Center and Office (CC&O) headsets. It describes the DECT security chain comprised of “Pairing”, “Per Call Authentication” and “Encryption”, which are all part of the standard DECT protocol.
Never store passwords in plain text or just their hash: it seems a no-brainier, but there are still plenty of people doing that. I present the why and how on this subject, offering my own real life solution that you can implement right away, bringin…
This tutorial will walk an individual through the process of configuring their Windows Server 2012 domain controller to synchronize its time with a trusted, external resource. Use Google, Bing, or other preferred search engine to locate trusted NTP …
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…

707 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now