Solved

Is there a tool to measure level of data change on a File Server?

Posted on 2009-05-12
10
478 Views
Last Modified: 2012-06-22
I'm looking for a way to measure the about of data changed in a week on a standard Windows 2003 file server?

I'd like to see not only the amount and size of files changed (I guess looking at a daily differential backup after a full could tell you me this) but I'd also like to see how much of the file has been changed. Example. A 30MB spreadsheet is updated 3 times a week and I'd like to know how much of that 30MB was changed as it may be only a few KB at a time rather than blindly thinking it's always 30MB.

I'm looking to replicate the changed data to another location and the method I'm using will replicate only the delta information changed so if I measure in that out of a 500GB file system, 10GB of files are changed per week, I need to know how much of those 10Gbs of files are changed as the transfer will only replicate the actual delta changes, not the entire file.

Hope this makes sense and someone knows about this?

Thanks,

h.
0
Comment
Question by:hotsox
  • 2
  • 2
  • 2
  • +2
10 Comments
 
LVL 4

Expert Comment

by:Macros82
Comment Utility
Do you do incremental backups? That would be a good measure.
Otherwise you might need to install some sort of third party data management software
0
 
LVL 4

Expert Comment

by:Macros82
Comment Utility
Shit didnt read the question. Disregard
0
 
LVL 7

Expert Comment

by:vikasjus
Comment Utility
It is very difficult to know these kind of changes. there might be tools available which can give you these kind of small change in information or file.
As far as replication is concern and if you have data on storage device that is SAN or NAS then changes happen to it will be in block form. That is if i change 30mb file with one word delete and save it then it will affect entire block in which this file is store. At the time of replication it will replicate that perticuler bock as incremental or delata change to destination. Replication works in this form only.
0
 
LVL 69

Expert Comment

by:Callandor
Comment Utility
I don't think what you are trying to do will work - if a 10MB spreadsheet is changed only in one cell, how can you send just one cell of information across?  Whoever is using the spreadsheet needs the entire spreadsheet, and you would have to have intimate knowledge of spreadsheets in order to know where to make the change.  Multiply this by the number of different file formats and you will be bogged down by the details.  The only practical solution is detecting what file changed and sending the entire file across.
0
Why do Marketing keep bothering you?

Is your marketing department constantly asking for new email signature updates? Are they requesting a different design for every department? Do they need yet another banner added? Don’t let it get you down! There is an easy way to manage all of these requests...

 

Author Comment

by:hotsox
Comment Utility
Delta replcation will work and we have been using it for DR purposes for some time. Of course there has to be an initial mirror when all the exisiting data is copied over to the target location but following that when a file is updated in the source site, only the delta changes to the file are replicated over and the target file is updated thus not requiring the whole file to be sent each time it is updated. The target files aren't to be used as a 'live' copy so users will never be accessing them unless a failover is manaully initiated.
This occasion requires sending the data over limited links which is why I need an accruate way to measure how much of the files are being modified not just the files being updated.  
0
 
LVL 69

Expert Comment

by:Callandor
Comment Utility
I guess you want a binary diff program.  JojoDiff http://jojodiff.sourceforge.net/ is open source and may work, though I haven't used it.
0
 
LVL 17

Expert Comment

by:OriNetworks
Comment Utility
Windwos server 2003 starting with R2 includes a reporting tool called File Server Resource Management which can be installed through add/remove windows components. It has a reporting tool that can tell you which files have changed, largest files, etc that can run on an automatic schedule that you set. This may be of use to you!!
0
 
LVL 17

Assisted Solution

by:OriNetworks
OriNetworks earned 150 total points
Comment Utility
While my suggestion is a good way of reporting overall files changes, it doesnt include reporting of delta changes.

I think Callandor offers the best recommendation of binary diff which would be necessary to complete the objective. The offered link from callandor does not exactly accomplish the goal but it comes closest. Using the open source code, an application can be created.
0
 

Accepted Solution

by:
hotsox earned 0 total points
Comment Utility
Thanks all but there seems no way to do this easily so will have to use differential and incremental backups to see the size changes.
0

Featured Post

IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

More or less everybody in the IT market understands the basics of Networking, however when we start talking about Storage Networks, things get a bit dizzier, and this is where I would like to help.
A procedure for exporting installed hotfix details of remote computers using powershell
This tutorial will walk an individual through locating and launching the BEUtility application and how to execute it on the appropriate database. Log onto the server running the Backup Exec database. In a larger environment, this would generally be …
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…

728 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

14 Experts available now in Live!

Get 1:1 Help Now