Improve company productivity with a Business Account.Sign Up

x
?
Solved

which is best object level or block size deduplication in commvault ?

Posted on 2015-02-24
2
Medium Priority
?
454 Views
Last Modified: 2015-02-25
we are looking to implement a deduplication store in commvault. we can setup as object level or block level. which is best
0
Comment
Question by:andrew5499
2 Comments
 
LVL 21

Accepted Solution

by:
Thomas Rush earned 2000 total points
ID: 40630644
It depends on what your needs are.  "Which is better -- a sedan or a pickup truck?"

Block level deduplication will generally pick up more 'hits', and have a higher dedupe ratio (i.e., enable you to store more backups in a similar amount of space).  On the other hand, that chunking and hashing has processor overhead, so it may slow your backups (or other applications, if your backup server is not a dedicated system).

Object Level looks at, well, objects -- a file, for instance.  It's often much easier to tell if a file has changed than to do the chunking and hashing of block level dedupe.  Simplistically: Has the file size changed?  Yes.  OK, we have to store this new file.   But think about all the times you change only minor things in a file -- you might change only the title slide in a 10MB presentation to put a new date or customer -- yet under object dedupe, the whole file might need to be stored again.   Or you add a line to a spreadsheet.   Or you have several copies of a VMDK, each with only minor modifications, yet at a file object level, each is different and needs to be stored in its entirety, whereas under block dedupe, only the one copy of the whole file, plus the differences from it in other files are saved.   But while less space-efficient, object dedupe is likely to be much easier on your CPU, if that's an issue.

For what it's worth, most of the dedupe appliances like HP's StoreOnce and EMC's Data Domain perform block-level dedupe, and with much better granularity (HP is 4KB average block; EMC is 8KB).  Because the dedupe is offloaded from the backup server, the appliances can achieve both great throughput and much better dedupe compaction.
0
 

Author Closing Comment

by:andrew5499
ID: 40630724
We have a dedicated server, so Looks like Block size will win this duel.
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Backups and Disaster RecoveryIn this post, we’ll look at strategies for backups and disaster recovery.
"Any files you do not have backed up in at least two [other] places are files you do not care about."
Two types of users will appreciate AOMEI Backupper Pro: 1 - Those with PCIe drives (and haven't found cloning software that works on them). 2 - Those who want a fast clone of their boot drive (no re-boots needed) and it can clone your drive wh…
Despite its rising prevalence in the business world, "the cloud" is still misunderstood. Some companies still believe common misconceptions about lack of security in cloud solutions and many misuses of cloud storage options still occur every day. …

585 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question