Large Volume Replication
Posted on 2012-04-05
Due to Symantec dropping CPS feature in their BackupExec product, I’m forced to look into another Real-time replication solution. This is file/folder data only, we are not concerned with application or database integration.
We are looking at possibly virtualizing the file servers and having the disks as Physical RDM’s and/or potentially breaking the volumes into smaller chunks. Our avg. daily (8hr workday) data changes (whole file, not block/bit) is ~150GB (~50GB on the Critical 4TB volume and ~100GB on the Important 4TB volume). Our storage is either 8 or 4Gbps Fiber and the offsite we have a 1Gbps connector (which I can up if needed).
I really am wanting a one-way sync to both a local and offsite volume, sync'ing changes in real-time along with NTFS ACL's. This way if server goes down I can redirect DFS link to second server that host onsite replica. If onsite storage goes down (i.e. both primary and onsite replica not available), I can redirect DFS to the offsite server hosting its replica... this way there is very little down time.
I'm looking into DFSR on 2K8R2 and DPM, as they would be the cheapest solution, but off the bat, DPM looks to 'hide' its replica and not really intended to reshare although great for snapshots and end-user recover via VSS Previous Version option. DFSR looks to be a solution, but the 8TB total and 8million file limit concerns me, particularly with future expansion. Of our 8TB, roughly 6TB is in use. We also have a few smaller 500GB -1TB volumes which are about 80% full. Both seem to require pretty heavy storage at the replicated site and there seems to be a pretty heavy CPU/Memory requirement, I'm assuming for the indexing and delta change calc's.
Does anyone have experience with a similar setup and DFSR/DPM or using a 3rd party product like Double-Take, FileReplication Pro, PeerSync, etc. Major pitfalls with my scenario. I'm in the process of setting up test network, but working with 2 - 3TB data chunks is long and laborous, so I'm looking for pitfalls, 'don't go there' or hey this worked for us so I spend as little time spinning or re-inventing the wheels as possible.