NetApp snapmirror bandwidth option

EE,

Hi thanks in advance for the help.

My question is how should we throttle snapmirror within the /etc/snapmirror.conf file? (or wizard) when transferring 3TB of data to another filer over a 20GB fiber link? We have 20GB from the NetApp to the switch via two 10GB cables and two 10GB fibers over a single vPC from switch to switch connecting to the other storage over the same configuration. I know NetApp throttles but am not sure how the initial sync will affect the performance and bandwidth of the system

Thanks again everyone
snyderkvAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Do you need to throttle the Snapmirror action, at a particular time?

We found we needed to throttle the bandwidth of a snapmirror function overnight when all our snapmirror functions occurred to our DR site, because we also carry VOIP telephone functions across to the DR site, when using the DR LAN, and it cause all the telephones to be lost.....

If you use a bandwidth throttle, your initial sync will take much longer to complete.

Are they any other vital network services that use this link you need to "protect" ?
0
snyderkvAuthor Commented:
Oh you're saying your DR site is actively has VOIP services? Good point. Yes we do use it as a "warm" site if you will and have random services over there possibly VOIP but is avoided when need be.

So the question is, how much do you throttle and do you pick specific interfaces for the snapmirror traffic as well?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
We do not pick specific interfaces, we use our production VLAN to snap mirror over, the reason for this is because our WAN link to DR site at present does not support VLANs, and we have no control over QoS for the WAN link, so therefore we have to reduce the bandwidth which Snapmirror uses.....

This has been done by trial and error....

we now use

kbs=1024 to kbs=2000
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

Paul SolovyovskySenior IT AdvisorCommented:
If the system is not under load another option you may want to look into is snapmirror compression.  Typically we get 1:4 to 1:8 compression and really helps the initial seeding process as well as replication with limited bandwidth.
0
snyderkvAuthor Commented:
You mean deduplication? We have turned that on as I understand replication is more efficiant. I won't know if the system or network is under load until initialization but 2 mbs over a 20GB link? I'll re read the netapp snapmirror document but I don't remember much talk about this
0
snyderkvAuthor Commented:
Oh you mean network compression. We have 20GB link that is unsaturated with just a few services. I don't think it would make sense to enable compression.
0
snyderkvAuthor Commented:
From what I read from doc tr-3446 is that the NetApp does not throttle and is unlimited. I'm not sure how it works but I think the 7MB windowing keeps it from saturdating the link. In any case we are going to leave the default. If anyone has better information than I gathered please provide.
0
robocatCommented:
You are unlikely to saturate a 10Gbit link. Even unthrottled, we've never seen an initial transfer go above 2-3Gbit. This is probably due to limitations in the disk subsystems.

Should you run into any issues, you can still dynamically adjust the throtlle value of a running transfer with the cli command "snapmirror throttle".
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
snyderkvAuthor Commented:
Ah I didn't think about that, the writes are limited by the 10k rpm disks whatever that comes out to
0
snyderkvAuthor Commented:
Ok it ran fine with defaults, no compression or throttling. Jumbo frames are enabled but I thought it was odd that we only get a couple hundred megs of throughput. I also noticed I can run multiple concurrent snapmirrors at the same exact time (5 Total) with no change in CPU or network according to sysstat -s before and after every snapmirror initialization.
0
snyderkvAuthor Commented:
By no change I mean no change between 1 and 5 snapmirror initializations. It does increase from 0 to 1 and then stays.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.