Solved

Teaming in 2012R2 2-node Hyper-V Cluster w. 6 x 1 gb NICs (FC based storage)

Posted on 2014-11-04
8
339 Views
Last Modified: 2014-11-07
Our solution is a Fibre-based one, so ethernet is not for storage but for Management, Cluster, LiveMigration and VM-traffic solely.

Our failover-cluster consist of two hosts with 256 gb of ram each, that utilize only the half under normal service, but they can carry all VMs if needed. This means, that around 100 gb ram needs to failover and even with Compression in 2012 R2 that can take som time when NICs and switches only run 1 gbit.

Teaming: Switch-dependant vs Switch-Independant
Recommendations from MS are switch-independant because that gives more queues for the virtual machines (VMQs) and less complexity in the infrastructure. But the backside is, that inbound traffic cannot be more than that of one of the team-members.

1.

But how much does VMQ matter, when we dont have 10 gbit adapters and when the VM-traffic it self is rather limited?

2.

What is your recommended teaming/converged Network solution in this scenario?
NB: I did read a lot about Converged Network up front. I.e. the Hyper-V 2012 R2 Network Architectures Series.
0
Comment
Question by:jmateknik
  • 4
  • 4
8 Comments
 
LVL 56

Accepted Solution

by:
Cliff Galiher earned 500 total points
ID: 40421856
VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.

With that said, use switch independent unless you have a single VM that realm needs more bandwidth while running. Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams. It will utilize SMB multichannel so, technically, it could use multiple NICs even if they were *not* teamed. That, in effect, eliminates that bottleneck for that kind of traffic without the need to run the LACP gauntlet.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40423502
Thank you Cliff!

VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.
I am really happy that I can simply ignore that consideration..

Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams
I have a vSwitch on top of the Switch Independent Team with 3 vEthernet adapters setup for Management, Cluster and LiveMigration (QoS is setup for bandwith control among these). I also have configured the LiveMigration to use the interface of the vEthernet(LiveMigration) adapter. What you say basically means that the vSwitch,  the Team and the interface is bypassed. Could you elaborate or do you have any links that shed light on the matter?

All the best!
0
 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40424889
I am not saying that it is bypassed at all. If you set QoS at any level, it will be honored at that level. I *am* saying that multichannel support is deeply integrated at all levels. A luv migration will say "I have 10Gb/s of data to send" ti the vEtherbet adapter. The adapter checks its QoS, and as long as it doesn't need to throttle, passes it on to the switch. The switch applies its logic and passes it on to the team. The team (in switch independent mode) decides if it needs to only send traffic to one NIC to honor switch independence OR if the receiving machine supports SMB multichannel, it can pass traffic to all NICs in the team (which would still honor switch independence because SMB Multichannel is handling the job of making sure the NICs dont loop back on themselves) and then tells the upper stacks "I can take 1Gb/s or "6Gb/s" or whatever.

That is a gross oversimplification. But the point is the switch was not bypassed. Nor was the virtual adapter. Nor the team. But because of deep integration of Smb multichannel, it kicks on as close to hardware as possible for application loads that support it, so you get its benefit even as the rest of the networking stack still does its job.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40425699
After writing my post and then reading it again - I felt that it revealed *my* superficial understanding of the matter (learning potential) . Your answer gives me the feeling that you've got a much deeper understanding - and there you have the challenge of explaining this stuff to a novice. I do feel though, that I get a lot of what you try to say, and that the whole "ByPass" approach I introduces doesn't make sense. When I run Get-SmbMultichannelConnection the system indeed sees more than one path to the other host.

I cross-read some posts and stumpled upon three interesting posts from Mr. WorkingHardInIT - before and after the introduction of the Dynamic Load Balancing algorithm. It would seem, that if the team is using the Dynamic algorithm (which theres are very few reasons not to) what you say holds true:

Teamed NIC Live Migrations Between Two Hosts In Windows Server 2012 Do Use All Members

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & TCP/IP in Windows Server 2012 R2

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & Compression in Windows Server 2012 R2

Final question
LiveMigration networks can be configures both in the Hyper-V Manager console (incoming traffic) *and* in the Failover Clustering console - with this whole discussion in mind - how do I configure these ideally (having 3 "Converged" networks).

Anders
0
IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40426853
Ideally. That's a heavily biased word. And truthfully, each network is different based on uniqueness of data and how it is used and accessed. Employee habits and such, I could not begin to accurately answer that.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40427902
It was not meant like Ideal entire network solution but rather like the recommended best practice way to configure LiveMigration traffic since that can be done both through Hyper-V Manager *and* Failover Cluster Consoler. I.e. should i only use Failover Cluster Manager.
0
 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40427917
Yes, use the cluster manager, not hyper-v manager.
0
 
LVL 1

Author Closing Comment

by:jmateknik
ID: 40427971
I reckonize that my second question "What is your recommended teaming/converged Network solution in this scenario?" is a hard question to answer. Answers given helped me a lot - thanks!

Anders
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

Suggested Solutions

ADCs have gained traction within the last decade, largely due to increased demand for legacy load balancing appliances to handle more advanced application delivery requirements and improve application performance.
Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
This video gives you a great overview about bandwidth monitoring with SNMP and WMI with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're looking for how to monitor bandwidth using netflow or packet s…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now