Solved

Teaming in 2012R2 2-node Hyper-V Cluster w. 6 x 1 gb NICs (FC based storage)

Posted on 2014-11-04
8
364 Views
Last Modified: 2014-11-07
Our solution is a Fibre-based one, so ethernet is not for storage but for Management, Cluster, LiveMigration and VM-traffic solely.

Our failover-cluster consist of two hosts with 256 gb of ram each, that utilize only the half under normal service, but they can carry all VMs if needed. This means, that around 100 gb ram needs to failover and even with Compression in 2012 R2 that can take som time when NICs and switches only run 1 gbit.

Teaming: Switch-dependant vs Switch-Independant
Recommendations from MS are switch-independant because that gives more queues for the virtual machines (VMQs) and less complexity in the infrastructure. But the backside is, that inbound traffic cannot be more than that of one of the team-members.

1.

But how much does VMQ matter, when we dont have 10 gbit adapters and when the VM-traffic it self is rather limited?

2.

What is your recommended teaming/converged Network solution in this scenario?
NB: I did read a lot about Converged Network up front. I.e. the Hyper-V 2012 R2 Network Architectures Series.
0
Comment
Question by:jmateknik
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 4
  • 4
8 Comments
 
LVL 58

Accepted Solution

by:
Cliff Galiher earned 500 total points
ID: 40421856
VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.

With that said, use switch independent unless you have a single VM that realm needs more bandwidth while running. Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams. It will utilize SMB multichannel so, technically, it could use multiple NICs even if they were *not* teamed. That, in effect, eliminates that bottleneck for that kind of traffic without the need to run the LACP gauntlet.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40423502
Thank you Cliff!

VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.
I am really happy that I can simply ignore that consideration..

Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams
I have a vSwitch on top of the Switch Independent Team with 3 vEthernet adapters setup for Management, Cluster and LiveMigration (QoS is setup for bandwith control among these). I also have configured the LiveMigration to use the interface of the vEthernet(LiveMigration) adapter. What you say basically means that the vSwitch,  the Team and the interface is bypassed. Could you elaborate or do you have any links that shed light on the matter?

All the best!
0
 
LVL 58

Expert Comment

by:Cliff Galiher
ID: 40424889
I am not saying that it is bypassed at all. If you set QoS at any level, it will be honored at that level. I *am* saying that multichannel support is deeply integrated at all levels. A luv migration will say "I have 10Gb/s of data to send" ti the vEtherbet adapter. The adapter checks its QoS, and as long as it doesn't need to throttle, passes it on to the switch. The switch applies its logic and passes it on to the team. The team (in switch independent mode) decides if it needs to only send traffic to one NIC to honor switch independence OR if the receiving machine supports SMB multichannel, it can pass traffic to all NICs in the team (which would still honor switch independence because SMB Multichannel is handling the job of making sure the NICs dont loop back on themselves) and then tells the upper stacks "I can take 1Gb/s or "6Gb/s" or whatever.

That is a gross oversimplification. But the point is the switch was not bypassed. Nor was the virtual adapter. Nor the team. But because of deep integration of Smb multichannel, it kicks on as close to hardware as possible for application loads that support it, so you get its benefit even as the rest of the networking stack still does its job.
0
Save the day with this special offer from ATEN!

Save 30% on the CV211 using promo code EXPERTS30 now through April 30th. The ATEN CV211 connects a laptop directly to any server allowing you instant access to perform data maintenance and local operations, for quick troubleshooting, updating, service and repair.

 
LVL 1

Author Comment

by:jmateknik
ID: 40425699
After writing my post and then reading it again - I felt that it revealed *my* superficial understanding of the matter (learning potential) . Your answer gives me the feeling that you've got a much deeper understanding - and there you have the challenge of explaining this stuff to a novice. I do feel though, that I get a lot of what you try to say, and that the whole "ByPass" approach I introduces doesn't make sense. When I run Get-SmbMultichannelConnection the system indeed sees more than one path to the other host.

I cross-read some posts and stumpled upon three interesting posts from Mr. WorkingHardInIT - before and after the introduction of the Dynamic Load Balancing algorithm. It would seem, that if the team is using the Dynamic algorithm (which theres are very few reasons not to) what you say holds true:

Teamed NIC Live Migrations Between Two Hosts In Windows Server 2012 Do Use All Members

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & TCP/IP in Windows Server 2012 R2

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & Compression in Windows Server 2012 R2

Final question
LiveMigration networks can be configures both in the Hyper-V Manager console (incoming traffic) *and* in the Failover Clustering console - with this whole discussion in mind - how do I configure these ideally (having 3 "Converged" networks).

Anders
0
 
LVL 58

Expert Comment

by:Cliff Galiher
ID: 40426853
Ideally. That's a heavily biased word. And truthfully, each network is different based on uniqueness of data and how it is used and accessed. Employee habits and such, I could not begin to accurately answer that.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40427902
It was not meant like Ideal entire network solution but rather like the recommended best practice way to configure LiveMigration traffic since that can be done both through Hyper-V Manager *and* Failover Cluster Consoler. I.e. should i only use Failover Cluster Manager.
0
 
LVL 58

Expert Comment

by:Cliff Galiher
ID: 40427917
Yes, use the cluster manager, not hyper-v manager.
0
 
LVL 1

Author Closing Comment

by:jmateknik
ID: 40427971
I reckonize that my second question "What is your recommended teaming/converged Network solution in this scenario?" is a hard question to answer. Answers given helped me a lot - thanks!

Anders
0

Featured Post

On Demand Webinar - Networking for the Cloud Era

This webinar discusses:
-Common barriers companies experience when moving to the cloud
-How SD-WAN changes the way we look at networks
-Best practices customers should employ moving forward with cloud migration
-What happens behind the scenes of SteelConnect’s one-click button

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When it comes to security, there are always trade-offs between security and convenience/ease of administration. This article examines some of the main pros and cons of using key authentication vs password authentication for hosting an SFTP server.
Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question