Solved

Teaming in 2012R2 2-node Hyper-V Cluster w. 6 x 1 gb NICs (FC based storage)

Posted on 2014-11-04
8
345 Views
Last Modified: 2014-11-07
Our solution is a Fibre-based one, so ethernet is not for storage but for Management, Cluster, LiveMigration and VM-traffic solely.

Our failover-cluster consist of two hosts with 256 gb of ram each, that utilize only the half under normal service, but they can carry all VMs if needed. This means, that around 100 gb ram needs to failover and even with Compression in 2012 R2 that can take som time when NICs and switches only run 1 gbit.

Teaming: Switch-dependant vs Switch-Independant
Recommendations from MS are switch-independant because that gives more queues for the virtual machines (VMQs) and less complexity in the infrastructure. But the backside is, that inbound traffic cannot be more than that of one of the team-members.

1.

But how much does VMQ matter, when we dont have 10 gbit adapters and when the VM-traffic it self is rather limited?

2.

What is your recommended teaming/converged Network solution in this scenario?
NB: I did read a lot about Converged Network up front. I.e. the Hyper-V 2012 R2 Network Architectures Series.
0
Comment
Question by:jmateknik
  • 4
  • 4
8 Comments
 
LVL 56

Accepted Solution

by:
Cliff Galiher earned 500 total points
ID: 40421856
VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.

With that said, use switch independent unless you have a single VM that realm needs more bandwidth while running. Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams. It will utilize SMB multichannel so, technically, it could use multiple NICs even if they were *not* teamed. That, in effect, eliminates that bottleneck for that kind of traffic without the need to run the LACP gauntlet.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40423502
Thank you Cliff!

VMQ is turned off internally (even if it says enabled) at 1GB speeds. So you will get zero benefit from VMQ.
I am really happy that I can simply ignore that consideration..

Live migration traffic is *not* limited tot he speed of a single NIC in 2012, even in switch independent teams
I have a vSwitch on top of the Switch Independent Team with 3 vEthernet adapters setup for Management, Cluster and LiveMigration (QoS is setup for bandwith control among these). I also have configured the LiveMigration to use the interface of the vEthernet(LiveMigration) adapter. What you say basically means that the vSwitch,  the Team and the interface is bypassed. Could you elaborate or do you have any links that shed light on the matter?

All the best!
0
 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40424889
I am not saying that it is bypassed at all. If you set QoS at any level, it will be honored at that level. I *am* saying that multichannel support is deeply integrated at all levels. A luv migration will say "I have 10Gb/s of data to send" ti the vEtherbet adapter. The adapter checks its QoS, and as long as it doesn't need to throttle, passes it on to the switch. The switch applies its logic and passes it on to the team. The team (in switch independent mode) decides if it needs to only send traffic to one NIC to honor switch independence OR if the receiving machine supports SMB multichannel, it can pass traffic to all NICs in the team (which would still honor switch independence because SMB Multichannel is handling the job of making sure the NICs dont loop back on themselves) and then tells the upper stacks "I can take 1Gb/s or "6Gb/s" or whatever.

That is a gross oversimplification. But the point is the switch was not bypassed. Nor was the virtual adapter. Nor the team. But because of deep integration of Smb multichannel, it kicks on as close to hardware as possible for application loads that support it, so you get its benefit even as the rest of the networking stack still does its job.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40425699
After writing my post and then reading it again - I felt that it revealed *my* superficial understanding of the matter (learning potential) . Your answer gives me the feeling that you've got a much deeper understanding - and there you have the challenge of explaining this stuff to a novice. I do feel though, that I get a lot of what you try to say, and that the whole "ByPass" approach I introduces doesn't make sense. When I run Get-SmbMultichannelConnection the system indeed sees more than one path to the other host.

I cross-read some posts and stumpled upon three interesting posts from Mr. WorkingHardInIT - before and after the introduction of the Dynamic Load Balancing algorithm. It would seem, that if the team is using the Dynamic algorithm (which theres are very few reasons not to) what you say holds true:

Teamed NIC Live Migrations Between Two Hosts In Windows Server 2012 Do Use All Members

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & TCP/IP in Windows Server 2012 R2

Live Migration over NIC Team in Switch Independent Mode With Dynamic Load Balancing & Compression in Windows Server 2012 R2

Final question
LiveMigration networks can be configures both in the Hyper-V Manager console (incoming traffic) *and* in the Failover Clustering console - with this whole discussion in mind - how do I configure these ideally (having 3 "Converged" networks).

Anders
0
Ransomware-A Revenue Bonanza for Service Providers

Ransomware – malware that gets on your customers’ computers, encrypts their data, and extorts a hefty ransom for the decryption keys – is a surging new threat.  The purpose of this eBook is to educate the reader about ransomware attacks.

 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40426853
Ideally. That's a heavily biased word. And truthfully, each network is different based on uniqueness of data and how it is used and accessed. Employee habits and such, I could not begin to accurately answer that.
0
 
LVL 1

Author Comment

by:jmateknik
ID: 40427902
It was not meant like Ideal entire network solution but rather like the recommended best practice way to configure LiveMigration traffic since that can be done both through Hyper-V Manager *and* Failover Cluster Consoler. I.e. should i only use Failover Cluster Manager.
0
 
LVL 56

Expert Comment

by:Cliff Galiher
ID: 40427917
Yes, use the cluster manager, not hyper-v manager.
0
 
LVL 1

Author Closing Comment

by:jmateknik
ID: 40427971
I reckonize that my second question "What is your recommended teaming/converged Network solution in this scenario?" is a hard question to answer. Answers given helped me a lot - thanks!

Anders
0

Featured Post

Best Practices: Disaster Recovery Testing

Besides backup, any IT division should have a disaster recovery plan. You will find a few tips below relating to the development of such a plan and to what issues one should pay special attention in the course of backup planning.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Veeam Backup & Replication has added a new integration – Veeam Backup for Microsoft Office 365.  In this blog, we will discuss how you can benefit from Office 365 email backup with the Veeam’s new product and try to shed some light on the needs and …
In this article, I will show you HOW TO: Perform a Physical to Virtual (P2V) Conversion the easy way from a computer backup (image).
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

914 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now