TEAMED NIC and Microsoft NLB resulting in server reboots

Posted on 2013-10-29
Last Modified: 2013-11-11

I have an 2 Exchange 2013 servers with Client Access Roles installed on Windows 2012.  Each server has two physical network connections which I've set-up in a TEAM spreading the load.

In order to balance load them, I installed Microsoft Network Load Balancing on both servers and created a virtual cluster node in multicast mode using the TEAM virtual network connection.

The problem I'm seeing is that every 2-4 hours each servers is rebooting in a sporadic blue screen fashion.  Well I imagine a BSOD as the server just times out and by the time I get the server room, i'ts booting up again.

I removed the TEAM and set-up the CAS servers to use a single network connection and when I did that the servers didn't reboot once.

So I'm not sure where to go.  The minidump says "Probably caused by : NETIO.SYS ( NETIO+1d532"

I have updated the driver and firmware of the NIC but that hasn't resolved the issue.  I presume it's okay to use a TEAMED NIC in an NLB cluster.

Guidance on the cause and resolution would be great.

Thank you
Question by:benowens
  • 5
  • 4
LVL 46

Expert Comment

by:Craig Beck
ID: 39610090
So it's a driver issue.  Are you using the latest?  If so, are there any release notes which mention previous issues or recent fixes?

If it is the most recent driver, try going back a version or two if Server 2012 supports it.

Author Comment

ID: 39610172
Do you think it's definitely a driver issue.  I've updated the server to use the latest drivers from the HP website and upgraded the NIC firmware then rebooted.

I'm just getting very odd behavior at the moment.  After I break the TEAM up I can't set a default gateway against the NIC.  I have to reboot and then the default gateway appears.

I'm not sure whether to look to downgrade the servers to Windows 2008 R2 or even look to Windows 2012 R2.  What do you think?

I believe the NIC is a Broadcom but you download the driver through the HP website.  I'll have a look at the Broadcom website tomorrow.
LVL 46

Expert Comment

by:Craig Beck
ID: 39610238
I would put money on it.  Trying 2008 R2 might be a good idea.
Simple, centralized multimedia control

Watch and learn to see how ATEN provided an easy and effective way for three jointly-owned pubs to control the 60 televisions located across their three venues utilizing the ATEN Control System, Modular Matrix Switch and HDBaseT extenders.


Author Comment

ID: 39610847
Cool.  Okay but using a teamed card with  NLB is generally considered okay?
LVL 46

Expert Comment

by:Craig Beck
ID: 39610944
I personally wouldn't do NLB with teamed NICs (for fear of this very reason more than anything due to past experiences).

Author Comment

ID: 39611130
Oh really.  But by that basis, anyone that is using NLB on Windows 2012 can only utilise one physical 1GB connection which isn't exactly making the most of the throughput available.

I tired using NLB and adding the network cards as separate entities but as soon as you go to add a network card from a host that is already part of the cluster, it says something along the lines of 'host is already part of the cluster'.

Surely not everyone who uses NLB has a single NIC connection being used?
LVL 46

Accepted Solution

Craig Beck earned 500 total points
ID: 39611145
Well, there are different approaches to achieving what you want now.  NLB is redundancy in it's own right, so it's not a requirement to have multiple NICs per host.

If you look around you'll not find any docs which mention that NLB -AND- NIC teaming is supported by Microsoft (at least I can't find any).  You will find plenty though that mention disabling teaming if you experience problems.

If I was wanting to use teamed NICs due to low bandwidth, and NLB, I'd look at virtualizing the server.  From past experience that has the best chance of stability as the Team and NLB don't use the same drivers.

Things like this make me worry...
LVL 63

Expert Comment

by:Simon Butler (Sembee)
ID: 39614322
The Exchange product team don't recommend the use of Windows NLB, and you will find very few others will. If you want load balancing, use a load balancer outside of the servers. Much more reliable than the Windows NLB junk.


Author Comment

ID: 39616378
Yes, I think I've effectively read a lot about session affinity not being required any longer meaning that Windows NLB is a real option now.  However I've obviously made an incorrect assumption thinking that TEAMING and NLB will work together on the same OS.

Agreed, I can't find anything giving the thumbs up for Windows NLB with TEAMED NIC's.

Essentially as you've said it's the two levels of virtualisation of the MAC at TEAM and NLB level run by the OS.

Moving forward with two virtualised CAS servers isn't a possibility as the hardware has already been purchased so we really need to push forward with that.  However I can see the sense in having a virtualised NIC as it will effectively give better throughput and appear as one MAC/NIC at OS level which should avoid the NLB.

So now I have pushed forward with the two CAS servers using one 1Gbps connection which is balance loaded for receving email and client connections going forward.

They are moving from a single Exchange 2010 server which has two NIC's in a TEAM and we had no complaints on throughput there, so moving to two CAS servers with a single NIC should suffice.

Annoying that I can't make the most of the throughput of those other 3 NIC's on each CAS server though....any thoughts on that.?...

The option we mused here is installed a 10Gbps card in each CAS server to use in the NLB...again your thoughts would be appreciated?

Author Closing Comment

ID: 39638440
There seems to be no rock hard document for or against this but the fact is without using TEAMED NIC'S with Windows NLB in the OS, the server doesn't crash.  So we have progressed with single NIC 50/50 balance loaded multicast Windows NLB.

Featured Post

Free Tool: Site Down Detector

Helpful to verify reports of your own downtime, or to double check a downed website you are trying to access.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Powershell Exchange - help using invoke-command 16 54
PowerShell and cisco ios 3 41
export the mailbox data to .pst from office365 mailbox 8 52
DNS/WINS in a domain 10 40
Utilizing an array to gracefully append to a list of EmailAddresses
This article explains in simple steps how to renew expiring Exchange Server Internal Transport Certificate.
The video tutorial explains the basics of the Exchange server Database Availability groups. The components of this video include: 1. Automatic Failover 2. Failover Clustering 3. Active Manager
This video discusses moving either the default database or any database to a new volume.

735 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question