Solved

TEAMED NIC and Microsoft NLB resulting in server reboots

Posted on 2013-10-29
10
1,114 Views
Last Modified: 2013-11-11
Hello,

I have an 2 Exchange 2013 servers with Client Access Roles installed on Windows 2012.  Each server has two physical network connections which I've set-up in a TEAM spreading the load.

In order to balance load them, I installed Microsoft Network Load Balancing on both servers and created a virtual cluster node in multicast mode using the TEAM virtual network connection.

The problem I'm seeing is that every 2-4 hours each servers is rebooting in a sporadic blue screen fashion.  Well I imagine a BSOD as the server just times out and by the time I get the server room, i'ts booting up again.

I removed the TEAM and set-up the CAS servers to use a single network connection and when I did that the servers didn't reboot once.

So I'm not sure where to go.  The minidump says "Probably caused by : NETIO.SYS ( NETIO+1d532"

I have updated the driver and firmware of the NIC but that hasn't resolved the issue.  I presume it's okay to use a TEAMED NIC in an NLB cluster.

Guidance on the cause and resolution would be great.

Thank you
0
Comment
Question by:benowens
  • 5
  • 4
10 Comments
 
LVL 45

Expert Comment

by:Craig Beck
ID: 39610090
So it's a driver issue.  Are you using the latest?  If so, are there any release notes which mention previous issues or recent fixes?

If it is the most recent driver, try going back a version or two if Server 2012 supports it.
0
 
LVL 1

Author Comment

by:benowens
ID: 39610172
Do you think it's definitely a driver issue.  I've updated the server to use the latest drivers from the HP website and upgraded the NIC firmware then rebooted.

I'm just getting very odd behavior at the moment.  After I break the TEAM up I can't set a default gateway against the NIC.  I have to reboot and then the default gateway appears.

I'm not sure whether to look to downgrade the servers to Windows 2008 R2 or even look to Windows 2012 R2.  What do you think?

I believe the NIC is a Broadcom but you download the driver through the HP website.  I'll have a look at the Broadcom website tomorrow.
0
 
LVL 45

Expert Comment

by:Craig Beck
ID: 39610238
I would put money on it.  Trying 2008 R2 might be a good idea.
0
 
LVL 1

Author Comment

by:benowens
ID: 39610847
Cool.  Okay but using a teamed card with  NLB is generally considered okay?
0
 
LVL 45

Expert Comment

by:Craig Beck
ID: 39610944
I personally wouldn't do NLB with teamed NICs (for fear of this very reason more than anything due to past experiences).
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 1

Author Comment

by:benowens
ID: 39611130
Oh really.  But by that basis, anyone that is using NLB on Windows 2012 can only utilise one physical 1GB connection which isn't exactly making the most of the throughput available.

I tired using NLB and adding the network cards as separate entities but as soon as you go to add a network card from a host that is already part of the cluster, it says something along the lines of 'host is already part of the cluster'.

Surely not everyone who uses NLB has a single NIC connection being used?
0
 
LVL 45

Accepted Solution

by:
Craig Beck earned 500 total points
ID: 39611145
Well, there are different approaches to achieving what you want now.  NLB is redundancy in it's own right, so it's not a requirement to have multiple NICs per host.

If you look around you'll not find any docs which mention that NLB -AND- NIC teaming is supported by Microsoft (at least I can't find any).  You will find plenty though that mention disabling teaming if you experience problems.

If I was wanting to use teamed NICs due to low bandwidth, and NLB, I'd look at virtualizing the server.  From past experience that has the best chance of stability as the Team and NLB don't use the same drivers.

Things like this make me worry...

http://support.microsoft.com/kb/278431
0
 
LVL 63

Expert Comment

by:Simon Butler (Sembee)
ID: 39614322
The Exchange product team don't recommend the use of Windows NLB, and you will find very few others will. If you want load balancing, use a load balancer outside of the servers. Much more reliable than the Windows NLB junk.

Simon.
0
 
LVL 1

Author Comment

by:benowens
ID: 39616378
Yes, I think I've effectively read a lot about session affinity not being required any longer meaning that Windows NLB is a real option now.  However I've obviously made an incorrect assumption thinking that TEAMING and NLB will work together on the same OS.

Agreed, I can't find anything giving the thumbs up for Windows NLB with TEAMED NIC's.

Essentially as you've said it's the two levels of virtualisation of the MAC at TEAM and NLB level run by the OS.

Moving forward with two virtualised CAS servers isn't a possibility as the hardware has already been purchased so we really need to push forward with that.  However I can see the sense in having a virtualised NIC as it will effectively give better throughput and appear as one MAC/NIC at OS level which should avoid the NLB.

So now I have pushed forward with the two CAS servers using one 1Gbps connection which is balance loaded for receving email and client connections going forward.

They are moving from a single Exchange 2010 server which has two NIC's in a TEAM and we had no complaints on throughput there, so moving to two CAS servers with a single NIC should suffice.

Annoying that I can't make the most of the throughput of those other 3 NIC's on each CAS server though....any thoughts on that.?...

The option we mused here is installed a 10Gbps card in each CAS server to use in the NLB...again your thoughts would be appreciated?
0
 
LVL 1

Author Closing Comment

by:benowens
ID: 39638440
There seems to be no rock hard document for or against this but the fact is without using TEAMED NIC'S with Windows NLB in the OS, the server doesn't crash.  So we have progressed with single NIC 50/50 balance loaded multicast Windows NLB.
0

Featured Post

Do You Know the 4 Main Threat Actor Types?

Do you know the main threat actor types? Most attackers fall into one of four categories, each with their own favored tactics, techniques, and procedures.

Join & Write a Comment

Suggested Solutions

Not sure what the best email signature size is? Are you worried about email signature image size? Follow this best practice guide.
This article explains in simple steps how to renew expiring Exchange Server Internal Transport Certificate.
In this video we show how to create a Contact in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Recipients >> Contact ta…
In this video we show how to create a mailbox database in Exchange 2013. We show this process by using the Exchange Admin Center. Log into Exchange Admin Center.: First we need to log into the Exchange Admin Center. Navigate to the Servers >> Data…

705 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now