Solved

Cluster Network Activity

Posted on 2013-12-06
1
293 Views
Last Modified: 2013-12-09
I have a 4 Node Cluster using Hyper V and 2008 server. There are two SAN Storage servers. I opened my taskmanger and put it on the network traffic. I logged into each node. I copied a 7GB VM onto the desktop. I did this from each node. All 4 nodes have 2 two iSCSI connections via gigabit network connecting to the san using MPIO. San Has 4 iscsi ports.

On each node I could see the VM copied at about 110mbs and averaged 47% activity on each iSCSI connection.

1. Is that normal? When i only use one Nic it averages 97% and the same 110mbs. Wouldn't two nics be faster.
2.
Why am  not getting 200 mbs?

NOW THE WEIRDNESS
I reversed the test. This time I copied the same VM from each desktop back to the SAN from which it came.  I started with Node 1. I had only HEARTBEAT activity and no iSCSI activity on Node 1. When I looked at Node 4, it had a ton of HEARTBEAT activity and the two iscsi ports lit up and they seem to be doing the work.

1. Why is this happening? I thought the heartbeat was for live migration only. Why didn't node 1 iSCSI ports copy the VM from its own desktop straight to the san. Why did it take the VM from its desktop send it to node 4 through the heartbeat nic to where node 4 used it's iSCSI port to copy it back to the SAN?

Also i noticed heartbeats were at 92% activity but iscsi again was split 50/50.


  This time my HEARTBEAT Nic had all the activity and there was no iscsi traffic.
0
Comment
Question by:MEATBALLHERO
1 Comment
 
LVL 9

Accepted Solution

by:
Beartlaoi earned 500 total points
ID: 39702192
1 and 2. Yes as you have not indicated that you have a real load balancing network setup.  A single TCP converstaion will go through the same ports because there are rules in place, like using the first port that can take the packet where it is supposed to go.
Specifically if you open a command prompt and enter ROUTE PRINT you will see the rules that Windows uses to determine where to send a packet.  
If you want REAL load balancing then you will have to do some serious research into the capabilities of your switches and what client side teaming software to use with it.  LACP for instance will also not accomplish what you want since it explicitely uses a hash based on IP/port on both sides to determine which port to use, so a single TCP connection will thus be stuck on one link.  LACP is designed for trunks that carry multiple conversations, not to load balance one conversation.
Newer switches like Nexus I believe solve this for you.

Other 1.  Do a ROUTE PRINT on both sides and see if you can see why packets may be going in the wrong direction.  One guess, make sure you dont have gateways defined on your heartbeat NICs.  Also if you have seperate iSCSI NICs in addition to the management and VM NICs then they should also not have gateways, only one NIC should have a gateway and that should be management.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Wireless network monitoring 8 54
TCP Error code:Unable to connect to a banking site 4 29
DHCP Server 14 65
Big Problem with Redirected Folder 8 7
Quality of Service (QoS) options are nearly endless when it comes to networks today. This article is merely one example of how it can be handled in a hub-n-spoke design using a 3-tier configuration.
You might have come across a situation when you have Exchange 2013 server in two different sites (Production and DR). After adding the Database copy in ECP console it displays Database copy status unknown for the DR exchange server. Issue is strange…
This tutorial will give a short introduction and overview of Backup Exec 2012 and how to navigate and perform basic functions. Click on the Backup Exec button in the upper left corner. From here, are global settings for the application such as conne…
This tutorial will walk an individual through the steps necessary to join and promote the first Windows Server 2012 domain controller into an Active Directory environment running on Windows Server 2008. Determine the location of the FSMO roles by lo…

895 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now