Solved

EqualLogic iSCSI network not optimized

Posted on 2010-08-18
13
1,524 Views
Last Modified: 2013-11-14
We have an EqualLogic 6000XV running in our production network. Two of the HBA/network ports are currently plugged in and active. While running some crude speed tests on the machines currently talking to the array, we see that traffic is doing some weird things. While copying large files from a Windows volume on the EqualLogic across the local network to another machine's internal drive, we see the two (MPIO) network adapters come up to about half speed, stay for a second, drop to almost nothing, then repeat. At absolute peak, speed seems to max out around 500Mbps. Everything is on 1Gb links.

So the iSCSI links appear to be doing these strange bursts, and then only to about half the max link speed. The iSCSI links go through a Dell PowerConnect 6220 with MTU turned up to 9216 and flow control on. The local network is running fine - when doing copies from internal disks to internal disks we see the LAN links max out all the way through.

I've checked out stats in the EqualLogic's Group Manager and there don't appear to be any errors on the network. The two unused links on the active controller are disabled.
0
Comment
Question by:j_h_2
  • 7
  • 3
  • 3
13 Comments
 
LVL 61

Expert Comment

by:gheist
ID: 33473403
might be flow control
basically if buffer of one port is full it slows all sources.
i dont know much about qos you have in your switch. if it resembles traffic shaping like HFSC then do it.
0
 

Author Comment

by:j_h_2
ID: 33474500
Do you mean a lack of flow control? Flow control is on for every port.
0
 
LVL 61

Expert Comment

by:gheist
ID: 33474546
presence of flow control is a problem.
you need to adjust shaping to make sure flow control never kicks in
0
 

Author Comment

by:j_h_2
ID: 33474822
Hmm I actually just checked everything in the config again and though the switches are set to use flow control, the NICs in the attached server(s) are not.
0
 
LVL 61

Expert Comment

by:gheist
ID: 33475028
no problem with iSCSI... fix your IP network....
0
 
LVL 29

Expert Comment

by:Michael W
ID: 33476412
Even though you stated the EqualLogic's Group Manager does not show any errors, but does the Dell PowerConnect 6220 show any CRC errors?

As for the hosts doing the data retrieving/storing, are these Linux or Windows servers? If the latter, which version -- 2003, 2008?
0
Better Security Awareness With Threat Intelligence

See how one of the leading financial services organizations uses Recorded Future as part of a holistic threat intelligence program to promote security awareness and proactively and efficiently identify threats.

 

Author Comment

by:j_h_2
ID: 33476890
No errors on any ports on the 6220. We actually have two 6220's running and no errors on either.

It's Windows Server 2008 x64. SQL Server 2008 on the machine.
0
 
LVL 29

Accepted Solution

by:
Michael W earned 500 total points
ID: 33477780
On the Windows Server 2008, do you have TOE enabled? The reason I ask is that under Windows 2003 and also seen under 2008, the TCP Offload Engine (TOE) part of the Scalable Networking Pack can at times cause network performance issues.

Post the output of this command: "netsh interface tcp show global"

0
 

Author Comment

by:j_h_2
ID: 33477809
Output:

C:\Windows\system32>netsh interface tcp show globalQuerying active state...TCP Global Parameters----------------------------------------------Receive-Side Scaling State          : enabledChimney Offload State               : automaticNetDMA State                        : enabledDirect Cache Acess (DCA)            : disabledReceive Window Auto-Tuning Level    : normalAdd-On Congestion Control Provider  : ctcpECN Capability                      : disabledRFC 1323 Timestamps                 : disabled
0
 
LVL 29

Assisted Solution

by:Michael W
Michael W earned 500 total points
ID: 33477892
Try the following configuration and see if this helps any:

netsh interface tcp set global chimney=disabled
netsh interface tcp set global rss=disabled

Information about the TCP Chimney Offload, Receive Side Scaling, and Network Direct Memory Access features in Windows Server 2008
http://support.microsoft.com/kb/951037
0
 

Author Comment

by:j_h_2
ID: 33477937
Okay, this is actually a failover cluster we're on, so I'll make changes on the inactive box and fail it over tonight to see what we get. Thanks for the input and I'll report back in the morning.
0
 

Author Comment

by:j_h_2
ID: 33512685
We're still having an issue, but it looks like a different issue now. Closing this one.
0
 

Author Closing Comment

by:j_h_2
ID: 33512710
Good, clear answers, but turns out that we needed to perform update drivers, update switch configs, do a few other things. Thanks for the responses!
0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Learn about cloud computing and its benefits for small business owners.
Create your own, high-performance VM backup appliance by installing NAKIVO Backup & Replication directly onto a Synology NAS!
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

706 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now