Want to win a PS4? Go Premium and enter to win our High-Tech Treats giveaway. Enter to Win


high disk queue lengths and latency on iSCSI volume used for file sharing - Netgear ReadyNAS 2120

Posted on 2014-03-25
Medium Priority
Last Modified: 2016-11-23
We have a Dell Equallogic P4000 with 16 x 600GB 15k SAS drives in a
RAID 50 configuration.  Separate LUNs for VMs, SQL DBs, and file data.  All LUNs are accessed via iSCSI on a separate dedicated network than LAN data.  Everything has been working well.  I started running low on space so on wanted to offload the file data to a different storage device.  I chose a Netgear ReadyNAS 2120.  I'm beginning to regret my choice.  There are four 2 TB 7200 RPM SATA drives in a RAID 10 config.  I have a single LUN configured for iSCSI.  I moved all the file share data off the Equallogic volume to the Netgear volume.  The same file server managing all the shared folders is in place.  It has a dedicated network interface for LAN traffic and one dedicated for iSCSI.  Ever since I did this, our clients are saying performance is horrendous.  Sometimes it takes 30 seconds to open a file, then the next file opens right away.  Seems to be intermittent.  But one thing is certain, it's been really bad since moving data to the Netgear.  Did I just make a bad decision with the Netgear?  Before I migrated, I tested by copying large files back and forth and comparing that with copying to and from the equallogic.  File copy speeds were identical.  I know the drive RPM is half, and going from SAS to SATA, but I wouldn't expect it to be this bad for simple file sharing.  I have opened a support case with Netgear - they are still analyzing the logs.  The NIC settings are the same as they were when connected to the iSCSI volume on the Equallogic.  Should I try changing settings like MTU, large send offload, TCP offload, etc?  Or should I just chalk it up to a low quality NAS device?  Please let me know if you have any ideas for improving performance.
Question by:ITLighthouse
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
LVL 30

Assisted Solution

pgm554 earned 668 total points
ID: 39953818
Almost sounds like cache settings.

Have a look:


With that being said,SAS is a superior drive interface ,hands down.

The SAS interface can use Tagged Command Queuing which SATA does not do well.


There are SAS 7200 drives for just a few bucks more than the SATA's.

If you can afford them,replace with SAS.

You could turn on jumbo frames if you need a speed burst too.
LVL 80

Assisted Solution

arnold earned 1332 total points
ID: 39954024
Does it make a difference whether you open an Office document or a PDF or non-office document.  Office documents create a lock file on the NAS while other apps do not.

Is the switch on for the iscsi managed such that you can see whether it has resource contention on the network?

Not clear why you are using a SHARE in an iscsi setup versus functioning as a CIFS/SAMBA share?

Your setup is
server iscsi to storage
share files to workstations

Author Comment

ID: 39954170
Thank you for the responses.  
PGM554:  Thanks- I have stumbled across that netgear document already.  But a lot of those settings are not available in the OS on this particular device.

Arnold:  I like having a Windows server manage the shared folders.  It gives me the most control over domain access permissions, performance monitoring, and backups.  I realize it's another layer to worry about when troubleshooting, but also gives me more flexibility and options for troubleshooting.

So, my setup is FILESERVER connects to iSCSI volume.  one NIC is for iSCSI traffic and the other is for LAN traffic.  FILESERVER sees the volume as a local disk.  Windows manages the shared folders.  Terminal servers access files through \\FILESERVER\Share.  There's a whole range of file types.  Everything from Word, Excel, PDF, to medical software accessing scanned charts attached to patient records.  It's very hard to reproduce.  I've tried opening several types of files in several folders.  The majority of them open instantaneously, but then you get the one that takes 30 seconds to open for some reason.  Then try the same file again and it opens immediately.  This was all working fine when the iSCSI volume was on the Equallogic.  I'm thinking the Netgear just isn't able to handle the load.  But I want to be sure before ditching that as an option.  Netgear support is talking about trying a beta firmware - I'm not keen on that.  From the searching I've done since having this problem, many people complain about performance issues with Netgear in general.
Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

LVL 80

Assisted Solution

arnold earned 1332 total points
ID: 39954870
Not sure what options you have besides the windows systems, using SNMP you can try polling the local server interface using Cacti.net then you can see whether the issue occurs during peak times when the iscsi dedicated network is approaching high utilization.

have a look at sqlio http://www.microsoft.com/en-us/download/details.aspx?id=20163
This is a tool that evaluates the iscsi/storage for suitability for sql.
You can look at the performance.

I am unfamiliar with the mode by which the RAID is managed on the Netgear i.e. whether this is a software raid (linux OS with raid) and when ........

You could try on the server running a dir command on the top level of the Netgear LUN resource to see whether that will continually maintain ......
LVL 17

Expert Comment

by:Gerald Connolly
ID: 39955802
What does your new network setup look like. How many and what speed are your network connections?

Accepted Solution

ITLighthouse earned 0 total points
ID: 39995515
I finally figured out the problem.  We ended up purchasing a Netgear ReadyNAS 4220 to replace the 2120 thinking that it was a more robust device and would provide better performance.  After installing it, I did a test copy and to my dismay, experienced the exact same lag times as the 2120.  After much testing, going over settings, trying different RAID levels and netgear firmware, and beating my head against the wall,  I finally stumbled across a setting that resolved the issue.  In Disk Management, properties of the connected iSCSI disk, under the policies tab, I checked the box to turn off Windows write-cache buffer flushing.  That immediately fixed the disk write lag times.  No reboot required.  Both the 4220 and 2120 does not allow me to disable write caching, and is enabled by default.  But it does let me disable buffer flushing.  Previous Netgear devices as well as the Equallogic have write caching and buffer flushing disabled by default.  Now large file copies are steady and don't hang for 30 seconds during the copy.  Previously, disk response times would spike to over 3000 and sometimes as high as 40,000.  Now it does't go above 400ms and usually averages around 60ms.  

Although I ended up figuring it out by myself, I did appreciate your input!

Author Closing Comment

ID: 40003493
figured it out myself

Featured Post

Concerto's Cloud Advisory Services

Want to avoid the missteps to gaining all the benefits of the cloud? Learn more about the different assessment options from our Cloud Advisory team.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

#Citrix #Citrix Netscaler #HTTP Compression #Load Balance
Each year, investment in cloud platforms grows more than 20% (https://www.immun.io/hubfs/Immunio_2016/Content/Marketing/Cloud-Security-Report-2016.pdf?submissionGuid=a8d80a00-6fee-4b85-81db-a4e28f681762) as an increasing number of companies begin to…
Windows 8 comes with a dramatically different user interface known as Metro. Notably missing from the new interface is a Start button and Start Menu. Many users do not like it, much preferring the interface of earlier versions — Windows 7, Windows X…
In this video, we discuss why the need for additional vertical screen space has become more important in recent years, namely, due to the transition in the marketplace of 4x3 computer screens to 16x9 and 16x10 screens (so-called widescreen format). …
Suggested Courses

618 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question