Solved

How to maximize network utilization

Posted on 2010-09-02
9
1,264 Views
Last Modified: 2013-12-02
My network topology is like this:

Dual Cisco 4507 Core Switches
Cisco 3750-E Server Switches & Access Switches Ports at 1Gbps
10Gbps backbone between Access/Core/Server Switches

My main storage server is a HP DL360 G4p connected at 1Gbps to the Server Switches
It connects to an EMC AX4 via an iSCSI connection at 1Gbps

The other day we had someone copying data from an SD card directly to the storage server over the network. So, removable storage dragged to share drive.

When the person was copying the data from the SD card (about 6 GB I think) it took up 36Mbps on our MRTG graphs and essentially shut everyone else out. Nobody could get to files or do anything. It was really bad.  I told her to stop the copy and everything returned to normal. I assumed that it was the slow read rate of the SD card that caused the problem.

My question is this: Why, with a 1Gbps network and a 10Gbps backbone did that take down my network? I mean, all the other servers stopped the ability to talk, for the most part.

Second, I’m having similar issues today when the utilization on the network is reaching about 36Mbps to the APP server and things are dying. What can I do to help this? Why does it barely fill the capacity of the server and it kills everything?

I have verified that the connections are in fact 1000/full duplex connections.

Would a more powerful server help? Is my network not optimized somehow?
0
Comment
Question by:cmaohio
  • 3
  • 2
  • 2
  • +2
9 Comments
 
LVL 16

Expert Comment

by:uescomp
ID: 33590722
Depending on how big the network is, if you have departments you can however break them appart into V-Lans to reduce network chatter to the department vs the whole building, all you would then have to do is setup a crosslink so all systems can still talk to each other but remain in their own v-lan.  This is best optimized when you have different sections of the office consiting of i would say 5-10 people/pc's etc.

As for the above issue that can happen when transfering from multiple locations (meaning the sd card).  The server is attempting to grab a file located on another systems SD card reader so it will try to get the transfer done as soon as possible.  I personally would not go that route and instead have her copy the data first to her local system, then from the local system transfer it to the server etc.
0
 
LVL 22

Expert Comment

by:eeRoot
ID: 33590839
When you have some time at night or on a weekend, replicate the user's setup and benchmark your network speed with Jperf.  It's nice little program that can test network transfer speeds.

http://code.google.com/p/xjperf/

Then transfer some files back and forth while monitoring your connection with Wireshark.  Wireshark has a variety of statistcs and analysis reports that can help you see what problems the network is having.

http://www.wireshark.org/

Also, test the transfer times of a large file from a hard drive versus a SD card and see if you notice any network problems while doing so.  There's no reason for a single slow connection to take down the entire network.

If Jperf and wireshark don't help, can you post a network diagram and the confgs from the core switches?
0
 
LVL 79

Expert Comment

by:lrmoore
ID: 33591474
Sounds like the bottleneck is the IO on the server, not the network.
0
 
LVL 5

Author Comment

by:cmaohio
ID: 33591580
Yes Irmoore, it does sound like that. How do I increase that? Trunk two Ethernet ports?  Still I was less than 33% utilization on the interface.
0
Why are Office 365 signatures so complicated?

Trying to setup transport rules for Office 365 email signatures and can’t quite figure it out? Having to test the signature over and over? Make things simple by using Exclaimer Cloud - Signatures for Office 365.

 
LVL 32

Accepted Solution

by:
aleghart earned 300 total points
ID: 33592032
The bottleneck could be at the drives/controller.  As a reference, a single 7200rpm drive with Windows can max out at 20-30MB/sec.  Having a gigabit NIC would mean nothing.  Even Fast Ethernet could keep up with that.  But, if the server has no more IO to the storage system, then just about everything that's not cached in RAM will crawl.
0
 
LVL 79

Assisted Solution

by:lrmoore
lrmoore earned 200 total points
ID: 33592053
Yeah, there's nothing you can do from a network perspective to speed up the IO on the server itself. It's all in the disk read/write/cache.. Get a better sever with faster drives? Perhaps RAID5 with 10 x 15K drives?
0
 
LVL 5

Author Comment

by:cmaohio
ID: 33596277
Ah, I see. So, that must be it. They are SATA 7200RPM drives. 4 in a RAID 5 configuration. So, that's my bottleneck. Man, that is unfortunate. All this stellar technology we spent money on and the DRIVES are the problem! damn!
0
 
LVL 5

Author Closing Comment

by:cmaohio
ID: 33596287
Essentially there is no solution but the answer to the question was complete.
0
 
LVL 32

Expert Comment

by:aleghart
ID: 33598190
No cost workaround (only costs you time and some drive space):

Backup.
Create 4-drive RAID-10.
Move data back.

You'll take a hit in drive space (RAID-1 space=2n, versus RAID-5 space=3n), but the performance boost should be noticeable.
0

Featured Post

U.S. Department of Agriculture and Acronis Access

With the new era of mobile computing, smartphones and tablets, wireless communications and cloud services, the USDA sought to take advantage of a mobilized workforce and the blurring lines between personal and corporate computing resources.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Management Network in CIsco L2 Switch 3 36
Upgrade View 5.1.2 to Horizon 7 3 56
Root STP in Cisco switch maintenance 2 46
ACL Logging Optimization 7 27
I see many questions here on Experts Exchange regarding switch port configurations and trunks. This article is meant for beginners in the subject to help to get basic knowledge about Virtual Local Area Network (VLAN (http://en.wikipedia.org/wiki/Vir…
This tutorial will go through the steps required to write a script that will back up the configuration settings of a HP-ProCurve switch. You will need to get the following things to follow this tutorial: Telnet Scripting Tool e.g. TST10.exe …
Here's a very brief overview of the methods PRTG Network Monitor (https://www.paessler.com/prtg) offers for monitoring bandwidth, to help you decide which methods you´d like to investigate in more detail.  The methods are covered in more detail in o…
You have products, that come in variants and want to set different prices for them? Watch this micro tutorial that describes how to configure prices for Magento super attributes. Assigning simple products to configurable: We assigned simple products…

919 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now