Solved

Slow File copy pulling data from a server, but not pushing

Posted on 2014-07-28
18
287 Views
Last Modified: 2016-11-23
I have a site that for the past few months has had a bit of a performance problem with an application that talks to their SQL database.  At first I thought it was an issue with the performance of the SQL DB, as it currently sits on the same hardware as the Exchange, so just running as a single server environment.

This was adequate when they were only a 10 user site, and not doing much reporting etc, but they have grown, and time has come to split SQL off to another piece of hardware, as the problem with their application is that when they first open it up, it can take up to 5mins to open up.

After a reboot of the server, it would only take 10-20secs to open up, but as SQL and Exchange starting gobbling up resources, over the period of about 5-6 days this would slowly push out again till got back to it's 5mins.

Adding RAM to the server and limiting the amount of RAM that Exchange could access helped the situation, but didn't resolve it, so new hardware was order and to move SQL onto that.

In the process of shifting the databases over, I have stumbled onto something which I believe could be more of the issue, but not sure what it causing it, or how to fix it.

If I go onto the SBS server, and push a large file to the other server, or workstation, the speed of the transfer is adequate, runs about 15mb/s, but if I try to pull the same file from the SBS server, then the transfer only runs at 400KB/s.

Have update all the controller, NIC, Hard drive firmware, sent all DSET logs to DELL, and they say everything looks good from their end, but clearly it isn't.  Have tried different ports on the switch, and a different switch, along with different cabling, and non of that makes any difference.

Anyone have any ideas where to start looking to try and narrow down what is causing the issue.
0
Comment
Question by:donovanb
  • 7
  • 6
  • 2
  • +3
18 Comments
 
LVL 30

Expert Comment

by:pgm554
ID: 40226792
Sounds like a duplex mismatch,
If you are running  gig E, everything must be set to auto.

If you are still having issues ,try this and post results:

http://openmaniak.com/iperf.php
Do not hard set any duplex settings!
0
 
LVL 42

Expert Comment

by:Davis McCarn
ID: 40226883
What antivirus software is running?
0
 
LVL 16

Expert Comment

by:Gerald Connolly
ID: 40227972
What are you pulling it onto? What machine, RAM, Disk?
0
 
LVL 30

Expert Comment

by:pgm554
ID: 40228024
You could try this too,but do the duplex and iperf thing first .

http://www.solarwinds.com/server-application-monitor.aspx
0
 

Author Comment

by:donovanb
ID: 40228056
Switch is not a smart one, so that is just auto, and the NIC on the server is set to Auto.

AV software is Symantec.

I have tried several different machines pulling data across, and all pretty much give the same result, so it does narrow it down to a problem with the server, or the switch the server is plugged into, but considering the problem goes away with a reboot for a few days, it has to be an issue with the server

I will upload the results later this evening.

Thanks
0
 
LVL 30

Expert Comment

by:pgm554
ID: 40228069
Symantec,
Endpoint by any chance?
Seen funny things with Symantec over the years and it's always a good place to look.
Their products have been the bane of many a sysadmins existence.
0
 
LVL 44

Expert Comment

by:Darr247
ID: 40228086
Along DavisMcCarn's line of thought...
It could be a TDI driver from the AV that's causing the slowdown.
See http://support.microsoft.com/kb/2493361 for microsoft's recommended fix.
0
 
LVL 30

Expert Comment

by:pgm554
ID: 40228135
Had that problem with AVG a long time ago ,except the server would not respond at all.
0
 
LVL 20

Expert Comment

by:wolfcamel
ID: 40243098
what sort of raid are you running?
What sort of performance are you getting if you simply move some files around on the server - from one partition to another? This may help identify if it is disk related or network related.
Disable the AV on the server also as a test.
Stick a USB stick in the server, share it and copy data across the lan to and from that.
Have you looked at resource monitor on the server - particularly at the disk queue length?
0
Find Ransomware Secrets With All-Source Analysis

Ransomware has become a major concern for organizations; its prevalence has grown due to past successes achieved by threat actors. While each ransomware variant is different, we’ve seen some common tactics and trends used among the authors of the malware.

 

Author Comment

by:donovanb
ID: 40248050
It is setup with 4 15K disk's in a raid 5 array, file copy within the server is fine, it takes about 3 secs to copy a 700mb file from on partition to the other.

Yes, it is running Endpoint, but that has been in place for a while, and this problem has only popped it's head up in the last few months or so.  I guess I could try disabling Symantec on the server and see if that makes any difference.

Also found this, which is kinda related.

http://social.technet.microsoft.com/Forums/windowsserver/en-US/e55022a4-db65-4dc9-a2f1-96b7f5d8e2fa/very-slow-dfsr-on-windows-server-2008?forum=winserverfiles
0
 

Author Comment

by:donovanb
ID: 40248056
Also tried to install the hotfix, and it just said the update is not applicable to your computer.
0
 

Author Comment

by:donovanb
ID: 40248070
Just to add another thing to the above, I have just tried pulling a file across from the server with no one on it, and the copy rate was 340kb/s, I rebooted the server and tried again as soon as the server had come up, and the rate was 29.8MB/s.

This rate will slowly decrease over the next 5 days or so back down to the 340kb/s
0
 
LVL 42

Expert Comment

by:Davis McCarn
ID: 40248622
On the Symantec Management server, you need to add a trust for the local lan ip address range: http://www.symantec.com/business/support/index?page=content&id=HOWTO55816
And you may need to change the Auto Protect settings; but, see if trusting the LAN takes care of it, first.
Page 62: http://www.isoftland.com/docs/symantec/endpoint/SymantecEndPointProtection___Manual_Client_guide.pdf
0
 
LVL 30

Expert Comment

by:pgm554
ID: 40249406
Why don't you download an eval of Solarwinds

http://www.solarwinds.com/server-application-monitor.aspx

and see what's going on.
0
 

Accepted Solution

by:
donovanb earned 0 total points
ID: 40285071
Just as an update if anyone else has this problem, applied the registry entry below and have been monitoring for a couple of weeks now, and seems to have solved the issue, pulling data from the server is no longer slow, and the customers application continues to only take a few seconds to log in, not minutes as before.

HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Tcpip\Parameters

Value =DisableTaskOffload
Type = DWORD
Data = 1

Value =EnableTCPChimney
Type = DWORD
Data = 0

Value =EnableTCPA
Type = DWORD
Data = 0

Value =EnableRSS
Type = DWORD
Data = 0
0
 

Author Closing Comment

by:donovanb
ID: 40294262
Found post about registry
0
 
LVL 30

Expert Comment

by:pgm554
ID: 40294652
And this was server 2008?

That was an issue with server 2003 and supposed to be fixed in 2008 because of the newer stack.
0
 

Author Comment

by:donovanb
ID: 40295034
Yes, server I applied this fix to was 2008R2, and the link refers to it being on a 2008 server as well, so obviously not fixed.
0

Featured Post

How to improve team productivity

Quip adds documents, spreadsheets, and tasklists to your Slack experience
- Elevate ideas to Quip docs
- Share Quip docs in Slack
- Get notified of changes to your docs
- Available on iOS/Android/Desktop/Web
- Online/Offline

Join & Write a Comment

Hyper-convergence systems have taken the IT world by storm and have quickly started to change our point of view of how the data center should and could be architected. In this article, I’ll explain the benefits of employing a hyper-converged system …
Every server (virtual or physical) needs a console: and the console can be provided through hardware directly connected, software for remote connections, local connections, through a KVM, etc. This document explains the different types of consol…
Excel styles will make formatting consistent and let you apply and change formatting faster. In this tutorial, you'll learn how to use Excel's built-in styles, how to modify styles, and how to create your own. You'll also learn how to use your custo…
This tutorial demonstrates a quick way of adding group price to multiple Magento products.

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now