Question

Slow file copy problem - Windows - Linux machine

Asked by: tlatev

Hi all,

I have 2 machines - a Debian server and a WinXP desktop. The Win box is the more powerful one and has a gigabit network card. The Linux box is relatively old machine, but still works fine except I think it can perform even better. the problem is that when copying large files over the cable I'm getting an average speed of 3Mbytes per second. According to my calculations it should be close to 10 if not more, since the slower network card is a 100 mbit one. I used different protocols - samba, ftp, http with the same results. I also checked the cable and the win machine - no problems there, I can get speeds of 300mbits when using a win laptop.
Also when copying the files I get a CPU load of ~80-85%, so I would imagine if the CPU is the bottleneck I should be able to squeeze some more mbits out of my connection. Any ideas on how to resolve that? Is there a reserved cpu time for the root user? I run smbd as a regular user.

NewWest:~# uname -a
Linux NewWest 2.6.16-1-686 #2 Thu May 4 18:22:23 UTC 2006 i686 GNU/Linux

NewWest:~# lspci
00:00.0 Host bridge: Intel Corporation 82810E DC-133 GMCH [Graphics Memory Controller Hub] (rev 03)
00:01.0 VGA compatible controller: Intel Corporation 82810E DC-133 CGC [Chipset Graphics Controller] (rev 03)
00:1e.0 PCI bridge: Intel Corporation 82801AA PCI Bridge (rev 02)
00:1f.0 ISA bridge: Intel Corporation 82801AA ISA Bridge (LPC) (rev 02)
00:1f.1 IDE interface: Intel Corporation 82801AA IDE (rev 02)
00:1f.2 USB Controller: Intel Corporation 82801AA USB (rev 02)
00:1f.3 SMBus: Intel Corporation 82801AA SMBus (rev 02)
01:07.0 Multimedia audio controller: Ensoniq ES1371 [AudioPCI-97] (rev 06)
01:09.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL-8029(AS)
01:0a.0 Ethernet controller: 3Com Corporation 3c905B 100BaseTX [Cyclone] (rev 24)
NewWest:~#

the 3com card is the one im talking about
I tweaked several tcp settings without any luck so far

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2007-06-23 at 19:52:22ID22653712
Tags

slow

,

copy

,

file

,

linux

,

windows

Topics

Samba File Sharing

,

Computer CPU Processors

,

Linux Networking

Participating Experts
5
Points
300
Comments
15

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. Performance issues in Debian with Samba.
    Im having some issues with the performance when I use Samba on my Linux computer (running Debian). The Linux computer is a 1 GHz Pentium III with 256 MB RAM and it runs linux kernel 2.2.20 and samba (it runs other servers/applications too). It is connected to a Windows XP com...
  2. Samba Error - Running on Debian Linux 3.0
    Hi I have recently installed and configured Samba 3.00 on my Debian server, which does work fine. When i restart samba i get the following: root@xbox:~# /etc/init.d/samba restart Stopping Samba daemons: nmbd smbd. Starting Samba daemons: nmbd smbd/usr/sbin/smbd: /usr/lib/li...
  3. Linux samba
    Dear All Im runing a linux suse ver 8 in windows 2000 domain, the linux has samba on it, and the user are accessing the shares in this server, now some times when they try to login to the shares it gives messages" the specifiled computer name is no longer available&quo...
  4. debian SAMBA package --with-acl-support
    Hi experts, How do I download and install SAMBA 3.0.x on Sarge via a pre-compiled binary, that has --with-acl-support? I have already modified /etc/apt/sources-list to say: deb http://us4.samba.org/samba/ftp/Binary_Packages/Debian sarge samba then, apt-get update then,...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: computerfixinsPosted on 2007-06-24 at 00:48:54ID: 19350222

usaully ftp is the least bloated protocol to use.

You can try jumbo frames to reduce cpu loads, if your nics, router, swtches, etc support it.

In linux world you just edit the ifcfg-eth? and add MTU=9000

not sure on windows side, not a microsqusih guy.

 

by: HalldorGPosted on 2007-06-24 at 02:10:16ID: 19350338

You may test the speed between the machines using a program like iperf it has both a linux and windows version and can be used to messure througput between to machines.

If you are getting much higher speed using iperf then the speedlimit is something in the linux machine
can be not enough memory or to slow disk.  
But if the speed is similar with iperf look at replacing the old network card with somthing more modern.

Also check that you are not haveing duplex problems on the network card using
mii-tool or similar to check the status of the ethernet connections.

 

by: tlatevPosted on 2007-06-24 at 11:31:40ID: 19352013

Oops, sorry
I forgot to mention that I did most of the things you recommend
I also tend to think that the problem can be the old 3 com netcard itself

NewWest:~# mii-tool -v
eth0: negotiated 100baseTx-FD, link ok
  product info: vendor 00:00:00, model 0 rev 0
  basic mode:   autonegotiation enabled
  basic status: autonegotiation complete, link ok
  capabilities: 100baseTx-FD 100baseTx-HD 10baseT-FD 10baseT-HD
  advertising:  100baseTx-FD 100baseTx-HD 10baseT-FD 10baseT-HD
  link partner: 100baseTx-FD 100baseTx-HD 10baseT-FD 10baseT-HD flow-control


NewWest:~# ethtool eth0
Settings for eth0:
        Supported ports: [ TP MII ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
        Advertised auto-negotiation: Yes
        Speed: 100Mb/s
        Duplex: Full
        Port: MII
        PHYAD: 24
        Transceiver: internal
        Auto-negotiation: on
        Current message level: 0x00000001 (1)
        Link detected: yes


NewWest:~# ifconfig eth0 mtu 9000
SIOCSIFMTU: Invalid argument

also I have no additional networking hardware - the Lin box has 2 net cards and Im using a crossed over  cable to connect them. then the other card is connected to the internet through a modem

I also tried iperf on both machines - the interesting thing is the fact that Im getting even worse results with that - the reported speed was just above 10mbits!

 

by: HalldorGPosted on 2007-06-24 at 12:21:25ID: 19352140

You could check if the realtek card is giving better performance

 

by: tlatevPosted on 2007-06-24 at 23:13:25ID: 19353655

No way - it's a 10mbit one :(
Im using it for the Internet connection only

 

by: RedimidoPosted on 2007-06-29 at 21:47:52ID: 19394908

he

snips:
...speed of 3Mbytes per second. According to my calculations it should be close to 10 if not more...
Also when copying the files I get a CPU load of ~80-85%...

I would then think your problem is I/O :-)
your hard disk capabilities can be checked with
hdparm -i /dev/hda

it would be great to have that info here.

also to see resumed how is your disk configured, issue
hdparm /dev/hda

and to check performance (pls put it here)
hdparm -Tt /dev/hda

I think (as you can see) it is your hard drive that cannot handle the troughput, not your lan. however, is usual the IDE hard drives are configured for slow performance. hdparm -i can help us to put the best performance your drive can get ;-)

it this is the cause, it would be more because the IDE interfase on your old server than because of the drive speed, as it have turned out to be on many systems I have reviewed.

 

by: tlatevPosted on 2007-06-30 at 22:46:03ID: 19397947

Sorry, I must have forgotten to post my hd results here, but I did test my drive before
Anyway, here they are:
NewWest:~# hdparm -i /dev/hda

/dev/hda:

 Model=Maxtor 6Y120L0, FwRev=YAR41BW0, SerialNo=Y32Q2PGE
 Config={ Fixed }
 RawCHS=16383/16/63, TrkSize=0, SectSize=0, ECCbytes=57
 BuffType=DualPortCache, BuffSize=2048kB, MaxMultSect=16, MultSect=1
 CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=240121728
 IORDY=on/off, tPIO={min:120,w/IORDY:120}, tDMA={min:120,rec:120}
 PIO modes:  pio0 pio1 pio2 pio3 pio4
 DMA modes:  mdma0 mdma1 mdma2
 UDMA modes: udma0 udma1 udma2 udma3 *udma4 udma5 udma6
 AdvancedPM=yes: disabled (255) WriteCache=enabled
 Drive conforms to: ATA/ATAPI-7 T13 1532D revision 0:  ATA/ATAPI-1,2,3,4,5,6,7

 * signifies the current active mode


NewWest:~# hdparm /dev/hda

/dev/hda:
 multcount     =  1 (on)
 IO_support    =  1 (32-bit)
 unmaskirq     =  0 (off)
 using_dma     =  1 (on)
 keepsettings  =  0 (off)
 readonly      =  0 (off)
 readahead     = 256 (on)
 geometry      = 65535/16/63, sectors = 240121728, start = 0

NewWest:~# hdparm -Tt /dev/hda

/dev/hda:
 Timing cached reads:   174 MB in  2.01 seconds =  86.72 MB/sec
 Timing buffered disk reads:   70 MB in  3.05 seconds =  22.94 MB/sec

So if we are to trust those numbers above my server could perform much better.
Any suggestions so far?

 

by: tlatevPosted on 2007-06-30 at 22:49:40ID: 19397951

I forgot to ask that in my previous posting, but Im thinking of an easy way to check if the problem is with the hard drive /which I doubt/
How can I configure a dummy file in the RAM and tell the system to copy it over the network, so I can be sure no hard drive activity is slowing down the process?

 

by: HalldorGPosted on 2007-07-01 at 03:30:14ID: 19398395

As iperf was not giving a better result this is not due to lack of disk performance.

As Iperf does not use disk...

 

by: tlatevPosted on 2007-07-01 at 10:08:37ID: 19399577

NewWest:~# iperf -s
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 85.3 KByte (default)
------------------------------------------------------------
[  4] local 192.168.1.1 port 5001 connected with 192.168.1.11 port 3166
[  4]  0.0-10.0 sec  11.9 MBytes  9.99 Mbits/sec
[  4] local 192.168.1.1 port 5001 connected with 192.168.1.11 port 3169
[  4]  0.0-10.0 sec  11.9 MBytes  10.0 Mbits/sec
NewWest:~# iperf -s -u
------------------------------------------------------------
Server listening on UDP port 5001
Receiving 1470 byte datagrams
UDP buffer size:   256 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.1 port 5001 connected with 192.168.1.11 port 3192
[  3]  0.0-10.0 sec  1.25 MBytes  1.05 Mbits/sec  0.212 ms    0/  893 (0%)
NewWest:~# iperf -s
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 85.3 KByte (default)
------------------------------------------------------------





[1920] local 192.168.1.11 port 3204 connected with 192.168.1.1 port 5001
[ ID] Interval       Transfer     Bandwidth
[1920]  0.0-30.0 sec  92.9 MBytes  26.0 Mbits/sec
read failed: Connection reset by peer

Thats the best I could get, which is ~3 mbytes/sec, which is what I achieve copying files

 

by: HalldorGPosted on 2007-07-01 at 11:53:17ID: 19399832

As it is faster in receiving than sending.
Would blame this on CPU or the network card
You will simply not get more performance from the machine than this.
Had an old laptop that did not perform more than about 30 Mbits

 

by: tlatevPosted on 2007-07-25 at 18:13:02ID: 19571226

Yep, I ended up replacing the network card with a gigabit one - I'm getting now twice that speed, but still far from the theoretical - turns out the problem is the CPU after all

 

by: srinut31Posted on 2008-11-11 at 00:09:35ID: 22928425

Dear tlatev,
               
              If want speed up moving  and coping files in linux and windows  just disable windows xp firewall it`s work for me also  

 

by: expert608Posted on 2009-02-20 at 06:27:12ID: 23692099

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...