Question

Windows to Unix File transfer

Asked by: jorbagw

I am a complete muppet wrt networking, but I am IT literate (application developer). Pls keep in mind in your answer.

I am trying to transfer files from a Win XP-64 box to a media streamer (popcorn hour A110) which runs linux. The onboard disk is formatted as ext3. The connection between the two is wired ethernet all the way via a Netgear DGN200  router.

The problem is the transfer speed. I can manage about 1MB/s using either windows explorer/networking (assume this is samba) or via ftp.

It's possible that the problem is the media streamer itself, but there are reports on the net of substantially higher speeds, although no details on how this was acheived (it just seems to have worked) - it may be because they're running linux?

My questions are
a) Is it possible/likely that the transfer problems I am having are because of the windows/linux conversion and/or because samba/ftp are not handling this well
b) This article suggested that I could fix the problem by switching to using the NFS protocol. Does this sound reasonable.
http://www.digitalreviews.net/reviews/video/popcorn-for-all-syabas-popcorn-hour-a-110-and-b-110-network-media-tanks-rev.html
c) If the answer to b is that this could be worthwhile, any links to how to go about getting/installing NFS

apologies for the incorrect SCO tag.

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2009-08-09 at 08:07:51ID24638160
Topics

SCO Unix

,

Linux Networking

,

Windows Networking

Participating Experts
3
Points
500
Comments
24

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. SCO UNIX and Win 2k
    Can anyone point me in the right direction whereby I can get some 'step-by-step' procedures on accessing SCO UNIX files from an NT machine (SAMBA or UNXIX services for Windows)- I am more than competent on NT platforms but pretty apprehensive around the UNIX stuff.
  2. Make connection between Office Network (Windows XP)…
    I have two networks namely Office Network running on Windows XP and Plant Network running on SCO UNIX (SCO OpenServer (TM) Release 5). The Subnet Mask for both networks is different. (Office Network 255.255.255.192 whereas Plant Network 255.255.0.0). I have made one PC on Off...
  3. Samba, Sco Unix & Windows Server
    My goal is to move data from Sco Unix to Windows Server. I have loaded samba and is able to see the Unix Server Directory to be backup to the Windows Server. However, I'm not sure what's the best route to take to move the data. my initial thought was to mount the windows d...
  4. Sco Unix - Transfer Queue?
    I have a SCO Unix server with several local printers and one remote/network printer. Another staff member has sent 2 jobs to a local queue - the printer has been removed - so the jobs are just sitting there. Is there any way I can redirect/transfer or move these 2 jobs to the...
  5. need unix sco terminal for file transfer
    I need to extract a file from a unix sco release 5. What terminal software we can use!
  6. SCO UNIX folder backup
    I need some help with getting information off of a SOC UNIZ server. I have a SCO UNIX server in which I want to backup the all the contents inside a specific directory to a single cpio file. Additionally I want to transfer that file from my SCO UNIX server to down to a works...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: mikelfritzPosted on 2009-08-09 at 12:38:06ID: 25055612

Have you updated the firmware to the latest for the A110?

I assume you have checked that both machines are linking up at 100M.

It certainly sounds like NFS performs far faster with this unit.  Here's a guide on how to set up the A110:
http://www.mpcclub.com/temp/MPC_SMB_and_NFS_Guide_PCH.pdf

Here is a free nfs windows server from MS (I don't think it will run on XP64 though):
http://www.microsoft.com/downloads/details.aspx?familyid=896C9688-601B-44F1-81A4-02878FF11778&displaylang=en

This one may run on XP64 (It doesn't so it doesn't but also doesn't say it does):
http://www.labf.com/nfsaxe/index.html
And a guide for that one:
http://www.labf.com/nfsaxe/nfsaxe_manual/ctx_chap14_2.htm

Another:
http://www.nfsforwindows.com/home


If none work then you may need to hunt for NFS server software for 64 bit.  I don't see much out there - maybe get a NAS drive that supports NFS.

You need to set up the PC as an NFS server and share a folder or two.  Then set up the A110 to access them - the guide above shows how to do that with the A110.  

 

by: nociPosted on 2009-08-10 at 02:36:49ID: 25058294

Also check your network ....

Sometime it just happens that auto negitiation of interfaces doesn't work out. Speed is allways ok, but the Duplex is simetimes mismatched (probabilities of it going good or bad heavily depend on hardware involved, switches interfaces...)

But if there is a mismatch then the transferrate will be low, wheras a ping will reveal nothing.

You have to check for misaligned frames, crc errors, short frames etc.

Both sides of a cable should have the same settings, when in doubt please make the settings fixed in stead of auto.
Also specifying different buffersizes might help (smb.conf).

 

by: it4sohoPosted on 2009-08-10 at 09:44:07ID: 25061573

This isn't an uncommon problem at all... consider inserting a high-speed (10/100, or even better: 10/100/1000) SWITCH between your systems and your router...

Even though we use them as such, even 4-port routers are not DESIGNED to be high-speed switches. And, even though each port may be 10/100, that DOES NOT mean that the internal switch can handle full-throttle speeds on any of those ports. Remember: the intended purpose of a router is to send data from LAN ports to WAN ports, not necessarily to other LAN ports.

I have had this problem with several clients over the years... several popular routers have overall throughput values that make even the cheapest switches seem LIGHTNING FAST by comparison.

I hope this helps...

Dan
IT4SOHO

 

by: it4sohoPosted on 2009-08-10 at 09:51:17ID: 25061636

After considering your opening comment ("I  am a complete muppet wrt networking..."), I thought I'd add a LITTLE bit more to my comment above....

The way you'll want to configure your LAN to follow my suggestion (BTW: a little 5-port Gbit switch is only about $35 (since you seem to like NetGear, try the GS605... $35 at newegg.com w/ free shipping).

Now what you'll do is move ALL of the network cables that go to your router's LAN ports and instead plug them into the new switch. Then, you'll add ONE new cable to connect the switch to the router. In the end, you'll see a data flow path like this:

    Internet <=> Router <=> Switch <=> systems

Since the switch will have a HIGH aggregate throughput capability, you should see MUCH faster file transfer speeds.

Good Luck!

Dan
IT4SOHO

 

by: jorbagwPosted on 2009-08-10 at 13:22:30ID: 25063687

OK Guys, bear with me. I'm going to have a look at everything suggested above. Some of this will take time. be back in a day or so.

Good answers btw ;o)

 

by: mikelfritzPosted on 2009-08-10 at 13:36:57ID: 25063819

Good luck.  The review you posted certainly looks like the ticket, but you may not have much luck finding the NFS server for 64 bit.  

It does not look like you get much control over the network settings and samba settings on the A110.

Maybe find someone with a 32 bit XP and try the MS nfs server to test the speed.

 

by: jorbagwPosted on 2009-08-13 at 05:09:09ID: 25087251

OK. I have a partial solution. I bought a gigabit switch and set it up as suggestted. Made no difference at all.
The NFS solution did work and I now have reasonable playback from shares on my PC.

Catch is I also want to be able to transfer files to the hard disk at a reasonable speed, but the NFS client I used (hanewin as per the guidance link I posted) doesnt have any way to do this. Any suggestions as to how I can use NFS for file transfer?

Any tips on why the switch made no difference also appreciated.

 

by: nociPosted on 2009-08-13 at 05:23:41ID: 25087342

Did you also check you cabling as Gigabit Xfers also need Cat5e or better cabling.

NFS is usualy used to mount disks over a network, so there should a mount or and extention to net use that uses NFS or so?

just like you can do net use F: \\machine\share\ for SMB/CIFS
You should be able to do mount machine:/share F:  for NFS
After that you have a disk F: that you can Access....

But you do need write access on the other side... mount with the right owner.
For Windows SFU it is along:   mount -u:username -p:password machine:/share X:

 

by: jorbagwPosted on 2009-08-13 at 06:07:34ID: 25087730

Cabling is all Cat 5.
I have no idea what you're suggesting wrt mounting a disk. Can you give a little more detailed instruction on how to do this on my windows box?  Remember this is NOT my area of expertise.

IP address of the device is 192.168.0.3
disk name for standard smb drive mapping is share on 'SMP8634 Share(Pch-a110)' (Z:)

 

by: mikelfritzPosted on 2009-08-13 at 07:13:41ID: 25088425

hanewin looks to be an NFS server only.  You need a NFS client on the XP box to connect to the NFS share on the A110.

 

by: jorbagwPosted on 2009-08-13 at 08:12:03ID: 25089244

Ah. Will start looking

 

by: nociPosted on 2009-08-13 at 09:28:02ID: 25090186

Windows Services for Unix (SFU for short).

 

by: jorbagwPosted on 2009-08-13 at 23:36:49ID: 25095654

Windows SFU doesnt work on 64 bit. Unfortunately

 

by: it4sohoPosted on 2009-08-14 at 09:57:58ID: 25100118

First thing, your query about why the new switch didn't seen to help -- the quick answer is that I was wrong, and your router wasn't the problem. It doesn't mean my premise was wrong (the router IS much slower than the switch), just that it apparently wasn't what was causing this issue. (You can keep the switch and with it the faster throughput capabilities, or return it because it didn't fix your problem).

Next, I'n not at all sure that NFS is going to somehow outperform FTP -- in both instances, you're using *nux protocols (vs. the Microsoft NetBIOS protocol [now called SMB ... how Samba got its name... or sometimes CIFS]) and so aren't supposed to have the "overhead" problems present in the MS protocols.

One wayward thought... I am assuming you've defragged your Win64 system's hard drive (and that it is not anywhere near capacity)... and emptied the temp folder (%TEMP%)...

For me, it helps to break down all of the steps involved to try to see where the "catch" is:
 1) read the source file off the disk
 2) buffer the data into RAM -- as much as possible
 3) write the source file contents (from the RAM buffer) to the network card -- NOTE: it must be broken up into 1500 byte blocks (or smaller) for the TCP protocol

 A) Receive data from the network card
 B) Checksum each packet of 1500 bytes (or thereabouts)
 C) Request re-transmit of corrupt packets
 D) Buffer good packets into RAM until larger blocks have been assembled completely
 E) Write completed blocks (usually equivalent in size to a disk track) to hard drive

So, as you can see -- there may be problems:
 a) reading the data off of the hard drive (bad drive or interface cable?)
 b) storing the data in the read buffer (bad RAM on Linux?)
 c) sending the data over the network (bad cable or switch causing re-transmits?)
 d) writing the data into write cache / buffer (bad RAM on Win64?)
 e) writing the data onto the disk (failing/fragmented/full hard drive?)

Hopefully, you'll be able to test each of these (although testing the Linux may be difficult if its an embedded system -- do you have another system you can try it on? If it's fast, say on an XP32 system, then we'd know its an issue with the Win64 system)

Good Luck -- I'm sticking with ya 'till we find the culprit!

Dan
IT4SOHO

 

by: jorbagwPosted on 2009-08-14 at 10:45:22ID: 25100468

Dan,
Appreciate the commitment;o) I can follow the process you've outlined so I'll address the parts I can/know how to do. Also one clarification. We're trying to get the data from the Win64 box to Linux - your post was the other way round (unless I've misunderstood)

1. Transfers over the network using SMB (explorer) or FTP (from win 64) to a win xp 32 netbook are quite quick. I'm assuming this rules out speed problems related to the disk/ram/switch on the windows box
2. NFS is quicker than SMB for streaming. I have proven this by setting up the NFS server on both devices and the buffering and fast forward etc are MUCH quicker under NFS. This mirrors the article I included in the initial post. Also found a way to pull files to the PCH over NFS and while it's undoubtedly quicker (5 mins for a 1gb movie rather than 22 via FTP) it's an incredibly painful interface - one file at a time when I have ~600 to go.
3. Bad Ram at either end should be unlikely. windows box has 8GB (why I need XP64), there should be enough good ram in there ;o). Linux device is brand new so this is less likely and more difficult to determine so I'll leave this until last.
4. Disk in the linux box was a 3 month old 2TB disk that I was using in the win64 box with no problems. Device reformatted it to ext3 so shouldnt be any defrag etc problems.
5. One very real possibility is the bad cable one. Both links (Win and linux) to the router are made using DeVolo ethernet over power cable connections. The one to the xp box works fine (it was used in the
test in 1 and internet etc). However the one to the device has not been tested AND it has a power adaptor in the process. (Twits advertising on amazon.CO.UK were selling stuff with German plugs).
Will test this by plugging the linux device into the switch using a direct cat5 cable.

Meantime, any gaps in my logic above or anything I've missed?
Thx
J.

 

by: jorbagwPosted on 2009-08-14 at 11:01:07ID: 25100628

that's doubled the speed of ftp!

Can't test NFS without manhandling the the (37") TV in there (no display on the device) which I am reluctant to do.

Going to test a direct FTP connection (get rid of the other ethernet over power connection) by copying files onto the netbook and plugging it directly into the switch - see what happens.

Meanwhile anyone know where I can find a free/cheap NFS client (not server)? So I can push stuff from win to Linux.
ProNFS and Axe were rubbish (or at least no use to a non networking guru)

 

by: jorbagwPosted on 2009-08-14 at 11:27:41ID: 25100909

Had another thought - dont know if this is possible. Instructions please

I could bring the switch and Linux device out to the main room and connect the two computers directly using the switch. but without the router assigning IP addresses how do I map from one device to the other?

 

by: mikelfritzPosted on 2009-08-14 at 11:35:41ID: 25101015

What has doubled the speed of ftp?

Doesn't the ProNFS client have a drive mapping utility?  Map a linux shared folder to a Windows drive letter.

There don't seem to be many 64 bit clients out there.  

 

by: mikelfritzPosted on 2009-08-14 at 11:37:35ID: 25101037

You could attach the switch to the router and then both devices to the switch.  Coms between devices will go through the swith and the router will shoot out the DHCP.

 

by: jorbagwPosted on 2009-08-14 at 11:51:54ID: 25101186

removing the devolo ethernet over power cable link to the unix device has doubled the speed of gtp

I guess I could unplug the router from the net. will try this
Thanx Mike

 

by: jorbagwPosted on 2009-08-14 at 13:04:02ID: 25101832

The ProNFS may well have a drive mapping facility, but it wasnt something I could get even close to using. There is config to set up first which didnt make a damn bit of sense to a non-networking person like me. Instructions would be helpful ????

 

by: mikelfritzPosted on 2009-08-14 at 16:35:08ID: 25103231

I don't know.  I installed the 32 bit version and I can go to:

Start->Programs->ProNFS v3.0 NFS Client->NFS Map Drive tool

What kind of settings is it looking for?  That 64 bit version is most likely much different from the 32 that I have.  

Beyond that:

Odd issue to have with a new device though.  SMB or FTP should be just as fast on a current device.  NFS V3.0 was RFC'd in 1989.  Why is a 20 year old protocol faster than the others (ftp is a grand-daddy too)?  In my experience transferring files via NFS is just okay when you are getting files and pitifully slow when sending them, more so when it's sending many small files.  Hopefully the disparity between gets and puts won't bite you here once you get the NFS client running.

It was mentioned before that tweaks to the smb.conf file (that you have no access to) might help.  There are also tweaks to the NFS config files that, apparently, are in good shape on that box.  

I think that the device needs to tweak it's settings to get this fixed; you are jumping through hoops to bypass an inherent problem with the embedded linux configuration.

 

by: jorbagwPosted on 2009-08-16 at 05:22:33ID: 31613410

Moving the router didnt improve things. I suspect this is the limit of what the device is capable of. Both the NFS solution and the cabling change have helped significantly which is why I'm splitting the points.

Many thanx to all

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...