Transferring large amounts of small files by FTP: slow, excessive bandwidth

I recently had to upload approximately 1,500 JPEG image files to my website. The total upload size was around 17Mb.

I used Windows built-in FTP transfer and the Internet connection is ADSL2+.

Firstly it took well over 12 hours to upload to complete which seems odd given that I frequently upload single large files in the same way and it is usually very quick. Is it because there were lots of small files that it took signifcantly longer?

The other strange thing about this was my Internet connection usage. I expected to see around 17Mb uploaded but my ISP reports that I DOWNLOADED (received) about 2000Mb and uploaded (sent) about 200Mb during this time. I typically use about 100Mb DL/20Mb UL a day so the majority of the other figures are all down to this FTP upload.

Is FTP a very inefficient method of transferring this type of data? Would it be better if I used another FTP client like Filezilla rather than the one in Windows? Are the above data transfer figures what is to be expected for this type of data transfer?
knobbylowboyAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

jansvetterCommented:
1500 Files produce a whole lot of overhead, considering you used the ftp functionality of IE would explain some of the traffic, but not 2 Gigabytes. That seems to be kind of a connection problem, best guess is that the server you're uploading the data to dismisses it and so you're resending it a hundred times.

Best Tip would be to try FileZilla as a client (use the portable version, keeps your'e systems reg. clean), works pretty well for me.

=>  http://portableapps.com/apps/internet/filezilla_portable
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
quincydudeCommented:
Do your server host support extracting zip files at server side?
 IF yes then you can just upload a single zip file and do the unzip after upload. It will save you a lot of time.
0
knobbylowboyAuthor Commented:
I downloaded and used Filezilla and did a smaller transfer of about 250 files, 5MB, and it was done in a matter of only a few minutes. Looks like Microsoft Windows Explorer FTP transfer is very slow and inefficient. I would be interested to hear if other people have found this too. (Or perhaps I am the only one foolish enough to use it for such a transfer.)
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Networking Protocols

From novice to tech pro — start learning today.