Solved

Fastest way to upload files to Windows Web Server 2008 R2

Posted on 2010-08-27
10
937 Views
Last Modified: 2013-12-02
Hello

I was wondering what is the fastest way to upload a large number of small files, but also large files (size over 500Mb) to a Windows Web Server 2008 from a VB.Net script.

I was thinking ftp but the negociation time is prohibitive for small files
I was thinking asp webservices, but the files have to be encoded to fit into an XML file, which increases the size, which is not great for large files.

But I am not on expert on windows services and I was wondering if a smarter way I wasn't aware of.

thanks
Charles
0
Comment
Question by:cm2187
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
10 Comments
 
LVL 7

Expert Comment

by:brettkm
ID: 33542655
Stab in the dark, is queing up all your files with an FTP client an option?  That way you could just let them all upload overnight.  Are you talking over the internet or LAN?

If I'm way off, a bit more info might help others.
0
 

Author Comment

by:cm2187
ID: 33542797
thanks. Unfortunately I am indeed trying to speedup the upload time. So an overnight batch won't do it.

The background is that I am trying to build a script that backs up files. I will compress most of the files before uploading them. But the user will be waiting in front of his machine while the files upload. Also I want to minimize the time it takes to backup in order to reduce the risk of the files being modified or deleted in between.
0
 

Author Comment

by:cm2187
ID: 33542883
And this would be over the internet (so relatively low and unstable connection)
0
Online Training Solution

Drastically shorten your training time with WalkMe's advanced online training solution that Guides your trainees to action. Forget about retraining and skyrocket knowledge retention rates.

 
LVL 4

Expert Comment

by:kjetilroe
ID: 33542945

The fastest way I know of, is to use zip-encoded binary streams with a TCP server - client model, or maybe using the binary transfer protocol with Windows Communication Foundation (WCF).

Tell me if you want examples for solving it this way.
0
 

Author Comment

by:cm2187
ID: 33543001
I wouldn't be developping a server with a service listening on a port from scratch but if there is something already available and which I can use on WS2008 then I am keen to try.

Does WCF requires to develop my own server app or is this just some ASP scripts?
0
 
LVL 4

Expert Comment

by:kjetilroe
ID: 33543106

WCF is a framework for develloping .Net remoting services (like web-services, just with more opportunities, and more protocols). I cant see how you can get the speeds you ask for by using plane ASP scripts.

And also, to make a TCP server is actually not as hard as you might think, and there are lots of examples with startingpoints for this on the internet.
0
 

Author Comment

by:cm2187
ID: 33543299
Well, it's perhaps the time to learn. Would you have some good links already about where to start with?
What I liked with the ASP webservice is that I just need to write the function with the arguments I need and I don't need to worry about security or encoding or any of these things.

Also lots of examples I see for TCP servers seem to be with windows forms. I though a service wasn't based on forms but more like some sort of console application. Although I would expect it to be events based.
0
 
LVL 4

Accepted Solution

by:
kjetilroe earned 250 total points
ID: 33554519

Here is maybe two good startingpoints for you:

http://www.codeproject.com/KB/WCF/wcffileserver.aspx
http://www.codeproject.com/KB/WCF/WCFDownloadUploadService.aspx

The TCP Servers can be both windows forms, console applications or a windows service. It all depends where or how you want to host your server. I think that the reason for making a windows forms app, is to easier make a window to be able to see the status of your TCP server. Apart from the status view, and the graphical userinterface that comes with a windows forms app, I can see no other reason to use forms. You can hook up events in a console application too, you just dont get the windows forms event loop.
 
0
 

Author Closing Comment

by:cm2187
ID: 33594156
Thanks. I tried creating the service but I think I will stick to an asp.net script. I understand it's going to be a bit complicated to handle concurrency properly and I am not entirely sure that it actually uses binary to transfer a bytes() variable.

thanks for your inputs
0
 
LVL 1

Expert Comment

by:thready
ID: 36143146
Hi cm2187,
Just wondering if you ever discovered some built-in support for file transfer on Windows Server 2008 web in the end?
Thanks!
Mike
0

Featured Post

Get 15 Days FREE Full-Featured Trial

Benefit from a mission critical IT monitoring with Monitis Premium or get it FREE for your entry level monitoring needs.
-Over 200,000 users
-More than 300,000 websites monitored
-Used in 197 countries
-Recommended by 98% of users

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

New Windows 7 Installations take days for Windows-Updates to show up and install. This can easily be fixed. I have finally decided to write an article because this seems to get asked several times a day lately. This Article and the Links apply to…
A procedure for exporting installed hotfix details of remote computers using powershell
This tutorial will walk an individual through locating and launching the BEUtility application to properly change the service account username and\or password in situation where it may be necessary or where the password has been inadvertently change…
To efficiently enable the rotation of USB drives for backups, storage pools need to be created. This way no matter which USB drive is installed, the backups will successfully write without any administrative intervention. Multiple USB devices need t…

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question