Solved

Fastest way to upload files to Windows Web Server 2008 R2

Posted on 2010-08-27
10
911 Views
Last Modified: 2013-12-02
Hello

I was wondering what is the fastest way to upload a large number of small files, but also large files (size over 500Mb) to a Windows Web Server 2008 from a VB.Net script.

I was thinking ftp but the negociation time is prohibitive for small files
I was thinking asp webservices, but the files have to be encoded to fit into an XML file, which increases the size, which is not great for large files.

But I am not on expert on windows services and I was wondering if a smarter way I wasn't aware of.

thanks
Charles
0
Comment
Question by:cm2187
10 Comments
 
LVL 7

Expert Comment

by:brettkm
Comment Utility
Stab in the dark, is queing up all your files with an FTP client an option?  That way you could just let them all upload overnight.  Are you talking over the internet or LAN?

If I'm way off, a bit more info might help others.
0
 

Author Comment

by:cm2187
Comment Utility
thanks. Unfortunately I am indeed trying to speedup the upload time. So an overnight batch won't do it.

The background is that I am trying to build a script that backs up files. I will compress most of the files before uploading them. But the user will be waiting in front of his machine while the files upload. Also I want to minimize the time it takes to backup in order to reduce the risk of the files being modified or deleted in between.
0
 

Author Comment

by:cm2187
Comment Utility
And this would be over the internet (so relatively low and unstable connection)
0
 
LVL 4

Expert Comment

by:kjetilroe
Comment Utility

The fastest way I know of, is to use zip-encoded binary streams with a TCP server - client model, or maybe using the binary transfer protocol with Windows Communication Foundation (WCF).

Tell me if you want examples for solving it this way.
0
 

Author Comment

by:cm2187
Comment Utility
I wouldn't be developping a server with a service listening on a port from scratch but if there is something already available and which I can use on WS2008 then I am keen to try.

Does WCF requires to develop my own server app or is this just some ASP scripts?
0
Free Gift Card with Acronis Backup Purchase!

Backup any data in any location: local and remote systems, physical and virtual servers, private and public clouds, Macs and PCs, tablets and mobile devices, & more! For limited time only, buy any Acronis backup products and get a FREE Amazon/Best Buy gift card worth up to $200!

 
LVL 4

Expert Comment

by:kjetilroe
Comment Utility

WCF is a framework for develloping .Net remoting services (like web-services, just with more opportunities, and more protocols). I cant see how you can get the speeds you ask for by using plane ASP scripts.

And also, to make a TCP server is actually not as hard as you might think, and there are lots of examples with startingpoints for this on the internet.
0
 

Author Comment

by:cm2187
Comment Utility
Well, it's perhaps the time to learn. Would you have some good links already about where to start with?
What I liked with the ASP webservice is that I just need to write the function with the arguments I need and I don't need to worry about security or encoding or any of these things.

Also lots of examples I see for TCP servers seem to be with windows forms. I though a service wasn't based on forms but more like some sort of console application. Although I would expect it to be events based.
0
 
LVL 4

Accepted Solution

by:
kjetilroe earned 250 total points
Comment Utility

Here is maybe two good startingpoints for you:

http://www.codeproject.com/KB/WCF/wcffileserver.aspx
http://www.codeproject.com/KB/WCF/WCFDownloadUploadService.aspx

The TCP Servers can be both windows forms, console applications or a windows service. It all depends where or how you want to host your server. I think that the reason for making a windows forms app, is to easier make a window to be able to see the status of your TCP server. Apart from the status view, and the graphical userinterface that comes with a windows forms app, I can see no other reason to use forms. You can hook up events in a console application too, you just dont get the windows forms event loop.
 
0
 

Author Closing Comment

by:cm2187
Comment Utility
Thanks. I tried creating the service but I think I will stick to an asp.net script. I understand it's going to be a bit complicated to handle concurrency properly and I am not entirely sure that it actually uses binary to transfer a bytes() variable.

thanks for your inputs
0
 
LVL 1

Expert Comment

by:thready
Comment Utility
Hi cm2187,
Just wondering if you ever discovered some built-in support for file transfer on Windows Server 2008 web in the end?
Thanks!
Mike
0

Featured Post

How your wiki can always stay up-to-date

Quip doubles as a “living” wiki and a project management tool that evolves with your organization. As you finish projects in Quip, the work remains, easily accessible to all team members, new and old.
- Increase transparency
- Onboard new hires faster
- Access from mobile/offline

Join & Write a Comment

Hello, As I have seen there a lot of requests regarding monitoring and reporting for exchange 2007 / 2010 / 2013 I have decided to post some thoughts together and link to articles that have helped me. Of course a lot of information you can get…
Restoring deleted objects in Active Directory has been a standard feature in Active Directory for many years, yet some admins may not know what is available.
This tutorial will walk an individual through the steps necessary to configure their installation of BackupExec 2012 to use network shared disk space. Verify that the path to the shared storage is valid and that data can be written to that location:…
To efficiently enable the rotation of USB drives for backups, storage pools need to be created. This way no matter which USB drive is installed, the backups will successfully write without any administrative intervention. Multiple USB devices need t…

744 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

15 Experts available now in Live!

Get 1:1 Help Now