Solved

Upload to multiple locations concurrently?

Posted on 2011-02-16
8
707 Views
Last Modified: 2012-05-11
I need a way to have clients upload large (up to 30GB) files to a single address via FTP and have that upload actually delivered to three separate locations simultanously.

Currently, we wait the two or three hours for the upload to complete and then we resend to the other two locations - which takes an additional two or three hours to complete.

We're not insistent on FTP, but we have many clients so that end needs to be either a standard technology or a web interface.

It sounds like a DFS thing, but can DFS start replicating before a file has fully been received?
0
Comment
Question by:frozenJim
8 Comments
 
LVL 95

Assisted Solution

by:Lee W, MVP
Lee W, MVP earned 250 total points
ID: 34909643
If you're using FTP, you could just run 3 different ftp's at the same time - it would take 3 times as long and no one would get it "first" (maybe a few minutes different).
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 34910457
I agree with leew, it depends on the location of the throughput bottleneck.

Currently you send 15 GB per hour (2 hours to send 30 GB)  

If this is the max your computer, network, and internet connection can manage then running concurrent uploads won't help... you'll just have 3 jobs running concurrently for 6 hours instead of 3 sequential jobs each running 2 hours for a total of 6 hours.

On the other hand if your computer, network, and internet connection are capable of doing a lot more than 15 GB per hour then you absolutely want to have three different instances of your ftp client running so you can transfer to all three remote sites concurrently.
0
 
LVL 68

Expert Comment

by:Qlemo
ID: 35339889
This question has been classified as abandoned and is being closed as part of the Cleanup Program. See my comment at the end of the question for more details.
0
Why won’t your email signature format correctly?

Struggling to get your corporate email signatures to format correctly? Does the logo keep resizing? Is the text appearing too big? What can you do to prevent this? Find out how you can save your signatures today.

 

Author Comment

by:frozenJim
ID: 37616818
I think that I should explain the problem more clearly:

A variety of uploaders - over whom I have no control - spread throughout the world, need to upload very large files to my FTP server.  They will send one file, one time using their own FTP client software.  I have no control over them.

I need these files to arrive in three locations throughout the world simultaneously: India, England, and Canada.

What I envision is an FTP server smart enough to "pass- through" the bits as they arrive at the main server.  But I am unaware of where I can find this technology.

If anyone has a solution, I would be grateful.
0
 
LVL 95

Expert Comment

by:Lee W, MVP
ID: 37617238
You're looking for a broadcast... FTP is a protocol -  a set of rules defining how something (in this case, file transfer) gets done.  There is no facility I've ever heard of to allow FTP to do this.

You might want to look at services that don't use FTP - DropBox or similar file sharing sites.
0
 

Author Comment

by:frozenJim
ID: 37654092
Yeah, thanks Leew, that is what I was thinking.

Due to security considerations, I cannot use a PUBLIC CLOUD service.  I need to own my own DropBox (or something similar).

Rumour has it that Watchguard may be building this device now... you receive the file in one location and AS IT ARRIVES it is replicated to other sites on a block basis.  THIS is what I need.

Anyone else know of this kind of solution?
0

Featured Post

PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Cisco Router DMZ 5 63
Need script to search multiple files in one drive 13 36
access denied when running native SQL tool: SQLIOSIM 2 26
2 Gateways (bandwidth) - One domain 7 54
Microservice architecture adoption brings many advantages, but can add intricacy. Selecting the right orchestration tool is most important for business specific needs.
The recent Microsoft changes on update philosophy for Windows pre-10 and their impact on existing WSUS implementations.
This Micro Tutorial hows how you can integrate  Mac OSX to a Windows Active Directory Domain. Apple has made it easy to allow users to bind their macs to a windows domain with relative ease. The following video show how to bind OSX Mavericks to …
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

867 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

16 Experts available now in Live!

Get 1:1 Help Now