Solved

Upload to multiple locations concurrently?

Posted on 2011-02-16
8
713 Views
Last Modified: 2012-05-11
I need a way to have clients upload large (up to 30GB) files to a single address via FTP and have that upload actually delivered to three separate locations simultanously.

Currently, we wait the two or three hours for the upload to complete and then we resend to the other two locations - which takes an additional two or three hours to complete.

We're not insistent on FTP, but we have many clients so that end needs to be either a standard technology or a web interface.

It sounds like a DFS thing, but can DFS start replicating before a file has fully been received?
0
Comment
Question by:frozenJim
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
8 Comments
 
LVL 96

Assisted Solution

by:Lee W, MVP
Lee W, MVP earned 250 total points
ID: 34909643
If you're using FTP, you could just run 3 different ftp's at the same time - it would take 3 times as long and no one would get it "first" (maybe a few minutes different).
0
 
LVL 16

Accepted Solution

by:
AlexPace earned 250 total points
ID: 34910457
I agree with leew, it depends on the location of the throughput bottleneck.

Currently you send 15 GB per hour (2 hours to send 30 GB)  

If this is the max your computer, network, and internet connection can manage then running concurrent uploads won't help... you'll just have 3 jobs running concurrently for 6 hours instead of 3 sequential jobs each running 2 hours for a total of 6 hours.

On the other hand if your computer, network, and internet connection are capable of doing a lot more than 15 GB per hour then you absolutely want to have three different instances of your ftp client running so you can transfer to all three remote sites concurrently.
0
 
LVL 70

Expert Comment

by:Qlemo
ID: 35339889
This question has been classified as abandoned and is being closed as part of the Cleanup Program. See my comment at the end of the question for more details.
0
Are your AD admin tools letting you down?

Managing Active Directory can get complicated.  Often, the native tools for managing AD are just not up to the task.  The largest Active Directory installations in the world have relied on one tool to manage their day-to-day administration tasks: Hyena. Start your trial today.

 

Author Comment

by:frozenJim
ID: 37616818
I think that I should explain the problem more clearly:

A variety of uploaders - over whom I have no control - spread throughout the world, need to upload very large files to my FTP server.  They will send one file, one time using their own FTP client software.  I have no control over them.

I need these files to arrive in three locations throughout the world simultaneously: India, England, and Canada.

What I envision is an FTP server smart enough to "pass- through" the bits as they arrive at the main server.  But I am unaware of where I can find this technology.

If anyone has a solution, I would be grateful.
0
 
LVL 96

Expert Comment

by:Lee W, MVP
ID: 37617238
You're looking for a broadcast... FTP is a protocol -  a set of rules defining how something (in this case, file transfer) gets done.  There is no facility I've ever heard of to allow FTP to do this.

You might want to look at services that don't use FTP - DropBox or similar file sharing sites.
0
 

Author Comment

by:frozenJim
ID: 37654092
Yeah, thanks Leew, that is what I was thinking.

Due to security considerations, I cannot use a PUBLIC CLOUD service.  I need to own my own DropBox (or something similar).

Rumour has it that Watchguard may be building this device now... you receive the file in one location and AS IT ARRIVES it is replicated to other sites on a block basis.  THIS is what I need.

Anyone else know of this kind of solution?
0

Featured Post

Optimum High-Definition Video Viewing and Control

The ATEN VM0404HA 4x4 4K HDMI Matrix Switch supports 4K resolutions of UHD (3840 x 2160) and DCI (4096 x 2160) with refresh rates of 30 Hz (4:4:4) and 60 Hz (4:2:0). It is ideal for applications where the routing of 4K digital signals is required.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When you try to share a printer , you may receive one of the following error messages. Error message when you use the Add Printer Wizard to share a printer: Windows could not share your printer. Operation could not be completed (Error 0x000006…
During and after that shift to cloud, one area that still poses a struggle for many organizations is what to do with their department file shares.
If you're a developer or IT admin, you’re probably tasked with managing multiple websites, servers, applications, and levels of security on a daily basis. While this can be extremely time consuming, it can also be frustrating when systems aren't wor…
Michael from AdRem Software outlines event notifications and Automatic Corrective Actions in network monitoring. Automatic Corrective Actions are scripts, which can automatically run upon discovery of a certain undesirable condition in your network.…

623 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question