?
Solved

How to automatically move files over Windows network?

Posted on 2009-04-04
7
Medium Priority
?
564 Views
Last Modified: 2012-05-06
Hello
I have a following question.

I have 5 workstations that generate about 200GB of data (video footage) per workstation every day. At the end of the day all this data has to be moved over network to a backup server where the data is held for 10 days and then deleted.

Currently the users manually Cut/Paste the folders to the network share at the end of the day, but it has it's disadvantages - the transfers often fail and the transfers often bite into the next work day, which is a big pain.

I have tried automatically archiving the data using EMC Retrospect which works great BUT it archives the data into it's own archive format. We on the other hand often need to browse the files that are on the server and copy them back to workstations, so Retrospect doesn't work out that way.

All in all, every workstation has a directory, the contents of which has to be moved into a single network share.

What would you recommend as a solution to this problem?
The solution can be free or commercial software but the backup server for some other reasons is Windows 2003 based, so I have to work within these boundaries.

Thanks in advance!
0
Comment
Question by:alexkink
7 Comments
 
LVL 4

Expert Comment

by:blissbear
ID: 24069998
There are several applications like this that are available, though if your network isn't heavily needed during the workday you might try MirrorFolder: http://www.techsoftpl.com/backup/index.php

You can mirror folders from each of the systems on the fly, as the files are created.  This will make backups more secure and immediate and also minimize the congestion after hours.
0
 
LVL 8

Accepted Solution

by:
MrMintanet earned 750 total points
ID: 24070015
>>The backup server for some other reasons is windows 2003 based
-Most servers are :)


Ok, this isn't too bad, so don't worry. :)

Write Batch File:

1.  Open Notepad
2.  Type:  move C:\FOLDER\ D:\FOLDERCOPY    <- You will have to modify this command, obviously.
3.  Save As
4.  File Type:  Any
5.  File Name:  Move.bat  

Create Schedule Task:

1.  On users workstation:  Open Scheduled Tasks: click Start, click All Programs, point to Accessories, point to System Tools, and then click Scheduled Tasks.

2.  Simply setup the move.bat file to launch at whatever time users should be finished.
0
 
LVL 50

Expert Comment

by:dbrunton
ID: 24070034
Give each workstation a USB 1 Tb drive.

Batch file at end of day to copy/move data across to USB drive.

USB drives are taken to server and data offloaded to server.

This means that someone is going to have to stick around and do the copying to the server but there's no load on the network.
0
Configuration Guide and Best Practices

Read the guide to learn how to orchestrate Data ONTAP, create application-consistent backups and enable fast recovery from NetApp storage snapshots. Version 9.5 also contains performance and scalability enhancements to meet the needs of the largest enterprise environments.

 
LVL 8

Expert Comment

by:MrMintanet
ID: 24070044
My solution is free....
0
 
LVL 4

Expert Comment

by:blissbear
ID: 24070160
You didn't address this issue:

> Currently the users manually Cut/Paste the folders to the network share at the end of the day, but it has it's disadvantages - the transfers often fail and the transfers often bite into the next work day, which is a big pain.

When everyone tries to copy files at the same time the network sounds like it's getting overloaded and the file copy commands are dying from latency timeouts.
0
 
LVL 70

Assisted Solution

by:garycase
garycase earned 750 total points
ID: 24070199
200GB/workstation x 5 workstations => 1TB of data to archive each night ... you're clearly keeping the network busy :-)

There are several free backup/synchronization utilities that can automate this for you.   I like SyncBack -- the free version will work fine if you're sure the files to be copied won't be in use when it's time to copy them;  otherwise get the SE version.  http://www.2brightsparks.com/freeware/freeware-hub.html

I would then simply set up a profile on each workstation and schedule it to run at a specified time every day.   If you'd prefer it not be initiated automatically, you could simply create a "Backup Now" icon (that's what I call mine -- you can clearly label it however you want) that the user double-clicks to initiate the backup.

Note that you could alternatively set up a single Group profile on a copy of Syncback on the server; and it could contain five profiles (one for each workstation) that would initiate the backup directlly from the server.   This would, of course, require that the video folders on the workstations were shared.
0
 
LVL 8

Expert Comment

by:MrMintanet
ID: 24070251
What would your budget be for this?  I did clearly miss the key point which was the "fail".  I am the "fail" at this point.  :(  Meh... It's midnight on a Saturday.  I suppose I'm after the mug.  LOL  Anyways, I am more than glad to help, but a projected budget would be necessary at this point.  Backing up this amount of data per night is insane.

1TB every night... wow.  And then to hold it for... 10 DAYS!  That's 10TB.  Have you considered a SAN?  Perhaps a NAS?  If anything, why not just have them  all have a 2TB external HD that does this independently per workstation?  200GB a day is a great deal of data.

0

Featured Post

Free recovery tool for Microsoft Active Directory

Veeam Explorer for Microsoft Active Directory provides fast and reliable object-level recovery for Active Directory from a single-pass, agentless backup or storage snapshot — without the need to restore an entire virtual machine or use third-party tools.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Concerto Cloud Services, a provider of fully managed private, public and hybrid cloud solutions, announced today it was named to the 20 Coolest Cloud Infrastructure Vendors Of The 2017 Cloud  (http://www.concertocloud.com/about/in-the-news/2017/02/0…
This article shows how to use a free utility called 'Parkdale' to easily test the performance and benchmark any Hard Drive(s) installed in your computer. We also look at RAM Disks and their speed comparisons.
This tutorial will show how to configure a new Backup Exec 2012 server and move an existing database to that server with the use of the BEUtility. Install Backup Exec 2012 on the new server and apply all of the latest hotfixes and service packs. The…
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…
Suggested Courses

831 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question