Solved

Scheduled folder synchronization with bandwidth throttling

Posted on 2007-03-21
8
2,448 Views
Last Modified: 2012-05-05
I have two facilities with a Windows 2000 Server at each plant.  The plants are connected together via a 54Mbps wireless connection.  During the weekday evenings and on the weekends I want to syncronize the contents of each server's external hard drive backup to the opposite plant.  The files I need to syncronize are all large multi-gigabyte files.  I need a recommendation for a free or paid-for program or solution that can:

1.  Run on a scheduled basis
2.  Synchronize two folders and their subfolders/files
3.  Pause in the middle of file transfers (in case the connection is interupted) and resume
4.  Can skip over files that are open, locked, or corrupt (and record the skipped file(s) in a log)
5.  Throttle file transfer bandwidth

Programs like Karen Replicator (http://www.karenware.com/powertools/ptreplicator.asp) and Cobian Backup (http://www.educ.umu.se/~cobian/cobianbackup.htm) can do points 1 and 2 very well.  NSCopy (http://www.nullsoft.com/free/nscopy/) can do 2 and 5.  And finally Total Copy (http://www.ranvik.net/totalcopy) does a great job with 2, 3, 4, and 5.

Is there another program out there that has all 5 features?  Is there a way to get Total Copy to run as a scheduled task?  It does not have the ability to save scripts and there is no interface to configure.  Is there any other way to do this correctly?  I would rather NOT use FTP programs to do this particular job, if possible.
0
Comment
Question by:fourjohn
  • 3
  • 2
8 Comments
 
LVL 17

Expert Comment

by:Jared Luker
ID: 18767694
Hmm... Microsoft has a power toy called SyncToy that does a really good job and it's jobs can be scheduled, but I don't think it'll do #3 and #5 is doubtful.

I think that Robocopy (from the server 2003 resource kit) can do everything, but I'm not sure about #5.  

They are both free so it couldn't hurt to check it out.
0
 
LVL 1

Author Comment

by:fourjohn
ID: 18767948
I should have mentioned that I tried Robocopy too already.  It can't do bandwidth throttling unless I'm missing something.
0
 
LVL 14

Expert Comment

by:Hedley Phillips
ID: 18768057
Try Rsync,

pretty sure it does the lot. Def does have bandwith throttling:

http://samba.anu.edu.au/rsync/



 --bwlimit=KBPS          limit I/O bandwidth; KBytes per second

http://samba.anu.edu.au/ftp/rsync/rsync.html
0
Efficient way to get backups off site to Azure

This user guide provides instructions on how to deploy and configure both a StoneFly Scale Out NAS Enterprise Cloud Drive virtual machine and Veeam Cloud Connect in the Microsoft Azure Cloud.

 
LVL 1

Author Comment

by:fourjohn
ID: 18768201
According to the rsync website, "rsync is a file transfer program for Unix systems."

However, it looks like there is a Windows port of rsync called cwRsync found at http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=6&MMN_position=23:23

cwRsync doesn't quite look like what I'm looking for and needs to have a working SSH system in place for it to run.
0
 
LVL 14

Expert Comment

by:Hedley Phillips
ID: 18768226
Rsync doesn't need ssh to run.

I have it set up in a batch file using the rsync & cygwin dll (not cwrsync) and then just run it from a scheduled task.

0
 
LVL 1

Accepted Solution

by:
fourjohn earned 0 total points
ID: 18768273
Oops sorry.  I should have studied the feature list more.

Actually, I just found the program that will do everything plus run as a service, log on to remote folders with seperate credentials, and even throttle CPU utilization.  It has a good GUI too.

It's called ViceVersa Pro and can be found here:

http://www.tgrmn.com/

I guess I answered my own questions
0

Featured Post

Portable, direct connect server access

The ATEN CV211 connects a laptop directly to any server allowing you instant access to perform data maintenance and local operations, for quick troubleshooting, updating, service and repair.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Know what services you can and cannot, should and should not combine on your server.
When you try to extract and to view the contents of a Microsoft Update Standalone Package (MSU) for Windows Vista, you cannot extract the files from the MSU. Here we are going to explain how to extract those hotfix details without using any third pa…
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…
This Micro Tutorial will give you a basic overview of Windows DVD Burner through its features and interface. This will be demonstrated using Windows 7 operating system.

820 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question