Solved

Scheduled folder synchronization with bandwidth throttling

Posted on 2007-03-21
8
2,380 Views
Last Modified: 2012-05-05
I have two facilities with a Windows 2000 Server at each plant.  The plants are connected together via a 54Mbps wireless connection.  During the weekday evenings and on the weekends I want to syncronize the contents of each server's external hard drive backup to the opposite plant.  The files I need to syncronize are all large multi-gigabyte files.  I need a recommendation for a free or paid-for program or solution that can:

1.  Run on a scheduled basis
2.  Synchronize two folders and their subfolders/files
3.  Pause in the middle of file transfers (in case the connection is interupted) and resume
4.  Can skip over files that are open, locked, or corrupt (and record the skipped file(s) in a log)
5.  Throttle file transfer bandwidth

Programs like Karen Replicator (http://www.karenware.com/powertools/ptreplicator.asp) and Cobian Backup (http://www.educ.umu.se/~cobian/cobianbackup.htm) can do points 1 and 2 very well.  NSCopy (http://www.nullsoft.com/free/nscopy/) can do 2 and 5.  And finally Total Copy (http://www.ranvik.net/totalcopy) does a great job with 2, 3, 4, and 5.

Is there another program out there that has all 5 features?  Is there a way to get Total Copy to run as a scheduled task?  It does not have the ability to save scripts and there is no interface to configure.  Is there any other way to do this correctly?  I would rather NOT use FTP programs to do this particular job, if possible.
0
Comment
Question by:fourjohn
  • 3
  • 2
8 Comments
 
LVL 17

Expert Comment

by:Jared Luker
Comment Utility
Hmm... Microsoft has a power toy called SyncToy that does a really good job and it's jobs can be scheduled, but I don't think it'll do #3 and #5 is doubtful.

I think that Robocopy (from the server 2003 resource kit) can do everything, but I'm not sure about #5.  

They are both free so it couldn't hurt to check it out.
0
 
LVL 1

Author Comment

by:fourjohn
Comment Utility
I should have mentioned that I tried Robocopy too already.  It can't do bandwidth throttling unless I'm missing something.
0
 
LVL 14

Expert Comment

by:Hedley Phillips
Comment Utility
Try Rsync,

pretty sure it does the lot. Def does have bandwith throttling:

http://samba.anu.edu.au/rsync/



 --bwlimit=KBPS          limit I/O bandwidth; KBytes per second

http://samba.anu.edu.au/ftp/rsync/rsync.html
0
Complete Microsoft Windows PC® & Mac Backup

Backup and recovery solutions to protect all your PCs & Mac– on-premises or in remote locations. Acronis backs up entire PC or Mac with patented reliable disk imaging technology and you will be able to restore workstations to a new, dissimilar hardware in minutes.

 
LVL 1

Author Comment

by:fourjohn
Comment Utility
According to the rsync website, "rsync is a file transfer program for Unix systems."

However, it looks like there is a Windows port of rsync called cwRsync found at http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=6&MMN_position=23:23

cwRsync doesn't quite look like what I'm looking for and needs to have a working SSH system in place for it to run.
0
 
LVL 14

Expert Comment

by:Hedley Phillips
Comment Utility
Rsync doesn't need ssh to run.

I have it set up in a batch file using the rsync & cygwin dll (not cwrsync) and then just run it from a scheduled task.

0
 
LVL 1

Accepted Solution

by:
fourjohn earned 0 total points
Comment Utility
Oops sorry.  I should have studied the feature list more.

Actually, I just found the program that will do everything plus run as a service, log on to remote folders with seperate credentials, and even throttle CPU utilization.  It has a good GUI too.

It's called ViceVersa Pro and can be found here:

http://www.tgrmn.com/

I guess I answered my own questions
0

Featured Post

Do email signature updates give you a headache?

Do you feel like you are constantly making changes to email signatures? Are the images not formatting how you want them to? Want high-quality HTML signatures on all devices, including on mobiles and Macs? Then, let Exclaimer solve all your email signature problems today.

Join & Write a Comment

This article is an update and follow-up of my previous article:   Storage 101: common concepts in the IT enterprise storage This time, I expand on more frequently used storage concepts.
Microservice architecture adoption brings many advantages, but can add intricacy. Selecting the right orchestration tool is most important for business specific needs.
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…
Windows 8 came with a dramatically different user interface known as Metro. Notably missing from that interface was a Start button and Start Menu. Microsoft responded to negative user feedback of the Metro interface, bringing back the Start button a…

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now