fourjohn
asked on
Scheduled folder synchronization with bandwidth throttling
I have two facilities with a Windows 2000 Server at each plant. The plants are connected together via a 54Mbps wireless connection. During the weekday evenings and on the weekends I want to syncronize the contents of each server's external hard drive backup to the opposite plant. The files I need to syncronize are all large multi-gigabyte files. I need a recommendation for a free or paid-for program or solution that can:
1. Run on a scheduled basis
2. Synchronize two folders and their subfolders/files
3. Pause in the middle of file transfers (in case the connection is interupted) and resume
4. Can skip over files that are open, locked, or corrupt (and record the skipped file(s) in a log)
5. Throttle file transfer bandwidth
Programs like Karen Replicator (http://www.karenware.com/powertools/ptreplicator.asp) and Cobian Backup (http://www.educ.umu.se/~cobian/cobianbackup.htm) can do points 1 and 2 very well. NSCopy (http://www.nullsoft.com/free/nscopy/) can do 2 and 5. And finally Total Copy (http://www.ranvik.net/totalcopy) does a great job with 2, 3, 4, and 5.
Is there another program out there that has all 5 features? Is there a way to get Total Copy to run as a scheduled task? It does not have the ability to save scripts and there is no interface to configure. Is there any other way to do this correctly? I would rather NOT use FTP programs to do this particular job, if possible.
1. Run on a scheduled basis
2. Synchronize two folders and their subfolders/files
3. Pause in the middle of file transfers (in case the connection is interupted) and resume
4. Can skip over files that are open, locked, or corrupt (and record the skipped file(s) in a log)
5. Throttle file transfer bandwidth
Programs like Karen Replicator (http://www.karenware.com/powertools/ptreplicator.asp) and Cobian Backup (http://www.educ.umu.se/~cobian/cobianbackup.htm) can do points 1 and 2 very well. NSCopy (http://www.nullsoft.com/free/nscopy/) can do 2 and 5. And finally Total Copy (http://www.ranvik.net/totalcopy) does a great job with 2, 3, 4, and 5.
Is there another program out there that has all 5 features? Is there a way to get Total Copy to run as a scheduled task? It does not have the ability to save scripts and there is no interface to configure. Is there any other way to do this correctly? I would rather NOT use FTP programs to do this particular job, if possible.
ASKER
I should have mentioned that I tried Robocopy too already. It can't do bandwidth throttling unless I'm missing something.
Try Rsync,
pretty sure it does the lot. Def does have bandwith throttling:
http://samba.anu.edu.au/rsync/
--bwlimit=KBPS limit I/O bandwidth; KBytes per second
http://samba.anu.edu.au/ftp/rsync/rsync.html
pretty sure it does the lot. Def does have bandwith throttling:
http://samba.anu.edu.au/rsync/
--bwlimit=KBPS limit I/O bandwidth; KBytes per second
http://samba.anu.edu.au/ftp/rsync/rsync.html
ASKER
According to the rsync website, "rsync is a file transfer program for Unix systems."
However, it looks like there is a Windows port of rsync called cwRsync found at http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=6&MMN_position=23:23
cwRsync doesn't quite look like what I'm looking for and needs to have a working SSH system in place for it to run.
However, it looks like there is a Windows port of rsync called cwRsync found at http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_page&PAGE_id=6&MMN_position=23:23
cwRsync doesn't quite look like what I'm looking for and needs to have a working SSH system in place for it to run.
Rsync doesn't need ssh to run.
I have it set up in a batch file using the rsync & cygwin dll (not cwrsync) and then just run it from a scheduled task.
I have it set up in a batch file using the rsync & cygwin dll (not cwrsync) and then just run it from a scheduled task.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
I think that Robocopy (from the server 2003 resource kit) can do everything, but I'm not sure about #5.
They are both free so it couldn't hurt to check it out.