Simple backup from remote linux server to a windows 2000 workstation...

Posted on 2003-03-08
Medium Priority
Last Modified: 2010-04-20
I need to implement an easy to use backup solution for a client that it's running a remote linux server and wants to backup all data on the server to his private network (window$ 2000) every 2 days ...

I tried to do by creating tar.gz files and then copying via FTP... does anyone know a faster way to do it? The files are close to 570mb after they have been compressed by gzip...


Question by:adcentrix
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions

Expert Comment

ID: 8095180
since the server is "remote" you'll probably be best off doing it with a similar setup as you are doing it now -- if it were possible the safest and fastest way would be plugging in a tape back-up system and backing all the files up to a tape device -- this would eliminate the danger of any stranger stealing information from your FTP server during the transfer.

Remember to encrypt your files, if you don't it'll be extremely easy for any hacker to intercept and copy all the files you are transfering, encryption will add a little bit more of security.

You could also set-up a VPN (virtual private network) which should make the communications more secure, and transfering the files through there, this would, like I said, decrease the chances of a hax0r getting to your files.
LVL 24

Accepted Solution

slyong earned 750 total points
ID: 8095343
Just to enhance your solution a bit try star and bzip2.  bzip2 will make your file smaller while star is faster then tar.

star (http://www.fokus.gmd.de/research/cc/glone/employees/joerg.schilling/private/star.html)

bzip2 (http://sources.redhat.com/bzip2/)

Expert Comment

ID: 8097076
Ok, so what you are saying is your client wants to backup his data on the remote linux server.

1, A script should be put together that is run as a cron job every two day's that compresses all the documents on the Linux server that need backing up, into a single archive and puts that new compressed archive into a specific folder that can be accessed via FTP. The choice of compression algorithm is up to you. The compression method can also serve as your encryption, you could even password restrict the archive if you use zip. For someone wanting to itercept the data in transit they would need to get a copy of the entire archive. At 570MB they would have to really want a copy of your data! The shear size and complexity of the transition would generally put off most of your average miscreant haxors. Your FTP password is addmitedly exposed, but it would require some one to be monitoring your connection 24/7 in order for them to grab the password. Is the data really that seretive?

2, The local Windows server could be setup with a scheduled task to access the remote Linux server on the day that it is not compresing the data via FTP. And again using a script that utilizes (FTP, get) download the backed up archive to the local server.

Overall my suggestion is, that you get a Linux server for your Local office and setup RSYNC and use SSH/SCP to transfer your archives, the compression method I would use would be bz2.
Will your db performance match your db growth?

In Percona’s white paper “Performance at Scale: Keeping Your Database on Its Toes,” we take a high-level approach to what you need to think about when planning for database scalability.


Expert Comment

ID: 8099574
Agree with paddyhaig in his/her last remark.
Use rsync (with SSH as transport layer), to do "incremental" backups (using builtin rsync features). Since the files are remaining on the target (?!) you never have to schedule "full" backups.. The first one will be full automatically.
Rsync have several methods (of varying performance) to choose from when doing "incremental" transfers. It's all in the docs. I even use rsync for local periodic incremental copy to other disks with great(!) speedup. The speedup would depend on how much data has changed since last backup of course. In my referenced with disk copy I've reduced 3-4 hours to 1-5 minutes.

Possibly you could just install openssh and rsync on the windos machine (www.cygwin.com) and off you go :-)
You would wan't to setup SSH public key authentication to be used from the Windos side, and initiate the synchronization from there (via scheduled task or "at" job or whatever).

Or install another unix/linux node at the "office" to do the job as suggested before. (same proceedure with public key authentication etc)


Expert Comment

ID: 8101761
"CygWin" along with Rsync is a great suggestion!

       The  rsync  remote-update protocol allows rsync to transfer just the differences between two sets of files
across the network link, using an efficient checksum-search algorithm described in  the  technical  report
that accompanies this package.

Some of the additional features of rsync are:

o      support for copying links, devices, owners, groups and permissions

o      exclude and exclude-from options similar to GNU tar

o      a CVS exclude mode for ignoring the same files that CVS would ignore

o      can use any transparent remote shell, including rsh or ssh

o      does not require root privileges

o      pipelining of file transfers to minimize latency costs

o      support for anonymous or authenticated rsync servers (ideal for mirroring)


Expert Comment

ID: 8102058
I don't know how rsync under cygwin handles device files and links when saving to NTFS though.. Could mean problems in a restore situation.
Perhaps another linux/unix node is the safest bet anyway?


Featured Post

WordPress Tutorial 1: Installation & Setup

WordPress is a very popular option for running your web site and can be used to get your content online quickly for the world to see. This guide will walk you through installing the WordPress server software and the initial setup process.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

You ever wonder how to backup Linux system files just like Windows System Restore?  Well you can use Timeshift in Linux to perform those similar action.  This tutorial will show you how to backup your system files and keep regular intervals. Note…
In part one, we reviewed the prerequisites required for installing SQL Server vNext. In this part we will explore how to install Microsoft's SQL Server on Ubuntu 16.04.
Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…
Connecting to an Amazon Linux EC2 Instance from Windows Using PuTTY.
Suggested Courses
Course of the Month13 days, 17 hours left to enroll

801 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question