[Webinar] Streamline your web hosting managementRegister Today


RHEL 5 copy large directory

Posted on 2010-03-29
Medium Priority
Last Modified: 2013-12-06

I have a production RHEL 5 server with a folder that I need to copy to a NAS appliance. Problem is that the RHEL 5 folder is very large with many files (180GB+/121,000 Files). Any one have the easiest/most reliable method to copy that folder to a NAS appliance that has already been setup (A Buffalo Duo Link NAS with 2 HDs in RAID 1)?

Question by:Vincent D
LVL 14

Expert Comment

by:Monis Monther
ID: 28989919
How do you access the NAS is it mounted on your RHEL as NFS, or as Direct mount point??

I Recommend to use rsync

rsync -avP --stats source destination

This will copy the files and dirs preserving permissions and providing statistics at the end, also in case the copy stopped for any reason before it finishes you can continue from where you stopped without repeating what previously has been copied.

Also for future copies it will only copy new changed and added files

LVL 30

Accepted Solution

Kerem ERSOY earned 2000 total points
ID: 28990078

I'll suggest you to use rsync. Rsync is a very powerful tool  you can also make incremental copes and transfer only the modified files to the remote nas. It also supports transfers over SSH and it is all you need.

rsync -ave ssh --numeric-ids --delete  /data/local nas:/data/remote

A command similar to above copies all your files to the other end. and it will run in incremental mode if run on a later date once the initial operatin has benn completed.


Expert Comment

ID: 29132172
just a couple of comments on rsync
- it'll require rsync on the target, either as a daemon, or as a binary executable
- if not running as a daemon, it'll require some other communication protocol that you can connect over, such as ssh as suggested by KeremE
- lastly, depending on the network speed, you /may/ benefit by adding the -z compression flag to the rsync copy

Featured Post

Upgrade your Question Security!

Your question, your audience. Choose who sees your identity—and your question—with question security.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Users are often faced with high disk consumption without really knowing where the largest amount of data resides. Disk Usage Analyzer (aka Baobab) is is a graphical, menu-driven application to analyse disk usage in any Gnome environment and can e…
The purpose of this article is to fix the unknown display problem in Linux Mint operating system. After installing the OS if you see Display monitor is not recognized then we can install "MESA" utilities to fix this problem or we can install additio…
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial
How to fix display issue, screen flickering issue when I plug in power cord to the machine. Before I start explaining the solution lets check out once the issue how it looks like after I connect the power cord. most of you also have faced this…

612 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question