We help IT Professionals succeed at work.
Get Started

Efficient way to copy / backup millions of small files

sunhux
sunhux asked
on
3,266 Views
Last Modified: 2012-05-10

Would like to know how people out there are handling this where
you have millions of small files (I've seen this in logfiles, Lotus Notes
email or Outlook files) :

In the past I dread copying or backing up (using Windows Explorer
or Windows or Unix OS copy commands) to copy directories with
million over small files.

Q1:
Does Veritas Netbackup or HP Dataprotector take very long to backup
such a directory to tape ?  

Q2:
Would it be faster to use SAN or snapshot technology to just take a
quick snap of the entire SAN disk partition (where such small files
reside) or would it be more efficient to place these millions of small
files on a Solid State Disk (SSD) as SSD do not have seek/rotational
delays of conventional disks (SCSI or IDE) ?
Comment
Watch Question
Data Warehouse / Database Architect
CERTIFIED EXPERT
Commented:
This problem has been solved!
Unlock 5 Answers and 11 Comments.
See Answers
Why Experts Exchange?

Experts Exchange always has the answer, or at the least points me in the correct direction! It is like having another employee that is extremely experienced.

Jim Murphy
Programmer at Smart IT Solutions

When asked, what has been your best career decision?

Deciding to stick with EE.

Mohamed Asif
Technical Department Head

Being involved with EE helped me to grow personally and professionally.

Carl Webster
CTP, Sr Infrastructure Consultant
Ask ANY Question

Connect with Certified Experts to gain insight and support on specific technology challenges including:

  • Troubleshooting
  • Research
  • Professional Opinions
Did You Know?

We've partnered with two important charities to provide clean water and computer science education to those who need it most. READ MORE