Solved

copy of many small files from of a single parent folder is failing

Posted on 2008-10-03
3
224 Views
Last Modified: 2012-06-27
I have a windows x64 Ent 2K3 server with a directory that has 1.2 million relatively small files off of a single parent folder, the total size is around 173gb, I have tried to copy to local USB drive on the server or to windows network clients with no success

PROBLEM
all of my copy utilities that normally work fine (robocopy, xxcopy, fastcopy, ycopy, allway sync) are failing, they all fail at different times and give different errors, what I suspect is that with this high a volume of small files on the windows server, there is some technical problem (cache, buffering, ntfs, something)

QUESTION
does anyone have any idea how to copy a directory with 1.2 million small files totaling 173gb from a Windows 2003 Enterprise x64 server
0
Comment
Question by:ryanrupert
3 Comments
 
LVL 3

Accepted Solution

by:
JJLost earned 125 total points
ID: 22636220
FTP

or

Zip

:)

0
 
LVL 10

Assisted Solution

by:TCB1
TCB1 earned 125 total points
ID: 22637475
Copying that many small files is a real I/O tax on a drive. I would use a utility like 7-zip to store them. Then copy the zip file to the drive and expand it if needed. Copying one large or even several large files will be much faster and less prone to I/O errors.
0

Featured Post

Google Storage: Standard vs. Nearline vs. Coldline

Google Cloud Storage has a number of classes to choose from. Although there are a lot in common, they vary in price and usage terms. This post explains Google Cloud Storage classes and helps to understand which  one to choose.

Join & Write a Comment

Suggested Solutions

Workplace bullying has increased with the use of email and social media. Retain evidence of this with email archiving to protect your employees.
Sometimes drives fill up and we don't know why.  If you don't understand the best way to use the tools available, you may end up being stumped as to why your drive says it's not full when you have no space left!  Here's how you can find out...
This tutorial will walk an individual through the steps necessary to enable the VMware\Hyper-V licensed feature of Backup Exec 2012. In addition, how to add a VMware server and configure a backup job. The first step is to acquire the necessary licen…
With the advent of Windows 10, Microsoft is pushing a Get Windows 10 icon into the notification area (system tray) of qualifying computers. There are many reasons for wanting to remove this icon. This two-part Experts Exchange video Micro Tutorial s…

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now