copy of many small files from of a single parent folder is failing

Posted on 2008-10-03
Medium Priority
Last Modified: 2012-06-27
I have a windows x64 Ent 2K3 server with a directory that has 1.2 million relatively small files off of a single parent folder, the total size is around 173gb, I have tried to copy to local USB drive on the server or to windows network clients with no success

all of my copy utilities that normally work fine (robocopy, xxcopy, fastcopy, ycopy, allway sync) are failing, they all fail at different times and give different errors, what I suspect is that with this high a volume of small files on the windows server, there is some technical problem (cache, buffering, ntfs, something)

does anyone have any idea how to copy a directory with 1.2 million small files totaling 173gb from a Windows 2003 Enterprise x64 server
Question by:ryanrupert

Accepted Solution

JJLost earned 375 total points
ID: 22636220




LVL 10

Assisted Solution

TCB1 earned 375 total points
ID: 22637475
Copying that many small files is a real I/O tax on a drive. I would use a utility like 7-zip to store them. Then copy the zip file to the drive and expand it if needed. Copying one large or even several large files will be much faster and less prone to I/O errors.

Featured Post

Never miss a deadline with monday.com

The revolutionary project management tool is here!   Plan visually with a single glance and make sure your projects get done.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Office 365 has multiple features and services which are specially designed to help businesses to reduce their dependence on on-premises IT resources. It also offers great flexibility and enhanced security. But like any other data, Office 365 mailbo…
This tutorial is about creating a new Microsoft Online User Profile account along with how to transfer your files and settings. You may be faced with this situation if your existing user profile has become corrupted.
The viewer will learn how to successfully create a multiboot device using the SARDU utility on Windows 7. Start the SARDU utility: Change the image directory to wherever you store your ISOs, this will prevent you from having 2 copies of an ISO wit…
Get a first impression of how PRTG looks and learn how it works.   This video is a short introduction to PRTG, as an initial overview or as a quick start for new PRTG users.

597 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question