?
Solved

copy of many small files from of a single parent folder is failing

Posted on 2008-10-03
3
Medium Priority
?
233 Views
Last Modified: 2012-06-27
I have a windows x64 Ent 2K3 server with a directory that has 1.2 million relatively small files off of a single parent folder, the total size is around 173gb, I have tried to copy to local USB drive on the server or to windows network clients with no success

PROBLEM
all of my copy utilities that normally work fine (robocopy, xxcopy, fastcopy, ycopy, allway sync) are failing, they all fail at different times and give different errors, what I suspect is that with this high a volume of small files on the windows server, there is some technical problem (cache, buffering, ntfs, something)

QUESTION
does anyone have any idea how to copy a directory with 1.2 million small files totaling 173gb from a Windows 2003 Enterprise x64 server
0
Comment
Question by:ryanrupert
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
3 Comments
 
LVL 3

Accepted Solution

by:
JJLost earned 375 total points
ID: 22636220
FTP

or

Zip

:)

0
 
LVL 10

Assisted Solution

by:TCB1
TCB1 earned 375 total points
ID: 22637475
Copying that many small files is a real I/O tax on a drive. I would use a utility like 7-zip to store them. Then copy the zip file to the drive and expand it if needed. Copying one large or even several large files will be much faster and less prone to I/O errors.
0

Featured Post

Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article helps those who get the 0xc004d307 error when trying to rearm (reset the license) Office 2013 in a Virtual Desktop Infrastructure (VDI) and/or those trying to prep the master image for Microsoft Key Management (KMS) activation. (i.e.- C…
In the absence of a fully-fledged GPO Management product like AGPM, the script in this article will provide you with a simple way to watch the domain (or a select OU) for GPOs changes and automatically take backups when policies are added, removed o…
This is used to tweak the memory usage for your computer, it is used for servers more so than workstations but just be careful editing registry settings as it may cause irreversible results. I hold no responsibility for anything you do to the regist…
How to fix incompatible JVM issue while installing Eclipse While installing Eclipse in windows, got one error like above and unable to proceed with the installation. This video describes how to successfully install Eclipse. How to solve incompa…

718 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question