Avatar of Albert Widjaja
Albert Widjaja
Flag for Australia asked on

Moving more than 1 millions of small files to Network shared directory using Robocopy ?

I had this question after viewing Modifying Robocopy script to migrate (move) from one drive to NFS share (retryable)?.

Source drive: NTFS
Target Drive: NFS share
Total number of files: more than 1.1 million
Source Directory Size: 490 GB+

Does anyone here know what's the suggested Robocopy command to move all files from the source directory to the target directory by overwriting whatever has been copied over to the target directory ?

Because when I manually cut-paste in Windows Explorer, it crashed.

I have used the script below

Robocopy "D:\Passenger Details" "\\10.10.10.12\Archive" /MOVE /COPYALL /IS /XX /R:2 /MT:32 /log+:X:\TEMP\MOVElogfile.txt /njh /njs /np

Open in new window


but it does not move anything for more than 48 hours no progress or disk space reduction in Source drive.
PowershellWindows BatchWindows OSActive Directory* Robocopy

Avatar of undefined
Last Comment
sirbounty

8/22/2022 - Mon
Nitin Sontakke

You mentioned /np so no progress will be reported on the screen.

While 48 hours is not justified, it might be checking what is already there.

Is log file at least growing, changing?
Albert Widjaja

ASKER
No, nothing is changed in terms of the log files.
Nitin Sontakke

I assume you have already thought of alternative paths to achieve the same result.

Making a .zip, moving a .zip and then expanding it there.

Physically moving files between machine (no network traffic, some other medium)

FTP?

etc. However smart a program be (such as robocopy!) it is pretty complex and repetitive task to perform over mn times over a network. I think!
Experts Exchange has (a) saved my job multiple times, (b) saved me hours, days, and even weeks of work, and often (c) makes me look like a superhero! This place is MAGIC!
Walt Forbes
Albert Widjaja

ASKER
No, I cannot zip it since the disk space is running out of space just few hundred megabytes left in SOurce drive.
SOLUTION
Nitin Sontakke

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
SOLUTION
Shaun Vermaak

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
ASKER CERTIFIED SOLUTION
sirbounty

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
Albert Widjaja

ASKER
The destination is NFS share, hence the NTFS permission is not retained.

I need to migrate the small but many files to the NFS share since the source disk is running out of disk space.

I will try and get back to you guys.
SOLUTION
sirbounty

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.