Link to home
Start Free TrialLog in
Avatar of Albert Widjaja
Albert WidjajaFlag for Australia

asked on

Moving more than 1 millions of small files to Network shared directory using Robocopy ?

I had this question after viewing Modifying Robocopy script to migrate (move) from one drive to NFS share (retryable)?.

Source drive: NTFS
Target Drive: NFS share
Total number of files: more than 1.1 million
Source Directory Size: 490 GB+

Does anyone here know what's the suggested Robocopy command to move all files from the source directory to the target directory by overwriting whatever has been copied over to the target directory ?

Because when I manually cut-paste in Windows Explorer, it crashed.

I have used the script below

Robocopy "D:\Passenger Details" "\\10.10.10.12\Archive" /MOVE /COPYALL /IS /XX /R:2 /MT:32 /log+:X:\TEMP\MOVElogfile.txt /njh /njs /np

Open in new window


but it does not move anything for more than 48 hours no progress or disk space reduction in Source drive.
Avatar of Nitin Sontakke
Nitin Sontakke
Flag of India image

You mentioned /np so no progress will be reported on the screen.

While 48 hours is not justified, it might be checking what is already there.

Is log file at least growing, changing?
Avatar of Albert Widjaja

ASKER

No, nothing is changed in terms of the log files.
I assume you have already thought of alternative paths to achieve the same result.

Making a .zip, moving a .zip and then expanding it there.

Physically moving files between machine (no network traffic, some other medium)

FTP?

etc. However smart a program be (such as robocopy!) it is pretty complex and repetitive task to perform over mn times over a network. I think!
No, I cannot zip it since the disk space is running out of space just few hundred megabytes left in SOurce drive.
SOLUTION
Avatar of Nitin Sontakke
Nitin Sontakke
Flag of India image

Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
ASKER CERTIFIED SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial
The destination is NFS share, hence the NTFS permission is not retained.

I need to migrate the small but many files to the NFS share since the source disk is running out of disk space.

I will try and get back to you guys.
SOLUTION
Link to home
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
Start Free Trial