Albert Widjaja
asked on
Moving more than 1 millions of small files to Network shared directory using Robocopy ?
I had this question after viewing Modifying Robocopy script to migrate (move) from one drive to NFS share (retryable)?.
Source drive: NTFS
Target Drive: NFS share
Total number of files: more than 1.1 million
Source Directory Size: 490 GB+
Does anyone here know what's the suggested Robocopy command to move all files from the source directory to the target directory by overwriting whatever has been copied over to the target directory ?
Because when I manually cut-paste in Windows Explorer, it crashed.
I have used the script below
but it does not move anything for more than 48 hours no progress or disk space reduction in Source drive.
Source drive: NTFS
Target Drive: NFS share
Total number of files: more than 1.1 million
Source Directory Size: 490 GB+
Does anyone here know what's the suggested Robocopy command to move all files from the source directory to the target directory by overwriting whatever has been copied over to the target directory ?
Because when I manually cut-paste in Windows Explorer, it crashed.
I have used the script below
Robocopy "D:\Passenger Details" "\\10.10.10.12\Archive" /MOVE /COPYALL /IS /XX /R:2 /MT:32 /log+:X:\TEMP\MOVElogfile.txt /njh /njs /np
but it does not move anything for more than 48 hours no progress or disk space reduction in Source drive.
ASKER
No, nothing is changed in terms of the log files.
I assume you have already thought of alternative paths to achieve the same result.
Making a .zip, moving a .zip and then expanding it there.
Physically moving files between machine (no network traffic, some other medium)
FTP?
etc. However smart a program be (such as robocopy!) it is pretty complex and repetitive task to perform over mn times over a network. I think!
Making a .zip, moving a .zip and then expanding it there.
Physically moving files between machine (no network traffic, some other medium)
FTP?
etc. However smart a program be (such as robocopy!) it is pretty complex and repetitive task to perform over mn times over a network. I think!
ASKER
No, I cannot zip it since the disk space is running out of space just few hundred megabytes left in SOurce drive.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
The destination is NFS share, hence the NTFS permission is not retained.
I need to migrate the small but many files to the NFS share since the source disk is running out of disk space.
I will try and get back to you guys.
I need to migrate the small but many files to the NFS share since the source disk is running out of disk space.
I will try and get back to you guys.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
While 48 hours is not justified, it might be checking what is already there.
Is log file at least growing, changing?