Best way to move 80,000+ files

Posted on 2009-04-24
Last Modified: 2012-05-06
Here is my situation.  I've been tasked with archiving off all files from a large directory structure that have not been modified in the last two years.  I ran a simple report and there are in excess of 80,000 of them.  My plan is to move them to another volume on the same server (maintaining directory structure) where they will sit for awhile prior to being archived off to disk (for easy restore purposes).  I've toyed with the idea of working some excel magic to build a batch file using individual robocopy commands which would work, but an 80,000+ line batch file seems somehow inherently wrong.  
The problem is that I don't want to copy entire directories, just certain identified files within the structure. Maybe a script which reads in paths and file names from a csv file and runs a command...    

I just know that there's a better way to do it.  I'm working under a deadline and will place this one at 500 points due to the complexity and importance of the task.  I'd make it 600, but they won't allow it.
Question by:mltets
    LVL 39

    Accepted Solution

    Robocopy can do this for you.

    /mov /e /minage:20090401
    LVL 4

    Author Comment

    And this will maintain the directory structure and everything?  Just pulling out the old files?
    LVL 4

    Author Comment

    Just wanting to verify...
    MINimum file AGE - exclude files newer than n days/date.
    (If n < 1900 then n = no of days, else n = YYYYMMDD date).

    This looks at the modified date?  or the Accessed date?
    LVL 47

    Assisted Solution

    Use Richcopy which is easier to use than robocopy

    LVL 4

    Author Comment

    Robocopy will definately do the trick.  Let me take a glance at richcopy and compare contrast...
    LVL 4

    Author Closing Comment

    Both will work very well.  Robocopy looks great from a command line.  Richcopy works great as well, but I had to wrestle with it before I caught onto the view advanced.  I'll test them both out and use one of them.  Thanks for the help guys!

    Featured Post

    How to run any project with ease

    Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
    - Combine task lists, docs, spreadsheets, and chat in one
    - View and edit from mobile/offline
    - Cut down on emails

    Join & Write a Comment

    Welcome to my series of short tips on migrations. Whilst based on Microsoft migrations the same principles can be applied to any type of migration. My first tip Migration Tip #1 – Source Server Health can be found here: http://www.experts-exchang…
    When you receive another warning that your shared drive is almost full and you have asked your users to clean out old files again and again, here is a single command that may help. This command will place all the files that have not been used rec…
    Excel styles will make formatting consistent and let you apply and change formatting faster. In this tutorial, you'll learn how to use Excel's built-in styles, how to modify styles, and how to create your own. You'll also learn how to use your custo…
    In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor ( If you're interested in additional methods for monitoring bandwidt…

    746 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    15 Experts available now in Live!

    Get 1:1 Help Now