Estimate the time huge file copy from one directory to others.

Posted on 2009-04-29
Last Modified: 2013-12-27
I have 16 GB RAM solaris box , I have to take backup of 12 GB files from one folder to other folder.Now my manger ask me to estimate the approx time to copy the from one files to others. I have googled alot but could find any appropiate procedure to calculate the time for copying files.

Please suggest me if there any specfic procedure.

Question by:bhavanisharansingh
    LVL 7

    Expert Comment

    There is no DEFINITE way to calculate the time it will take to copy this information.  There are many different factors that come into play...

    Your Disk RPM Speed
    If you're transferring over the network, your upload speed...
    You disk integrity (bad sectors on disk)
    Any processes that run on your machine can cause lag...

    The best way to tell, is to drag and drop it and wait to see what the estimated time is.

    That's the only thing I know to do with it.
    LVL 68

    Expert Comment

    You could use a tool like Bonnie to get a very rough estimate of the performance of your disks.
    But, basically, dandmantra is right. Just try it (perhaps with only a subset ot the actual data)
    This is Bonnie -
    LVL 40

    Expert Comment

    it depends on many things

    - your disk rpm speed
    - the controller / bus throughput / speed
    - the nature of files (small / big files)
    - the number of files and dirs
    - if copying to the same disk or different disk
    - the tools used to copy
    - if system is running any other applications / processes that are cpu or I/O intensive

    I suggest to do a small test:

    - take a 10 MB file and see how much time it takes to copy it:

    time cp file file1

    then do some calculations on the size you mentioned. This will give you an idea
    LVL 61

    Accepted Solution

    Optimally you copy using large blocks with dd - lets say 16MB
    This way you get close to theoretical limit of half speed of disk (physical surface, not cable interface) - i.e something like 20-30MB/s

    Author Closing Comment


    Featured Post

    Top 6 Sources for Identifying Threat Actor TTPs

    Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

    Join & Write a Comment

    Suggested Solutions

    In tuning file systems on the Solaris Operating System, changing some parameters of a file system usually destroys the data on it. For instance, changing the cache segment block size in the volume of a T3 requires that you delete the existing volu…
    I promised to write further about my project, and here I am.  First, I needed to setup the Primary Server.  You can read how in this article: Setup FreeBSD Server with full HDD encryption (…
    Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
    Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…

    745 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    14 Experts available now in Live!

    Get 1:1 Help Now