VMWare Move VMs over to another drive on the same server is going to take FOREVER!

Hello All;

I have a 1TB drive of which has 11 VMs on it.
Taking up about 95% of the space.
I purchased some 500GB driver, I am in the process of moving the VMs over.

What I have done.
#1:
Using the datastore, I chose the VMs and I "Moved" them.
It is going to take a few days to move the ones I selected over, about 426GB.

#2: I tried the OpenSSH
Just to move one of the VMs over that is 60GB, will take over 24-hours.

Code for the SSH

[root@localhost:/vmfs/volumes/5b005dd5-2ce20e85-e704-001517fcd2e8] scp -r "00 - DNS Server" root@192.168.2.101:/vmfs/volumes/Date-2016/"00\\-\\DNS\\Server"

Open in new window


How can I make this go faster?
It is only going from one drive to another drive, on the same server.

Thanks
Carrzkiss
LVL 31
Wayne BarronAuthor, Web DeveloperAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
it will take time to move them if you have slow datastores.

A single drive does not produce many IOPS.
0
johnsoneSenior Oracle DBACommented:
Am I reading this correctly?

You have a server with a physical 1 TB drive.  You added a second physical drive to the same server that is 500 GB.  You now have a server with 2 physical drives (1 TB and 500 GB).

If that is the case, why are you using scp?  cp would do the job, and it should be faster because it wouldn't get the network and encryption involved.

You could also look into using dd.  That may be actually faster, but a little more complicated to get the command correct.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Yes, you will need to power off the VM to move it.

Unless you have vCenter Server and the licenses and you can then move in real time with zero downtime.

SCP will be slow, you may find it better to use vmkfstools to move a VM, of simply cutting and pasting between datastores.
0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

Wayne BarronAuthor, Web DeveloperAuthor Commented:
All the VMs that are being moved are already shut down.
I will check in on the vmkfstools.
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
vCenter server is expensive! $7,472.00
Maybe one day, I will be big enough to have something like that.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Much cheaper deal, Essentials - approx $700!

Licenses for 3 Hosts (2 CPU) and vCenter Server license - $700!

But a single disk, moving to another single disk is going to be slow...
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
Yes, johnsone.
I have multiple 500GB drives connected to replace the single 1TB drive.
All on the same machine.

trying to find commands for the CP and DD
I am searching Google right now, but with no luck.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Remember that ESXi is NOT Linux!
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
I am also looking in on vmkfstools
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
I am assuming that the comment has something to do with the CP and DD commands being Linux based
And will not work with esxi?

What would be the best way of doing it with vmkfstools
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
That is a VMware vSphere ESXi command, and is faster than cp and scp. (cp, scp and dd are Linux commands)

--clonevirtualdisk | -i <src_file> <dest_file> --diskformat | -d <format> --adaptertype | -a <type>

Open in new window


Creates a copy of a virtual disk or raw disk. The copy will be in the specified disk format. Takes source disk and destination disk as arguments

but it's still slow......

https://www.vmware.com/support/developer/vcli/vcli41/doc/reference/vmkfstools.html
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Wayne BarronAuthor, Web DeveloperAuthor Commented:
this is what I used.
I had to CD into the directory, and create my folder. (removing the spaces in the original folder name, to relieve the hassle of all the \\ for spaces, in the future)
mkdir 00-DNS-Server

Open in new window


Then I was able to start the coping process.
vmkfstools -i "/vmfs/volumes/Date-2016/00 - DNS Server/00 - DNS Server.vmdk" -d thin "/vmfs/volumes/DES Lessons/00-DNS-Serve
r/00 - DNS Server.vmdk"

Open in new window


It is at 13% right now, and the file is 50GB.
So, we will wait and see how long it will take.

Thanks, Andrew.
Love learning new things.
The sharing of Knowledge is power, my friend.

Wayne
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
Andrew put me on the right path, to get started.
It is at 14% right now.
This is a LOT faster than the other methods I tried.

Thanks, Andrew.
Wayne
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
cut and paste takes the same amount of time!! if you use the gui!
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
How do you use the GUI?
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
New question, if you can assist.
vmkfstools not Cloning the full size of the VMDK
0
Wayne BarronAuthor, Web DeveloperAuthor Commented:
The other issue is resolved.
Files are made smaller during the cloning process.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Because you created a THIN disk!

There are three types of disk, thin, thick (eager zero) etc

to be expected when you created a thin disk!
0
johnsoneSenior Oracle DBACommented:
Seems strange to me that there would be access to a low level command like scp, but no access to cp.  I guess that's the way it goes.  I'm sure that if you could find the *IX distribution that created the OS, you could get the commands there.  But, that seems to be making is more complicated.

I also got confused.  I used to work with a *IX variant called ESIX.  Slightly different spelling and it caught me.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Server Hardware

From novice to tech pro — start learning today.