?
Solved

Copying large thin-provisioned VMDKs from NAS to ESXi 5.5 DAS extremely slow

Posted on 2014-09-26
6
Medium Priority
?
650 Views
Last Modified: 2014-10-02
Hi everyone.

I'm hoping you can help with an issue we are having.

We are using a ReadyNAS Pro 4 as off-line backup of VMs and to move VMs between 2 sites. Running RAIDiator 4.2.26 and ESXi 5.5. Using NFS. We copied a bunch of VMs to the NAS at site 1. Sent it to site 2. Using Datastore Browser in VMWare we can copy anything off the NAS to ESXi's direct attached storage and vice versa.

The problem we are currently having is that the NAS copies are slow when it comes to copying a thin provisioned VMDK from the NAS over NFS to DAS.

It's a thin provisioned VMDK which is 40GB. The files size has reached 40GB and it's not growing so it's not inflating the drive to a thick VMDK. The problem is the copy time is slowwwww at 2000+ hours.

Is this expected? Has anyone come across this before?
0
Comment
Question by:unit9419
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
6 Comments
 
LVL 123

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 1500 total points
ID: 40346569
Some NFS based NASes can be slow, we are currently transferring off (archive-ing) VMs, 40GB to Synology NAS from NetApp NAS (NFS and iSCSI), it's been taking 8+ hours.

Now this is quicker than your stats, but are you

1. using Jumbo Frames ?

2., How many spindles (disks), and speed is your NAS using ?

3. How many ethernet connections are your NAS using ?

4. Datastore browser copy, copies to workstation and back again, so it's a slow method to copy, direct copy on the console will be quicker, or migrate.

5. More Expensive NASes, e.g. NetApp use VAAI plugins to speed up and offload NFS operations to the storage processor.
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 40346732
If you're doing a copy instead of cloning or cold migrate it will actually copy every block because it copies no matter thin provisioned at the source or not (Datastore Browser)
0
 

Author Comment

by:unit9419
ID: 40346744
thanks for the response, Paul!  I'm confused though.  When we do the same kind of operation between 2 DAS VMFS datastores it quickly copies the 42GB and is done with it.  And when we copied this VMDK *TO* the NAS via NFS it didn't take days to finish like this...
0
Free learning courses: Active Directory Deep Dive

Get a firm grasp on your IT environment when you learn Active Directory best practices with Veeam! Watch all, or choose any amount, of this three-part webinar series to improve your skills. From the basics to virtualization and backup, we got you covered.

 
LVL 42

Expert Comment

by:paulsolov
ID: 40346844
If you're doing a cold migration or storage vmotion via the client it will just copy used blocks (as  it allows you to pick thin or thick provisioned).  If you're copying VM folders with Datastore Browser it will migrate file level and not take into account for blocks actually used.
0
 
LVL 62

Expert Comment

by:gheist
ID: 40347273
Netgear says to disable any VAAI on ESXi-s connected to ReadyNAS.
I would suggest you try transfer with Veeam SCP. It usually is faster than vmware itself at moving vmdks. Once you have result from it we get better idea where is the bottleneck.
0
 

Author Closing Comment

by:unit9419
ID: 40357739
Turned out to be jumbo frames and allowing the NIC to auto negotiate higher speed. Much better now
0

Featured Post

VIDEO: THE CONCERTO CLOUD FOR HEALTHCARE

Modern healthcare requires a modern cloud. View this brief video to understand how the Concerto Cloud for Healthcare can help your organization.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

If we need to check who deleted a Virtual Machine from our vCenter. Looking this task in logs can be painful and spend lot of time, so the best way to check this is in the vCenter DB. Just connect to vCenter DB(default DB should be VCDB and using…
Your data is at risk. Probably more today that at any other time in history. There are simply more people with more access to the Web with bad intentions.
This tutorial will walk an individual through the process of configuring basic necessities in order to use the 2010 version of Data Protection Manager. These include storage, agents, and protection jobs. Launch Data Protection Manager from the deskt…
This video shows you how easy it is to boot from ISO images for virtual machines with the ISO images stored on a local datastore on the ESXi host.

765 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question