Solved

Copying large thin-provisioned VMDKs from NAS to ESXi 5.5 DAS extremely slow

Posted on 2014-09-26
6
623 Views
Last Modified: 2014-10-02
Hi everyone.

I'm hoping you can help with an issue we are having.

We are using a ReadyNAS Pro 4 as off-line backup of VMs and to move VMs between 2 sites. Running RAIDiator 4.2.26 and ESXi 5.5. Using NFS. We copied a bunch of VMs to the NAS at site 1. Sent it to site 2. Using Datastore Browser in VMWare we can copy anything off the NAS to ESXi's direct attached storage and vice versa.

The problem we are currently having is that the NAS copies are slow when it comes to copying a thin provisioned VMDK from the NAS over NFS to DAS.

It's a thin provisioned VMDK which is 40GB. The files size has reached 40GB and it's not growing so it's not inflating the drive to a thick VMDK. The problem is the copy time is slowwwww at 2000+ hours.

Is this expected? Has anyone come across this before?
0
Comment
Question by:unit9419
6 Comments
 
LVL 119

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 40346569
Some NFS based NASes can be slow, we are currently transferring off (archive-ing) VMs, 40GB to Synology NAS from NetApp NAS (NFS and iSCSI), it's been taking 8+ hours.

Now this is quicker than your stats, but are you

1. using Jumbo Frames ?

2., How many spindles (disks), and speed is your NAS using ?

3. How many ethernet connections are your NAS using ?

4. Datastore browser copy, copies to workstation and back again, so it's a slow method to copy, direct copy on the console will be quicker, or migrate.

5. More Expensive NASes, e.g. NetApp use VAAI plugins to speed up and offload NFS operations to the storage processor.
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 40346732
If you're doing a copy instead of cloning or cold migrate it will actually copy every block because it copies no matter thin provisioned at the source or not (Datastore Browser)
0
 

Author Comment

by:unit9419
ID: 40346744
thanks for the response, Paul!  I'm confused though.  When we do the same kind of operation between 2 DAS VMFS datastores it quickly copies the 42GB and is done with it.  And when we copied this VMDK *TO* the NAS via NFS it didn't take days to finish like this...
0
PRTG Network Monitor: Intuitive Network Monitoring

Network Monitoring is essential to ensure that computer systems and network devices are running. Use PRTG to monitor LANs, servers, websites, applications and devices, bandwidth, virtual environments, remote systems, IoT, and many more. PRTG is easy to set up & use.

 
LVL 42

Expert Comment

by:paulsolov
ID: 40346844
If you're doing a cold migration or storage vmotion via the client it will just copy used blocks (as  it allows you to pick thin or thick provisioned).  If you're copying VM folders with Datastore Browser it will migrate file level and not take into account for blocks actually used.
0
 
LVL 62

Expert Comment

by:gheist
ID: 40347273
Netgear says to disable any VAAI on ESXi-s connected to ReadyNAS.
I would suggest you try transfer with Veeam SCP. It usually is faster than vmware itself at moving vmdks. Once you have result from it we get better idea where is the bottleneck.
0
 

Author Closing Comment

by:unit9419
ID: 40357739
Turned out to be jumbo frames and allowing the NIC to auto negotiate higher speed. Much better now
0

Featured Post

Active Directory Webinar

We all know we need to protect and secure our privileges, but where to start? Join Experts Exchange and ManageEngine on Tuesday, April 11, 2017 10:00 AM PDT to learn how to track and secure privileged users in Active Directory.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article will show you how to create an ISO CD-ROM/DVD-ROM image (*.iso), and MD5 checksum signature, for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5). It's a good idea to compare checksums, because many installations fail because of a corr…
In this article, I show you step by step with screenshots to assist you - HOW TO: Deploy and Install the VMware vCenter Server Appliance 6.5 (VCSA 6.5), with some helpful tips along the way.
This tutorial will walk an individual through the steps necessary to install and configure the Windows Server Backup Utility. Directly connect an external storage device such as a USB drive, or CD\DVD burner: If the device is a USB drive, ensure i…
This tutorial will walk an individual through the process of installing of Data Protection Manager on a server running Windows Server 2012 R2, including the prerequisites. Microsoft .Net 3.5 is required. To install this feature, go to Server Manager…

820 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question