Copying large thin-provisioned VMDKs from NAS to ESXi 5.5 DAS extremely slow

Hi everyone.

I'm hoping you can help with an issue we are having.

We are using a ReadyNAS Pro 4 as off-line backup of VMs and to move VMs between 2 sites. Running RAIDiator 4.2.26 and ESXi 5.5. Using NFS. We copied a bunch of VMs to the NAS at site 1. Sent it to site 2. Using Datastore Browser in VMWare we can copy anything off the NAS to ESXi's direct attached storage and vice versa.

The problem we are currently having is that the NAS copies are slow when it comes to copying a thin provisioned VMDK from the NAS over NFS to DAS.

It's a thin provisioned VMDK which is 40GB. The files size has reached 40GB and it's not growing so it's not inflating the drive to a thick VMDK. The problem is the copy time is slowwwww at 2000+ hours.

Is this expected? Has anyone come across this before?
unit9419Asked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Some NFS based NASes can be slow, we are currently transferring off (archive-ing) VMs, 40GB to Synology NAS from NetApp NAS (NFS and iSCSI), it's been taking 8+ hours.

Now this is quicker than your stats, but are you

1. using Jumbo Frames ?

2., How many spindles (disks), and speed is your NAS using ?

3. How many ethernet connections are your NAS using ?

4. Datastore browser copy, copies to workstation and back again, so it's a slow method to copy, direct copy on the console will be quicker, or migrate.

5. More Expensive NASes, e.g. NetApp use VAAI plugins to speed up and offload NFS operations to the storage processor.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
Paul SolovyovskySenior IT AdvisorCommented:
If you're doing a copy instead of cloning or cold migrate it will actually copy every block because it copies no matter thin provisioned at the source or not (Datastore Browser)
0
unit9419Author Commented:
thanks for the response, Paul!  I'm confused though.  When we do the same kind of operation between 2 DAS VMFS datastores it quickly copies the 42GB and is done with it.  And when we copied this VMDK *TO* the NAS via NFS it didn't take days to finish like this...
0
Ultimate Tool Kit for Technology Solution Provider

Broken down into practical pointers and step-by-step instructions, the IT Service Excellence Tool Kit delivers expert advice for technology solution providers. Get your free copy now.

Paul SolovyovskySenior IT AdvisorCommented:
If you're doing a cold migration or storage vmotion via the client it will just copy used blocks (as  it allows you to pick thin or thick provisioned).  If you're copying VM folders with Datastore Browser it will migrate file level and not take into account for blocks actually used.
0
gheistCommented:
Netgear says to disable any VAAI on ESXi-s connected to ReadyNAS.
I would suggest you try transfer with Veeam SCP. It usually is faster than vmware itself at moving vmdks. Once you have result from it we get better idea where is the bottleneck.
0
unit9419Author Commented:
Turned out to be jumbo frames and allowing the NIC to auto negotiate higher speed. Much better now
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.