2TB VMDK limit exceeded - Snapshot and Backups fail

We had a VM (Windows Server 2008 R2 in a two-host ESX 5.0 vCenter environment) which was running out of space on one of its partitions. So we upgraded the VMDK to 2TB. We were aware of the 2TB - 512 bytes limit of VMDKs in ESX 5.0, so we had originally tried upgrading the VMDK to around 1.8TB, but vSphere automatically rounded it up to 2TB in the GUI window just before we pressed the OK button, and the change was committed to 2TB with no going back. Genius programming on VMware's part...

Now obviously VMware snapshots and backups are failing (we are using Veeam B&R). We've read about a few different resolutions online, but all of them seem to require in-depth testing beforehand as they are major changes. We also want to avoid having to move the data manually to another, smaller VMDK if possible. Any ideas?
SleezedAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
The maximum virtual disk size, 2TB-512bytes, also includes the snapshot size of the disk.

So by making the virtual disk, the maximum size, also prevents any snapshots being taken of the disk.

Options:-

1. Reduce the size of the virtual disk, using VMware Converter.

Part 13: HOW TO: Shrink or Reduce a VMware Virtual Machine Disk (VMDK) using VMware vCenter Converter Standalone v5.5.2

2. Upgrade to ESXi 5.5 which supports 62TB virtual hard disks.

HOW TO: Upgrade from VMware vSphere Hypervisor ESXi 5.1 to VMware vSphere Hypervisor ESXi 5.5 for FREE

(same process from 5.1 to 5.5!)
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
SleezedAuthor Commented:
Thanks for the suggestions Andrew Hancock. Unfortunately, I'm a bit weary of upgrading the ESXi. I will probably have to go for the V2V conversion. What's strange is how the convertor tool can reduce the size of the VMDK without losing any data/sectors. Does it select to not convert/copy only blank sectors?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
VMware Converter, is just a clone tool. So it creates the new size disk, and then streams the data across.
0
SleezedAuthor Commented:
Thanks Andrew. We also found another solution which is pointing the snapshots to a different datastore.

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1002929

Other forums have said that the solution solves the issue. Do you personally have any experience on whether this works or not in my scenario?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
The maximum size of a virtual machine disk under your version of ESXi is 2TB-512bytes.

This includes the snapshot size, as you are at max, you will not be able top create a snapshot.

This is a common, issues amongst VMware Admins, forgetting about snapshots.

see here

http://kb.vmware.com/selfservice/microsites/search.do?cmd=displayKC&docType=kc&externalId=1012384&sliceId=2&docTypeID=DT_KB_1_1&dialogID=706551614&stateId=0%200%20706559858
0
SleezedAuthor Commented:
Unfortunately, that fix didn't work. Even though the workingDir configuration was successful, the snapshots failed with the same "File is larger than maximum file size supported" error.

We decided on updating the servers...
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
That is correct. (that fix only works, if you have issues with block size!)

You have exceeded the maximum size of the virtual machine disk (VMDK) by setting it to 2TB-512 bytes.

Any snapshot created will exceed the maximum size of  2TB-512 bytes.
0
SleezedAuthor Commented:
I have two questions...

1. If I upgrade, will that necessarily mean that the problem is solved? Would just upgrading the vSphere hosts upgrade all the VMDK's storage limits universally? Or will I have to still upgrade the virtual hardware, VMware Tools etc of the VMs?

2. Is the 2TB - 512 byte limit calculated on provisioned storage or used storage? The problematic VMs are currently thick provisioned and have around 1TB of user data on them. So if I were to convert them to thin via a storage migration, even though the provisioned storage would remain the same, the used storage would be halved. Would that solve the issue?
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
1. You will need to upgrade the host, and then you will need to upgrade VMware Tools, and you will need to upgrade the virtual hardware, and then increase the size of the virtual hard disk.

2. It's based on the size of the virtual disk (VMDK). It's a limit imposed by the hypervisor. As a last resort, you could try a storage vMotion. I can try this later, not sure if it would help your situation because the max pointers in the VMDK have been set, thick or thin, it's still 2TB-512bytes.
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Virtualization

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.