vDR Restore Failed

hongedit
hongedit used Ask the Experts™
on
Hi

Restore of my Exchange failed, using VDR.

Restore was of 3 disks - OS, Mailbox, Logs.

I only really needed to do Mailbox and Logs, OS was otherwise OK, but in my haste I ticked the whole lot.

Error log:

5/14/2011 11:34:05 PM: Restore using Saints Exchange
5/14/2011 11:34:05 PM: To volume Saints Exchange...
5/14/2011 11:34:05 PM: Restoring from /SCSI-0:1/, Session (5/14/2011 12:14:11 AM)
5/15/2011 12:56:11 AM: Performing full restore of disk "[Exchange Logs] Saints Exchange/Saints Exchange_1-flat.vmdk" using "Network"
5/15/2011 8:48:02 AM: File "Saints-MGMT.Saints.local/Saints HQ/host/esx1.saints.local/Resources/Saints Exchange/Saints Exchange-flat.vmdk": can't write, error -3952 ( write failed)
5/15/2011 2:58:52 PM: Performing full restore of disk "[Exchange MB] Saints Exchange/Saints Exchange_1-flat.vmdk" using "Network"
5/15/2011 2:58:53 PM: 1 task errors
5/15/2011 2:58:53 PM: Completed: 8 files, 422.7 GB
5/15/2011 2:58:53 PM: Performance: 468.0 MB/minute
5/15/2011 2:58:53 PM: Duration: 15:24:39 (00:00:08 idle/loading/preparing)

And

5/15/2011 2:58:54 PM: Restore using Saints Exchange copy
5/15/2011 2:58:54 PM: To volume Saints Exchange...
5/15/2011 2:58:54 PM: Restoring from /SCSI-0:1/, Session (5/14/2011 12:14:11 AM)
5/15/2011 2:59:00 PM: Can't initialize destination, error -3941 ( create snapshot failed)
5/15/2011 2:59:00 PM: Task incomplete

Looking at the logs it seems the Logs disk restored successfully.
Looking at the logs it seems the Mailbox disk restored successfully.
THe OS disk failed due to insufficient space.

The VM wont start due to insufficient space. I have created a new Datastore with a larger allocation of space and I am now transferring the OS disk to the new Datastore.

Mailbox Datastore looks around the right size...Im hoping this works.

in the OS VMX file it says the disk in use is filename.vmdk. In the Datastore there are filename_1.vmdk and filename_2.vmdk also, both not quite as big as the filename.vmdk.

What are these? Why have I run out of space?

Does the restore -add- files to the Datastore as opposed to overwriting that is currently there?



Comment
Watch Question

Do more with

Expert Office
EXPERT OFFICE® is a registered trademark of EXPERTS EXCHANGE®
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
it will not overwrite files already on the store.

it will append.

you can restore to different location or datastore, or use rehersal mode that restores to separate folder called vmname rehersal.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
change the names in vmx file

Author

Commented:
Ok, that explains why its run out of space.

I have cancelled the migrate and I am now moving the filename_1.vmdk to local host datastore, which will free up about 12GB's.

I can then see if the VM will boot.

Yes?
Acronis in Gartner 2019 MQ for datacenter backup

It is an honor to be featured in Gartner 2019 Magic Quadrant for Datacenter Backup and Recovery Solutions. Gartner’s MQ sets a high standard and earning a place on their grid is a great affirmation that Acronis is delivering on our mission to protect all data, apps, and systems.

Author

Commented:
The name is correct I think.

Are the filename_#.vmdk's snapshots?

Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
they could be separate disks

snapshots usually 000001.vmdk etc

Author

Commented:
I dont understand.

I have 3 disks asscoiated with this VM:

OS
Mailbox
Logs

Each disk is a seperate datastore.

In the OS Datatsore I have (amongst other files):

Filename.vmdk (85GB)
Filename_1.vmdk (12GB)
Filename_2.vmdk (53GB)

I am moving off Filename_1.vmdk to ESX local datastore.

Is this ok?

Author

Commented:
I now have 11GB free on the OS datastore and the VM will still not power on due to insufficient disk space!!

WHat is going on
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay thats okay then if you have three different virtual disks.

that would be okay.

then just readd the disk to vm settings if your doing this msnually.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
which disks were restored?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
1 and 2

Author

Commented:
I accidentally selected all 3 disks to restore.

Mailbox and Logs seem to be ok, but the OS disk failed due to insufficient space.

I moved off Filename_1.vmdk (freed up 11GB) and it still says insufficient space.

I created a new VM, added those disks, same thing.

I dont get all, all disks have free space!!
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
you mentioned that the os disk was not restored due to insufficient disk space?

of exchange_1 was restored correctly

but exchange-flat has a write error, so this disk could be damaged?

Author

Commented:
Yes the disk ran out of space - I thought the restore would overwrite, not append.

Other 2 disks restored ok it seems (need to boot exchange to check!)

I see no exchange-flat.

Would it be best to try restoring the OS again, after making sure there is enough space?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay so you deleted os and logs?

can you select the original os disk only in properties and see if u can start machine

sometimes a insufficient disk error could be many things

Author

Commented:
No, originally I deleted Mailbox and Logs. OS was fine, but I chose by mistake to restore that too.

If I remove the Mailbox and Logs disk from the VM it still fails to boot.
VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017
Commented:
and thisbis the same os file or is it the one thats been restored and overwritten the original?

becausr the os disk failed to restore, so this could be a faulty os disk.

maybe best to restore a good os disk to a datastore now from vdr

Author

Commented:
Ok.

If I choose to restore the OS disk to another Datastore, I get the error:

The virtual disk at node "SCSI (0:0) Hard Disk 1" is currently configured to overwrite an exisitjng virtual disk on the destination.

An unused virtual disk node must first be selected before a different datastore can be selected.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
have you changed the destination target?

Author

Commented:
That is the error I get when I am trying to select another destination to restore to

Author

Commented:
Ah I wonder if this is becuase I am currently moving a file from the OS disk to another store...

Author

Commented:
That was it,

Rsstoring to a different (new) datatstore now on the 15k sas array, I will then attach this to the VM and hope it boots.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Are you using the same Virtual Machine name?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Okay, so just restore the OS disk. Attach to a virtual machine, and see if it quickly starts to boot and then power off.

then add Logs and Mailbox virtual disks.

Power On.

Author

Commented:
Back to the old 100Mbps bottleneck now.

The OS disk size is 199GB, but with only about 80GB used - will it restore 199GB or 80GB?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
It will restore the VMDK that was on the original disk.

If that was 199GB, it will restore 199GB.

Author

Commented:
Well I used Thin disks so only 80Gb or so was used, althought 199Gb was provisioned
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
There was an issue with vDR which on restore converted a thin disk to a thick, filling up the datastores, but I believe this has been now fixed in 1.2 and later.

What version of vDR are you using?

Author

Commented:
1.2.1
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay the latest.

Author

Commented:
Well, just have to sit tight now and wait.

Author

Commented:
Restore finsihed, still wouldnt boot.

However, I created another VM, identical hardware config, booted up and all disks are there.

But no network. Device Manager shows ! next to Ethernet Controller.

Just reinstalling VMWare tools..

Author

Commented:
Well the old (original) Exchange VM thinks its still using the corrupted datastore/disk and still will not boot with the same error. Even afetr removing all the disks, in the summary it still says the old Datastore is connected,

If I manually try to remove the Datastore it tells me it cannot becuase the resource is in use.

I manually disconnected the datastore from the SAN end and now the old VM is greyed out as (inaccessible).

THe new VM will not install or uninstall VMWare Tools, the install just hangs.

So close, yet so far!
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
can you start a VM with just the OS disk?

Author

Commented:
The new VM Starts fine now.

Just no NIC and problems installing VMWare Tools.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay, put tools on hold for the moment.

is tools already installed?

and are the disks okay, exchange look okay?

despite nic issue? we can see if we can work on this and get you up and running.

Author

Commented:
Tools were already installed, but when I booted no NIC driver on guest OS.

Exchange files looks ok...but of course I cannot check properly becuase of no network to communicate with AD!
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay, if you add a new nic does that work?

you can do this hot plug as well?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
what nic type have you been using e1000, vmxnet3

Author

Commented:
Doesnt work - tried online and offline adding NICs, both E1000 and VMXNET3

Author

Commented:
I also did a setup.exe /c which forcefully removed VMWare Tools.

Install still just hangs on "Preparing to install"
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
does plug and play start in the vm?

what is the device error in the device manager and what nic is currently in the vm?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
so we have no tools in the machine now?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
no tools vmxnet3 will not work.

Author

Commented:
When I add a NIC the OS does pick it up, but device manage shows the yellow ! next to Ethernet Controller like there is no driver.

No Tools now

Author

Commented:
Just removed all NICs, rebooted, and try to install tools like this
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay is plug and play services started
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
there are drivers already for the e1000 in the os.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
have you tried removing the nics from the vm, but leaving thr nic in the vm settings

also check plug and play services?

Author

Commented:
PnP service is started

Author

Commented:
have you tried removing the nics from the vm, but leaving thr nic in the vm settings

Can you clarify please?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
in the virtual machine device manager in th os delete

Author

Commented:
Ok I uninstalled the NIC from Device Manager

Now what?
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
if you click refresh at the top of device manager, does it find a nic?

Author

Commented:
Yes
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
it does find a nic by no drivers?

what is the error in device manager?

Author

Commented:
Yes, finds nic but no drivers.

Error is the standard "no driver"
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
is the nic an intel e1000?

what nic is defined in the vm properties?

as we got no tools it must be e1000

Author

Commented:
The NIC in VM Settings is E1000
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
what is the driver specified in the vm settings?

Author

Commented:
Its all E1000!
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
ok, you could try installing an intel driver manually, ive never had to, as it should pickup the driver in the machine.

Author

Commented:
the only way I can get the file over is via ISO.

But when I mount the ISO nothing happens in guest OS.

Works fine on other VM's...
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
something is wrong in this vm, with plug and play, its not performing correctly.

you could attach the disk another vm, mount the iso, copy files to, detatch carefully, do not delete, and after bootup try the drivers.

Author

Commented:
Whilst I was doing all this I just noticed the NIC popped up!

I set the IP and I can ping it.

Just rebooting to see if it sticks.

Hopefully this will be it.

I will be installing another Exchange VM from scratch after this and moving everything over though, as I am not convinced this VM is 100% working properly.
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
okay, another exchange server, quite straight forward, install in organization, move mailboxes, move publuc folders, let users all users connect and their profile will update to new one with the new server reference, change smtp connevtor, and then decomission as per microsoft docs.

Author

Commented:
BINGO

Mail flow

I love you Hanccocka
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
Thanks, i'll expect a card on Valentines Day!
Andrew Hancock (VMware vExpert / EE Fellow)VMware and Virtualization Consultant
Fellow 2018
Expert of the Year 2017

Commented:
for what its worth get a full backup.

Author

Commented:
Yes!!

Do more with

Expert Office
Submit tech questions to Ask the Experts™ at any time to receive solutions, advice, and new ideas from leading industry professionals.

Start 7-Day Free Trial