Solved

Unable to migrate VM in VMWare ESXi 5

Posted on 2013-05-21
68
1,619 Views
Last Modified: 2014-09-07
We've just reconfigured our other VM Host (used to have NO raid, now it has) and used the same ESXi configuration (on a USB.

It detected the new RAID configuration, all network cards, etc.. and has successfully joined the cluster.

I tried moving a virtual machine (turned off > Migrate) but were unsuccessful and got this error. ** see screenshot. It doesn't matter what operating system the guest is running, nothing gets moved over.

Any ideas what could the issue be?
migrate-error.PNG
0
Comment
Question by:andrew_transparent
  • 34
  • 16
  • 15
  • +1
68 Comments
 
LVL 118
ID: 39185895
looks like a linked clone, are you using VDI?

it's a very odd, virtual machine disk name? (vmdk)
0
 
LVL 7

Expert Comment

by:BT15
ID: 39185958
are you using Virtual Center for your migration? are there any firewalls present between your hosts?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39185975
yes it is a clone and used VMWare View to create these VMs basically from templates.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39185977
the host used to be the main ESX host until we reconfigured it with RAID.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39192257
Are you able to migrate other VM's to the rebuild ESXi server?

Can you please upload the vmware.log file for the VM that failed to migrate and the vmkernel.log file from both the source and destination Vmware server as well.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39199453
no, can't migrate any other VMs..
and I just recently created a VM on the rebuild ESXi server, now it went as "inaccessible".
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39199454
How do we get the vmware.log and vmkernel.log from the VM and host?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39199492
i also noticed that the storage of the rebuild host, goes unmounted for some time then I usually rescan the storage and it connects back.
Also browsing to its datastores, it usually shows no files saved, then when I hit refresh it slowly loads up the other files.

what can i do to test the storage and make sure its working properly?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39199637
Here are the VMKernel Log files from source and destination server.
vmkernel-dest.log
vmkernel-source.log
0
 
LVL 118
ID: 39199690
okay, what's your storage?

inaccessible, is likely when the storage has disappeared from the ESXi host?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39199797
Its a RAID10 setup.. running Perc 5 cards.
yeah for some reason it does that sometimes.. then when I hit refresh, it comes back online.

any ideas?
0
 
LVL 118
ID: 39199804
That's very odd for local storage, I've seen it on remote storage.

I would check firmware of storage controller, and disks are up to date, and check driver for ESXi is the correct upto date driver for your card.

Are you using ESXi (OEM Dell version, from Dell Support Site and Download).

Check no issue with RAID (virtual disks) in the Storage BIOS.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39200957
I agree with Hanccocka, I to have see remote storage unmount and become accessiable but not with local storage.

Here is what I would recommend.
1) Reboot your server and access your Perc controller bios
2) delete your current raid
3) recreate a new raid volume
4) reload Vmware
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39206329
do you mean by reloading Vmware, just plug in the same USB stick? or do you recommend reinstalling the software on the USB as fresh?

Also, can you give some light on updating the drivers for ESXi?
No, we are not using the Dell version of ESXi.

thanks!
0
 
LVL 118
ID: 39206350
1. Download the latest firmware DVD from Dell and update firmwares.

2. Download ESXi from DELL, and re-install, it will not overwrite datastore or VMFS.

3. Then check if symptoms persist, with this inaccessible datastore.

4. Check RAID Virtual Disk is not faulty using Storage Contoller BIOS at startup.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39206383
do you have the link to download ESXi from Dell?
The server is not Dell brand, only the RAID card is.
0
 
LVL 118
ID: 39206400
I was going to write, enter your Dell TAG Number on the support site, and it will list the software available for your server.

As it's not a Dell server. - Not applicable.

What is the server?

HP, Dell, IBM, or nothing!
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39212101
no brand!
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39212105
i've also recreated the virtual disk multiple times before taking it back onsite.

is it possible to update the RAID card firmware/drivers remotely?
0
 
LVL 118
ID: 39212174
your issue maybe this is not tested or certified hardware.

You would normally boot the Dell server with Dell firmware DVD, but that may not run because you have a non Dell system. Also the RAID card could also have issues running in a non Dell server.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39212191
You can update the storage firmware remotely if  you have access to a IP KVM console or iLO connection to the server.

As for VMware supported hardware in your server if something isn't certificate they will not support it if something goes wrong. This doesn't mean if would work it just means your on your own if you run into issues with VMware.

Let me know if you need help with the PERC firmware update.

BTW, what make and model Motherboard, NIC and HD's is ypur server using
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39282855
sorry for not responding to this question in a while.. but for some reason it looks like the RAID card is working properly now as I was able to create a VM and its been running fine for the last couple of days.

Now the question is with migrating some of the current VMs to this host. I think the only issue here is that the "replica volume" is not present anymore and VM is trying to move it with the guest.

Is there a way to exclude this from the migration? I don't see it listed in the hard drives under VM settings.

thanks.
0
 
LVL 118
ID: 39282881
could you explain what you mean by replica volume?

do you mean datastore is missing?
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39284055
Are you using ESXi 5.1 Vm replication???
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39294219
from what i can see that the VMs were previously created (by the former IT guys) from a template and there is a replica vhd file that the VMs can't find when I try to migrate.
The VMs run properly though when started.

I'll try to get a screenshot of the error in a bit.

no we're not using replication.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39294499
What version of ESXi our you using and what license level?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39300284
we're using VMWare ESXi 5.0.0 (build 469512)
License Features:
Product Features:
    Up to 32-way virtual SMP
    vCenter agent for VMware host
    vStorage APIs
    VMsafe
    vSphere HA
    Hot-Pluggable virtual HW
    vMotion
    vSphere FT
    vSphere Data Recovery
    vShield Zones
    vSphere DRS
    Storage vMotion
    MPIO / Third-Party Multi-Pathing
    vSphere Distributed Switch
    Host profiles
    Remote virtual Serial Port Concentrator
    Storage I/O Control
    Direct Path vMotion
    vAAI
    Shared Smart Card Reader
    Storage DRS
    Profile-Driven Storage
    vMotion Metro
    vSphere Auto Deploy
    vSphere View Accelerator

I've also attached a screenshot of the error regarding a disk that the VM couldn't find.
replicavmdk.PNG
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39300300
that replica file used to be on HOST1 (server that we just rebuilt and wiped its disk, setup its RAID).
Before we setup the RAID on HOST1, I tried moving all files from its datastore but couldn't move those replica vmdk files somehow. Thinking that its not required (because I didnt see it listed in the VM configuration, we just went and wiped the disks and setup RAID.


any ideas? how can i move the VM without ESX looking for that replica vmdk file that doesn't exist anymore?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39300318
to add we use View Composer for creating the VMs. (setup by previous IT)
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39300658
I noticed you are licensed for Storage vMotion ...

Try the suggestion in the following KB regarding failed storage migrations:
 
http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2038497
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39302113
can i use the CLI to run the commands? or ssh?
0
 
LVL 118
ID: 39302120
have you tried manually moving or copying the files at the console?
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39303114
the file is not there anymore. the previous datastore on HOST1 that stored the "replica" vmdk has been reconfigured/wiped for RAID. (they didnt have RAID before)
0
IT, Stop Being Called Into Every Meeting

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 
LVL 118
ID: 39303128
so just to recap, you have a vmdk, which cannot be moved because a file is missing?

if you look at the summary for the VM, does it show two datastores?
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39303292
Any way for you to upload a screen shot of what files you are seeing with this VM???
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39307790
Here are the screenshots.

From the tasks view - You can see that it fails when VMware tries to copy "replica-xxxx.vmdk". This file used to live on the HOST1 datastore (but has now been wiped and reconfigured with RAID, new datastore)

These are the 4 disks of the computer.. no disks related to "replica"

The datastore that the computer is using - living on HOST3, and esx3_DS2 datastore

Here are the replica files seen from "Hosts and Clusters" view, note that they are now greyed out and inaccessible.
desktop16-tasks.PNG
disk1.PNG
disk2.PNG
disk3.PNG
disk4.PNG
datastore.PNG
replica-file.PNG
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39307887
0
 
LVL 118
ID: 39308062
you can modify the VMX file, using WinSCP or SSH remotely, or from the console.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39308105
i just tried migrating a fresh VM (not a clone, new install) from HOST1 to HOST3 and got an error.
Could this be an issue with the network or HOST1 itself?

@hanccocka - i can't connect to the hosts using SSH for some reason. and i work remotely so I dont have access to the console.
migrate-VM1-error.PNG
0
 
LVL 118
ID: 39308834
if you cannot migrate a normal VM, this is an issue with your network/host.

see my EE article

HOW TO: Enable SSH Remote Access on a VMware vSphere Hypervisor 5.1 (ESXi 5.1)
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39311320
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39315966
sorry i'm very limited with running commands.. so i dont even know how to open the vmkernel logs.

but.. i checked the block size from each datastores and they are all set to 1MB.

any other ideas?
0
 
LVL 118
ID: 39316750
upload the vmx file here for the VM
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39318199
what type of storage controller are you using?

Please include the driver version as well.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39327237
please see attached file for the vmx file of the VM.

HOST1 - PERC 5e
HOST 3 - PERC H700

How do I get the driver version?
Desktop-16.vmx.log
0
 
LVL 118
ID: 39327326
let me have a look at this vmx file?
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39327352
try setting your display memory to default /auto and set your number of displays to 1.

Also make sure your devices like: cd-rom, floppy or another I/O port are set to connect to the host directly.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39333544
@hanccocka - go ahead.
@compdigit44 - i've disconnected the devices temporarily so that it wont affect the migration, i'll try the memory. why would the error be related to the display memory though??
0
 
LVL 118
ID: 39333618
okay remove the lines in the vmx file with reference to replica vmdk

if this vmdk and datastore no longer exist
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39333927
I'm try to simply the VM as much as possible for troubleshooting..

Also, try reducing your vmotion-checkpoint size to:  134217728
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39394677
@hanccocka - how would i remove the lines in the vmx files? where would i edit them? that's exactly what we need done so that it doesnt look for it anymore.
0
 
LVL 118
ID: 39394688
you can edit it on the server, or using WinSCP if not comfortable with editing tools on the server.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39396586
do i just open the file from the datastore or?
can you provide some basic steps? i'll see what I can find.

thanks!
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39396665
i opened up the vmx file from the datastore and could not find any references to the replica files.

see attached file
Desktop-16.vmx.txt
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39396699
Check out this link in you VMX file:


scsi1:0.fileName = "Desktop-16-vdm-disposable-ceb88168-98e2-4c57-a10c-9f0819829ec4.vmdk"
0
 
LVL 118
ID: 39396797
delete that line.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39396834
After you edit the VMX file make sure you do not save it on your ESXi server with the .txt file extension
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39396846
that's an actual drive that they use though.. that's part of how the VMs were configured with VMWare View.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39396863
I belive this is the drive your clients are using:

scsi1:1.fileName = "Desktop-16-vdm-user-disk-D-ceb88168-98e2-4c57-a10c-9f0819829ec4.vmdk
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39396897
ok i'll try deleting it and see what happens.
pretty sure they have a C:\, D:\ and E:\ (disposable)
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39396911
ok i deleted the line..

and got this error when trying to start it up.

An unexpected error was received from the ESX host while powering on VM vm-166.
We will respond on the basis of your support entitlement.
 To collect data to submit to VMware technical support, run "vm-support".
You can request support and include the contents of the log file and the core file.  
A core file is available in "/var/core/vmx-zdump.000".  
A log file is available in "/vmfs/volumes/4fd227bf-5c96ffc0-5063-d4ae528beff1/Desktop-16/vmware.log".  
VMware ESX unrecoverable error: (vmx) Unexpected signal: 11.

Failed to configure disk scsi1:0. The virtual machine cannot be powered on with an unconfigured disk.
Incorrect parameter scsi1:0.fileName: no file specified.
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39397049
ok i deleted this line. so nothing is being referenced to the disposable disk at all.
I got page file errors once I tried booting up..

scsi1:0.present = "true"
scsi1:0.fileName = "Desktop-16-vdm-disposable-ceb88168-98e2-4c57-a10c-9f0819829ec4.vmdk"
scsi1:0.mode = "independent-persistent"
scsi1:0.deviceType = "scsi-hardDisk"
sched.scsi1:0.shares = "normal"
sched.scsi1:0.throughputCap = "off"

Tried deleting this line and operating system cannot be found.

scsi0:0.present = "true"
scsi0:0.fileName = "replica-b1d692c2-cb98-41ba-84b0-.vmdk"
scsi0:0.deviceType = "scsi-hardDisk"
sched.scsi0:0.shares = "normal"
sched.scsi0:0.throughputCap = "off"
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39397086
also one thing i noticed is the replica file resides in the folder of the VM, so technically it should be able to copy from it to the other host.
0
 
LVL 19

Expert Comment

by:compdigit44
ID: 39397196
Can you please upload a current copy of your VMX file post changes...
0
 
LVL 1

Author Comment

by:andrew_transparent
ID: 39560105
Will try it and update you asap! thx
0
 
LVL 1

Accepted Solution

by:
andrew_transparent earned 0 total points
ID: 40288400
The server ended up crashing and we've replaced it with a server with a compatible RAID card supported by VMWare...
Thanks for your suggestions and comments
0

Featured Post

Highfive + Dolby Voice = No More Audio Complaints!

Poor audio quality is one of the top reasons people don’t use video conferencing. Get the crispest, clearest audio powered by Dolby Voice in every meeting. Highfive and Dolby Voice deliver the best video conferencing and audio experience for every meeting and every room.

Join & Write a Comment

HOW TO: Install and Configure VMware vSphere Hypervisor 6.5 (ESXi 6.5), Step by Step Tutorial with screenshots. From Download, Checking Media, to Completed Installation.
In this article, I show you step by step with screenshots to assist you - HOW TO: Deploy and Install the VMware vCenter Server Appliance 6.5 (VCSA 6.5), with some helpful tips along the way.
Advanced tutorial on how to run the esxtop command to capture a batch file in csv format in order to export the file and use it for performance analysis. He demonstrates how to download the file using a vSphere web client (or vSphere client) and exp…
This Micro Tutorial walks you through using a remote console to access a server and install ESXi 5.1. This example is showing remote access and installation using a Dell server. The hypervisor is the very first component of your virtual infrastructu…

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now