hyper-V migration failed now corrupt can not start

Posted on 2012-08-24
Last Modified: 2012-09-04
im trying to figure out how to effectivly use my equallogic SAN with hyperv.

I started by creating a large volume on my SAN and attaching both my hyper-v hosts to it. i even gave it the same drive letter.
I then setup a new vm on one server and put the files on that volume.

I then tried to migrate that vm to the other hyper-v host using VMM and it failed with:
Error (2903)
VMM could not locate the specified file K:\XenApp\config.xml on the server. This file might be required as part of another object.
 (The system cannot find the file specified (0x80070002))

I was like bumber, ok ill just use it on original server.  But now i cant start it.

I tried to do an "undo" which gave me this

Error (12700)
VMM cannot complete the Hyper-V operation on the server because of the error: 'XenApp' failed to remove snapshot. (Virtual machine ID 4AE02CDA-0131-48C9-A117-CB208D6EB880)

Cannot delete snapshot: The file or directory is corrupted and unreadable. (0x80070570). Snapshot ID 88FF00E6-4DD2-4020-B527-95A67E32D9D0.
 (Unknown error (0x8000))

not feeling good about hyper-v so far. I had much better luck with xenserver.

It gets wierd now. if i look at the contents of the VOlume i mapped to both servers (which is the exact same volume) they have different results.  How is this possible? im so confused.
Question by:ecszone
    LVL 56

    Accepted Solution

    At first glance, it appears as though you did not set up a clustered shared volume, but attached each hyper-v node to the same LUN directly. Since NTFS is a local filesystem it does not expect this nor know how to handle contention issues, thus corruption occurs.

    You have three options

    You can give each hyper-v server its own disk, which will allow VMs tobe migrated or moved offline

    You set up the two hyper-v servers as a fail-over cluster and still give each disk their own LUN (not shared.) There is a rigid set of tests that must pass before the nodes will be allowed to join the cluster, and it is these tests that ensure that both nodes will pass ownership of the LUNs properly for a love migration.

     Ideally, youcan set up a failover cluster and you'd want to set up a clustered shared volume using one LUN. this removed the need for multiple LUNs and resolves many difficulties with managing shared storage.
    LVL 41

    Expert Comment

    I agree with cgaliher and it sounds like you didn't understand how to cluster storage and you have now corrupted your volume. The corruption is not specific to Hyper-V and can happen with anytime you improperly try to connect multiple servers to the same LUN. Hopefully you have a backup or snapshot of the volume. Otherwise, the whole thing is probably trash.

    I highly suggest you read the following EqualLogic documentation for deployment with Hyper-V. The recommended deployment model for storage with Hyper-V clusters is to use CSV.

    Microsoft Hyper-V with PS Series Arrays

    For a step-by-step guide on Hyper-V™ Failover Clustering see the Microsoft® TechNet
    LVL 11

    Author Comment

    I found something about NTFS not being cluster aware shortly after posting this.  You guys confirmed my findings.  I have never created a cluster.
    Xenserver must auto do all this w/o me even knowing.
    Ill be honest, xenserver is a far superior VM platform from what I can tell.  The reason I am moving away from it is because when there is some odd little issue, i don't know how to troubleshot linux, and there are like 2 people in the world that have any decent knowledge of xenserver and how to fix common problems.

    So im not about to also learn clustering and all that goes with it for this project.  I guess I can throw away featuers like HA and live migration :(  
    With those things aside my next concern is, what if this server has  a hardware failure. I could lose 10+ VM's all at the same time. That sounds aweful.  I guess if i had another serveri could attach to the LUN and somehow get it to run on a new host?
    is that hard? Its obviously very manual, but honestly i almost never had hardware failures KNock on wood. I cycle my servers out every 4-5 years.  MOst issues i have had are simple, (controller warnings, bad disks in an array, etc, nothing that stopped me from working)

    SO if i can quickly bring these servers up again manually on another server by connecting to a new LUN on a seperate hyperv host, i guess thats acceptable, just disapointing vs what I am used to.

    I do like how i can install y equallogic hitkit finally and use multipathing.  IN xenserver you need linux skillz and unicorn dust to get it to work, I never did. I used bonding which i think sucked.

    Thanks guys for the information so far.
    LVL 11

    Author Comment

    also, how many VM's can i put on a LUN?  is it bad for performance to put all vms on 1 hyperv host in the same equallogic volume/lun?

    the way vmm seems to manage vm's (you pick a default location in the host settings) leads me to believe its ok to put a few or bunch or all vm's in the same place. (VHD)

    although, I know i had performance issues in the past if i extracted a 30Gb rar file to the same LUN as the original rar file.
    \If i created a second lun, and extracted it to that, it was about 95% faster.  The NIC was nowhere near max, nor was the SAN.  I think its something to do with how windows handles storage, but im not sure. SO thats why I question putting a bunch of VM"s on the same LUN.

    LVL 41

    Assisted Solution

    I have never used Xenserver, but I hear that it is quite capable, though it only seems to have traction for cloud providers, so supportability for regular businesses seems to be a problem. Yes, it should have hidden all of the clustering filesystem and such from you.

    IMHO your best option is to look over the documentation I provided on how to setup clustering. It takes a little bit of time, but not too much. The clustering wizard does just about everything for you. You will need to ignore the warning that you have multiple NICs on the same subnet. You should have two NICS per host on the iSCSI network for EqualLogic, but the clustering wizard will flag that as a warning.

    If you insist on keeping the hosts as stand alone, you will need to keep the VMs for each host on their own LUN, so that the hosts don't share any storage. To bring the VMs up on the other host, you will need to modify the ACL on the LUN to give the new host access, and disable access to the old host. Each VM will need to be manually recreated on the new host and then point them to the existing VHD files. You will need to recreate any static network settings in the VMs because the VMs will see a new NIC when moved to the new host. Since you are used to clustering, I don't think that you'll be happy going back. Do the clustering, it is worth it.

    A possible clustering gotcha it to make sure that you have a separate, preferably physical domain controller. Microsoft clustering requires Active Directory to be available.

    You can generally put as many VMs as you want on a LUN. There should be little difference performance wise between one large LUN with many VMs, and smaller LUNs with fewer VMs.
    LVL 11

    Author Comment

    we went with xenserver bc it was and myabe still is more efficent at running xenapp. we have a large xenapp farm.  that is what i want to move because ironicly thats where im noticing performance issues.  I cant install the hitkit which is what the recommendation is by equallogic.  I cant even specifiy jumbo frames etc in the version i have. I think you can in xenserver 6 though.

    I currently only have 1 server to use for this  I will add more in a few months once i have it working. (this would have been ok with xenserver)  but i dont think i can create a cluster with one server.

    Maybe i need to re-evaluate and checkout all my options vmware/xenserver6/hyperv server 2012/hyperv current.

    Thanks for all your useful insight. its nice to have someone knowledgeable reply.
    LVL 41

    Expert Comment

    I believe that Citrix actually puts more development towards XenApp on Hyper-V than XenApp on XenServer. Features seem to get released for Hyper-V first. It wouldn't surprise me if Citrix eventually stops targeting XenServer for the enterprise market because they have so little traction there. They seem more than willing to continue to partner with Microsoft to support XenApp on Hyper-V.

    I haven't looked at Hyper-V 2012 yet.

    Write Comment

    Please enter a first name

    Please enter a last name

    We will never share this with anyone.

    Featured Post

    New My Cloud Pro Series - organize everything!

    With space to keep virtually everything, the My Cloud Pro Series offers your team the network storage to edit, save and share production files from anywhere with an internet connection. Compatible with both Mac and PC, you're able to protect your content regardless of OS.

    Suggested Solutions

    Citrix XenDesktop 7.6 Citrix Policies Graphics
    VMware Update Manager(VUM) “error code: 15” during ESXi 6.0 Remediate update in VUM operation
    This tutorial will walk an individual through locating and launching the BEUtility application to properly change the service account username and\or password in situation where it may be necessary or where the password has been inadvertently change…
    This tutorial will show how to inventory, catalog, and restore media from legacy versions of Backup Exec into both 2012 and 2014 versions of the software. Select Storage from the tabs along the ribbon bar as the top: Ensure the proper storage devi…

    759 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    10 Experts available now in Live!

    Get 1:1 Help Now