[Last Call] Learn how to a build a cloud-first strategyRegister Now

  • Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 3799
  • Last Modified:

hyper-V migration failed now corrupt can not start

im trying to figure out how to effectivly use my equallogic SAN with hyperv.

I started by creating a large volume on my SAN and attaching both my hyper-v hosts to it. i even gave it the same drive letter.
I then setup a new vm on one server and put the files on that volume.

I then tried to migrate that vm to the other hyper-v host using VMM and it failed with:
Error (2903)
VMM could not locate the specified file K:\XenApp\config.xml on the hypervhost2.domain.com server. This file might be required as part of another object.
 (The system cannot find the file specified (0x80070002))

I was like bumber, ok ill just use it on original server.  But now i cant start it.

I tried to do an "undo" which gave me this

Error (12700)
VMM cannot complete the Hyper-V operation on the hypervhost2.domain.com server because of the error: 'XenApp' failed to remove snapshot. (Virtual machine ID 4AE02CDA-0131-48C9-A117-CB208D6EB880)

Cannot delete snapshot: The file or directory is corrupted and unreadable. (0x80070570). Snapshot ID 88FF00E6-4DD2-4020-B527-95A67E32D9D0.
 (Unknown error (0x8000))

not feeling good about hyper-v so far. I had much better luck with xenserver.

It gets wierd now. if i look at the contents of the VOlume i mapped to both servers (which is the exact same volume) they have different results.  How is this possible? im so confused.
  • 3
  • 3
2 Solutions
Cliff GaliherCommented:
At first glance, it appears as though you did not set up a clustered shared volume, but attached each hyper-v node to the same LUN directly. Since NTFS is a local filesystem it does not expect this nor know how to handle contention issues, thus corruption occurs.

You have three options

You can give each hyper-v server its own disk, which will allow VMs tobe migrated or moved offline

You set up the two hyper-v servers as a fail-over cluster and still give each disk their own LUN (not shared.) There is a rigid set of tests that must pass before the nodes will be allowed to join the cluster, and it is these tests that ensure that both nodes will pass ownership of the LUNs properly for a love migration.

 Ideally, youcan set up a failover cluster and you'd want to set up a clustered shared volume using one LUN. this removed the need for multiple LUNs and resolves many difficulties with managing shared storage.
I agree with cgaliher and it sounds like you didn't understand how to cluster storage and you have now corrupted your volume. The corruption is not specific to Hyper-V and can happen with anytime you improperly try to connect multiple servers to the same LUN. Hopefully you have a backup or snapshot of the volume. Otherwise, the whole thing is probably trash.

I highly suggest you read the following EqualLogic documentation for deployment with Hyper-V. The recommended deployment model for storage with Hyper-V clusters is to use CSV.

Microsoft Hyper-V with PS Series Arrays

For a step-by-step guide on Hyper-V™ Failover Clustering see the Microsoft® TechNet
article: http://technet.Microsoft.com/en-us/library/cc732181.aspx.
EricIT ManagerAuthor Commented:
I found something about NTFS not being cluster aware shortly after posting this.  You guys confirmed my findings.  I have never created a cluster.
Xenserver must auto do all this w/o me even knowing.
Ill be honest, xenserver is a far superior VM platform from what I can tell.  The reason I am moving away from it is because when there is some odd little issue, i don't know how to troubleshot linux, and there are like 2 people in the world that have any decent knowledge of xenserver and how to fix common problems.

So im not about to also learn clustering and all that goes with it for this project.  I guess I can throw away featuers like HA and live migration :(  
With those things aside my next concern is, what if this server has  a hardware failure. I could lose 10+ VM's all at the same time. That sounds aweful.  I guess if i had another serveri could attach to the LUN and somehow get it to run on a new host?
is that hard? Its obviously very manual, but honestly i almost never had hardware failures KNock on wood. I cycle my servers out every 4-5 years.  MOst issues i have had are simple, (controller warnings, bad disks in an array, etc, nothing that stopped me from working)

SO if i can quickly bring these servers up again manually on another server by connecting to a new LUN on a seperate hyperv host, i guess thats acceptable, just disapointing vs what I am used to.

I do like how i can install y equallogic hitkit finally and use multipathing.  IN xenserver you need linux skillz and unicorn dust to get it to work, I never did. I used bonding which i think sucked.

Thanks guys for the information so far.
Cyber Threats to Small Businesses (Part 1)

This past May, Webroot surveyed more than 600 IT decision-makers at medium-sized companies to see how these small businesses perceived new threats facing their organizations.  Read what Webroot CISO, Gary Hayslip, has to say about the survey in part 1 of this 2-part blog series.

EricIT ManagerAuthor Commented:
also, how many VM's can i put on a LUN?  is it bad for performance to put all vms on 1 hyperv host in the same equallogic volume/lun?

the way vmm seems to manage vm's (you pick a default location in the host settings) leads me to believe its ok to put a few or bunch or all vm's in the same place. (VHD)

although, I know i had performance issues in the past if i extracted a 30Gb rar file to the same LUN as the original rar file.
\If i created a second lun, and extracted it to that, it was about 95% faster.  The NIC was nowhere near max, nor was the SAN.  I think its something to do with how windows handles storage, but im not sure. SO thats why I question putting a bunch of VM"s on the same LUN.

I have never used Xenserver, but I hear that it is quite capable, though it only seems to have traction for cloud providers, so supportability for regular businesses seems to be a problem. Yes, it should have hidden all of the clustering filesystem and such from you.

IMHO your best option is to look over the documentation I provided on how to setup clustering. It takes a little bit of time, but not too much. The clustering wizard does just about everything for you. You will need to ignore the warning that you have multiple NICs on the same subnet. You should have two NICS per host on the iSCSI network for EqualLogic, but the clustering wizard will flag that as a warning.

If you insist on keeping the hosts as stand alone, you will need to keep the VMs for each host on their own LUN, so that the hosts don't share any storage. To bring the VMs up on the other host, you will need to modify the ACL on the LUN to give the new host access, and disable access to the old host. Each VM will need to be manually recreated on the new host and then point them to the existing VHD files. You will need to recreate any static network settings in the VMs because the VMs will see a new NIC when moved to the new host. Since you are used to clustering, I don't think that you'll be happy going back. Do the clustering, it is worth it.

A possible clustering gotcha it to make sure that you have a separate, preferably physical domain controller. Microsoft clustering requires Active Directory to be available.

You can generally put as many VMs as you want on a LUN. There should be little difference performance wise between one large LUN with many VMs, and smaller LUNs with fewer VMs.
EricIT ManagerAuthor Commented:
we went with xenserver bc it was and myabe still is more efficent at running xenapp. we have a large xenapp farm.  that is what i want to move because ironicly thats where im noticing performance issues.  I cant install the hitkit which is what the recommendation is by equallogic.  I cant even specifiy jumbo frames etc in the version i have. I think you can in xenserver 6 though.

I currently only have 1 server to use for this  I will add more in a few months once i have it working. (this would have been ok with xenserver)  but i dont think i can create a cluster with one server.

Maybe i need to re-evaluate and checkout all my options vmware/xenserver6/hyperv server 2012/hyperv current.

Thanks for all your useful insight. its nice to have someone knowledgeable reply.
I believe that Citrix actually puts more development towards XenApp on Hyper-V than XenApp on XenServer. Features seem to get released for Hyper-V first. It wouldn't surprise me if Citrix eventually stops targeting XenServer for the enterprise market because they have so little traction there. They seem more than willing to continue to partner with Microsoft to support XenApp on Hyper-V.

I haven't looked at Hyper-V 2012 yet.

Featured Post

2017 Webroot Threat Report

MSPs: Get the facts you need to protect your clients.
The 2017 Webroot Threat Report provides a uniquely insightful global view into the analysis and discoveries made by the Webroot® Threat Intelligence Platform to provide insights on key trends and risks as seen by our users.

  • 3
  • 3
Tackle projects and never again get stuck behind a technical roadblock.
Join Now