Solved

Hyper V / FCM CSV migrations

Posted on 2012-03-16
13
1,945 Views
Last Modified: 2012-06-27
I have a Server 2008 r2 sp1 Hyper V 2 node cluster. All software is up to date.
We are connected to our Netapp SAN via iSCSI.
Historically we had our Virtual guests in a 1:1 vol/lun ratio, each volume on our storage contained 1 lun and each lun had a unique drive letter assigned to it.
As the story goes we started to run out of drive letters so I researched Cluster Shared Volumes and liked what I found so I implemented them. The CSV config went well and we are running 25% of our VM's on CSV's. I can move and live migrate the 1:1 vol/lun VM's we have, but are looking to upgrade everything to CSV.

The problem I am having is moving or Live Migrating the CSV's. The CSV VM's fail at the end of the migration and Move back to the host I was trying to move them from. The only way I can move the CSV's is to shutdown > move > start. In Failover cluster manager I think the failure happens because the "Current Owner" under Cluster Shared Volumes does not change.

I have tried both from SCVMM and Failover Cluster Manager same result with both.
I have added dedicated Live Migration NIC's and set the metrics and roles on all nics appropriately.
All Networks in FCM have the same name.

I have exhausted my novice CSV knowledge and would appreciate any help!

thank you
0
Comment
Question by:Trivita
  • 7
  • 6
13 Comments
 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37731929
Normally this is caused by problems with the virtual network names. You can test this out by taking a VM and disconnecting it from all networks and then try to live migrate it. If it works, then your problem is in the virtual network configuration, in which case I usually rebuild all of the virtual networks on all hosts. The CSV owner normally doesn't ever change unless the owner is rebooted, or you manually switch it.

FWIW, I don't use any dedicated live migration or cluster networks. I configure networking for my hosts and then whatever virtual networks I need for VM configuration.
0
 

Author Comment

by:Trivita
ID: 37740211
I removed the virtual network
Tried every scenario Move/ Quick Migration/ Live migration
Each attempt failed, the only way I can successfully migrate is if im migrating to the owner (host) of the CSV.

Added the virtual network back and got the same results.


I found an interesting article
http://www.simple-talk.com/sysadmin/virtualization/hyper-v-r2-live-migration/

The Using Hyper-V with CSV storage section of the document states to add following paths to hyperv manager > ...

C:\ClusterStorage\Volume1\Hyper-V\Virtual Hard Disk
C:\ClusterStorage\Volume1\Hyper-V

1. We have 10 volumes under CSV, can the path just be C:\ClusterStorage ?
2. Since we have both regular virtual guests and CSV guests on the same highly available host environment, a path is already in the Hyper-V settings for VHD and VM locations...below

-C:\Users\Public\Documents\Hyper-V\Virtual Hard Disks  (this location has no data in it so doesn't look like an issue if I change it)
-C:\ProgramData\Microsoft\Windows\Hyper-V                      (this location has data that has today's date...like it is being used)

I am just afraid that if I change what appears to be a global setting i will break the non CSV vm's.
0
 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37740390
The configuration data for your CSV based VMs needs to be under c:\clusterstorage\CSVVolumeName . If it is under anything else, those files are not available to other nodes in the cluster. The snapshot file location should also be there.

You may need to use SCVMM to migrate the storage of the VMs to the C:\ClusterStorage\Volume1 CSV path. Why do you have so many CSVs? Are you just converting your old LUNs without consolidating them?

You can't have things under just c:\clusterstorage because that is the root of the mount points to the CSV volumes.
0
 

Author Comment

by:Trivita
ID: 37743274
I have attached a file with some screen shots and questions...

The attachment also contains answers to your questions...

Thank you for your continued support
0
 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37743785
I don't see any attachments.
0
 

Author Comment

by:Trivita
ID: 37744302
oops..attached
hyperv-questions.docx
0
How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37755493
The screen shots of Volume2 look okay. You only have 1 VM there, which defeats the main benefits of CSV which is to have many VMs on a single volume. The ClusterHBFile is used for coordinating access to the files on the CSV, I believe.

As long as everything is under VolumeX, you are okay.

The two things that I can think of that would prevent a Live Migration are incompatable network names, and processor incompatability. Have you made sure that the processor compatability option is checked under the processor section of the VM? Your servers are ALL Intel or ALL AMD, right? What happens if you try to do a quick migration?

FYI, I will be generally unavailable until Tuesday.
0
 

Author Comment

by:Trivita
ID: 37757936
I have triple checked the network names.
Verified the procs are all the same on the dell PE 2950's
I have checked the proc compatibility option...did not fix.

Quick and Live migration both fail.
It appears they fail right at the end when they try to turn on the vm or activate memory pages on the other host.

To add a side note, we have VM's that existed pre R2 so they have not been migrated to CSV's. These non CSV VM guests Live Migrate without a problem.

About to call Microsoft since I have reached the end of the internet trying to find a solution. I will update the ticket if they find the issue.
But by all means respond if you want me to try anything else you can think of.

thank you for your continued support!
0
 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37769923
Just so I am clear, if you take a VM that you can not Live Migrate or quick migrate, if you shut it down, you can migrate it? Very strange.
0
 

Accepted Solution

by:
Trivita earned 0 total points
ID: 37789076
Resolved...

We adjusted some network settings which helped.
In the end it ended up being A/V removal.
CSV's must migrate differently then regular vm's.
Sophos was blocking the migration even though we had followed best practice on exclusions for A/V according to sophos and microsoft.

Below is the list of steps we performed on the Live migration case.
 
1)      Check the Disk by moving between the nodes. If the disk is not coming online then we need to troubleshoot on disk connectivity.

2)      Checked the Quick migration of the Virtual machines.

3)      Change the ownership of the CSV volume and then tried Quick Migration.

4)      Check the Virtual Machine`s VHD location. It should point the right Clusterstorage\volume *

5)      Tried Dummy Virtual machine (without VHD ) to see if that works fine.

6)      Tried attaching the VHD and then try the Quick and Live Migration

7)      Check the Binding order on all the node it should be in the following manager (Public network | Heartbeat | Storage | Live Migration | hyper-v network)

8)      Check the Antivirus and removed it.
0
 

Author Comment

by:Trivita
ID: 37789086
where my points at?
0
 
LVL 42

Expert Comment

by:kevinhsieh
ID: 37789239
Wow, that was a lot of troubleshooting. I haven't gotten to the point of getting Sophos to run on my Hyper-V Server hosts, so I guess that has saved me. Files on CSV are different because the drive never detaches from the hosts, which may be causing the problems...maybe Sophos is trying to hold onto the files?
0
 

Author Closing Comment

by:Trivita
ID: 37805199
because it working
0

Featured Post

Enabling OSINT in Activity Based Intelligence

Activity based intelligence (ABI) requires access to all available sources of data. Recorded Future allows analysts to observe structured data on the open, deep, and dark web.

Join & Write a Comment

Introduction In one of my previous articles (http://www.experts-exchange.com/Microsoft/Applications/Virtual_Server/Hyper-V/A_10686-Creating-a-Hyper-V-Cluster-on-Windows-2012.html), I explained how to create a native Windows 2012 Cluster.  The metho…
You might have come across a situation when you have Exchange 2013 server in two different sites (Production and DR). After adding the Database copy in ECP console it displays Database copy status unknown for the DR exchange server. Issue is strange…
This tutorial will show how to push an installation of Backup Exec to an additional server in both 2012 and 2014 versions of the software. Click on the Backup Exec button in the upper left corner. From here, select Installation and Licensing, then I…
This tutorial will walk an individual through the steps necessary to join and promote the first Windows Server 2012 domain controller into an Active Directory environment running on Windows Server 2008. Determine the location of the FSMO roles by lo…

758 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

19 Experts available now in Live!

Get 1:1 Help Now