Solved

2008 R2 Dual Node Failover Cluster Storage Access Problem

Posted on 2013-06-05
4
1,611 Views
Last Modified: 2013-06-12
We have 2 x DL380 G7 connected to a HP P2000 in a MS Hyper-v Failover Cluster Configuration for Highly Available VMs.

Setup as follows:
MS iSCSI Initiator on each Node
MS Failover Cluster manager on each Node
SCVMM 2008 R2 on each node
Q:\ Quorum is 500MB in size
CSV is 2.3TB in size
HP P2000 has 2 controllers with 4 ports each. We are using ports A1 and A3 and B1 and B3 for the SAN traffic. Dedciated NICs on each server
Dedicated Cluster Hearbeat using a Crossover cable
Dedicated NICs for the Physical & Hyper-V traffic

This has been operational for 6 months but then a severe power cut upset the complete set-up. After power was restored the CSV on the SAN was offline to both nodes until we ran a Powershell command on Node2

"clear-clusterdiskreservation -disk3"

This brought it online but neither Nodes could access the CSV, only the Quorum was accessible.

After 4 hours of reboots and "fettling" we destroyed the cluster and rebuilt it.

The result now is that Node 1 has the Quorum and can access the CSV c:\clusterstorage\volume1 no problem. Vms are back online and running on Node1.
Node 2 CANNOT access the CSV and when you browse to c:\clusterstorage\volume1 it is empty.

Main error within cluster manager is:

Cluster Shared Volume 1Volume1" (Cluster Disk 2) is no longer accessible from this cluster node because of error "ERROR_CANT_ACCESS_DOMAIN_INFO (1351)".

Research suggests changing the cluster service to Automatic Delayed Start which has had no effect.

Lots of research and attempts to fix the issue have resulted in nought. Problem is that the servers are live and in use by one of our clients so before they have any further downtime we must be certain of a fix, gulp!

Attached are 2 grabs showing the status of disk management on each Node1.
Cluster logs are available.

Anyone got any ideas on where to start?
Node1.JPG
Node2.JPG
0
Comment
Question by:robtheplod
  • 2
  • 2
4 Comments
 
LVL 38

Accepted Solution

by:
Philip Elder earned 500 total points
ID: 39224615
In my experience the disks that are shared between cluster nodes MUST be the same number.

Disk 0 = OS
Disk 1 = Quorum
Disk 2 = VHD/VHDX Storage

What the chicken is that QuikStor doing there? Get rid of it. Run your Cluster Validation Wizard again.

You will probably have to reboot both nodes to get the disks to line up. But, line up they must.

Philip
0
 

Author Comment

by:robtheplod
ID: 39226030
Thank you for the advice Philip.
We will make the changes and will let you know the result.
0
 

Author Comment

by:robtheplod
ID: 39240272
Thanks Philip, you were right on the money. The cluster shared volume is now available to both nodes after removing the Quickstor and rebooting both nodes.
0
 
LVL 38

Expert Comment

by:Philip Elder
ID: 39241434
Excellent. :)

Philip
0

Featured Post

Free Trending Threat Insights Every Day

Enhance your security with threat intelligence from the web. Get trending threat insights on hackers, exploits, and suspicious IP addresses delivered to your inbox with our free Cyber Daily.

Join & Write a Comment

Suggested Solutions

Hello All, I have been training on Multicast for a while now and whenever I start the topic , I find out that my friends /  Colleagues mention that they do not know how to test Multicast Joins. As most of the multicast would be video traffic and …
Microsoft has released remote PowerShell capabilities to all commercial Office 365 customers. So you can be controlled via PowerShell and not from the Office 365 admin center Download Windows PowerShell Module for Lync Online http://www.micros…
This demo shows you how to set up the containerized NetScaler CPX with NetScaler Management and Analytics System in a non-routable Mesos/Marathon environment for use with Micro-Services applications.
When you create an app prototype with Adobe XD, you can insert system screens -- sharing or Control Center, for example -- with just a few clicks. This video shows you how. You can take the full course on Experts Exchange at http://bit.ly/XDcourse.

760 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

17 Experts available now in Live!

Get 1:1 Help Now