?
Solved

How to setup LDOM redundancy for multiple Guest Domains connected to SAN

Posted on 2010-08-12
5
Medium Priority
?
2,065 Views
Last Modified: 2013-12-21
I have a T5240 server with 2 fiber channel cards.  This server has two PCI buses, so I am looking into setting up two I/O domains -- one for each PCI bus.  I am confused on how to setup the FC cards and multipathing to support multiple guest domains.  If each I/O domain controls one FC card then I'm assuming multipathing can't be setup at the I/O domain level but I'm not sure it can be setup at the guest domain level either.  In addition, if there are multiple guest domains then I'm assuming I would need NPIV to be able to use the same FC cards for all the guest domains.  So how would this work?  Without NPIV would I need a separate set of FC cards for each guest domain?  
0
Comment
Question by:macklinj
  • 3
  • 2
5 Comments
 
LVL 13

Expert Comment

by:Rowley
ID: 33427326
In this case, your secondary i/o domain will also become a service domain once you create your vdiskserver service and share vdisk devices to other hosts. You multi-pathing software within the guest that is using resources from these services domains (your primary + i/o domain) will work out which devices are available.

Because only the service domains need to have control over your hba's - remember, you're creating vdiskserver services in each i/o domain - then any guests using these services only need to ever worry about the disk devices presented to them.

Any clearer?
0
 

Author Comment

by:macklinj
ID: 33448956
Hi Rowley,

It's getting clearer.  I am working on setting this up so I may have an additional question in a couple of days.
0
 

Author Comment

by:macklinj
ID: 33503423
The Sun Blue Print, "LDOMs I/O Best Practices", states "If the server’s two PCI buses are allocated to each of two I/O domains, however, two host bus adapters can be configured to provide access to external storage through two PCI Express slots via two I/O domains. Redundancy and resiliency can then be established in the guest domain with software mirroring such as that provided by Solaris Volume Manager software."  

Hence, multipathing cannot be done in the Guest domain.  I'm guessing when NPIV support is added to Solaris you will be able to do multipathing in the Guest domain.
0
 

Accepted Solution

by:
macklinj earned 0 total points
ID: 33506372
From Octave Orgeron's "An Introduction to Logical Domains":

SAN storage has many benefits, including performance, reliability, and
portability among servers. Solaris 10 and above include support for SAN
connectivity. Although third-party drivers and FC HBAs may work on standalone
servers, they may not work with LDoms. This is also true with SAN
multi-pathing software. STMS (a.k.a. MPXIO) should be utilized. STMS can
only be utilized in a service domain that has direct access to the FC HBAs,
such as the primary domain. The SAN infrastructure and multi-pathing are
completely transparent to guest domains. This situation will change in the
future when FC HBAs can be virtualized using NPIV, which provides guest
domains with a virtualized FC HBA instance [3]. Here is an example of virtualizing
SAN storage.
0
 
LVL 13

Expert Comment

by:Rowley
ID: 33508669
Thanks for sharing, useful to know next time I'm asked to multipath within a guest.
0

Featured Post

Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Windows Server 2003 introduced persistent Volume Shadow Copies and made 2003 a must-do upgrade.  Since then, it's been a must-implement feature for all servers doing any kind of file sharing.
Among the most obnoxious of Exchange errors is error 1216 – Attached Database Mismatch error of the Jet Database Engine. When faced with this error, users may have to suffer from mailbox inaccessibility and in worst situations, permanent data loss.
In this video, Percona Director of Solution Engineering Jon Tobin discusses the function and features of Percona Server for MongoDB. How Percona can help Percona can help you determine if Percona Server for MongoDB is the right solution for …
In this video, Percona Solutions Engineer Barrett Chambers discusses some of the basic syntax differences between MySQL and MongoDB. To learn more check out our webinar on MongoDB administration for MySQL DBA: https://www.percona.com/resources/we…
Suggested Courses
Course of the Month8 days, 21 hours left to enroll

621 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question