Booting to alternate LUN failed in Solaris 11, why?

This is using a SPARC server hardware. This is using Solaris 11, with 2 VMs (using ldm). We used fiber-optics network-based SAN Storage, create LUNs, and allocated for 1 or more for individual VMs. We are using "ldm" commands to manage these VMs. On one of this VM - mcsat1, there is only 1 LUN allocated for the rpool. Now, we wanted to add-in one more LUN to form the "storage pool" (mirrored). After that, we wanted to remove the original LUN and use only the new LUN. Please see attached document for steps we conduct.

c1d3s2 is the new disk added in and kept, and c1d2s0 is the old disk and supposed need to remove. After the detaching, we do the system reboot. However, we faced a problem here - system failed to reboot, with the reason being "boot disk can't find". In this case, we already change the "boot-disk" with command - "ldm set-variable boot-disk=IBM2SAN2 mcsat1".

In "ok" prompt, we typed "boot /virtual-devices@100/channel-devices@200/disk@3" with attempt to boot the system up via this new disk was successful. If you see the document, this IBM2SAN2 is actually refer to "/virtual-devices@100/channel-devices@200/disk@3", booting "IBM2SAN2" failed while "/virtual-devices@100/channel-devices@200/disk@3" passed, why?

Thanks in advance.
Replace-LUN---step-by-step.docx
LVL 1
MichaelBalackSenior System EngineerAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

andyalderCommented:
Changing which LUN it boots from under LDM will have no effect since LDM isn't loaded when the hardware boots. You have to change the hardware boot order under hardware. Whether it is real or virtual hardware it will still boot from the first LUN it sees if this is not set.

ok setenv boot-device device[n]

See SPARC: How to Change the Default Boot Device by Using the Boot PROM in the following document.
https://docs.oracle.com/cd/E26502_01/html/E28983/gkkvs.html

I have not read all your docx but setenv is not there so you haven't set the boot device.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
MichaelBalackSenior System EngineerAuthor Commented:
Hi andyalder,

Thanks for the suggesting article and the opinion.

I roughly played around in this ok PROMPT environment. It looks like the boot-device is best to be defined as, /virtual-devices@100/channel-devices@200/disk@2, instead of originally just, IBM2SAN2.

The commands, "setenv boot-device /virtual-devices@100/channel-devices@200/disk@2", "printenv boot-device", "reset-all", and finally, "boot". System rebooting successfully.

I have a LUN replacement tomorrow. I will update you about the status.
MichaelBalackSenior System EngineerAuthor Commented:
Hi andyalder,

Yes, you are right.

I used the commands below and eventually LUN replaced can be boot without problem.

Type “init 0”, to boot to Boot PROM      

Type “setenv boot-device=/virtual-devices@100/channel-devices@200/disk@1”;
      Type “printenv boot-device”
      Type “reset-all”            * Save the updates
      Type “boot”
MichaelBalackSenior System EngineerAuthor Commented:
Thanks for expert - andyalder, in suggesting the article and pointed out the boot-device didn't updated. By using the commands recommended, the boot-device is updated and can be booting without a problem.

Really appreciated it.
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Server Hardware

From novice to tech pro — start learning today.