Aix VIOS server failing to map second adapter to client. path missing - no child device on cfgmgr.

On a Pureflex Power 460 node the vios server is failing to map with the fcs1 adapter.
The clients are logged in successfully on fcs0.
You can see clients logged into fcs0.$ lsmap -all -npiv
Name          Physloc                            ClntID ClntName       ClntOS
------------- ---------------------------------- ------ -------------- -------
vfchost0      U7895.43X.10EC5BB-V2-C11                1 optim          AIX

Status:LOGGED_IN
FC name:fcs0                    FC loc code:U78AF.001.WZS06ZE-P1-C34-L1-T1
Ports logged in:3
Flags:a<LOGGED_IN,STRIP_MERGE>
VFC client name:fcs0            VFC client DRC:U7895.43X.10EC5BB-V1-C11

Name          Physloc                            ClntID ClntName       ClntOS
------------- ---------------------------------- ------ -------------- -------
vfchost1      U7895.43X.10EC5BB-V2-C12                1

Status:NOT_LOGGED_IN
FC name:                        FC loc code:
Ports logged in:0
Flags:1<NOT_MAPPED,NOT_CONNECTED>
VFC client name:                VFC client DRC:

Name          Physloc                            ClntID ClntName       ClntOS
------------- ---------------------------------- ------ -------------- -------
vfchost2      U7895.43X.10EC5BB-V2-C41                4

Status:NOT_LOGGED_IN
FC name:fcs0                    FC loc code:U78AF.001.WZS06ZE-P1-C34-L1-T1
Ports logged in:0
Flags:4<NOT_LOGGED>
VFC client name:                VFC client DRC:

Name          Physloc                            ClntID ClntName       ClntOS
------------- ---------------------------------- ------ -------------- -------
vfchost3      U7895.43X.10EC5BB-V2-C42                4

Status:NOT_LOGGED_IN
FC name:                        FC loc code:
Ports logged in:0
Flags:1<NOT_MAPPED,NOT_CONNECTED>
VFC client name:                VFC client DRC:

Name          Physloc                            ClntID ClntName       ClntOS
------------- ---------------------------------- ------ -------------- -------
vfchost4      U7895.43X.10EC5BB-V2-C51                5 cognos         AIX

Status:LOGGED_IN
FC name:fcs0                    FC loc code:U78AF.001.WZS06ZE-P1-C34-L1-T1
Ports logged in:3
Flags:a<LOGGED_IN,STRIP_MERGE>
VFC client name:fcs0            VFC client DRC:U7895.43X.10EC5BB-V5-C11

Name          Physloc                            ClntID ClntName       ClntOS

The VIOS server shows fca_err12 followed by fcs_err4 errors on fcs1.
The lspath command on the clients show missing path for fscsi1.
Enabled hdisk0 fscsi0
Enabled hdisk0 fscsi0
Missing hdisk0 fscsi1
Missing hdisk0 fscsi1
Enabled hdisk0 fscsi2
Enabled hdisk0 fscsi2
Enabled hdisk0 fscsi3
Enabled hdisk0 fscsi3
Enabled hdisk2 fscsi0
Enabled hdisk2 fscsi0
Missing hdisk2 fscsi1
Missing hdisk2 fscsi1
Enabled hdisk2 fscsi2
Enabled hdisk2 fscsi2
Enabled hdisk2 fscsi3
Enabled hdisk2 fscsi3
Enabled hdisk1 fscsi0
Enabled hdisk1 fscsi0
Missing hdisk1 fscsi1
Missing hdisk1 fscsi1
Enabled hdisk1 fscsi2
Enabled hdisk1 fscsi2
Enabled hdisk1 fscsi3
Enabled hdisk1 fscsi3
#
Trying a cfgmgr on the vios server or client I get the following error.

# cfgmgr -l fcs1
Method error (/usr/lib/methods/cfgefscsi -l fscsi1 ):
        .0514-061 Cannot find a child device
Adapters on VIOS server.
# lscfg -vpl fcs0
  fcs0             U78AF.001.WZS06ZE-P1-C34-L1-T1  10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)

        Part Number.................00E3477
        Serial Number...............11S00E3477Y150HY38S019
        EC Level....................D77532
        Manufacturer................001A
        FRU Number..................00E3478
        Customer Card ID Number.....EC24
        ROM Level.(alterable).......100500
        Network Address.............10000090FA42ACE4
        Device Specific.(Z0)........0000000B
        Device Specific.(Z1)........00000010
        Device Specific.(Z2)........00000000
        Device Specific.(Z3)........08090000
        Device Specific.(Z4)........00003001
        Device Specific.(Z5)........33342E31
        Device Specific.(Z6)........33342E31
        Device Specific.(Z7)........C0022B40
        Device Specific.(Z8)........20000090FA42ACE4
        Device Specific.(Z9)........1.1.34.10
        Device Specific.(ZA)........1.1.34.10
        Device Specific.(ZB)........30313435
        Device Specific.(ZC)........00040000
        Device Specific.(ZD)........000000A8
        Hardware Location Code......U78AF.001.WZS06ZE-P1-C34-L1-T1


  PLATFORM SPECIFIC

  Name:  fibre-channel
    Model:  OCe15102-FM
    Node:  fibre-channel@0,4
    Device Type:  fcp
    Physical Location: U78AF.001.WZS06ZE-P1-C34-L1-T1
# lscfg -vpl fcs1
  fcs1             U78AF.001.WZS06ZE-P1-C34-L1-T2  10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)

        Part Number.................00E3477
        Serial Number...............11S00E3477Y150HY38S019
        EC Level....................D77532
        Manufacturer................001A
        FRU Number..................00E3478
        Customer Card ID Number.....EC24
        ROM Level.(alterable).......100500
        Network Address.............10000090FA42ACE5
        Device Specific.(Z0)........0000000B
        Device Specific.(Z1)........00000010
        Device Specific.(Z2)........00000000
        Device Specific.(Z3)........08090000
        Device Specific.(Z4)........00013101
        Device Specific.(Z5)........33342E31
        Device Specific.(Z6)........33342E31
        Device Specific.(Z7)........C0022B40
        Device Specific.(Z8)........20000090FA42ACE5
        Device Specific.(Z9)........1.1.34.10
        Device Specific.(ZA)........1.1.34.10
        Device Specific.(ZB)........30313435
        Device Specific.(ZC)........00040000
        Device Specific.(ZD)........000000A8
        Hardware Location Code......U78AF.001.WZS06ZE-P1-C34-L1-T2

Adapters on client

  PLATFORM SPECIFIC

  Name:  fibre-channel
    Model:  OCe15102-FM lscfg -vpl fcs0
  fcs0             U7895.43X.10EC5BB-V5-C11-T1  Virtual Fibre Channel Client Adapter

        Network Address.............C05076078B0D0034
        ROS Level and ID............
        Device Specific.(Z0)........
        Device Specific.(Z1)........
        Device Specific.(Z2)........
        Device Specific.(Z3)........
        Device Specific.(Z4)........
        Device Specific.(Z5)........
        Device Specific.(Z6)........
        Device Specific.(Z7)........
        Device Specific.(Z8)........C05076078B0D0034
        Device Specific.(Z9)........
        Hardware Location Code......U7895.43X.10EC5BB-V5-C11-T1


  PLATFORM SPECIFIC

  Name:  vfc-client
    Node:  vfc-client@3000000b
    Device Type:  fcp
    Physical Location: U7895.43X.10EC5BB-V5-C11-T1
# lscfg -vpl fcs1
  fcs1             U7895.43X.10EC5BB-V5-C12-T1  Virtual Fibre Channel Client Adapter

        Network Address.............C05076078B0D0036
        ROS Level and ID............
        Device Specific.(Z0)........
        Device Specific.(Z1)........
        Device Specific.(Z2)........
        Device Specific.(Z3)........
        Device Specific.(Z4)........
        Device Specific.(Z5)........
        Device Specific.(Z6)........
        Device Specific.(Z7)........
        Device Specific.(Z8)........C05076078B0D0036
        Device Specific.(Z9)........
        Hardware Location Code......U7895.43X.10EC5BB-V5-C12-T1


  PLATFORM SPECIFIC

  Name:  vfc-client
    Node:  vfc-client@3000000c
    Device Type:  fcp
    Physical Location: U7895.43X.10EC5BB-V5-C12-T1
#

    Node:  fibre-channel@0,5
    Device Type:  fcp
    Physical Location: U78AF.001.WZS06ZE-P1-C34-L1-T2
#
From client.# lsparent -Cl fcs1
vio0 Available  Virtual I/O Bus
# lsparent -Cl hdisk0
fscsi0 Available 11-T1-01 FC SCSI I/O Controller Protocol Device
fscsi1 Available 12-T1-01 FC SCSI I/O Controller Protocol Device
fscsi2 Available 21-T1-01 FC SCSI I/O Controller Protocol Device
fscsi3 Available 22-T1-01 FC SCSI I/O Controller Protocol Device
# lsdev -Cc adapter
ent0   Available       Virtual I/O Ethernet Adapter (l-lan)
fcs0   Available 11-T1 Virtual Fibre Channel Client Adapter
fcs1   Available 12-T1 Virtual Fibre Channel Client Adapter
fcs2   Available 21-T1 Virtual Fibre Channel Client Adapter
fcs3   Available 22-T1 Virtual Fibre Channel Client Adapter
pkcs11 Available       ACF/PKCS#11 Device
vsa0   Available       LPAR Virtual Serial Adapter
vscsi0 Defined         Virtual SCSI Client Adapter
# lsparent -Cl fcs1
pci0 Available  PCI Express Bus
pci1 Available  PCI Express Bus
pci2 Available  PCI Express Bus
pci3 Available  PCI Express Bus
# lsdev -Cc adapter
ent0     Available 00-00 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent1     Available 00-01 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent2     Available 00-02 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent3     Available 00-03 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent4     Available 02-00 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent5     Available 02-01 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent6     Available 02-02 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent7     Available 02-03 10GbE 8-port Mezzanine Converged Network Adapter (df1020e214105104)
ent8     Defined         Virtual I/O Ethernet Adapter (l-lan)
ent9     Defined         Virtual I/O Ethernet Adapter (l-lan)
ent10    Available       Virtual I/O Ethernet Adapter (l-lan)
ent11    Defined         Virtual I/O Ethernet Adapter (l-lan)
ent12    Available       Virtual I/O Ethernet Adapter (l-lan)
ent13    Available       Virtual I/O Ethernet Adapter (l-lan)
ent14    Available       Shared Ethernet Adapter
fcs0     Available 00-04 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs1     Available 00-05 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs2     Available 00-06 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs3     Available 00-07 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs4     Available 02-04 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs5     Available 02-05 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs6     Available 02-06 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
fcs7     Available 02-07 10Gb 8-Port FCoE Mezzanine Adapter (df1060e214105204)
pkcs11   Available       PKCS#11 Device
sissas0  Available 03-00 PCI Express x8 Planar 3Gb SAS Adapter
usbhc0   Available 04-08 USB Host Controller (33103500)
usbhc1   Available 04-09 USB Host Controller (33103500)
usbhc2   Available 04-0a USB Enhanced Host Controller (3310e000)
vfchost0 Available       Virtual FC Server Adapter
vfchost1 Available       Virtual FC Server Adapter
vfchost2 Available       Virtual FC Server Adapter
vfchost3 Available       Virtual FC Server Adapter
vfchost4 Available       Virtual FC Server Adapter
vfchost5 Available       Virtual FC Server Adapter
vfchost6 Available       Virtual FC Server Adapter
vfchost7 Available       Virtual FC Server Adapter
vfchost8 Available       Virtual FC Server Adapter
vfchost9 Available       Virtual FC Server Adapter
vhost0   Available       Virtual SCSI Server Adapter
vhost1   Available       Virtual SCSI Server Adapter
vsa0     Available       LPAR Virtual Serial Adapter

Any suggestions on how to proceed to resolve this error would be appreciate.

From VIOS.
LVL 1
craig FennengineerAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

gheistCommented:
Can you edit your post and remove -v parameter from all info commands?
It is not readable
0
craig FennengineerAuthor Commented:
I don't see what your seeing. I can read it without issues.
0
gheistCommented:
I cannot read past ROM level and blank PCI slots, sorry. Make it in one screen if you care.
0
HTML5 and CSS3 Fundamentals

Build a website from the ground up by first learning the fundamentals of HTML5 and CSS3, the two popular programming languages used to present content online. HTML deals with fonts, colors, graphics, and hyperlinks, while CSS describes how HTML elements are to be displayed.

craig FennengineerAuthor Commented:
Which command(s) do you specifically
 want to see the output from?
0
dfkeCommented:
Hi,

usually it is caused by one of the following reasons:

- Storage mapping error caused by the WWN (network address) not being in the zone on the fabric
- Changing a fibre card
- Moving to a new switch, which creates a new path and the existing path will then fail
- Storage controller goes offline
- Changing the host port on the storage within the zone

So you might want to check them out and see if it will come up with something

When changing storage mapping, you’ll find yourself with failed or missing disk paths on your AIX SAN. Failed paths are commonly due to a change that’s happened. In general, paths are set to fail if they go down during normal processing. If a path is lost during a restart, it will be set to missing.

Cheers
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
dfkeCommented:
Hi,

The tips I gave will find the root cause of this issue.

Cheers
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Unix OS

From novice to tech pro — start learning today.