Recently, I upgraded all my ESX to 6 to get the full VDP feature. A week after upgrade I started noticing VM issues and slowness on data discovery.
VMware support pointed out the logs .............."naa.60a9800
d6339" - failed to issue command due to Not found (APD), try again." on only two ISCSI LUN out of four. They traced the log back couple of days before the upgrade, that makes it confusing if it happened due to upgrade or was already there. VMware said it needs to be addressed by Netapps.
Netapp took 1 week just to collect logs never had support person calling. Today there was another support person calling and ran Interoperability Matrix Tool. When we selected ONTAP 8.2 with ESX 6 the protocol for ISCSI was grayed and he speculated that ESX 6 does not support ISCSI on ONTAP 8.2 7 node but it did not show any error or explanation. He said netapps has communicated this bug fix to vmware and until the fix is released by VMware it wont work on ONTAP 8.2 and it should be up to vmware. The article on bug fix is vague and does not clearly explains, if it is ISCSI or could it fix if I change datastore to NFS.
Now VMware recommeds, if netapps has pointed out issue with 6 then I should rollback the version. But I am sure if rollback would really fix it. Plus I have already done clean install on one ESX host thinking how clean installation works in comparison to issues showed after upgrade.
Another, point I came across while doing clean installation on one ESX host to eliminate if the issue is with upgrade was virtual network setup. Looks like the remote support vendor had setup multi-homed network switch with two ISCSI kernel storage switch (active and unused order NIC is different on both as active/ unused ) with same network subnet, one management network and vm network on same subnet different than storage subnet and one additional VLAN for voice using two 10 GB NIC cards. MTU on storage network is set to 9000.
I had some issues discovering storage ISCSI LUN after discovering adaptor. I had to create separate network switch for storage by using one of 10 G adapter and once the storage was discovered and changed the it back to same as the other virtual switches. This add another confusion, if it is something to do with multi homed setup, if this is the case why problem started showing after 6 months only at the time of upgrade. The log on clean installed still shows error on ISCSI storage network but not exactly the ADP error but does show bunch of error with ISCSI.
Has anyone experienced similar kind of issue with ESX upgrade using netapps FAS2554 ontap 7 mode