VMware iSCSI dead or error, lost comm issues

Greetings,

so had this issue on one of my hosts

http://www.experts-exchange.com/Software/VMWare/Q_28242969.html

reboot did the trick (had no other option though) and doing so even found all my new datastores I was scanning for in the first place.

of course the other host was still showing connected in vSphere client so I didn't check it. Went to rescan the host that didn't freeze up yesterday to add some datastores and it failed. Found several dead or error / lost comm devices in iSCSI adapter. Specifically, I received these two errors

Call "HostStorageSystem.RescanAllHba" for object "storageSystem-4744" on vCenter Server "vc.domain.local" failed.

Call "HostDatastoreSystem.QueryAvailableDisksForVmfs" for object "datastoreSystem-4744" on vCenter Server "vc.domain.local" failed.

how can I remove those targets without rebooting the host? Even if I can remove them manually, will rescanning all HBAs work or is a reboot inevitable? I might like to reboot to "freshen" things up but don't want to until next week sometime, if possible.

thanks
LVL 7
king daddyAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Once the iSCSI stack goes down into a spiral it's often a lost cause.

Restart host.

Why has the host lost access to LUNs or iSCSI SAN?
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
king daddyAuthor Commented:
Not sure why. All I did was remove some data stores from vsphere client. Some were on a VNXe and some on an HP P2000. I then deleted them from the SAN. I configured a few new data stores on the VNXe and rescanned both hosts. Upon rescanning one host froze up yesterday. Other host showed the errors I posted when I scanned all earlier today.

Although, we did move all equipment to new UPSs this past Saturday. Perhaps a switch didn't failover correctly then and I'm feeling the repercussions doing these tasks.
Thx
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Okay I understand now and this does and can happen.

Hosts are trying to poll the old datastores.

Did you delete from Host first and unmount?
0
Powerful Yet Easy-to-Use Network Monitoring

Identify excessive bandwidth utilization or unexpected application traffic with SolarWinds Bandwidth Analyzer Pack.

king daddyAuthor Commented:
Yes. I deleted from each host. I right-clicked and chose delete on each data store. Should I unmount? I've never done that before. After deleting on host I deleted from each SAN.
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
Is this 5.1?
0
king daddyAuthor Commented:
No. Haven't upgraded from 5 yet.
0
king daddyAuthor Commented:
as expected, the reboot worked.

however, I have a few old machines coming down so I will be removing them and their associated data stores. Any tips on how to remove them so I can avoid these iSCSI issues? Don't want to have to keep rebooting the host.

thanks
0
Andrew Hancock (VMware vExpert / EE MVE^2)VMware and Virtualization ConsultantCommented:
It's an iSCSI bug, usually it's best to remove the datastore first. One at a time, and then re-scan, but this could be waht you are doing.
0
king daddyAuthor Commented:
that's exactly what I did in an effort to not have this happen. Oh well...

thanks as usual
0
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
VMware

From novice to tech pro — start learning today.