Avatar of maxihost
maxihost
 asked on

Cant reconnect ESXi 4.1 to vCenter Server

Hello,

Yesterday one of my ESXi 4.1 disconnected from my vCenter 4.1 and when I try to reconnect it to the vCenter I get the following error,

A general system error ocurred: internal error: vmodl.fault.HostCommunication

I have searched Google and found that most of those errors are related to DNS issue resolutions, although I have verified and my ESXi server and my vCenter are correctling seeing each other, and the /etc/hosts file on the Host and on the vCenter are correctly configured.

I tried to restart the management agents through the console but the error is still the same.

Anybody can give me any advice ?
VMwareVirtualization

Avatar of undefined
Last Comment
maxihost

8/22/2022 - Mon
ASKER CERTIFIED SOLUTION
jramsier

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
maxihost

ASKER
Yes I did. It didnt fix my issue. Same error.
Danny McDaniel

Can you connect to the host with the vsphere client directly?  The issue could be that there's a problem with the host management service not starting completely.  If you have had storage issues, this can cause it to get hung when starting or running.

If you can connect to it directly, then you'll probably need to start digging in the logs.  the /var/log/vmware/vpx/vpxa.log file on the ESXi host being the first place to start.
maxihost

ASKER
Hello,

I could connect directly to the vSphere Client, but I am not able to register that server to my vCenter.

This is what I could see from the vpxa.log while I was trying to connect the server to the vCenter,


1018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi.vmdk
[2010-11-12 22:20:10.124 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/10548 - srv03.marcelo-belotti/10548 - srv03.marcelo-belotti.vmdk to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/10548 - srv03.marcelo-belotti/10548 - srv03.marcelo-belotti.vmdk
[2010-11-12 22:20:10.124 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation/Guilherme Workstation.vmx to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation/Guilherme Workstation.vmx
[2010-11-12 22:20:10.124 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation
[2010-11-12 22:20:10.124 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation/Guilherme Workstation.vmdk to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/Guilherme Workstation/Guilherme Workstation.vmdk
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell/11542 - srv01.guilherme-faganell.vmx to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell/11542 - srv01.guilherme-faganell.vmx
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell
[2010-11-12 22:20:10.125 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell
[2010-11-12 22:20:10.126 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell/11542 - srv01.guilherme-faganell.vmdk to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11542 - srv01.guilherme-faganell/11542 - srv01.guilherme-faganell.vmdk
[2010-11-12 22:20:10.126 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o/13078 - srv01.maria-concei+w6fDow-o.vmx to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o/13078 - srv01.maria-concei+w6fDow-o.vmx
[2010-11-12 22:20:10.126 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o
[2010-11-12 22:20:10.126 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o
[2010-11-12 22:20:10.127 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o
[2010-11-12 22:20:10.127 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o/13078 - srv01.maria-concei+w6fDow-o.vmdk to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13078 - srv01.maria-concei+w6fDow-o/13078 - srv01.maria-concei+w6fDow-o.vmdk
[2010-11-12 22:20:10.127 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti/11169 - srv01.ramiro-cavalcanti.vmx to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti/11169 - srv01.ramiro-cavalcanti.vmx
[2010-11-12 22:20:10.127 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti/11169 - srv01.ramiro-cavalcanti.vmdk to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11169 - srv01.ramiro-cavalcanti/11169 - srv01.ramiro-cavalcanti.vmdk
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi.vmx to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi.vmx
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi
[2010-11-12 22:20:10.128 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi
[2010-11-12 22:20:10.129 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi-000001.vmdk to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi-000001.vmdk
[2010-11-12 22:20:10.129 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi.vmdk to URL sanfs://vmfs_uuid:4c52e6fd-c89b9657-2732-0024e8455dc1/11018 - srv01.ugo-rossi/11018 - srv01.ugo-rossi.vmdk
[2010-11-12 22:20:10.129 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2/janaina-nova2.vmx to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2/janaina-nova2.vmx
[2010-11-12 22:20:10.129 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2 to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2
[2010-11-12 22:20:10.129 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2 to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2 to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2/janaina-nova2.vmdk to URL sanfs://vmfs_uuid:4c51ceca-b8a05ad2-3045-001b2140ced1/janaina-nova2/janaina-nova2.vmdk
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_.vmx to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_.vmx
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_ to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_ to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_
[2010-11-12 22:20:10.130 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_ to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_
[2010-11-12 22:20:10.131 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_-000002.vmdk to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_-000002.vmdk
[2010-11-12 22:20:10.131 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_-000001.vmdk to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_-000001.vmdk
[2010-11-12 22:20:10.131 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_.vmdk to URL sanfs://vmfs_uuid:4c749559-8f82d84f-4a49-0026b93a830f/11057 - srv01.rodrigo-freitas_/11057 - srv01.rodrigo-freitas_.vmdk
[2010-11-12 22:20:10.131 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin/12440 - srv01.fabio-martin.vmx to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin/12440 - srv01.fabio-martin.vmx
[2010-11-12 22:20:10.132 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin
[2010-11-12 22:20:10.132 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin
[2010-11-12 22:20:10.132 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin
[2010-11-12 22:20:10.132 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin/12440 - srv01.fabio-martin.vmdk to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/12440 - srv01.fabio-martin/12440 - srv01.fabio-martin.vmdk
[2010-11-12 22:20:10.133 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari/13065 - srv01.fabio-notari.vmx to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari/13065 - srv01.fabio-notari.vmx
[2010-11-12 22:20:10.133 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari
[2010-11-12 22:20:10.133 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari
[2010-11-12 22:20:10.134 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari
[2010-11-12 22:20:10.134 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxURL] Resolved localPath /vmfs/volumes/4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari/13065 - srv01.fabio-notari.vmdk to URL sanfs://vmfs_uuid:4c58d215-b399cc94-bc12-001b2140ced1/13065 - srv01.fabio-notari/13065 - srv01.fabio-notari.vmdk
[2010-11-12 22:20:10.134 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxaInvtHost] Increment master gen. no (114): VpxaInvtHost::DiscoverVMs
[2010-11-12 22:20:10.134 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxaInvtHost::DiscoverVMs] Finished
[2010-11-12 22:20:10.135 19322B90 verbose 'App' opID=task-internal-8-43239b29] [VpxaVMAP::LoadAamAndStartVMAP] No validation script installed, need to install AAM
[2010-11-12 22:20:10.135 19322B90 info 'Heartbeat' opID=task-internal-8-43239b29] Started heartbeating..
[2010-11-12 22:20:10.136 1956BB90 verbose 'App' opID=task-internal-8-43239b29] [VpxaVmFailover::VmFailoverEntry] Enter into main entry point
[2010-11-12 22:20:10.136 1956BB90 error 'App' opID=task-internal-8-43239b29] [VpxaVmFailover::VmFailoverEntry] No messages in the queue, waiting
[2010-11-12 22:20:10.137 19322B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-8-43239b29] HTTP Response: Complete (processed 384 bytes)
[2010-11-12 22:20:10.138 19322B90 info 'App' opID=task-internal-8-43239b29] [VpxLRO] -- FINISH task-internal-8 --  -- vpxapi.VpxaService.login -- 522b396a-9533-9469-4241-ba2d64491fac
[2010-11-12 22:20:10.143 194A8B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
[2010-11-12 22:20:10.144 194A8B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
[2010-11-12 22:20:10.144 193A4B90 info 'App' opID=task-internal-9-aa31f8ed] [VpxLRO] -- BEGIN task-internal-9 --  -- vpxapi.VpxaService.retrieveTaskManager -- 522b396a-9533-9469-4241-ba2d64491fac
[2010-11-12 22:20:10.145 193A4B90 verbose 'SoapAdapter.HTTPService' opID=task-internal-9-aa31f8ed] HTTP Response: Complete (processed 461 bytes)
[2010-11-12 22:20:10.145 193A4B90 info 'App' opID=task-internal-9-aa31f8ed] [VpxLRO] -- FINISH task-internal-9 --  -- vpxapi.VpxaService.retrieveTaskManager -- 522b396a-9533-9469-4241-ba2d64491fac
[2010-11-12 22:20:10.152 192E1B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
[2010-11-12 22:20:10.152 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
[2010-11-12 22:20:10.153 192E1B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
[2010-11-12 22:20:10.153 192E1B90 info 'Libs'] UUID: Unable to open /dev/mem: No such file or directory
[2010-11-12 22:20:10.153 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 516 bytes)
[2010-11-12 22:20:10.162 194E9B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
[2010-11-12 22:20:10.162 194E9B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
[2010-11-12 22:20:10.194 192E1B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
[2010-11-12 22:20:10.194 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
[2010-11-12 22:20:10.194 192E1B90 verbose 'SoapAdapter.HTTPService'] User agent is 'VMware-client/4.1.0'
[2010-11-12 22:20:10.194 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Client: NeedsContentLength: false UnderstandsChunking: true CanKeepAlive: true (PresetContentLength -1)
[2010-11-12 22:20:10.194 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 530 bytes)
[2010-11-12 22:20:10.195 192E1B90 verbose 'SoapAdapter.HTTPService'] HTTP Response: Complete (processed 406 bytes)
[2010-11-12 22:20:11.203 19363B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
[2010-11-12 22:20:11.203 19363B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 3 to 4 (at 3)
[2010-11-12 22:20:11.203 19363B90 verbose 'App'] Event vim.event.UserLogoutSessionEvent ignored: username (vpxuser)
[2010-11-12 22:20:11.203 19363B90 verbose 'App'] [VpxaHalServices] EventsRecorded Event Fired
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 5- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65611- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 23- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65625- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327696- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262144- is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262164-host/system is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262167-host/system is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262164-host/system/vmotion is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262167-host/system/vmotion is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262164-host/vim is available
[2010-11-12 22:20:11.749 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262167-host/vim is available
[2010-11-12 22:20:11.755 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 5- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65611- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65541- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65545- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65586- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65549- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65582- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65553- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65591- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65621- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65624- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65620- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65626- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 65627- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262145- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 262144- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327680- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327683- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327684- is available
[2010-11-12 22:20:11.756 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327682- is available
[2010-11-12 22:20:11.757 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327685- is available
[2010-11-12 22:20:11.757 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327690- is available
[2010-11-12 22:20:11.757 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327692- is available
[2010-11-12 22:20:11.757 FFC7DB10 verbose 'App'] [GetQuickStatsMetrics] Quick stat metric 327695- is available
[2010-11-12 22:20:11.791 FFC7DB10 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2
[2010-11-12 22:20:24.611 19053B90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
[2010-11-12 22:20:24.611 19053B90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 4 to 5 (at 4)
[2010-11-12 22:20:24.612 19053B90 verbose 'App'] [VpxaHalVmHostagent] 1632: GuestInfo changed 'guest.disk'
[2010-11-12 22:20:24.612 19053B90 verbose 'App'] [VpxaHalServices] VmGuestDiskChange Event for vm(6) 1632
[2010-11-12 22:20:24.612 19053B90 verbose 'App'] [VpxaInvtVmChangeListener] Guest DiskInfo Changed
[2010-11-12 22:20:24.612 19053B90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (115): VmRuntime:GuestDiskChanged
[2010-11-12 22:20:28.751 195EDB90 verbose 'VpxaHalCnxHostagent'] Received callback in WaitForUpdatesDone
[2010-11-12 22:20:28.751 195EDB90 verbose 'VpxaHalCnxHostagent'] [VpxaHalCnxHostagent::ProcessUpdate] Applying updates from 5 to 6 (at 5)
[2010-11-12 22:20:28.751 195EDB90 verbose 'App'] [VpxaHalVmHostagent] 1728: GuestInfo changed 'guest.disk'
[2010-11-12 22:20:28.751 195EDB90 verbose 'App'] [VpxaHalServices] VmGuestDiskChange Event for vm(9) 1728
[2010-11-12 22:20:28.751 195EDB90 verbose 'App'] [VpxaInvtVmChangeListener] Guest DiskInfo Changed
[2010-11-12 22:20:28.751 195EDB90 verbose 'App'] [VpxaInvtHost] Increment master gen. no to (116): VmRuntime:GuestDiskChanged
[2010-11-12 22:20:31.749 1909FB90 warning 'App'] [VpxaHalStats] Unexpected return result. Expect 1 sample, receive 2

Experts Exchange is like having an extremely knowledgeable team sitting and waiting for your call. Couldn't do my job half as well as I do without it!
James Murphy
jramsier

where there any changes before this happened? or did it just happen.  Also when adding to vmware it is case sensitive.
maxihost

ASKER
Some things happened,

I run three servers in the same cluster. I have attempted to put one of the host into maintenance mode (not this one that is having this issue). The vMotion started moving VMs to the other two machines when suddenly one of the machines stopped responding to vCenter and the vMotion for some VMs just froze and then timed out.

Guilherme
Danny McDaniel

I don't see any problems from that log snippet.  

run these commands to remove the VPX and HA agents:

/opt/vmware/uninstallers/VMware-vpxa-uninstall.sh
/opt/vmware/uninstallers/VMware-aam-ha-uninstall.sh


Then try to reconnect the host.  It should attempt to re-download the agents from the vcenter server and install them.  If they don't get re-installed, then it is usually a communication issue between the host and the VC, or a problem with the host.  Many times a reboot will fix the host issues, especially when it's a problem with the storage/firmware.  ESXi works more like an appliance than an OS like ESX does, so sometimes you get into situations with ESXi that requires a reboot when ESX wouldn't.  So, if you can shutdown the VM's on it and reboot it, that may be your quicker route.
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
maxihost

ASKER
Hello,

It seems that it almooooost worked !

Before the procedure to reconnect the host to the vCenter was getting stuck in 9% and then getting the error. After your procedure it went until 89% and then I had the same error.

One information is that your first command ran well but I had Operation not permited on two files or directories. And the second command didnt work because the aam-ha file doesnt exist.



~ # /opt/vmware/uninstallers/VMware-aam-ha-uninstall.sh
-ash: /opt/vmware/uninstallers/VMware-aam-ha-uninstall.sh: not found
~ # su
~ # su - root
~ #
~ #
~ # /opt/vmware/uninstallers/VMware-vpxa-uninstall.sh
Stopping vmware-vpxa:success

rm: cannot remove '/etc/opt/vmware/vpxa/.#vpxa.cfg': Operation not permitted
rm: cannot remove '/etc/opt/vmware/vpxa': Directory not empty
Successfully removed service.
Successfully added service.
~ # whereis VMware-aam-ha-uninstall.sh
-ash: whereis: not found
~ # cd /opt/vmware/uninstallers
/opt/vmware/uninstallers # ls -la
drwxr-xr-x    1 root     root                512 Nov 12 23:36 .
drwxr-xr-x    1 root     root                512 Nov 12 23:39 ..
-r-xr-xr-x    1 root     root               1160 May 14  2010 VMware-vpxa-uninstall.sh
/opt/vmware/uninstallers #

I wouldnt like to reboot the server as I am running many VMs on this server and they are running well.

Thanks.

Guilherme
Danny McDaniel

the AAM part is for HA, so if you didn't have HA enabled, it wouldn't be installed.  Did you notice if the VPX service got reinstalled?

Also, run through the steps in http://kb.vmware.com/kb/1008643 and see if that helps.
maxihost

ASKER
Hello,

I didnt have HA enabled, so you are right. About the VPX service, yes it got reinstalled during host reconnection to the vCenter.

Regarding the free inodes, I think its not the case as I see I have enough inodes,


~ # stat -f /
  File: "/"
    ID: 1        Namelen: 127     Type: visorfs
Block size: 4096
Blocks: Total: 365828     Free: 273942     Available: 273942
Inodes: Total: 8192       Free: 6510
~ #
I started with Experts Exchange in 2004 and it's been a mainstay of my professional computing life since. It helped me launch a career as a programmer / Oracle data analyst
William Peck
maxihost

ASKER
Nobody have any ideas ?