VMWare Virtual Machines won't start after upgrade
Hello Everyone,
I just upgraded from VMWare server 2 build 116503 to build 122956. After starting all of the necessary services and logging into the WebUI, I start my virtual machines. I have two of them on this machine, and both are Windows. The host machine runs CentOS. When starting either machine, I'm able to go into the console and watch them start to boot, but then they shut off before fully starting the guest OS. I'm not entirely sure what information would be helpful to troubleshoot this problem, so here's a sample of the output of my hostd log:
[2009-02-08 13:11:42.891 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:42.891 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:42.892 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: capability, 32
[2009-02-08 13:11:42.892 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:43.043 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: config.changeVersion, 32
[2009-02-08 13:11:43.044 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: config.hardware.memoryMB, 32
[2009-02-08 13:11:43.044 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:43.470 'PropertyProvider' 1103911232 verbose] RecordOp ASSIGN: info, haTask-32-vim.EnvironmentB
[2009-02-08 13:11:43.674 'PropertyProvider' 1102276928 verbose] RecordOp ASSIGN: info, haTask-32-vim.EnvironmentB
[2009-02-08 13:11:48.394 'TaskManager' 1107646784 info] Task Created : haTask-32-vim.VirtualMachi
[2009-02-08 13:11:48.394 'PropertyProvider' 1107646784 verbose] RecordOp ADD: recentTask["haTask-32-vim.
[2009-02-08 13:11:48.394 'PropertyProvider' 1107646784 verbose] RecordOp ADD: recentTask["haTask-32-vim.
[2009-02-08 13:11:48.396 'ha-eventmgr' 1107646784 info] Event 50 : Red on host Leopard.xxx.com in ha-datacenter is starting
[2009-02-08 13:11:48.396 'PropertyProvider' 1107646784 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:48.396 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.396 'PropertyProvider' 1107646784 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:48.396 'ha-license-manager' 1107646784 info] CheckLicenses: skipped on this platform
[2009-02-08 13:11:48.411 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: info, haTask-32-vim.VirtualMachi
[2009-02-08 13:11:48.430 'Libs' 1101166912 info] connect to /var/run/vmware/root_0/123
[2009-02-08 13:11:48.430 'Libs' 1089972544 info] VMHSVMCbPower: Setting state of VM /vm/#c8d244237d936657/ to powerOn with option soft
[2009-02-08 13:11:48.431 'Libs' 1089972544 info] VMHS: Exec()'ing /usr/lib/vmware/bin/vmware
[2009-02-08 13:11:48.440 'App' 1089972544 error] IsOurChild: read IsOurChild failed /proc/1968/stat/3
[2009-02-08 13:11:48.544 'Libs' 1089972544 info] Mounting virtual machine paths on connection: /db/connection/#3f/, /backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.620 'Libs' 1089972544 info] Mount VM completion for vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.621 'Libs' 1089972544 info] Mount VM Complete: /backup/DS/Red/Red.vmx, Return code: OK
[2009-02-08 13:11:48.959 'Libs' 1101166912 info] Connected to /backup/DS/Red/Red.vmx:tes
[2009-02-08 13:11:49.032 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.032 'vm:/backup/DS/Red/Red.vmx
Virtual device ide1:0 will start disconnected.
, Id: 10 : Type : 2, Default: 0, Number of options: 1
[2009-02-08 13:11:49.141 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.extraConfig["mainMe
[2009-02-08 13:11:49.142 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:49.143 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:11:49.143 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:11:49.144 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] VMX status has been set for vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.300 'ha-eventmgr' 1079429440 info] Event 51 : Red on Leopard.xxx.com in ha-datacenter is powered on
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:49.300 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary.runtime.bootTime, 32
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: runtime.bootTime, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: runtime.powerState, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary.runtime.powerState
[2009-02-08 13:11:49.301 'TaskManager' 1079429440 info] Task Completed : haTask-32-vim.VirtualMachi
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: info, haTask-32-vim.VirtualMachi
[2009-02-08 13:11:49.304 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.312 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.314 'ha-eventmgr' 1101748544 info] Event 52 : Message on Red on Leopard.xxx.com in ha-datacenter: File "/home/vmware/Virtual Machines/en_windows_server
Virtual device ide1:0 will start disconnected.
[2009-02-08 13:11:49.314 'PropertyProvider' 1101748544 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:49.315 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.315 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hardware.device[300
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hotPlugMemoryLimit,
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hotPlugMemoryIncrem
[2009-02-08 13:11:49.471 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:49.471 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:12:33.958 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.958 'vm:/backup/DS/Red/Red.vmx
Unrecoverable memory allocation failure at /build/mts/release/bora-12
A log file is available in "/backup/DS/Red/vmware.log
To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
We will respond on the basis of your support entitlement.
, Id: 11 : Type : 3, Default: 0, Number of options: 1
[2009-02-08 13:12:33.958 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.959 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.959 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.960 'ha-eventmgr' 1101482304 info] Event 53 : Message on Red on Leopard.xxx.com in ha-datacenter: VMware Server unrecoverable error: (Worker#3)
Unrecoverable memory allocation failure at /build/mts/release/bora-12
A log file is available in "/backup/DS/Red/vmware.log
To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
We will respond on the basis of your support entitlement.
[2009-02-08 13:12:33.960 'PropertyProvider' 1101482304 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:12:33.960 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.180 'Libs' 1089972544 info] vmdbPipe_Streams Couldn't read: OVL_STATUS_EOF
[2009-02-08 13:12:35.181 'Libs' 1089972544 warning] VMHS: Connection to VM broken: cfg: /backup/DS/Red/Red.vmx; error: Pipe: Read failed; state: 3
[2009-02-08 13:12:35.181 'Libs' 1089972544 info] Unmounting the vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.182 'Libs' 1089972544 info] Unmounting VM complete: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.186 'Libs' 1089972544 info] Mount state values have changed: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.187 'Libs' 1089972544 info] Reloading config state: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.260 'Libs' 1089972544 info] VMHS: Transitioned vmx/execState/val to poweredOff
[2009-02-08 13:12:35.349 'Libs' 1089972544 info] SOCKET 7 (43)
[2009-02-08 13:12:35.349 'Libs' 1089972544 info] recv error 104: Connection reset by peer
[2009-02-08 13:12:35.693 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[400
[2009-02-08 13:12:35.694 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.extraConfig["mainMe
[2009-02-08 13:12:35.694 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:12:35.695 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:12:35.695 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:12:35.696 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.696 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:12:35.696 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: runtime.powerState, 32
[2009-02-08 13:12:35.697 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: summary.runtime.powerState
[2009-02-08 13:12:35.697 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.699 'ha-eventmgr' 1107380544 info] Event 54 : Red on Leopard.xxx.com in ha-datacenter is powered off
[2009-02-08 13:12:35.699 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:12:35.699 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.852 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[300
[2009-02-08 13:12:35.852 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[400
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hotPlugMemoryLimit,
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hotPlugMemoryIncrem
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:12:36.167 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary.guest, 32
Any help would be greatly appreciated. I have some important services on these machines, so I'd like to get them back up and running as soon as I can. Thanks in advance!
Best Regards,
Martin Schultz
I just upgraded from VMWare server 2 build 116503 to build 122956. After starting all of the necessary services and logging into the WebUI, I start my virtual machines. I have two of them on this machine, and both are Windows. The host machine runs CentOS. When starting either machine, I'm able to go into the console and watch them start to boot, but then they shut off before fully starting the guest OS. I'm not entirely sure what information would be helpful to troubleshoot this problem, so here's a sample of the output of my hostd log:
[2009-02-08 13:11:42.891 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:42.891 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:42.892 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: capability, 32
[2009-02-08 13:11:42.892 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:43.043 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: config.changeVersion, 32
[2009-02-08 13:11:43.044 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: config.hardware.memoryMB, 32
[2009-02-08 13:11:43.044 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:43.470 'PropertyProvider' 1103911232 verbose] RecordOp ASSIGN: info, haTask-32-vim.EnvironmentB
[2009-02-08 13:11:43.674 'PropertyProvider' 1102276928 verbose] RecordOp ASSIGN: info, haTask-32-vim.EnvironmentB
[2009-02-08 13:11:48.394 'TaskManager' 1107646784 info] Task Created : haTask-32-vim.VirtualMachi
[2009-02-08 13:11:48.394 'PropertyProvider' 1107646784 verbose] RecordOp ADD: recentTask["haTask-32-vim.
[2009-02-08 13:11:48.394 'PropertyProvider' 1107646784 verbose] RecordOp ADD: recentTask["haTask-32-vim.
[2009-02-08 13:11:48.396 'ha-eventmgr' 1107646784 info] Event 50 : Red on host Leopard.xxx.com in ha-datacenter is starting
[2009-02-08 13:11:48.396 'PropertyProvider' 1107646784 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:48.396 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.396 'PropertyProvider' 1107646784 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:48.396 'ha-license-manager' 1107646784 info] CheckLicenses: skipped on this platform
[2009-02-08 13:11:48.411 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: info, haTask-32-vim.VirtualMachi
[2009-02-08 13:11:48.430 'Libs' 1101166912 info] connect to /var/run/vmware/root_0/123
[2009-02-08 13:11:48.430 'Libs' 1089972544 info] VMHSVMCbPower: Setting state of VM /vm/#c8d244237d936657/ to powerOn with option soft
[2009-02-08 13:11:48.431 'Libs' 1089972544 info] VMHS: Exec()'ing /usr/lib/vmware/bin/vmware
[2009-02-08 13:11:48.440 'App' 1089972544 error] IsOurChild: read IsOurChild failed /proc/1968/stat/3
[2009-02-08 13:11:48.544 'Libs' 1089972544 info] Mounting virtual machine paths on connection: /db/connection/#3f/, /backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.620 'Libs' 1089972544 info] Mount VM completion for vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:48.621 'Libs' 1089972544 info] Mount VM Complete: /backup/DS/Red/Red.vmx, Return code: OK
[2009-02-08 13:11:48.959 'Libs' 1101166912 info] Connected to /backup/DS/Red/Red.vmx:tes
[2009-02-08 13:11:49.032 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.032 'vm:/backup/DS/Red/Red.vmx
Virtual device ide1:0 will start disconnected.
, Id: 10 : Type : 2, Default: 0, Number of options: 1
[2009-02-08 13:11:49.141 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.extraConfig["mainMe
[2009-02-08 13:11:49.142 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:49.143 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:11:49.143 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:11:49.144 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] VMX status has been set for vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.194 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.300 'ha-eventmgr' 1079429440 info] Event 51 : Red on Leopard.xxx.com in ha-datacenter is powered on
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:49.300 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary.runtime.bootTime, 32
[2009-02-08 13:11:49.300 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: runtime.bootTime, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: runtime.powerState, 32
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: summary.runtime.powerState
[2009-02-08 13:11:49.301 'TaskManager' 1079429440 info] Task Completed : haTask-32-vim.VirtualMachi
[2009-02-08 13:11:49.301 'PropertyProvider' 1079429440 verbose] RecordOp ASSIGN: info, haTask-32-vim.VirtualMachi
[2009-02-08 13:11:49.304 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.312 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.314 'ha-eventmgr' 1101748544 info] Event 52 : Message on Red on Leopard.xxx.com in ha-datacenter: File "/home/vmware/Virtual Machines/en_windows_server
Virtual device ide1:0 will start disconnected.
[2009-02-08 13:11:49.314 'PropertyProvider' 1101748544 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:11:49.315 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.315 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hardware.device[300
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hotPlugMemoryLimit,
[2009-02-08 13:11:49.470 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: config.hotPlugMemoryIncrem
[2009-02-08 13:11:49.471 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:11:49.471 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:11:49.784 'PropertyProvider' 1086781760 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:12:33.958 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.958 'vm:/backup/DS/Red/Red.vmx
Unrecoverable memory allocation failure at /build/mts/release/bora-12
A log file is available in "/backup/DS/Red/vmware.log
To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
We will respond on the basis of your support entitlement.
, Id: 11 : Type : 3, Default: 0, Number of options: 1
[2009-02-08 13:12:33.958 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.959 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.959 'Libs' 1089972544 info] Disconnect check in progress: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:33.960 'ha-eventmgr' 1101482304 info] Event 53 : Message on Red on Leopard.xxx.com in ha-datacenter: VMware Server unrecoverable error: (Worker#3)
Unrecoverable memory allocation failure at /build/mts/release/bora-12
A log file is available in "/backup/DS/Red/vmware.log
To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
We will respond on the basis of your support entitlement.
[2009-02-08 13:12:33.960 'PropertyProvider' 1101482304 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:12:33.960 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.180 'Libs' 1089972544 info] vmdbPipe_Streams Couldn't read: OVL_STATUS_EOF
[2009-02-08 13:12:35.181 'Libs' 1089972544 warning] VMHS: Connection to VM broken: cfg: /backup/DS/Red/Red.vmx; error: Pipe: Read failed; state: 3
[2009-02-08 13:12:35.181 'Libs' 1089972544 info] Unmounting the vm: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.182 'Libs' 1089972544 info] Unmounting VM complete: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.186 'Libs' 1089972544 info] Mount state values have changed: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.187 'Libs' 1089972544 info] Reloading config state: /backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.260 'Libs' 1089972544 info] VMHS: Transitioned vmx/execState/val to poweredOff
[2009-02-08 13:12:35.349 'Libs' 1089972544 info] SOCKET 7 (43)
[2009-02-08 13:12:35.349 'Libs' 1089972544 info] recv error 104: Connection reset by peer
[2009-02-08 13:12:35.693 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[400
[2009-02-08 13:12:35.694 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.extraConfig["mainMe
[2009-02-08 13:12:35.694 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:12:35.695 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:12:35.695 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary.guest, 32
[2009-02-08 13:12:35.696 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.696 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:12:35.696 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: runtime.powerState, 32
[2009-02-08 13:12:35.697 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: summary.runtime.powerState
[2009-02-08 13:12:35.697 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.699 'ha-eventmgr' 1107380544 info] Event 54 : Red on Leopard.xxx.com in ha-datacenter is powered off
[2009-02-08 13:12:35.699 'PropertyProvider' 1107380544 verbose] RecordOp ASSIGN: latestEvent, ha-eventmgr
[2009-02-08 13:12:35.699 'vm:/backup/DS/Red/Red.vmx
[2009-02-08 13:12:35.852 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[300
[2009-02-08 13:12:35.852 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hardware.device[400
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hotPlugMemoryLimit,
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config.hotPlugMemoryIncrem
[2009-02-08 13:12:35.853 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary, 32
[2009-02-08 13:12:36.167 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: config, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: disabledMethod, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: guest, 32
[2009-02-08 13:12:36.169 'PropertyProvider' 1100638528 verbose] RecordOp ASSIGN: summary.guest, 32
Any help would be greatly appreciated. I have some important services on these machines, so I'd like to get them back up and running as soon as I can. Thanks in advance!
Best Regards,
Martin Schultz
rindi
Rerun the vmware-config.pl script again. That should fix it.
ASKER
Rindi,
Thanks very much for your help. I did in fact re-run the config script immediately after ugprading the software, per the instructions it gave. I tried again just to be sure, but I got the same results. Any other suggestions would be greatly appreciated.
Thanks,
Martin
Thanks very much for your help. I did in fact re-run the config script immediately after ugprading the software, per the instructions it gave. I tried again just to be sure, but I got the same results. Any other suggestions would be greatly appreciated.
Thanks,
Martin
ASKER
I checked the log file for the guest itself, and found this. I'm guessing my issue has to do with these "Cannot allocate memory" errors, but I'm not sure how to solve them:
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.085: Worker#2| Unrecoverable memory allocation failure at /build/mts/release/bora-12
Feb 08 14:42:04.085: Worker#2| Core dump limit is 0 KB.
Feb 08 14:42:05.088: Worker#2| Child process 13698 failed to dump core (status 0x6).
Feb 08 14:42:05.088: Worker#2| Backtrace:
Feb 08 14:42:05.088: Worker#2| Backtrace[0] 00000000447229f0 rip=000000000041526c rbx=0000000000000000 rbp=0000000000415550 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[1] 0000000044722a10 rip=00000000004db6a0 rbx=0000000000000000 rbp=0000000000000008 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[2] 0000000044722ef0 rip=000000000047e91f rbx=0000000000000000 rbp=0000000000000008 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[3] 0000000044722f30 rip=000000000047eb5f rbx=00000002fe850000 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000017c05350 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[4] 0000000044722fa0 rip=000000000054ccdb rbx=00000000177bd290 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000000000000 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[5] 0000000044722fc0 rip=00000000004f169d rbx=00000000177fffc0 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000000000000 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[6] 0000000044723010 rip=00000000004f18ac rbx=00000000177fffc0 rbp=00000000177fff90 r12=0000000000000000 r13=0000000017bd57d0 r14=0000000000edfb60 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[7] 0000000044723040 rip=000000000048547a rbx=0000000000ee0b30 rbp=0000000000000000 r12=0000000043d21620 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[8] 0000000044723140 rip=00000036e6606367 rbx=0000000000000000 rbp=0000000000000000 r12=0000000000000000 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[9] 0000000044723260 rip=00000036e5ad30ad rbx=0000000044723940 rbp=0000000000000000 r12=0000000000000000 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| SymBacktrace[0] 00000000447229f0 rip=000000000041526c in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.088: Worker#2| SymBacktrace[1] 0000000044722a10 rip=00000000004db6a0 in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.088: Worker#2| SymBacktrace[2] 0000000044722ef0 rip=000000000047e91f in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[3] 0000000044722f30 rip=000000000047eb5f in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[4] 0000000044722fa0 rip=000000000054ccdb in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[5] 0000000044722fc0 rip=00000000004f169d in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[6] 0000000044723010 rip=00000000004f18ac in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[7] 0000000044723040 rip=000000000048547a in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[8] 0000000044723140 rip=00000036e6606367 in function (null) in object /lib64/libpthread.so.0 loaded at 00000036e6600000
Feb 08 14:42:05.089: Worker#2| SymBacktrace[9] 0000000044723260 rip=00000036e5ad30ad in function clone in object /lib64/libc.so.6 loaded at 00000036e5a00000
Feb 08 14:42:05.089: Worker#2| Msg_Post: Error
Feb 08 14:42:05.089: Worker#2| [msg.log.error.unrecoverab
Feb 08 14:42:05.089: Worker#2| Unrecoverable memory allocation failure at /build/mts/release/bora-12
Feb 08 14:42:05.089: Worker#2| [msg.panic.haveLog] A log file is available in "/backup/DS/Red/vmware.log
Feb 08 14:42:05.089: Worker#2| To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
Feb 08 14:42:05.089: Worker#2| [msg.panic.response] We will respond on the basis of your support entitlement.
Feb 08 14:42:05.089: Worker#2| --------------------------
Feb 08 14:42:05.187: vcpu-0| VTHREAD watched thread 38 "Worker#2" died
Feb 08 14:42:05.188: vmx| VTHREAD watched thread 4 "vcpu-0" died
Feb 08 14:42:05.191: mks| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.285: Worker#0| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.285: Worker#3| VTHREAD watched thread 4 "vcpu-0" died
Feb 08 14:42:05.285: vcpu-1| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.286: Worker#1| VTHREAD watched thread 4 "vcpu-0" died
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.058: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.059: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.060: vcpu-1| Could not mmap paging file : Cannot allocate memory
Feb 08 14:42:04.085: Worker#2| Unrecoverable memory allocation failure at /build/mts/release/bora-12
Feb 08 14:42:04.085: Worker#2| Core dump limit is 0 KB.
Feb 08 14:42:05.088: Worker#2| Child process 13698 failed to dump core (status 0x6).
Feb 08 14:42:05.088: Worker#2| Backtrace:
Feb 08 14:42:05.088: Worker#2| Backtrace[0] 00000000447229f0 rip=000000000041526c rbx=0000000000000000 rbp=0000000000415550 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[1] 0000000044722a10 rip=00000000004db6a0 rbx=0000000000000000 rbp=0000000000000008 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[2] 0000000044722ef0 rip=000000000047e91f rbx=0000000000000000 rbp=0000000000000008 r12=0000000000008000 r13=0000000044722f50 r14=0000000000000000 r15=00000000177bd2d8
Feb 08 14:42:05.088: Worker#2| Backtrace[3] 0000000044722f30 rip=000000000047eb5f rbx=00000002fe850000 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000017c05350 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[4] 0000000044722fa0 rip=000000000054ccdb rbx=00000000177bd290 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000000000000 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[5] 0000000044722fc0 rip=00000000004f169d rbx=00000000177fffc0 rbp=00000000177fff90 r12=0000000000000002 r13=0000000000000018 r14=0000000000000000 r15=ffffffffffffffff
Feb 08 14:42:05.088: Worker#2| Backtrace[6] 0000000044723010 rip=00000000004f18ac rbx=00000000177fffc0 rbp=00000000177fff90 r12=0000000000000000 r13=0000000017bd57d0 r14=0000000000edfb60 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[7] 0000000044723040 rip=000000000048547a rbx=0000000000ee0b30 rbp=0000000000000000 r12=0000000043d21620 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[8] 0000000044723140 rip=00000036e6606367 rbx=0000000000000000 rbp=0000000000000000 r12=0000000000000000 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| Backtrace[9] 0000000044723260 rip=00000036e5ad30ad rbx=0000000044723940 rbp=0000000000000000 r12=0000000000000000 r13=0000000000000000 r14=0000000044724000 r15=0000000000001000
Feb 08 14:42:05.088: Worker#2| SymBacktrace[0] 00000000447229f0 rip=000000000041526c in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.088: Worker#2| SymBacktrace[1] 0000000044722a10 rip=00000000004db6a0 in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.088: Worker#2| SymBacktrace[2] 0000000044722ef0 rip=000000000047e91f in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[3] 0000000044722f30 rip=000000000047eb5f in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[4] 0000000044722fa0 rip=000000000054ccdb in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[5] 0000000044722fc0 rip=00000000004f169d in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[6] 0000000044723010 rip=00000000004f18ac in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[7] 0000000044723040 rip=000000000048547a in function (null) in object /usr/lib/vmware/bin/vmware
Feb 08 14:42:05.089: Worker#2| SymBacktrace[8] 0000000044723140 rip=00000036e6606367 in function (null) in object /lib64/libpthread.so.0 loaded at 00000036e6600000
Feb 08 14:42:05.089: Worker#2| SymBacktrace[9] 0000000044723260 rip=00000036e5ad30ad in function clone in object /lib64/libc.so.6 loaded at 00000036e5a00000
Feb 08 14:42:05.089: Worker#2| Msg_Post: Error
Feb 08 14:42:05.089: Worker#2| [msg.log.error.unrecoverab
Feb 08 14:42:05.089: Worker#2| Unrecoverable memory allocation failure at /build/mts/release/bora-12
Feb 08 14:42:05.089: Worker#2| [msg.panic.haveLog] A log file is available in "/backup/DS/Red/vmware.log
Feb 08 14:42:05.089: Worker#2| To collect data to submit to VMware support, select Help > About and click "Collect Support Data". You can also run the "vm-support" script in the Workstation folder directly.
Feb 08 14:42:05.089: Worker#2| [msg.panic.response] We will respond on the basis of your support entitlement.
Feb 08 14:42:05.089: Worker#2| --------------------------
Feb 08 14:42:05.187: vcpu-0| VTHREAD watched thread 38 "Worker#2" died
Feb 08 14:42:05.188: vmx| VTHREAD watched thread 4 "vcpu-0" died
Feb 08 14:42:05.191: mks| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.285: Worker#0| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.285: Worker#3| VTHREAD watched thread 4 "vcpu-0" died
Feb 08 14:42:05.285: vcpu-1| VTHREAD watched thread 0 "vmx" died
Feb 08 14:42:05.286: Worker#1| VTHREAD watched thread 4 "vcpu-0" died
Maybe you also need to make sure centos is uptodate. Run Yum update.
Have you tried removing the VM from the inventory and re-adding it? Another option is leave the VM in the shutdown state and run the VMware convertor, convert the VM to what it already is (I know this sounds stupid, what I mean is remove the VM from the inventory and then reun through the convertor wizard) once done it should work.
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.