amait
asked on
HP Proliant DL380 G3 with VMWare ESX Server 3i sporadically rebooting
We have an HP Proliant DL380 G3 server (see specs below) running VMWare (see specs below)with two virtual machines. For some reason the host sporadically reboots so the two virtual machines go with it. We cant figure out if the reboot is being caused by the HP server or the VMWare software
We have a log file attached.
If there is any info i missed please let me know.
Any help would be appreciated....
Thank you
David
HP Proliant DL 380 G3 Specs
2 CPU x 3.054 Ghz (Intel Xeon 3.06)
8.75 GB Memory
Hyperthreading = active
2 virtual Machines
2 power supplies (both being used)
VMWare
ESX Server 3i (version 3.5.0 Build 238493)
last message repeated 1 times
Apr 23 17:31:13 Hostd: [2010-04-23 17:31:13.303 'SyslogConfigProvider' 196621 info] Set called with key 'Syslog.Remote.Hostname' value '"192.168.12.54"'
Apr 23 17:31:13 Hostd: [2010-04-23 17:31:13.311 'TaskManager' 196621 info] Task Completed : haTask-ha-host-vim.option. OptionMana ger.update Values-116
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Activation [N5Vmomi10ActivationE:0xa6 ae2a8] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Result:
Apr 23 17:31:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:31:39 Hostd:
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.174 'App' 81926 error] Failed to send response to the client: Broken pipe
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.288 'Vmomi' 278544 info] Activation [N5Vmomi10ActivationE:0x18 61d048] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.290 'Vmomi' 278544 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.290 'Vmomi' 278544 info] Result:
Apr 23 17:32:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:32:39 Hostd:
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.291 'App' 278544 error] Failed to send response to the client: Broken pipe
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.404 'Vmomi' 311313 info] Activation [N5Vmomi10ActivationE:0x18 3337b8] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.405 'Vmomi' 311313 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.405 'Vmomi' 311313 info] Result:
Apr 23 17:33:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:33:39 Hostd:
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.408 'App' 311313 error] Failed to send response to the client: Broken pipe
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Activation [N5Vmomi10ActivationE:0x18 3337b8] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Result:
Apr 23 17:34:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:34:39 Hostd:
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.525 'App' 327698 error] Failed to send response to the client: Broken pipe
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.636 'Vmomi' 131081 info] Activation [N5Vmomi10ActivationE:0x18 b01d10] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.636 'Vmomi' 131081 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.637 'Vmomi' 131081 info] Result:
Apr 23 17:35:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:35:39 Hostd:
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.638 'App' 131081 error] Failed to send response to the client: Broken pipe
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Activation [N5Vmomi10ActivationE:0xa6 a9d60] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Result:
Apr 23 17:36:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:36:39 Hostd:
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.762 'App' 180236 error] Failed to send response to the client: Broken pipe
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.869 'Vmomi' 327698 info] Activation [N5Vmomi10ActivationE:0x18 b00dc8] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.870 'Vmomi' 327698 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.870 'Vmomi' 327698 info] Result:
Apr 23 17:37:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:37:39 Hostd:
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.871 'App' 327698 error] Failed to send response to the client: Broken pipe
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.981 'Vmomi' 131081 info] Activation [N5Vmomi10ActivationE:0x18 387b08] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.982 'Vmomi' 131081 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.983 'Vmomi' 131081 info] Result:
Apr 23 17:38:39 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:38:39 Hostd:
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.986 'App' 131081 error] Failed to send response to the client: Broken pipe
Apr 23 17:39:31 sfcb[1510]: Process "emulex" PID is 9801
Apr 23 17:39:31 sfcb[1510]: Process "lsi_storage" PID is 9812
Apr 23 17:39:31 sfcb[9814]: INTERNAL System::loadConfigurationD ata()::Fai led to open configuration file: /etc/cim/lsi/lsi_mr.conf
Apr 23 17:39:32 sfcbd[2631]: TIMEOUT DOING SHARED SOCKET RECV RESULT
Apr 23 17:39:32 sfcbd[2631]: Request Header Id (362) != Response Header reqId (0) in request to provider 220 in process 4
Apr 23 17:39:32 sfcb[1517]: SLP data collection finished
Apr 23 17:39:33 sfcbd[10118]: -#- SMXSmartArray - 2970 provider exiting due to a SIGSEGV signal
Apr 23 17:39:33 vmkernel: 0:00:29:56.259 cpu3:10118)User: 1973: wantCoreDump : sfcbd -enabled : 0
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.101 'Vmomi' 49156 info] Activation [N5Vmomi10ActivationE:0x18 b05228] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.101 'Vmomi' 49156 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.102 'Vmomi' 49156 info] Result:
Apr 23 17:39:40 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:39:40 Hostd:
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.104 'App' 49156 error] Failed to send response to the client: Broken pipe
Apr 23 17:40:01 crond[1292]: USER root pid 10220 cmd /sbin/decodeSel.sh #Every 10 minutes, translate the latest IPMI SEL data
Apr 23 17:40:10 sfcb[1510]: Process "smx" PID is 10294
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.213 'Vmomi' 196621 info] Activation [N5Vmomi10ActivationE:0x18 61d048] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.214 'Vmomi' 196621 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.215 'Vmomi' 196621 info] Result:
Apr 23 17:40:40 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:40:40 Hostd:
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.218 'App' 196621 error] Failed to send response to the client: Broken pipe
Apr 23 17:41:13 Hostd: [2010-04-23 17:41:13.535 'PropertyCollector' 327698 warning] GetPropertyProvider failed for haTask-ha-host-vim.option. OptionMana ger.update Values-116
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.346 'Vmomi' 180236 info] Activation [N5Vmomi10ActivationE:0x18 b00da0] : Invoke done [waitForUpdates] on [vmodl.query.PropertyColle ctor:ha-pr operty-col lector]
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.346 'Vmomi' 180236 info] Throw vmodl.fault.RequestCancele d
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.347 'Vmomi' 180236 info] Result:
Apr 23 17:41:40 Hostd: (vmodl.fault.RequestCancel ed) { dynamicType = <unset>, msg = "" }
Apr 23 17:41:40 Hostd:
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.361 'App' 180236 error] Failed to send response to the client: Broken pipe
-
We have a log file attached.
If there is any info i missed please let me know.
Any help would be appreciated....
Thank you
David
HP Proliant DL 380 G3 Specs
2 CPU x 3.054 Ghz (Intel Xeon 3.06)
8.75 GB Memory
Hyperthreading = active
2 virtual Machines
2 power supplies (both being used)
VMWare
ESX Server 3i (version 3.5.0 Build 238493)
last message repeated 1 times
Apr 23 17:31:13 Hostd: [2010-04-23 17:31:13.303 'SyslogConfigProvider' 196621 info] Set called with key 'Syslog.Remote.Hostname' value '"192.168.12.54"'
Apr 23 17:31:13 Hostd: [2010-04-23 17:31:13.311 'TaskManager' 196621 info] Task Completed : haTask-ha-host-vim.option.
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Activation [N5Vmomi10ActivationE:0xa6
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Throw vmodl.fault.RequestCancele
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.173 'Vmomi' 81926 info] Result:
Apr 23 17:31:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:31:39 Hostd:
Apr 23 17:31:39 Hostd: [2010-04-23 17:31:39.174 'App' 81926 error] Failed to send response to the client: Broken pipe
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.288 'Vmomi' 278544 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.290 'Vmomi' 278544 info] Throw vmodl.fault.RequestCancele
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.290 'Vmomi' 278544 info] Result:
Apr 23 17:32:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:32:39 Hostd:
Apr 23 17:32:39 Hostd: [2010-04-23 17:32:39.291 'App' 278544 error] Failed to send response to the client: Broken pipe
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.404 'Vmomi' 311313 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.405 'Vmomi' 311313 info] Throw vmodl.fault.RequestCancele
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.405 'Vmomi' 311313 info] Result:
Apr 23 17:33:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:33:39 Hostd:
Apr 23 17:33:39 Hostd: [2010-04-23 17:33:39.408 'App' 311313 error] Failed to send response to the client: Broken pipe
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Throw vmodl.fault.RequestCancele
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.523 'Vmomi' 327698 info] Result:
Apr 23 17:34:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:34:39 Hostd:
Apr 23 17:34:39 Hostd: [2010-04-23 17:34:39.525 'App' 327698 error] Failed to send response to the client: Broken pipe
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.636 'Vmomi' 131081 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.636 'Vmomi' 131081 info] Throw vmodl.fault.RequestCancele
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.637 'Vmomi' 131081 info] Result:
Apr 23 17:35:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:35:39 Hostd:
Apr 23 17:35:39 Hostd: [2010-04-23 17:35:39.638 'App' 131081 error] Failed to send response to the client: Broken pipe
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Activation [N5Vmomi10ActivationE:0xa6
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Throw vmodl.fault.RequestCancele
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.761 'Vmomi' 180236 info] Result:
Apr 23 17:36:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:36:39 Hostd:
Apr 23 17:36:39 Hostd: [2010-04-23 17:36:39.762 'App' 180236 error] Failed to send response to the client: Broken pipe
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.869 'Vmomi' 327698 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.870 'Vmomi' 327698 info] Throw vmodl.fault.RequestCancele
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.870 'Vmomi' 327698 info] Result:
Apr 23 17:37:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:37:39 Hostd:
Apr 23 17:37:39 Hostd: [2010-04-23 17:37:39.871 'App' 327698 error] Failed to send response to the client: Broken pipe
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.981 'Vmomi' 131081 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.982 'Vmomi' 131081 info] Throw vmodl.fault.RequestCancele
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.983 'Vmomi' 131081 info] Result:
Apr 23 17:38:39 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:38:39 Hostd:
Apr 23 17:38:39 Hostd: [2010-04-23 17:38:39.986 'App' 131081 error] Failed to send response to the client: Broken pipe
Apr 23 17:39:31 sfcb[1510]: Process "emulex" PID is 9801
Apr 23 17:39:31 sfcb[1510]: Process "lsi_storage" PID is 9812
Apr 23 17:39:31 sfcb[9814]: INTERNAL System::loadConfigurationD
Apr 23 17:39:32 sfcbd[2631]: TIMEOUT DOING SHARED SOCKET RECV RESULT
Apr 23 17:39:32 sfcbd[2631]: Request Header Id (362) != Response Header reqId (0) in request to provider 220 in process 4
Apr 23 17:39:32 sfcb[1517]: SLP data collection finished
Apr 23 17:39:33 sfcbd[10118]: -#- SMXSmartArray - 2970 provider exiting due to a SIGSEGV signal
Apr 23 17:39:33 vmkernel: 0:00:29:56.259 cpu3:10118)User: 1973: wantCoreDump : sfcbd -enabled : 0
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.101 'Vmomi' 49156 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.101 'Vmomi' 49156 info] Throw vmodl.fault.RequestCancele
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.102 'Vmomi' 49156 info] Result:
Apr 23 17:39:40 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:39:40 Hostd:
Apr 23 17:39:40 Hostd: [2010-04-23 17:39:40.104 'App' 49156 error] Failed to send response to the client: Broken pipe
Apr 23 17:40:01 crond[1292]: USER root pid 10220 cmd /sbin/decodeSel.sh #Every 10 minutes, translate the latest IPMI SEL data
Apr 23 17:40:10 sfcb[1510]: Process "smx" PID is 10294
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.213 'Vmomi' 196621 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.214 'Vmomi' 196621 info] Throw vmodl.fault.RequestCancele
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.215 'Vmomi' 196621 info] Result:
Apr 23 17:40:40 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:40:40 Hostd:
Apr 23 17:40:40 Hostd: [2010-04-23 17:40:40.218 'App' 196621 error] Failed to send response to the client: Broken pipe
Apr 23 17:41:13 Hostd: [2010-04-23 17:41:13.535 'PropertyCollector' 327698 warning] GetPropertyProvider failed for haTask-ha-host-vim.option.
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.346 'Vmomi' 180236 info] Activation [N5Vmomi10ActivationE:0x18
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.346 'Vmomi' 180236 info] Throw vmodl.fault.RequestCancele
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.347 'Vmomi' 180236 info] Result:
Apr 23 17:41:40 Hostd: (vmodl.fault.RequestCancel
Apr 23 17:41:40 Hostd:
Apr 23 17:41:40 Hostd: [2010-04-23 17:41:40.361 'App' 180236 error] Failed to send response to the client: Broken pipe
-
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
you can install the insight agent without a reboot and be able to start looking at immediately.
ASKER
Definitely a hardware related problem. We just swapped out the server as we couldn't put the nail on it.
ASKER
Thank you