• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 5991
  • Last Modified:

Server 2008 x64 SP1, Rebooted unexpectedly.

File server,  IBM 3650, 7979 with Server 2008 /64 SP1 fully patched and updated unexpectedly rebooted. The 2 on board NICs are teamed together.
Last event before reboot was: Event #4, "Broadcom BCM5708C: The network link is down.  Check to make sure the network cable is properly connected."
IBM has run a DSA and confirmed that there is no hardware failure.
 I have attached the Memory dump bellow.

Thank You.
Opened log file 'c:\debuglog.txt'
0: kd> .sympath srv*c:\symbols*http://msdl.microsoft.com/download/symbols 
Symbol search path is: srv*c:\symbols*http://msdl.microsoft.com/download/symbols 
Expanded Symbol search path is: srv*c:\symbols*http://msdl.microsoft.com/download/symbols 
WARNING: Whitespace at end of path element
0: kd> .sympath srv*c:\symbols*http://msdl.microsoft.com/download/symbols
Symbol search path is: srv*c:\symbols*http://msdl.microsoft.com/download/symbols
Expanded Symbol search path is: srv*c:\symbols*http://msdl.microsoft.com/download/symbols
0: kd> .reload;!analyze -v;r;!thread;lmnt;.logclose;q
Loading Kernel Symbols
...............................................................
................................................................
...................
Loading User Symbols
PEB is paged out (Peb.Ldr = 000007ff`fffd9018).  Type ".hh dbgerr001" for details
Loading unloaded module list
.......................................
*******************************************************************************
*                                                                             *
*                        Bugcheck Analysis                                    *
*                                                                             *
*******************************************************************************
 
SYSTEM_SERVICE_EXCEPTION (3b)
An exception happened while executing a system service routine.
Arguments:
Arg1: 00000000c0000005, Exception code that caused the bugcheck
Arg2: fffffa60084db6a8, Address of the exception record for the exception that caused the bugcheck
Arg3: fffffa600a2b5eb0, Address of the context record for the exception that caused the bugcheck
Arg4: 0000000000000000, zero.
 
Debugging Details:
------------------
 
PEB is paged out (Peb.Ldr = 000007ff`fffd9018).  Type ".hh dbgerr001" for details
PEB is paged out (Peb.Ldr = 000007ff`fffd9018).  Type ".hh dbgerr001" for details
 
EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at "0x%08lx" referenced memory at "0x%08lx". The memory could not be "%s".
 
FAULTING_IP: 
srvnet!SvcLengthOfStringInApiBuffer+8
fffffa60`084db6a8 0fb701          movzx   eax,word ptr [rcx]
 
CONTEXT:  fffffa600a2b5eb0 -- (.cxr 0xfffffa600a2b5eb0)
.cxr 0xfffffa600a2b5eb0
rax=0000000000000000 rbx=fffff88016291940 rcx=0000000000000020
rdx=fffff88017ce3ab0 rsi=fffff8800a6e2a40 rdi=fffff88017ce3a70
rip=fffffa60084db6a8 rsp=fffffa600a2b6718 rbp=0000000000000000
 r8=0000000000000010  r9=fffff8800a50b758 r10=0000000000000073
r11=0000000000000000 r12=0000000010af9800 r13=fffffa60084df260
r14=0000000000000000 r15=0000000000000000
iopl=0         nv up ei pl nz na pe nc
cs=0010  ss=0018  ds=002b  es=002b  fs=0053  gs=002b             efl=00010202
srvnet!SvcLengthOfStringInApiBuffer+0x8:
fffffa60`084db6a8 0fb701          movzx   eax,word ptr [rcx] ds:002b:00000000`00000020=????
.cxr
Resetting default scope
 
DEFAULT_BUCKET_ID:  VISTA_DRIVER_FAULT
 
BUGCHECK_STR:  0x3B
 
PROCESS_NAME:  svchost.exe
 
CURRENT_IRQL:  0
 
LAST_CONTROL_TRANSFER:  from fffffa60084e0acf to fffffa60084db6a8
 
STACK_TEXT:  
fffffa60`0a2b6718 fffffa60`084e0acf : fffff880`16291940 fffff880`16291940 00000000`00000000 00000000`00000000 : srvnet!SvcLengthOfStringInApiBuffer+0x8
fffffa60`0a2b6720 fffffa60`084e1218 : fffff880`17ce3a70 00000000`00000000 00000000`00000000 fffff800`01b49384 : srvnet!SizeConnections+0x6f
fffffa60`0a2b6750 fffffa60`084e2631 : 00000000`00074001 00000000`00000000 23300000`00002000 fffff880`0a512000 : srvnet!SvcEnumApiHandler64+0x98
fffffa60`0a2b67e0 fffffa60`084d1c11 : fffffa80`41856440 00000000`00002000 fffffa60`00000001 00000000`00000002 : srvnet!SvcConnectionEnum+0x71
fffffa60`0a2b6840 fffffa60`084ec296 : fffffa80`328a6fb0 00000000`00146003 fffffa80`328a6ee0 00000000`0000005c : srvnet!SrvAdminProcessFsctl+0x171
fffffa60`0a2b68c0 fffffa60`084d159e : fffffa80`328a6fb0 00000000`00146003 fffffa80`328a6ee0 00000000`00000000 : srvnet!SrvNetProcessFsctl+0x286
fffffa60`0a2b6940 fffffa60`084ec2e4 : fffffa80`328a6ee0 00000000`00000003 fffffa60`0a2b6ca0 00000000`00000001 : srvnet!SrvNetDeviceControl+0x8e
fffffa60`0a2b69c0 fffff800`01b3331a : fffffa80`32097f20 fffffa80`32097f20 00000000`00000001 00ff0000`01b40001 : srvnet!SrvNetDefaultDispatch+0x24
fffffa60`0a2b69f0 fffff800`01b3bac2 : 00000000`03bfee20 00000000`00001714 00000000`00000000 00000000`00000000 : nt!IopXxxControlFile+0x5da
fffffa60`0a2b6b40 fffff800`018aedf3 : fffffa80`33b4e610 00000000`03bfed98 fffffa60`0a2b6bc8 00000000`00000000 : nt!NtFsControlFile+0x56
fffffa60`0a2b6bb0 00000000`76ee5e0a : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KiSystemServiceCopyEnd+0x13
00000000`03bfed78 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x76ee5e0a
 
 
FOLLOWUP_IP: 
srvnet!SvcLengthOfStringInApiBuffer+8
fffffa60`084db6a8 0fb701          movzx   eax,word ptr [rcx]
 
SYMBOL_STACK_INDEX:  0
 
SYMBOL_NAME:  srvnet!SvcLengthOfStringInApiBuffer+8
 
FOLLOWUP_NAME:  MachineOwner
 
MODULE_NAME: srvnet
 
IMAGE_NAME:  srvnet.sys
 
DEBUG_FLR_IMAGE_TIMESTAMP:  47919116
 
STACK_COMMAND:  .cxr 0xfffffa600a2b5eb0 ; kb
 
FAILURE_BUCKET_ID:  X64_0x3B_srvnet!SvcLengthOfStringInApiBuffer+8
 
BUCKET_ID:  X64_0x3B_srvnet!SvcLengthOfStringInApiBuffer+8
 
Followup: MachineOwner
---------
 
rax=fffffa600a2b5600 rbx=fffffa600a2b6c20 rcx=000000000000003b
rdx=00000000c0000005 rsi=fffff800018aedf3 rdi=fffff80001a5ddf4
rip=fffff800018af350 rsp=fffffa600a2b54f8 rbp=fffffa600a2b64d8
 r8=fffffa60084db6a8  r9=fffffa600a2b5eb0 r10=0000000000000000
r11=0000000000000001 r12=fffffa600a2b1000 r13=fffffa600a2b7000
r14=fffff8000185a000 r15=fffff800019a84ec
iopl=0         nv up ei ng nz na po nc
cs=0010  ss=0018  ds=002b  es=002b  fs=0053  gs=002b             efl=00000286
nt!KeBugCheckEx:
fffff800`018af350 48894c2408      mov     qword ptr [rsp+8],rcx ss:0018:fffffa60`0a2b5500=000000000000003b
THREAD fffffa8033b4e610  Cid 0238.1268  Teb: 000007fffffa6000 Win32Thread: 0000000000000000 RUNNING on processor 0
IRP List:
    fffffa80328a6ee0: (0006,0118) Flags: 00060800  Mdl: 00000000
Not impersonating
DeviceMap                 fffff880000061f0
Owning Process            fffffa8031b1d040       Image:         svchost.exe
Attached Process          N/A            Image:         N/A
Wait Start TickCount      37380624       Ticks: 0
Context Switch Count      2364             
UserTime                  00:00:00.000
KernelTime                00:00:00.015
Win32 Start Address 0x000007fefec91840
Stack Init fffffa600a2b6db0 Current fffffa600a2b67e0
Base fffffa600a2b7000 Limit fffffa600a2b1000 Call 0
Priority 10 BasePriority 8 PriorityDecrement 0 IoPriority 2 PagePriority 5
Child-SP          RetAddr           : Args to Child                                                           : Call Site
fffffa60`0a2b54f8 fffff800`018af0ee : 00000000`0000003b 00000000`c0000005 fffffa60`084db6a8 fffffa60`0a2b5eb0 : nt!KeBugCheckEx
fffffa60`0a2b5500 fffff800`018aeabc : fffffa60`0a2b64d8 fffffa60`0a2b5eb0 fffff800`019b1b4c fffff800`0185a000 : nt!KiBugCheckDispatch+0x6e
fffffa60`0a2b5640 fffff800`018c26bd : 00000000`00000000 fffff800`0185a000 fffffa60`0a2b7000 fffff800`01a5ddf4 : nt!KiSystemServiceHandler+0x7c
fffffa60`0a2b5680 fffff800`018c9cff : fffffa60`00000001 00000000`00000001 00000000`00000000 fffffa60`0a2b6c20 : nt!RtlpExecuteHandlerForException+0xd
fffffa60`0a2b56b0 fffff800`01886d83 : fffffa60`0a2b64d8 fffffa60`0a2b5eb0 00000000`00000000 fffffa60`0a2b6580 : nt!RtlDispatchException+0x22f
fffffa60`0a2b5da0 fffff800`018af1a9 : fffffa60`0a2b64d8 fffff880`16291940 fffffa60`0a2b6580 fffff880`0a6e2a40 : nt!KiDispatchException+0xc3
fffffa60`0a2b63a0 fffff800`018adfa5 : 00000000`00000000 00000000`000ff601 00000000`00000000 fffff880`16291940 : nt!KiExceptionDispatch+0xa9
fffffa60`0a2b6580 fffffa60`084db6a8 : fffffa60`084e0acf fffff880`16291940 fffff880`16291940 00000000`00000000 : nt!KiPageFault+0x1e5 (TrapFrame @ fffffa60`0a2b6580)
fffffa60`0a2b6718 fffffa60`084e0acf : fffff880`16291940 fffff880`16291940 00000000`00000000 00000000`00000000 : srvnet!SvcLengthOfStringInApiBuffer+0x8
fffffa60`0a2b6720 fffffa60`084e1218 : fffff880`17ce3a70 00000000`00000000 00000000`00000000 fffff800`01b49384 : srvnet!SizeConnections+0x6f
fffffa60`0a2b6750 fffffa60`084e2631 : 00000000`00074001 00000000`00000000 23300000`00002000 fffff880`0a512000 : srvnet!SvcEnumApiHandler64+0x98
fffffa60`0a2b67e0 fffffa60`084d1c11 : fffffa80`41856440 00000000`00002000 fffffa60`00000001 00000000`00000002 : srvnet!SvcConnectionEnum+0x71
fffffa60`0a2b6840 fffffa60`084ec296 : fffffa80`328a6fb0 00000000`00146003 fffffa80`328a6ee0 00000000`0000005c : srvnet!SrvAdminProcessFsctl+0x171
fffffa60`0a2b68c0 fffffa60`084d159e : fffffa80`328a6fb0 00000000`00146003 fffffa80`328a6ee0 00000000`00000000 : srvnet!SrvNetProcessFsctl+0x286
fffffa60`0a2b6940 fffffa60`084ec2e4 : fffffa80`328a6ee0 00000000`00000003 fffffa60`0a2b6ca0 00000000`00000001 : srvnet!SrvNetDeviceControl+0x8e
fffffa60`0a2b69c0 fffff800`01b3331a : fffffa80`32097f20 fffffa80`32097f20 00000000`00000001 00ff0000`01b40001 : srvnet!SrvNetDefaultDispatch+0x24
fffffa60`0a2b69f0 fffff800`01b3bac2 : 00000000`03bfee20 00000000`00001714 00000000`00000000 00000000`00000000 : nt!IopXxxControlFile+0x5da
fffffa60`0a2b6b40 fffff800`018aedf3 : fffffa80`33b4e610 00000000`03bfed98 fffffa60`0a2b6bc8 00000000`00000000 : nt!NtFsControlFile+0x56
fffffa60`0a2b6bb0 00000000`76ee5e0a : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KiSystemServiceCopyEnd+0x13 (TrapFrame @ fffffa60`0a2b6c20)
00000000`03bfed78 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x76ee5e0a
 
start             end                 module name
fffff800`01814000 fffff800`0185a000   hal      hal.dll      Sat Jan 19 02:55:25 2008 (4791ACED)
fffff800`0185a000 fffff800`01d72000   nt       ntkrnlmp.exe Wed Sep 17 22:17:25 2008 (48D1BA35)
fffff960`00030000 fffff960`002e1000   win32k   win32k.sys   Wed Sep 17 22:27:53 2008 (48D1BCA9)
fffff960`00440000 fffff960`0045e000   dxg      dxg.sys      Sat Jan 19 01:08:00 2008 (479193C0)
fffff960`00660000 fffff960`0066a000   TSDDD    TSDDD.dll    Sat Jan 19 01:42:04 2008 (47919BBC)
fffff960`008b0000 fffff960`0091a000   ati2dvag ati2dvag.dll Mon Jan 21 22:34:35 2008 (4795644B)
fffff960`00a20000 fffff960`00a82000   ati2cqag ati2cqag.dll Mon Jan 21 21:38:51 2008 (4795573B)
fffff960`00ca0000 fffff960`00ce7000   atikvmag atikvmag.dll Mon Jan 21 22:01:44 2008 (47955C98)
fffff960`00e30000 fffff960`00e60000   RDPDD    RDPDD.dll    Sat Jan 19 01:42:36 2008 (47919BDC)
fffffa60`0060f000 fffffa60`00619000   kdcom    kdcom.dll    Sat Jan 19 02:58:25 2008 (4791ADA1)
fffffa60`00619000 fffffa60`00646000   mcupdate_GenuineIntel mcupdate_GenuineIntel.dll Sat Jan 19 02:56:17 2008 (4791AD21)
fffffa60`00646000 fffffa60`0065a000   PSHED    PSHED.dll    Sat Jan 19 02:58:13 2008 (4791AD95)
fffffa60`0065a000 fffffa60`006b7000   CLFS     CLFS.SYS     Sat Jan 19 00:53:58 2008 (47919076)
fffffa60`006b7000 fffffa60`00768000   CI       CI.dll       Sat Jan 19 02:57:59 2008 (4791AD87)
fffffa60`00784000 fffffa60`007d4000   msrpc    msrpc.sys    Sat Jan 19 01:27:01 2008 (47919835)
fffffa60`0080a000 fffffa60`009cd000   NDIS     NDIS.SYS     Sat Jan 19 01:37:13 2008 (47919A99)
fffffa60`009cd000 fffffa60`009e2000   partmgr  partmgr.sys  Sat Jan 19 01:29:14 2008 (479198BA)
fffffa60`00a00000 fffffa60`00a58000   NETIO    NETIO.SYS    Sat Jan 19 01:37:27 2008 (47919AA7)
fffffa60`00a58000 fffffa60`00b32000   Wdf01000 Wdf01000.sys Sat Jan 19 01:33:27 2008 (479199B7)
fffffa60`00b32000 fffffa60`00b40000   WDFLDR   WDFLDR.SYS   Sat Jan 19 01:32:33 2008 (47919981)
fffffa60`00b40000 fffffa60`00b96000   acpi     acpi.sys     Sat Jan 19 01:02:45 2008 (47919285)
fffffa60`00b96000 fffffa60`00b9f000   WMILIB   WMILIB.SYS   Sat Jan 19 01:33:45 2008 (479199C9)
fffffa60`00b9f000 fffffa60`00ba9000   msisadrv msisadrv.sys Sat Jan 19 01:02:50 2008 (4791928A)
fffffa60`00ba9000 fffffa60`00bd9000   pci      pci.sys      Sat Jan 19 01:02:57 2008 (47919291)
fffffa60`00bd9000 fffffa60`00bfb000   mpio     mpio.sys     Sat Jan 19 01:30:31 2008 (47919907)
fffffa60`00c0a000 fffffa60`00c43000   ds4utm   ds4utm.sys   Wed Sep 24 13:03:50 2008 (48DA72F6)
fffffa60`00c43000 fffffa60`00c57000   volmgr   volmgr.sys   Sat Jan 19 01:29:12 2008 (479198B8)
fffffa60`00c57000 fffffa60`00cbd000   volmgrx  volmgrx.sys  Sat Jan 19 01:29:45 2008 (479198D9)
fffffa60`00cbd000 fffffa60`00cc4000   pciide   pciide.sys   Thu Nov 02 05:38:14 2006 (4549BC86)
fffffa60`00cc4000 fffffa60`00cd4000   PCIIDEX  PCIIDEX.SYS  Sat Jan 19 01:28:53 2008 (479198A5)
fffffa60`00cd4000 fffffa60`00cf2000   msdsm    msdsm.sys    Sat Jan 19 01:30:37 2008 (4791990D)
fffffa60`00cf2000 fffffa60`00d40000   ds4dsm   ds4dsm.sys   Wed Sep 24 13:02:53 2008 (48DA72BD)
fffffa60`00d40000 fffffa60`00d53000   mountmgr mountmgr.sys Sat Jan 19 01:28:01 2008 (47919871)
fffffa60`00d53000 fffffa60`00d5b000   atapi    atapi.sys    Sat Jan 19 01:28:49 2008 (479198A1)
fffffa60`00d5b000 fffffa60`00d7f000   ataport  ataport.SYS  Sat Jan 19 01:28:52 2008 (479198A4)
fffffa60`00d7f000 fffffa60`00d8e000   RepDac   RepDac.sys   Thu Jan 22 17:16:16 2009 (4978F030)
fffffa60`00d8e000 fffffa60`00dae000   RepDrv   RepDrv.sys   Thu Jan 22 17:16:23 2009 (4978F037)
fffffa60`00dae000 fffffa60`00dd6000   RepKap   RepKap.sys   Thu Jan 22 17:16:27 2009 (4978F03B)
fffffa60`00e06000 fffffa60`00f39000   ql2300   ql2300.sys   Fri Nov 17 18:09:46 2006 (455E413A)
fffffa60`00f39000 fffffa60`00f96000   storport storport.sys Sat Jan 19 01:29:09 2008 (479198B5)
fffffa60`00f96000 fffffa60`00faf000   arcsas   arcsas.sys   Fri May 25 14:59:06 2007 (465731FA)
fffffa60`00faf000 fffffa60`00ff5000   fltmgr   fltmgr.sys   Sat Jan 19 00:54:10 2008 (47919082)
fffffa60`0100d000 fffffa60`01088000   bxvbda   bxvbda.sys   Tue Aug 12 19:42:45 2008 (48A21FF5)
fffffa60`01088000 fffffa60`0110d000   ksecdd   ksecdd.sys   Sat Jan 19 01:16:38 2008 (479195C6)
fffffa60`01130000 fffffa60`0113c000   tunnel   tunnel.sys   Sat Jan 19 01:36:44 2008 (47919A7C)
fffffa60`0113c000 fffffa60`0114f000   intelppm intelppm.sys Sat Jan 19 00:52:45 2008 (4791902D)
fffffa60`0114f000 fffffa60`01164000   bxnd60a  bxnd60a.sys  Mon Aug 18 17:40:41 2008 (48A9EC59)
fffffa60`01164000 fffffa60`01170000   usbuhci  usbuhci.sys  Sat Jan 19 01:33:56 2008 (479199D4)
fffffa60`01170000 fffffa60`011b6000   USBPORT  USBPORT.SYS  Sat Jan 19 01:34:00 2008 (479199D8)
fffffa60`011b6000 fffffa60`011c7000   usbehci  usbehci.sys  Sat Jan 19 01:33:57 2008 (479199D5)
fffffa60`011c7000 fffffa60`011e4000   tdx      tdx.sys      Sat Jan 19 01:36:53 2008 (47919A85)
fffffa60`011e4000 fffffa60`011ff000   smb      smb.sys      Sat Jan 19 01:36:17 2008 (47919A61)
fffffa60`01200000 fffffa60`01209000   rasacd   rasacd.sys   Sat Jan 19 01:37:30 2008 (47919AAA)
fffffa60`01209000 fffffa60`0137d000   tcpip    tcpip.sys    Sat Jan 19 01:38:58 2008 (47919B02)
fffffa60`0137d000 fffffa60`013a9000   fwpkclnt fwpkclnt.sys Sat Jan 19 01:36:43 2008 (47919A7B)
fffffa60`013a9000 fffffa60`013b6000   qd160x64 qd160x64.sys Fri Jan 18 11:42:22 2008 (4790D6EE)
fffffa60`013b6000 fffffa60`013c5000   storflt  storflt.sys  Wed Jun 11 08:13:52 2008 (484FC180)
fffffa60`013c5000 fffffa60`013f1000   CLASSPNP CLASSPNP.SYS Sat Jan 19 01:28:53 2008 (479198A5)
fffffa60`01400000 fffffa60`0140a000   crcdisk  crcdisk.sys  Sat Jan 19 01:30:12 2008 (479198F4)
fffffa60`0140a000 fffffa60`0158e000   Ntfs     Ntfs.sys     Sat Jan 19 00:55:29 2008 (479190D1)
fffffa60`0158e000 fffffa60`015d2000   volsnap  volsnap.sys  Sat Jan 19 01:29:47 2008 (479198DB)
fffffa60`015d2000 fffffa60`015da000   spldr    spldr.sys    Thu Jun 21 20:57:56 2007 (467B1E94)
fffffa60`015da000 fffffa60`015ec000   mup      mup.sys      Sat Jan 19 00:54:18 2008 (4791908A)
fffffa60`015ec000 fffffa60`01600000   disk     disk.sys     Sat Jan 19 01:29:02 2008 (479198AE)
fffffa60`04607000 fffffa60`0482d000   ati2mtag ati2mtag.sys Mon Jan 21 22:34:13 2008 (47956435)
fffffa60`0482d000 fffffa60`04852000   VIDEOPRT VIDEOPRT.SYS Sat Jan 19 01:32:25 2008 (47919979)
fffffa60`04852000 fffffa60`04861000   watchdog watchdog.sys Sat Jan 19 01:07:23 2008 (4791939B)
fffffa60`04861000 fffffa60`0487e000   serial   serial.sys   Sat Jan 19 01:28:41 2008 (47919899)
fffffa60`0487e000 fffffa60`0488a000   serenum  serenum.sys  Sat Jan 19 01:28:36 2008 (47919894)
fffffa60`0488a000 fffffa60`048a2000   IPMIDrv  IPMIDrv.sys  Sat Jan 19 01:13:43 2008 (47919517)
fffffa60`048a2000 fffffa60`048be000   cdrom    cdrom.sys    Sat Jan 19 01:29:04 2008 (479198B0)
fffffa60`048be000 fffffa60`048d8000   basp     basp.sys     Wed May 28 13:17:57 2008 (483D93C5)
fffffa60`048d8000 fffffa60`048e5000   TDI      TDI.SYS      Sat Jan 19 01:38:11 2008 (47919AD3)
fffffa60`048e5000 fffffa60`0491d000   msiscsi  msiscsi.sys  Sat Jan 19 01:30:31 2008 (47919907)
fffffa60`0491d000 fffffa60`04940000   rasl2tp  rasl2tp.sys  Sat Jan 19 01:37:33 2008 (47919AAD)
fffffa60`04940000 fffffa60`0494c000   ndistapi ndistapi.sys Sat Jan 19 01:37:22 2008 (47919AA2)
fffffa60`0494c000 fffffa60`0497d000   ndiswan  ndiswan.sys  Sat Jan 19 01:37:33 2008 (47919AAD)
fffffa60`0497d000 fffffa60`0498d000   raspppoe raspppoe.sys Sat Jan 19 01:37:30 2008 (47919AAA)
fffffa60`0498d000 fffffa60`049ab000   raspptp  raspptp.sys  Sat Jan 19 01:37:34 2008 (47919AAE)
fffffa60`049ab000 fffffa60`049c3000   rassstp  rassstp.sys  Sat Jan 19 01:37:42 2008 (47919AB6)
fffffa60`049c3000 fffffa60`049d1000   vga      vga.sys      Sat Jan 19 01:32:21 2008 (47919975)
fffffa60`049d1000 fffffa60`049da000   RDPCDD   RDPCDD.sys   Sat Jan 19 01:42:04 2008 (47919BBC)
fffffa60`049da000 fffffa60`049e3000   rdpencdd rdpencdd.sys Sat Jan 19 01:42:03 2008 (47919BBB)
fffffa60`049e3000 fffffa60`049ee000   Msfs     Msfs.SYS     Sat Jan 19 00:53:55 2008 (47919073)
fffffa60`049ee000 fffffa60`049ff000   Npfs     Npfs.SYS     Sat Jan 19 00:53:57 2008 (47919075)
fffffa60`04a06000 fffffa60`04aa0000   rdpdr    rdpdr.sys    Sat Jan 19 01:43:38 2008 (47919C1A)
fffffa60`04aa0000 fffffa60`04ab2000   termdd   termdd.sys   Sat Jan 19 01:42:03 2008 (47919BBB)
fffffa60`04ab2000 fffffa60`04ac0000   kbdclass kbdclass.sys Sat Jan 19 01:28:05 2008 (47919875)
fffffa60`04ac0000 fffffa60`04acc000   mouclass mouclass.sys Sat Jan 19 01:28:05 2008 (47919875)
fffffa60`04acc000 fffffa60`04acd480   swenum   swenum.sys   Thu Nov 02 05:37:33 2006 (4549BC5D)
fffffa60`04ace000 fffffa60`04b02000   ks       ks.sys       Sat Jan 19 01:28:24 2008 (47919888)
fffffa60`04b02000 fffffa60`04b0d000   mssmbios mssmbios.sys Sat Jan 19 01:02:54 2008 (4791928E)
fffffa60`04b0d000 fffffa60`04b1d000   umbus    umbus.sys    Sat Jan 19 01:34:16 2008 (479199E8)
fffffa60`04b1d000 fffffa60`04b64000   usbhub   usbhub.sys   Sat Jan 19 01:34:13 2008 (479199E5)
fffffa60`04b64000 fffffa60`04b78000   NDProxy  NDProxy.SYS  Sat Jan 19 01:37:26 2008 (47919AA6)
fffffa60`04b78000 fffffa60`04beb000   SRTSP64  SRTSP64.SYS  Wed Jan 28 21:55:07 2009 (49811A8B)
fffffa60`04beb000 fffffa60`04bff000   SRTSPX64 SRTSPX64.SYS Wed Jan 28 21:57:42 2009 (49811B26)
fffffa60`06200000 fffffa60`06209000   Null     Null.SYS     Thu Nov 02 05:37:15 2006 (4549BC4B)
fffffa60`06209000 fffffa60`06372000   EX64     EX64.SYS     Thu Feb 12 18:43:23 2009 (4994B41B)
fffffa60`0639d000 fffffa60`063b9000   usbccgp  usbccgp.sys  Sat Jan 19 01:34:04 2008 (479199DC)
fffffa60`063b9000 fffffa60`063bae00   USBD     USBD.SYS     Sat Jan 19 01:33:53 2008 (479199D1)
fffffa60`063bb000 fffffa60`063c4000   hidusb   hidusb.sys   Sat Jan 19 01:33:54 2008 (479199D2)
fffffa60`063c4000 fffffa60`063d6000   HIDCLASS HIDCLASS.SYS Sat Jan 19 01:33:52 2008 (479199D0)
fffffa60`063d6000 fffffa60`063ddb80   HIDPARSE HIDPARSE.SYS Sat Jan 19 01:33:51 2008 (479199CF)
fffffa60`063de000 fffffa60`063e8000   kbdhid   kbdhid.sys   Sat Jan 19 01:28:10 2008 (4791987A)
fffffa60`063e8000 fffffa60`063f3000   mouhid   mouhid.sys   Sat Jan 19 01:28:10 2008 (4791987A)
fffffa60`063f3000 fffffa60`063fd000   Fs_Rec   Fs_Rec.SYS   Sat Jan 19 00:53:41 2008 (47919065)
fffffa60`0640f000 fffffa60`0647c000   afd      afd.sys      Sat Jan 19 01:38:15 2008 (47919AD7)
fffffa60`0647c000 fffffa60`064c0000   netbt    netbt.sys    Sat Jan 19 01:36:24 2008 (47919A68)
fffffa60`064c0000 fffffa60`064de000   pacer    pacer.sys    Sat Jan 19 01:36:51 2008 (47919A83)
fffffa60`064de000 fffffa60`064ed000   netbios  netbios.sys  Sat Jan 19 01:36:35 2008 (47919A73)
fffffa60`064ed000 fffffa60`06508000   wanarp   wanarp.sys   Sat Jan 19 01:37:35 2008 (47919AAF)
fffffa60`06508000 fffffa60`06556000   rdbss    rdbss.sys    Sat Jan 19 00:55:09 2008 (479190BD)
fffffa60`06556000 fffffa60`06562000   nsiproxy nsiproxy.sys Sat Jan 19 01:36:45 2008 (47919A7D)
fffffa60`06562000 fffffa60`065d8000   eeCtrl64 eeCtrl64.sys Fri Feb 06 14:39:27 2009 (498C91EF)
fffffa60`065d8000 fffffa60`065fc000   EraserUtilRebootDrv EraserUtilRebootDrv.sys Fri Feb 06 14:39:27 2009 (498C91EF)
fffffa60`0680c000 fffffa60`06842000   SYMEVENT64x86 SYMEVENT64x86.SYS Mon Jan 14 18:32:19 2008 (478BF103)
fffffa60`06842000 fffffa60`0685f000   dfsc     dfsc.sys     Sat Jan 19 00:54:16 2008 (47919088)
fffffa60`0685f000 fffffa60`0686d000   crashdmp crashdmp.sys Sat Jan 19 01:28:59 2008 (479198AB)
fffffa60`0686d000 fffffa60`06877000   dump_diskdump dump_diskdump.sys Sat Jan 19 01:28:58 2008 (479198AA)
fffffa60`06877000 fffffa60`06890000   dump_arcsas dump_arcsas.sys Fri May 25 14:59:06 2007 (465731FA)
fffffa60`06890000 fffffa60`0689c000   Dxapi    Dxapi.sys    Sat Jan 19 01:08:00 2008 (479193C0)
fffffa60`0689c000 fffffa60`068af000   monitor  monitor.sys  Sat Jan 19 01:32:34 2008 (47919982)
fffffa60`068af000 fffffa60`068d1000   luafv    luafv.sys    Sat Jan 19 00:59:06 2008 (479191AA)
fffffa60`068d1000 fffffa60`068e5000   lltdio   lltdio.sys   Sat Jan 19 01:35:48 2008 (47919A44)
fffffa60`068e5000 fffffa60`068fd000   rspndr   rspndr.sys   Sat Jan 19 01:35:48 2008 (47919A44)
fffffa60`068fd000 fffffa60`069088a0   WGX64    WGX64.SYS    Mon Feb 02 00:39:38 2009 (4986871A)
fffffa60`06909000 fffffa60`06927000   bowser   bowser.sys   Sat Jan 19 00:54:51 2008 (479190AB)
fffffa60`06927000 fffffa60`06941000   mpsdrv   mpsdrv.sys   Sat Jan 19 01:35:28 2008 (47919A30)
fffffa60`06941000 fffffa60`06969000   mrxsmb   mrxsmb.sys   Sat Jan 19 00:55:21 2008 (479190C9)
fffffa60`06969000 fffffa60`069b2000   mrxsmb10 mrxsmb10.sys Tue Aug 26 21:26:08 2008 (48B4AD30)
fffffa60`069b2000 fffffa60`069d1000   mrxsmb20 mrxsmb20.sys Sat Jan 19 00:55:19 2008 (479190C7)
fffffa60`07e06000 fffffa60`07ea0000   spsys    spsys.sys    Thu Jun 21 21:02:05 2007 (467B1F8D)
fffffa60`07ea0000 fffffa60`07eab000   asyncmac asyncmac.sys Sat Jan 19 01:37:27 2008 (47919AA7)
fffffa60`07eab000 fffffa60`07f46000   HTTP     HTTP.sys     Sat Jan 19 01:36:22 2008 (47919A66)
fffffa60`07f46000 fffffa60`07f54000   FSAFilter_x64 FSAFilter_x64.sys Mon Aug 25 16:33:10 2008 (48B31706)
fffffa60`07f54000 fffffa60`07f90000   RDPWD    RDPWD.SYS    Sat Jan 19 01:42:20 2008 (47919BCC)
fffffa60`07f90000 fffffa60`07fac000   cdfs     cdfs.sys     Sat Jan 19 00:53:45 2008 (47919069)
fffffa60`07fac000 fffffa60`07fd1000   ENG64    ENG64.SYS    Thu Feb 12 18:41:48 2009 (4994B3BC)
fffffa60`0840f000 fffffa60`084c5000   peauth   peauth.sys   Mon Oct 23 07:57:00 2006 (453CAE0C)
fffffa60`084c5000 fffffa60`084d0000   secdrv   secdrv.SYS   Wed Sep 13 09:18:38 2006 (4508052E)
fffffa60`084d0000 fffffa60`084f8000   srvnet   srvnet.sys   Sat Jan 19 00:56:38 2008 (47919116)
fffffa60`084f8000 fffffa60`08507000   tcpipreg tcpipreg.sys Sat Jan 19 01:37:01 2008 (47919A8D)
fffffa60`08507000 fffffa60`08539000   srv2     srv2.sys     Thu Mar 06 21:19:59 2008 (47D0A64F)
fffffa60`08539000 fffffa60`085cd000   srv      srv.sys      Mon Dec 15 22:42:00 2008 (49472388)
fffffa60`085cd000 fffffa60`085da000   tdtcp    tdtcp.sys    Sat Jan 19 01:42:03 2008 (47919BBB)
fffffa60`085da000 fffffa60`085e8000   tssecsrv tssecsrv.sys Sat Jan 19 01:42:10 2008 (47919BC2)
 
Unloaded modules:
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fd1000 fffffa60`07ff6000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`07fac000 fffffa60`07fd1000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06209000 fffffa60`06372000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`06378000 fffffa60`0639d000   ENG64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`0620f000 fffffa60`06378000   EX64.SYS
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`085e8000 fffffa60`085ef000   BASFND.sys
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`013f1000 fffffa60`013ff000   crashdmp.sys
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`0110d000 fffffa60`01117000   dump_storport.sys
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`01117000 fffffa60`01130000   dump_arcsas.sys
    Timestamp: unavailable (00000000)
    Checksum:  00000000
fffffa60`00768000 fffffa60`00784000   sacdrv.sys
    Timestamp: unavailable (00000000)
    Checksum:  00000000
Closing open log file c:\debuglog.txt

Open in new window

Palm-debuglog.txt
0
Lumpsum
Asked:
Lumpsum
  • 4
  • 2
  • 2
  • +1
1 Solution
 
Zuhir ElgmatiCommented:
make sure that you updated the Broadcom BCM5708C NIC driver to the latest version
also see this discussion
http://www.ibm.com/developerworks/forums/thread.jspa?threadID=207984
0
 
dolomitiCommented:
hi,
also at my customer, a 3650, during massive I/O disks, "regularly" went down .

We changed, under suggest of IBM support, on the bios settings,
the memory Frequency from auto to another value, that now I don't remeber
(probably 533 MHz, found in below links)

https://www.ibm.com/developerworks/forums/thread.jspa?threadID=248145&tstart=-3
http://www.ibm.com/developerworks/forums/thread.jspa?messageID=14244351

When you say fully patched, mean OS or machine BIOS/BMC and ServeRAID ?
About Broadcom, I usually disable at OS level, unused Eth ports.

bye
vic

0
 
bdesmondCommented:
Can you grab the hotfix from 967657 and see if loading that resolves the problem? It's the latest version I see of the driver that the crash is in.

Thanks,
Brian Desmond
Active Directory MVP
0
Concerto Cloud for Software Providers & ISVs

Can Concerto Cloud Services help you focus on evolving your application offerings, while delivering the best cloud experience to your customers? From DevOps to revenue models and customer support, the answer is yes!

Learn how Concerto can help you.

 
LumpsumAuthor Commented:
All,
To answer as many questions as possible, here is the DSA from this server from this morning.
I updated the Broadcom Drivers last night to 4.6.15.

dolomiti, we do the same thing by disabling the unused NIC's in the OS, but in this case, we are teaming the NIC's (LACP).

Since this is a production server and We have people in the office until 10:30 pm EST, this will take some time to resolve. As a side note, this is the first time the server has rebooted since we upgraded, 2 weeks ago (Easter Sunday)
7979E9U-99GZ073-20090427-094302..zip
0
 
bdesmondCommented:
What is a DSA?

Thanks,
Brian Desmond
Active Directory MVP
0
 
LumpsumAuthor Commented:
The DSA is the Dynamic System Analysis program from IBM.
It collects all of the data from the system (event logs, Bios, everything) and put's it in a file to be parsed.
It's a XML file inside the gz file.
0
 
dolomitiCommented:
hi,
my comment about unused NIC, referred at message:
"Event #4, "Broadcom BCM5708C: The network link is down.....".

Regard my post about memory frequency, you can wait for the moment
to reboot server, seeing if the problem presents again,
furthermore if you find server powered-off.

bye
vic
0
 
LumpsumAuthor Commented:
dolomiti,

Thanks, I was just giving out information about the NIC configuration.
I think we are going to wait for the moment, unless someone has a major revelation about this issue.
I do not want to make too many changes and then never figure out that fixed it.
If it reboots again, then I will adjust the frequency of the RAM in the BIOS.
0
 
LumpsumAuthor Commented:
The current driver was only 2 weeks old but installing the latest update has fixed the problem. 30 days have passed with no incidents.
Good advice.
Thank You.
0

Featured Post

Concerto's Cloud Advisory Services

Want to avoid the missteps to gaining all the benefits of the cloud? Learn more about the different assessment options from our Cloud Advisory team.

  • 4
  • 2
  • 2
  • +1
Tackle projects and never again get stuck behind a technical roadblock.
Join Now