• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 1727
  • Last Modified:

Catalyst 4006 Router Module rommon prompt

Folks on our network use a VLAN on our Catalyst 4006 as their gateway.  I restarted the switch after users began having issues with internet connectivity.  It would come back up for an hour or so and then users could no longer get out through that VLAN again.  I'm able to get users out to the internet by pointing them directly to our edge router, but our remote sites can no longer see our internal network.  

When I plug into the switch console I don't see any issues with the modules.  However, when I plug into the console of the router module I get the following error:

*** System received an abort due to Break Key ***
signal= 0x3, code= 0x0, context= 0x60929ca8
PC = 0x600b60ec, Cause = 0x20, Status Reg = 0x34018302

ROMMON1>

As soon as I plug in and get this prompt even the folks that were pointing to the edge router lose their internet connection- as they must go through this switch at some point. None of the usual commands like sh, dir, or format work at the rommon1 prompt.  Not being a cisco guy I gave cisco a call for help.  Of the three techs I chatted with each suggested a different problem, whether it be corrupt software, OLD software, or a bad memory module.  

Before I start ripping out memory modules or uploading a new IOS, I wanted to see if anyone has seen this particular problem before.  Can I do any additional non intrusive testing that doesn't involve my having to rebuild the router?



0
erndog5800
Asked:
erndog5800
  • 4
  • 3
  • 2
2 Solutions
 
lrmooreCommented:
>*** System received an abort due to Break Key ***
Did you intentionally break the boot sequence? Was there anything else plugged into the Console port?
Can you restart the switch from the prompt?
rommon1>reset

0
 
erndog5800Author Commented:
Thanks. Nothing else is plugged into the console port and I did not intentionally break the boot sequence.  I could plug into the console port an hour or 24 hours after cold boot and still get this error message.  I did not try restarting from the prompt. I'll give this a whirl when I'm back in the office.  Just to clarify this is the router module I'm getting this prompt at, so I'd be restarting the router module, not the switch, correct?.  Anything else I should be looking at?
0
 
Vladan_MOBTELCommented:
on 4006 you have routing and switching part (if you use using supervisor engine II) THey have two separate console ports, so you can break boot on both sides. CHeck the config of the router, and stay connected while you boot from there, and sed us the output. You could continue booting using boot command, you could specify the source to boot as well. Could you post the output of the sh ver command?
0
Technology Partners: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

 
erndog5800Author Commented:
I went ahead and typed 'reset' at the ROMMON prompt.  The following is what I got after it restarted.

rommon 1 > reset

ROMMON: Entered init
ROMMON: Cold Reset frame @0x00000000
ROMMON: Reading reset reason register
ROMMON: Valid NVRAM config

System Bootstrap, Version 12.0(7)W5(15b) RELEASE SOFTWARE
Copyright (c) 2000 by cisco Systems, Inc.

ROMMON: Initializing exceptions
ROMMON: Initializing TLB
ROMMON: Initializing cache
ROMMON: Sizing and zeroing main memory ... 64 MBytes
ROMMON: Sizing non-volatile memory ... 128 KBytes
ROMMON: Exiting init

Catalyst-4232 platform with 65536 Kbytes of main memory


Self decompressing the image : #################################################
################################################################################
################################################################################
############################################################################ [OK
]
Inside platform_power_on_main()
Inside platform_main()

Initializing GT64120 and FX1000 Subsystem ... done.
Downloading TCAM FPGA ... done.
Initializing Temperature Monitoring Subsystem ... done.
Self decompressing the image : #################################################
################################################################################
################################################################################
############################################################################ [OK
]
Inside platform_power_on_main()
Inside platform_main()

              Restricted Rights Legend

Use, duplication, or disclosure by the Government is
subject to restrictions as set forth in subparagraph
(c) of the Commercial Computer Software - Restricted
Rights clause at FAR sec. 52.227-19 and subparagraph
(c) (1) (ii) of the Rights in Technical Data and Computer
Software clause at DFARS sec. 252.227-7013.

           cisco Systems, Inc.
           170 West Tasman Drive
           San Jose, California 95134-1706



Cisco Internetwork Operating System Software
IOS (tm) L3 Switch/Router Software (CAT4232-IN-M), Version 12.0(10)W5(18f)  RELE
ASE SOFTWARE
Copyright (c) 1986-2000 by cisco Systems, Inc.
Compiled Mon 04-Dec-00 22:07 by integ
Image text-base: 0x60010928, data-base: 0x605F6000


Initializing GT64120 and FX1000 Subsystem ... done.
Downloading TCAM FPGA ... done.
Initializing Switch Fabric Driver Subsystem ... done.
Initializing Temperature Monitoring Subsystem ... done.
cisco Cat4232L3 (R5000) processor with 57344K/8192K bytes of memory.
R5000 processor, Implementation 35, Revision 2.1
Last reset from power-on
1 FastEthernet/IEEE 802.3 interface(s)
4 Gigabit Ethernet/IEEE 802.3z interface(s)
123K bytes of non-volatile configuration memory.

16384K bytes of Flash internal SIMM (Sector size 256K).

ENABLING INTERFACES. PLEASE WAIT...


Force linkup done for GigabitEthernet4
Force linkup done for GigabitEthernet3




Press RETURN to get started!


GigabitEthernet4 added as member-1 to port-channel1

GigabitEthernet3 added as member-2 to port-channel1

00:00:08: %SYS-5-CONFIG_I: Configured from memory by console
00:00:08: %LINK-3-UPDOWN: Interface FX1000, changed state to up
00:00:08: %LINEPROTO-5-UPDOWN: Line protocol on Interface Controller5, changed s
tate to up
00:00:08: %LINK-5-CHANGED: Interface FastEthernet1, changed state to administrat
ively down
00:00:08: %SYS-5-RESTART: System restarted --
Cisco Internetwork Operating System Software
IOS (tm) L3 Switch/Router Software (CAT4232-IN-M), Version 12.0(10)W5(18f)  RELE
ASE SOFTWARE
Copyright (c) 1986-2000 by cisco Systems, Inc.
Compiled Mon 04-Dec-00 22:07 by integ
00:00:09: %LINEPROTO-5-UPDOWN: Line protocol on Interface FX1000, changed state
to up
00:00:09: %LINEPROTO-5-UPDOWN: Line protocol on Interface FastEthernet1, changed
 state to down
00:00:19: WARNING: This will force the link-up with 1000Mbps and Full Duplex set
tings.
00:00:19:          Make sure the partner port is also forced link up.

00:00:19: WARNING: This will force the link-up with 1000Mbps and Full Duplex set
tings.
00:00:19:          Make sure the partner port is also forced link up.

00:00:25: %LINK-3-UPDOWN: Interface GigabitEthernet4, changed state to up
00:00:25: %LINK-3-UPDOWN: Interface GigabitEthernet3, changed state to up
00:00:26: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet4, chan
ged state to up
00:00:26: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet2, chan
ged state to down
00:00:26: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet3, chan
ged state to up
00:00:26: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet1, chan
ged state to down
00:00:27: %LINK-3-UPDOWN: Interface Port-channel1, changed state to up
00:00:28: %LINEPROTO-5-UPDOWN: Line protocol on Interface Port-channel1, changed
 state to up
00:00:37: %AUTOSTATE-6-SHUT_DOWN: Putting interface Port-channel1.10 into Autost
ate mode
00:00:53: %AUTOSTATE-6-BRING_UP: Taking interface Port-channel1.10 out of Autost
ate mode
00:01:09: %AUTOSTATE-6-SHUT_DOWN: Putting interface Port-channel1.11 into Autost
ate mode
00:01:26: %AUTOSTATE-6-BRING_UP: Taking interface Port-channel1.11 out of Autost
ate mode
00:01:42: %AUTOSTATE-6-SHUT_DOWN: Putting interface Port-channel1.1 into Autosta
te mode
00:01:58: %AUTOSTATE-6-BRING_UP: Taking interface Port-channel1.1 out of Autosta
te mode
00:02:14: %AUTOSTATE-6-SHUT_DOWN: Putting interface Port-channel1.10 into Autost
ate mode
00:02:31: %AUTOSTATE-6-BRING_UP: Taking interface Port-channel1.10 out of Autost
ate mode
00:02:47: %AUTOSTATE-6-SHUT_DOWN: Putting interface Port-channel1.11 into Autost
ate mode
00:03:03: %AUTOSTATE-6-BRING_UP: Taking interface Port-channel1.11 out of Autost
ate mode

***I watched this for a half hour or so and then had to leave for the day.  So far no ROMMON prompt.  I'll know more in the ***morning.  If I get the ROMMON prompt again I will try to boot from the prompt.  I do realize that this is an old IOS version ***but figured upgrading would only add another variable to the problem.

***Here's the sh ver for the switch:

----------------Sh ver ---------------------

System Bootstrap Version: 5.4(1)

Hardware Version: 1.3  Model: WS-C4006  Serial #: <removed>

Mod Port Model      Serial #              Versions
--- ---- ---------- -------------------- ---------------------------------
1   2    WS-X4013   <removed>          Hw : 1.3
                                         Gsp: 5.5(3.0)
                                         Nmp: 5.5(3)
2   34   WS-X4232-L3 <removed>          Hw : 1.7
4   6    WS-X4306   <removed>          Hw : 2.0
5   6    WS-X4306   <removed>          Hw : 2.0

       DRAM                    FLASH                   NVRAM
Module Total   Used    Free    Total   Used    Free    Total Used  Free
------ ------- ------- ------- ------- ------- ------- ----- ----- -----
1       65536K  31380K  34156K  16384K   8017K   8367K  480K  170K  310K

Uptime is 0 day, 14 hours, 14 minutes

----------------sh module--------------------

Mod Slot Ports Module-Type               Model               Sub Status
--- ---- ----- ------------------------- ------------------- --- --------
1   1    2     1000BaseX Supervisor      WS-X4013            no  ok
2   2    34    Router Switch Card        WS-X4232-L3         no  ok
4   4    6     1000BaseX Ethernet        WS-X4306            no  ok
5   5    6     1000BaseX Ethernet        WS-X4306            no  ok

Mod Module-Name         Serial-Num
--- ------------------- --------------------
1                       <removed>
2                       <removed>
4                       <removed>
5                       <removed>

Mod MAC-Address(es)                        Hw     Fw         Sw
--- -------------------------------------- ------ ---------- -----------------
1   00-04-dd-c3-cf-00 to 00-04-dd-c3-d2-ff 1.3    5.4(1)     5.5(3)
2   00-06-28-43-81-34 to 00-06-28-43-81-55 1.7    12.0(7)W5( 12.0(10)W5(18f)
4   00-02-16-e8-63-60 to 00-02-16-e8-63-65 2.0
5   00-02-16-e8-6f-12 to 00-02-16-e8-6f-17 2.0

---------------sh log-------------------------------

Network Management Processor (ACTIVE NMP) Log:
  Reset count:   56
  Re-boot History:   Apr 07 2005 18:41:33 0, Apr 07 2005 17:28:16 0
                     Apr 07 2005 09:03:08 0, Nov 20 2004 12:18:22 0
                     Sep 01 2004 17:07:37 0, Aug 31 2004 15:12:10 0
                     Aug 20 2004 10:21:37 0, Aug 17 2004 14:26:31 0
                     May 06 2004 16:06:51 0, Mar 15 2004 18:20:36 0
  Bootrom Checksum Failures:      0   UART Failures:                  0
  Flash Checksum Failures:        0   Flash Program Failures:         0
  Power Supply 1 Failures:       21   Power Supply 2 Failures:       17
  DRAM Failures:                  0

  Exceptions:                     0

  Loaded NMP version:            5.5(3)
  Reload same NMP version count: 46

  Last software reset by user: 3/15/2004,18:19:26

  MCP Exceptions/Hang:            0

Heap Memory Log:
Corrupted Block = none

NVRAM log:

01. 1/31/2001,20:39:44: convertCiscoMIB:PreSac(0) checksum failed: 0x0(0x4C5C)
02. 8/7/2001,16:47:37: convert_post_SAC_CiscoMIB:Block 0 converted from version
10 to 11
03. 8/7/2001,16:47:40: supVersion:Nmp version 5.5(3)

Module 2 Log:
  Reset Count:   52
  Reset History: Thu Apr 7 2005, 18:42:29
                 Thu Apr 7 2005, 17:29:12
                 Thu Apr 7 2005, 09:04:04
                 Sat Nov 20 2004, 12:19:17


Module 4 Log:
  Reset Count:   55
  Reset History: Thu Apr 7 2005, 18:41:43
                 Thu Apr 7 2005, 17:28:26
                 Thu Apr 7 2005, 09:03:18
                 Sat Nov 20 2004, 12:18:31


Module 5 Log:
  Reset Count:   55
  Reset History: Thu Apr 7 2005, 18:41:43
                 Thu Apr 7 2005, 17:28:26
                 Thu Apr 7 2005, 09:03:18
                 Sat Nov 20 2004, 12:18:31
0
 
erndog5800Author Commented:
OK, I'm back at the router prompt, but my VLAN appears to still be down.  Folks using VLAN11 - 10.11.1.1 can't get out to the internet.  Any thoughts?  Here's the sh ver of the router module as requested.

Cisco Internetwork Operating System Software
IOS (tm) L3 Switch/Router Software (CAT4232-IN-M), Version 12.0(10)W5(18f)  RELE
ASE SOFTWARE
Copyright (c) 1986-2000 by cisco Systems, Inc.
Compiled Mon 04-Dec-00 22:07 by integ
Image text-base: 0x60010928, data-base: 0x605F6000

ROM: System Bootstrap, Version 12.0(7)W5(15b) RELEASE SOFTWARE

whs4006rtr uptime is 16 hours, 53 minutes
System restarted by power-on
Running default software

cisco Cat4232L3 (R5000) processor with 57344K/8192K bytes of memory.
R5000 processor, Implementation 35, Revision 2.1
Last reset from power-on
1 FastEthernet/IEEE 802.3 interface(s)
4 Gigabit Ethernet/IEEE 802.3z interface(s)
123K bytes of non-volatile configuration memory.

16384K bytes of Flash internal SIMM (Sector size 256K).
Configuration register is 0x2
0
 
Vladan_MOBTELCommented:
erndog5800,

I think this link caould help you a bit:

http://www.cisco.com/en/US/products/hw/switches/ps663/products_field_notice09186a0080094bae.shtml

THe problem is that register 0x2 means that you can go to rmmon anytime you want, not only during the boot time.

THis should help:

The way to do this is:
DIS-4006#configure terminal
DIS-4006(config)#config-reg 0x2102
DIS-4006(config)#^Z
DIS-4006#show version

If you could say if this solved your problem I would appreciate it a lot.

Regards,
Vladan
0
 
erndog5800Author Commented:
That article nailed it.  This is exactly the problem I am encountering when I connect my cable to the router.  It would appear that resetting at the ROMMON prompt and staying connected got me back to a prompt I could work from, so I split the points between the two of you.  I am still having issues with the VLAN, but I'll post again if I can't pin that down. This particular problem was keeping me from doing any troubleshooting at all.   Thanks to you both!
0
 
lrmooreCommented:
Thanks, Vladan,  for the followup while I was away and could not respond back to erndog5800 in a timely manner..
0
 
Vladan_MOBTELCommented:
Your are welcome, lrmoore
0

Featured Post

Restore individual SQL databases with ease

Veeam Explorer for Microsoft SQL Server delivers an easy-to-use, wizard-driven interface for restoring your databases from a backup. No expert SQL background required. Web interface provides a complete view of all available SQL databases to simplify the recovery of lost database

  • 4
  • 3
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now