Solved

Cisco Switch Crashing - Log Included

Posted on 2011-02-18
6
3,620 Views
Last Modified: 2012-05-11
Any ideas?

I would like to isolate this issue to 1 unit / component if possible. Otherwise, I will be forced to replace the entire stack.

This is a stack of 6 Cisco 3750 switches.

The stack has been locking up / crashing recently. Typically a power cycle is required to restore functionality. I have it scheduled for replacement in a week or two.

This is an example of my logs on this stack:

 
Feb 18 13:36:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27468 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:36:48: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3108 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:37:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27480 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:37:48: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3120 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:38:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27492 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:38:48: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3132 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:39:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27504 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:39:48: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3144 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:40:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27516 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:40:49: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3156 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:41:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27528 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)
Feb 18 13:41:49: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 3168 (switch.name.here-6)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-6)
Feb 18 13:42:15: %PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism: type 37, class 14, max_msg 32, total throttled 27540 (switch.name.here-1)-Traceback= 6543C0 7FBF00 800648 7E6148 99E638 995C24 (switch.name.here-1)

Open in new window

0
Comment
Question by:c-h-r-i-s-t-o-p-h
  • 3
  • 3
6 Comments
 

Author Comment

by:c-h-r-i-s-t-o-p-h
ID: 34928523
Stack Ports

 
Switch #    Port 1       Port 2
  --------    ------       ------
    1           Ok           Ok
    2           Ok          Down
    3          Down          Ok
    4           Ok           Ok
    5           Ok           Ok
    6           Ok           Ok

Open in new window


Stack Members

 
Switch#  Role   Mac Address     Priority Version  State
----------------------------------------------------------
 1       Member 0000.0000.0000     1      0       Ready
 2       Member 0000.0000.0000     1      0       Ready
 3       Member 0000.0000.0000     1      0       Ready
*4       Master 0000.0000.0000     15     0       Ready
 5       Member 0000.0000.0000     1      0       Ready
 6       Member 0000.0000.0000     1      0       Ready

Open in new window

0
 
LVL 34

Expert Comment

by:Istvan Kalmar
ID: 34928531
Hi,

you need: no snmp-server ifindex persist
0
 
LVL 34

Accepted Solution

by:
Istvan Kalmar earned 500 total points
ID: 34928547
if you not have this command you need to contact the TAC:
Error Message    PLATFORM_RPC-3-MSG_THROTTLED: RPC Msg Dropped by throttle mechanism:
type [int], class [int], max_msg [int], total throttled [int]

Explanation    This message means that there are too many outgoing messages queued for a message class. An RSP message was dropped. The first [int] is the message type, the second [int] is the message class, the third [int] is the maximum number of messages that can be queued before throttling occurs, and the last [int] is the total number of messages that have been throttled.

Recommended Action    Copy the error message exactly as it appears on the console or in the system log, call your Cisco technical support representative, and provide the representative with the gathered information.

http://www.cisco.com/en/US/docs/switches/lan/catalyst3750/software/release/12.1_11_ax/system/message/msg_desc.html#wp66427
0
Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

 

Author Comment

by:c-h-r-i-s-t-o-p-h
ID: 34928601
Any alternatives to TAC?
0
 
LVL 34

Expert Comment

by:Istvan Kalmar
ID: 34930008
I advise to try IOS upgrade.....
0
 

Author Closing Comment

by:c-h-r-i-s-t-o-p-h
ID: 34953710
hardware replaced
0

Featured Post

Highfive Gives IT Their Time Back

Highfive is so simple that setting up every meeting room takes just minutes and every employee will be able to start or join a call from any room with ease. Never be called into a meeting just to get it started again. This is how video conferencing should work!

Join & Write a Comment

Data center, now-a-days, is referred as the home of all the advanced technologies. In-fact, most of the businesses are now establishing their entire organizational structure around the IT capabilities.
If you're not part of the solution, you're part of the problem.   Tips on how to secure IoT devices, even the dumbest ones, so they can't be used as part of a DDoS botnet.  Use PRTG Network Monitor as one of the building blocks, to detect unusual…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor (https://www.paessler.com/prtg). If you're interested in additional methods for monitoring bandwidt…

747 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

13 Experts available now in Live!

Get 1:1 Help Now