Solved

high cpu utilization

Posted on 2015-02-04
1
366 Views
Last Modified: 2015-02-08
we have a switch that has high utilization
but i cant see any process that shows up on the sh proc.
Any help would be appreciated.
We dont have spanning tree loop and dont think we have a bad port on the switch that would generate broadcast messages.
My senior engineer told me that this might be due to the fact we have multiple virtual interfaces.

roc-sw05#sh proc cpu | exc 0%  

CPU utilization for five seconds: 92%/1%; one minute: 98%; five minutes: 98%

 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process

  36    12600976   1691547       7449  1.51%  1.33%  1.34%   0 IDB Work        

  48    67989264 158716526        428 31.43% 34.24% 32.82%   0 Cat4k Mgmt HiPri

  49   197728452  77877251       2538 24.07% 17.82% 18.86%   0 Cat4k Mgmt LoPri

  50       13292    752312         17  0.07%  0.03%  0.02%   0 Galios Reschedul

  56      302748    269287       1124  0.07%  0.06%  0.07%   0 Compute load avg

 103     2968600   2940379       1009  6.71%  8.32%  8.45%   0 IP Input        

 109    28585204  19802032       1443  3.03%  3.02%  3.03%   0 Spanning Tree    

 143    11310032   6989400       1618 23.27% 31.06% 31.35%   0 DHCPD Receive    

rockilxx-sw05#

 

roc-sw05#sh proc cpu

CPU utilization for five seconds: 98%/1%; one minute: 98%; five minutes: 98%

 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process

   1      151028   4471781         33  0.00%  0.01%  0.00%   0 Chunk Manager    

   2        2756    182760         15  0.00%  0.00%  0.00%   0 Load Meter      

   3         552       454       1215  0.00%  0.00%  0.00%   0 SpanTree Helper  

   4           0         1          0  0.00%  0.00%  0.00%   0 Deferred Events  

   5           0        45          0  0.00%  0.00%  0.00%   0 Retransmission o

   6          20        48        416  0.00%  0.00%  0.00%   0 IPC ISSU Receive

   7     2271268    186887      12153  0.00%  0.28%  0.24%   0 Check heaps      

   8          32       153        209  0.00%  0.00%  0.00%   0 Pool Manager    

   9           0         2          0  0.00%  0.00%  0.00%   0 Timers          

  10         148         3      49333  0.00%  0.00%  0.00%   0 PrstVbl          

  11           0         2          0  0.00%  0.00%  0.00%   0 Serial Backgroun

  12           0         1          0  0.00%  0.00%  0.00%   0 Crash writer    

  13           0        11          0  0.00%  0.00%  0.00%   0 ifIndex Receive  

  14       94252    188166        500  0.00%  0.00%  0.00%   0 ARP Input        

  15           0         1          0  0.00%  0.00%  0.00%   0 CEF MIB API      

  16           0         7          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT

  17           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit

  18           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager  

  19         108        19       5684  0.00%  0.00%  0.00%   0 Entity MIB API  

  20          60      1251         47  0.00%  0.00%  0.00%   0 EEM ED Syslog    

  21           0         1          0  0.00%  0.00%  0.00%   0 IFS Agent Manage

 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process

  22          52     15234          3  0.00%  0.00%  0.00%   0 IPC Dynamic Cach

  23           0         1          0  0.00%  0.00%  0.00%   0 IPC Zone Manager

  24        7472    911571          8  0.07%  0.00%  0.00%   0 IPC Periodic Tim

  25        3868    104064         37  0.00%  0.00%  0.00%   0 IPC Managed Time

  26        6416    911570          7  0.00%  0.00%  0.00%   0 IPC Deferred Por

  27       12564    103460        121  0.00%  0.00%  0.00%   0 IPC Seat Manager

  28         376        31      12129  0.00%  0.00%  0.00%   0 IPC Session Serv

  29           4         6        666  0.00%  0.00%  0.00%   0 client_entity_se

  30           0         1          0  0.00%  0.00%  0.00%   0 SERIAL A'detect  

  31           0         1          0  0.00%  0.00%  0.00%   0 ARP Snoop        

  32        8728    911570          9  0.00%  0.00%  0.00%   0 Dynamic ARP Insp

  33        5900    911527          6  0.00%  0.00%  0.00%   0 GraphIt          

  34           0         1          0  0.00%  0.00%  0.00%   0 Critical Bkgnd  

  35       16336    368922         44  0.00%  0.00%  0.00%   0 Net Background  

  36    12591372   1690093       7450  1.43%  1.35%  1.35%   0 IDB Work        

  37          72      1339         53  0.00%  0.00%  0.00%   0 Logger          

  38        8660    911522          9  0.00%  0.00%  0.00%   0 TTY Background  

  39       17968    918523         19  0.00%  0.00%  0.00%   0 Per-Second Jobs  

  40      792412     27120      29218  1.03%  0.12%  0.07%   0 Per-minute Jobs  

  41          32        14       2285  0.00%  0.00%  0.00%   0 IF-MGR control p

  42          60       906         66  0.00%  0.00%  0.00%   0 IF-MGR event pro

  43          12        29        413  0.00%  0.00%  0.00%   0 ISSU PROCESS IPC

  44           0        31          0  0.00%  0.00%  0.00%   0 PrstVbl IPC Msg  

  45           4         4       1000  0.00%  0.00%  0.00%   0 IP Host Track HA

  46          28       679         41  0.00%  0.00%  0.00%   0 ARP HA          

  47           4        17        235  0.00%  0.00%  0.00%   0 IP Admission HA  

  48    67761484 158566902        427 30.87% 32.07% 32.01%   0 Cat4k Mgmt HiPri

  49   197596712  77868731       2537 22.47% 19.98% 19.78%   0 Cat4k Mgmt LoPri

  50       13020    741444         17  0.00%  0.02%  0.02%   0 Galios Reschedul

  51           0         1          0  0.00%  0.00%  0.00%   0 IOS ACL Helper  

  52          16       883         18  0.00%  0.00%  0.00%   0 BACK CHECK      

  53        4536    101753         44  0.00%  0.00%  0.00%   0 rf task          

  54        3768    101539         37  0.00%  0.00%  0.00%   0 RF High Priority

  55        3912    109749         35  0.00%  0.00%  0.00%   0 Net Input        

  56      302324    269130       1123  0.07%  0.06%  0.07%   0 Compute load avg

  57           8        37        216  0.00%  0.00%  0.00%   0 GalRedMsgProc    

  58           4         8        500  0.00%  0.00%  0.00%   0 RFS server proce

  59           0        19          0  0.00%  0.00%  0.00%   0 RTTYS Process    

  60           0        12          0  0.00%  0.00%  0.00%   0 IPC Apps Task    

  61       15384    912158         16  0.00%  0.00%  0.00%   0 RedStateMonitor  

  62         476      1845        257  0.00%  0.00%  0.00%   0 CHKPT rcv MSG pr
0
Comment
Question by:c_hockland
1 Comment
 
LVL 50

Accepted Solution

by:
Don Johnston earned 500 total points
ID: 40590260
From the Cisco output interpreter:

I'd make sure fast switching is enabled.


INFO: Total CPU Utilization is comprised of process and interrupt percentages.
  Total CPU Utilization: 98%
  Process Utilization: 97%
  Interrupt Utilization: 1%
These values are found on the first line of the output:
 CPU utilization for five seconds: x%/y%; one minute: a%; five minutes: b%
  Total CPU Utilization: x%
  Process Utilization: (x - y)%
  Interrupt Utilization: y%
Process Utilization is the difference between the Total and Interrupt (x and y).
The one and five minute utilizations are exponentially decayed averages (rather
than an arithmetic average), therefore recent values have more influence on the
calculated average.

ERROR: Total CPU Utilization is at 98% for the past 5 seconds, which is very high
(>90%).
ERROR: Total CPU Utilization is at 98% for the past 5 minutes, which is very high
(>90%).
NOTE: This is an exponentially decayed average rather than an arithmetic average,
therefore recent events have a greater effect than past events.
This can cause the following symptoms:
 - Input queue drops
 - Slow performance
 - Slow response in Telnet or unable to Telnet to the router
 - Slow response on the console
 - Slow or no response to ping
 - Router doesn't send routing updates
The following processes are causing excessive CPU usage:
 PID      CPU Time      Process
  48      30.87%            Cat4k Mgmt HiPri
  49      22.47%            Cat4k Mgmt LoPri
REFERENCE: For troubleshooting information, please visit Troubleshooting High
CPU Utilization on Cisco Routers

TRY THIS: Cat4k Mgmt LoPri is the process that allocates cpu if jobs are exceeding
their target cpu utilization. If the Cat4k Mgmt LoPri process is consuming the
CPU, this indicates that the packets are being process switched.
1. This can be due to ARP process caused by instability in STP. Use Port fast on
   access ports so that devices coming on/off do not cause a STP topology change.
2. If this device is the default gateway and traffic is routed out of the same
   interface then disable redirects using the commands 'no ip redirects' and
   'no ip unreachables'.
3. Use the show platform health command to see which jobs are above target.
4. If the show platform health does not help then sniff the CPU port on the
   switch to see which packets are going to the CPU and troubleshoot accordingly.
   The procedure explained: CPU Port Sniffing.
REFERENCE: The Catalyst 4500 considers the CPU underutilized unless the CPU is
used at 100 percent for a single time slot. For more information see High CPU
Utilization on Cisco IOS Software-Based Catalyst 4500 Switches.
0

Featured Post

Control application downtime with dependency maps

Visualize the interdependencies between application components better with Applications Manager's automated application discovery and dependency mapping feature. Resolve performance issues faster by quickly isolating problematic components.

Join & Write a Comment

Tired of waiting for your show or movie to load?  Are buffering issues a constant problem with your internet connection?  Check this article out to see if these simple adjustments are the solution for you.
In the world of WAN, QoS is a pretty important topic for most, if not all, networks. Some WAN technologies have QoS mechanisms built in, but others, such as some L2 WAN's, don't have QoS control in the provider cloud.
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…
After creating this article (http://www.experts-exchange.com/articles/23699/Setup-Mikrotik-routers-with-OSPF.html), I decided to make a video (no audio) to show you how to configure the routers and run some trace routes and pings between the 7 sites…

757 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

20 Experts available now in Live!

Get 1:1 Help Now