high CPU usage on 2811 router

dear experts
i have a problem recently, i have a 2811 router, there are several EIGRP VPN tunnel setup on it, recently i found this router running high CPU utilization, it almost reach 80 percent at the most day busy time, when i try to find what process causing that after " show proc cpu", the summarize number not such high, it estimate not more than 20 percent. i know in old Cisco IOS there is a command "show platform health", but seem this not exist in 2800 serials any more.

 
so my question is what can i do next step to finding out what is causing high CPU usage, so that i can decide if the router need to be upgraded.

 
thanks very much
beardog1113Asked:
Who is Participating?
 
koudryCommented:
Hello,

The text below is taken from a Cisco document:

"
The Cisco IPsec and SSL VPN AIM supports up to 800 tunnels on the Cisco 1841, up to 1500 tunnels on the Cisco 2800 Series, and up to 2000 tunnels on the Cisco 3800 Series. The Maximum Tunnel Scalability test is done with no data passing over the tunnels to only determine maximum number. For site-to-site design, Cisco recommends you consult with your Cisco account team or a Cisco authorized reseller and also review the Cisco DMVPN Design Guide at: http://www.cisco.com/application/pdf/en/us/guest/netsol/ns171/c649/ccmigration_09186a008075ea98.pdf
"
URL: http://www.cisco.com/en/US/prod/collateral/routers/ps5853/data_sheet_vpn_aim_for_18128003800routers_ps5853_Products_Data_Sheet.html

The text did say that the number of tunnels was recorded with no data passing through the tunnels. So this cannot be trusted. What we need is the real number of tunnels with various bandwidth of data. So I am going to look around.

Thanks.
0
 
lrmooreCommented:
This troubleshooting guide might help you narrow down the issues
http://www.cisco.com/en/US/products/hw/routers/ps133/products_tech_note09186a00800a70f2.shtml
0
 
beardog1113Author Commented:
hi expert, sorry for that doesn't help after reading that, my problem i can not find out which process causing high CPU usage, looking at the result please.

RTR-01#sh proc cpu | e 0.00%__0.00%__0.00%
CPU utilization for five seconds: 55%/50%; one minute: 50%; five minutes: 49%
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
   2     3602780  11624099        309  0.08%  0.02%  0.02%   0 Load Meter      
   5    87633012   7171842      12219  0.00%  0.14%  0.12%   0 Check heaps      
  25     1833916  17417410        105  0.00%  0.01%  0.00%   0 HC Counter Timer
  36    10567452  97507145        108  0.08%  0.11%  0.10%   0 Net Background  
  40     2812896  58158310         48  0.00%  0.02%  0.02%   0 Per-Second Jobs  
  52     2852320 232458651         12  0.00%  0.02%  0.00%   0 Netclock Backgro
  77   5586115121137500788        491  0.57%  0.65%  0.62%   0 IP Input        
  87     2971988 227014034         13  0.00%  0.01%  0.00%   0 SSS Feature Time
 106     3317984  88176368         37  0.00%  0.03%  0.02%   0 CEF process      
 120     3619772 116190701         31  0.08%  0.03%  0.02%   0 DHCPD Receive    
 133     9658304 579888255         16  0.08%  0.08%  0.08%   0 RBSCP Background
 153       29336     23447       1251  0.00%  0.01%  0.00%   0 TPLUS            
 164         600       127       4724  0.32%  0.33%  0.09% 322 SSH Process      
 177   131058248  48195066       2719  0.00%  0.10%  0.08%   0 Crypto IKMP      
 180    55463488  46382891       1195  0.00%  0.01%  0.01%   0 Crypto PAS Proc  
 206      388268  58085150          6  0.08%  0.00%  0.00%   0 trunk conditioni
 211    18317420 118455146        154  0.00%  0.01%  0.00%   0 Net Input        
 212     2644948  11654551        226  0.08%  0.02%  0.00%   0 Compute load avg
 213    21602784   1023747      21101  0.49%  0.05%  0.00%   0 Per-minute Jobs  
 217    46104924-677278654          0  0.40%  0.40%  0.40%   0 IP SLA Mon Respo
 218   1460778401368173467        106  1.47%  1.45%  1.47%   0 IP SLA Mon Event
 222   174949408 412693160        423  0.24%  0.26%  0.24%   0 IP SNMP          
 223    45265988 206415383        219  0.08%  0.07%  0.07%   0 PDU DISPATCHER  
 224   160557040 206639476        776  0.24%  0.27%  0.24%   0 SNMP ENGINE      
 229   232634524 550327791        422  0.40%  0.39%  0.21%   0 IP-EIGRP: PDM    
 230   108066560 734551569        147  0.49%  0.46%  0.47%   0 IP-EIGRP: HELLO
RTR-01#
0
How do you know if your security is working?

Protecting your business doesn’t have to mean sifting through endless alerts and notifications. With WatchGuard Total Security Suite, you can feel confident that your business is secure, meaning you can get back to the things that have been sitting on your to-do list.

 
koudryCommented:
Hello,

Cisco 2811 comes with an on-board crypto engine and should much more resilient even if you have several VPN tunnels.  The above output was taken when the CPU usage wasn't at its peak, so you need another output when the CPU usage is high so that we can see what process is using more CPU. For example, the IP input is only 0.57%. We need to see this go up.

There are other things that can push the CPU usage up in addition to VPN, e.g. fragmentation of packets.  This is dictated by your MTU configurations. If you have default MTU which is 1500 bytes, then I assume there is no chance for fragmentation if all ports are the same.

Is it possible to get another output when CPU is high? Can you also "sho int" for both your WAN and LAN interfaces, please? I just want to check the MTU.

Thanks.
0
 
beardog1113Author Commented:
hello expert, following is the out put of interface, for the CPU usage output, i did try several time at the most busy time range, but i can not find out which process causing even 80% usage from the result. any other ideas ?
thanks


RTR-01#sh int fa 0/0
FastEthernet0/0 is up, line protocol is up
  Hardware is MV96340 Ethernet, address is 001e.4aed.c1f0 (bia 001e.4aed.c1f0)
  Description: L2 Switch WAN Interface
  Internet address is 122.248.141.2/28
  MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
     reliability 255/255, txload 6/255, rxload 2/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Mb/s, 100BaseTX/FX
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:01:43, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d04h
  Input queue: 0/75/51/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: Class-based queueing
  Output queue: 0/1000/64/0 (size/max total/threshold/drops)
     Conversations  0/2/256 (active/max active/max total)
     Reserved Conversations 2/2 (allocated/max allocated)
     Available Bandwidth 10000 kilobits/sec
  5 minute input rate 1171000 bits/sec, 366 packets/sec
  5 minute output rate 2420000 bits/sec, 489 packets/sec
     167702526 packets input, 3743395987 bytes
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     10682 input errors, 0 CRC, 0 frame, 0 overrun, 10683 ignored
     0 watchdog
     0 input packets with dribble condition detected
     176976950 packets output, 53139649 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out
RTR-01#

RTR-01#sh int fa 0/1
FastEthernet0/1 is up, line protocol is up
  Hardware is MV96340 Ethernet, address is 001e.4aed.c1f1 (bia 001e.4aed.c1f1)
  Description: Connected to Internal Switch Vlan1
  Internet address is 10.137.8.4/25
  MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
     reliability 255/255, txload 2/255, rxload 5/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Mb/s, 100BaseTX/FX
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:00, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d04h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 2035000 bits/sec, 459 packets/sec
  5 minute output rate 924000 bits/sec, 352 packets/sec
     157392209 packets input, 1839499706 bytes
     Received 3230846 broadcasts, 0 runts, 0 giants, 0 throttles
     500 input errors, 0 CRC, 0 frame, 0 overrun, 500 ignored
     0 watchdog
     0 input packets with dribble condition detected
     155492358 packets output, 1258341581 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out
RTR-01#
0
 
koudryCommented:
Hello,

I wanted to see the output of the "show interface" because I wanted to be sure we are not dealing with packet fragmentation which is caused by a smaller MTU on the WAN interface and a larger MTU on the LAN interface. Fragmentation stress the CPU up no matter how powerful your network device. This does not appear to be the case here.

We do need to see the "show proc cpu" output when it is high.  If you have access to the device, it should not be too hard to get the output.  The above output does not show the problem clearly.

Thanks.

Koudry
0
 
beardog1113Author Commented:
hello expert, here is the out put, a little long, thanks

RTR-01#sh int
FastEthernet0/0 is up, line protocol is up
  Hardware is MV96340 Ethernet, address is 001e.4aed.c1f0 (bia 001e.4aed.c1f0)
  Description: L2 Switch WAN Interface
  Internet address is 122.248.141.2/28
  MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
     reliability 255/255, txload 9/255, rxload 7/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Mb/s, 100BaseTX/FX
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:27, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/51/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: Class-based queueing
  Output queue: 0/1000/64/0 (size/max total/threshold/drops)
     Conversations  0/2/256 (active/max active/max total)
     Reserved Conversations 2/2 (allocated/max allocated)
     Available Bandwidth 10000 kilobits/sec
  5 minute input rate 2825000 bits/sec, 697 packets/sec
  5 minute output rate 3808000 bits/sec, 740 packets/sec
     194903732 packets input, 4171726269 bytes
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     12276 input errors, 0 CRC, 0 frame, 0 overrun, 12277 ignored
     0 watchdog
     0 input packets with dribble condition detected
     205160325 packets output, 90018052 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out
FastEthernet0/1 is up, line protocol is up
  Hardware is MV96340 Ethernet, address is 001e.4aed.c1f1 (bia 001e.4aed.c1f1)
  Description: Connected to Internal Switch Vlan1
  Internet address is 10.137.8.4/25
  MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
     reliability 255/255, txload 5/255, rxload 8/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Mb/s, 100BaseTX/FX
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:00, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 3299000 bits/sec, 678 packets/sec
  5 minute output rate 2340000 bits/sec, 663 packets/sec
     182923605 packets input, 3710195463 bytes
     Received 3440526 broadcasts, 0 runts, 0 giants, 0 throttles
     644 input errors, 0 CRC, 0 frame, 0 overrun, 644 ignored
     0 watchdog
     0 input packets with dribble condition detected
     181127276 packets output, 3532672853 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out
Tunnel101 is up, line protocol is up
  Hardware is Tunnel
  Description: to Beijing
  Internet address is 10.137.26.122/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 38/255, rxload 23/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 119.161.229.94
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 3865
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 372000 bits/sec, 109 packets/sec
  5 minute output rate 608000 bits/sec, 128 packets/sec
     28367548 packets input, 995717719 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     28509545 packets output, 844778400 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel102 is up, line protocol is up
  Hardware is Tunnel
  Description: to Guangzhou
  Internet address is 10.137.11.1/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 76/255, rxload 15/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 218.107.48.148
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 125000 bits/sec, 78 packets/sec
  5 minute output rate 597000 bits/sec, 86 packets/sec
     15466766 packets input, 1624503918 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     16406958 packets output, 571330123 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel103 is up, line protocol is up
  Hardware is Tunnel
  Description: to Shanghai
  Internet address is 10.137.11.5/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 105/255, rxload 124/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 210.13.87.170
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:02, output 00:00:01, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 973000 bits/sec, 177 packets/sec
  5 minute output rate 828000 bits/sec, 155 packets/sec
     19953085 packets input, 4258333751 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     20217514 packets output, 2215350273 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel104 is up, line protocol is up
  Hardware is Tunnel
  Description: to Chengdu
  Internet address is 10.137.11.9/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 21/255, rxload 4/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 119.6.23.178
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:03, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/0 (size/max)
  5 minute input rate 35000 bits/sec, 28 packets/sec
  5 minute output rate 167000 bits/sec, 29 packets/sec
     7117409 packets input, 1615377801 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     8502001 packets output, 861324258 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel105 is up, line protocol is up
  Hardware is Tunnel
  Description: to Melbourne Hawthorn Main Circuit
  Internet address is 10.140.16.225/30
  MTU 1514 bytes, BW 512 Kbit, DLY 700000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 203.94.134.30
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:03, output 00:00:04, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 1511
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     156652 packets input, 14996246 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     158092 packets output, 13757094 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel106 is up, line protocol is up
  Hardware is Tunnel
  Description: to HK
  Internet address is 10.137.11.13/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 37/255, rxload 45/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 125.215.234.209
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 358000 bits/sec, 49 packets/sec
  5 minute output rate 292000 bits/sec, 52 packets/sec
     23462098 packets input, 1283206885 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     21430144 packets output, 2964911017 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel107 is up, line protocol is up
  Hardware is Tunnel
  Description: to Beijing Niujie Office
  Internet address is 10.137.11.17/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 222.128.17.51
  Tunnel protocol/transport IP/IP
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:02, output 00:00:04, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 1000 bits/sec, 2 packets/sec
  5 minute output rate 2000 bits/sec, 2 packets/sec
     391697 packets input, 71178020 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     430009 packets output, 167876480 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel108 is up, line protocol is up
  Hardware is Tunnel
  Description: to Japan
  Internet address is 10.137.11.21/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 3/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 210.174.104.114
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:04, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 9000 bits/sec, 4 packets/sec
  5 minute output rate 24000 bits/sec, 6 packets/sec
     3255521 packets input, 973112692 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     5101904 packets output, 3546652424 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel109 is up, line protocol is up
  Hardware is Tunnel
  Description: to Korea
  Internet address is 10.137.11.25/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 68/255, rxload 42/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 116.120.80.4
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:04, output 00:00:04, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 255000 bits/sec, 118 packets/sec
  5 minute output rate 413000 bits/sec, 99 packets/sec
     59627110 packets input, 3908565917 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     39347579 packets output, 2816956098 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel110 is up, line protocol is up
  Hardware is Tunnel
  Description: to Singapore
  Internet address is 10.137.11.29/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 3/255, rxload 2/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 58.185.45.180
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:04, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 16000 bits/sec, 7 packets/sec
  5 minute output rate 31000 bits/sec, 12 packets/sec
     6305489 packets input, 2093613164 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     7374886 packets output, 4261448302 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel111 is up, line protocol is up
  Hardware is Tunnel
  Description: to TaiWan
  Internet address is 10.137.11.33/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 13/255, rxload 2/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 220.130.138.70
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 19000 bits/sec, 9 packets/sec
  5 minute output rate 109000 bits/sec, 18 packets/sec
     3424024 packets input, 1148364674 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     4412316 packets output, 2632937218 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel112 is up, line protocol is up
  Hardware is Tunnel
  Description: to Thailand
  Internet address is 10.137.11.37/30
  MTU 1514 bytes, BW 2000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 6/255, rxload 2/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 221.128.85.50
  Tunnel protocol/transport IP/IP
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 21000 bits/sec, 14 packets/sec
  5 minute output rate 54000 bits/sec, 22 packets/sec
     7348023 packets input, 2385570964 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     10807724 packets output, 1160994225 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel113 is up, line protocol is up
  Hardware is Tunnel
  Description: to NA1
  Internet address is 10.137.11.45/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 12.151.115.234
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:02, output 00:00:03, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     201242 packets input, 15528445 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     208229 packets output, 17557927 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel114 is up, line protocol is up
  Hardware is Tunnel
  Description: to NA2
  Internet address is 10.137.11.49/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 12.45.14.18
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:04, output 00:00:03, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     203130 packets input, 15881185 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     208491 packets output, 16953020 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel115 is up, line protocol is up
  Hardware is Tunnel
  Description: to AU co-lo Datacenter
  Internet address is 10.140.16.218/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 119.225.151.198
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:02, output 00:00:03, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 3
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     231798 packets input, 21575751 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     227403 packets output, 24643176 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel116 is administratively down, line protocol is down
  Hardware is Tunnel
  Description: to Dallas2
  Internet address is 10.137.11.57/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 74.205.84.38
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input never, output never, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     0 packets output, 0 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel117 is up, line protocol is up
  Hardware is Tunnel
  Description: to Paris RTR-01
  Internet address is 10.254.252.245/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 84.14.151.51
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:00, output 00:00:01, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 2000 bits/sec, 2 packets/sec
     150313 packets input, 13712113 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     1086431 packets output, 142456749 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel118 is up, line protocol is up
  Hardware is Tunnel
  Description: to Paris RTR-02
  Internet address is 10.254.252.241/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 62.23.36.201
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:01, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     203869 packets input, 15645850 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     374770 packets output, 40169303 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel119 is up, line protocol is down
  Hardware is Tunnel
  Description: HK to RS VPN
  Internet address is 10.160.226.98/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 89.234.16.39
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input never, output never, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 56866
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     0 packets output, 0 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel120 is up, line protocol is up
  Hardware is Tunnel
  Description: to Philippines
  Internet address is 10.137.11.61/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 5/255, rxload 7/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 203.82.42.138
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:01, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 25
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 112000 bits/sec, 18 packets/sec
  5 minute output rate 91000 bits/sec, 17 packets/sec
     2847380 packets input, 662699885 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     3385700 packets output, 2406314097 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel121 is up, line protocol is up
  Hardware is Tunnel
  Description: to Sydney
  Internet address is 10.140.16.241/30
  MTU 1514 bytes, BW 128 Kbit, DLY 7000000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 218.185.92.42
  Tunnel protocol/transport IP/IP
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 37w6d, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     122875 packets output, 9830000 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel122 is up, line protocol is up
  Hardware is Tunnel
  Description: to Brisbane
  Internet address is 10.140.16.237/30
  MTU 1514 bytes, BW 128 Kbit, DLY 700000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 203.94.176.122
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:04, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     160421 packets input, 15311783 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     160244 packets output, 14009926 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel123 is up, line protocol is up
  Hardware is Tunnel
  Description: to Indonesia
  Internet address is 10.137.11.65/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 2/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 117.102.118.194
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:01, output 00:00:01, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 12000 bits/sec, 8 packets/sec
  5 minute output rate 33000 bits/sec, 9 packets/sec
     4394864 packets input, 1649325387 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     4322160 packets output, 2150470007 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel124 is up, line protocol is up
  Hardware is Tunnel
  Description: to India Mumbai
  Internet address is 10.137.11.73/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 115.119.4.54
  Tunnel protocol/transport IP/IP
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 2w6d, output 00:00:03, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     0 packets input, 0 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     122881 packets output, 9830408 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel125 is up, line protocol is up
  Hardware is Tunnel
  Description: to Malaysia
  Internet address is 10.137.11.125/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 211.24.171.3
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:04, output 00:00:01, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 9000 bits/sec, 5 packets/sec
  5 minute output rate 11000 bits/sec, 3 packets/sec
     2823775 packets input, 956956185 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     3168869 packets output, 1523527282 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel126 is up, line protocol is up
  Hardware is Tunnel
  Description: to JSR Rinkai office
  Internet address is 10.137.11.85/30
  MTU 1514 bytes, BW 4000 Kbit, DLY 500000 usec,
     reliability 255/255, txload 4/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 218.219.208.185
  Tunnel protocol/transport IP/IP
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:03, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 25000 bits/sec, 15 packets/sec
  5 minute output rate 74000 bits/sec, 24 packets/sec
     6740858 packets input, 2239275882 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     8275185 packets output, 4242212181 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel127 is up, line protocol is up
  Hardware is Tunnel
  Description: Melbourne Hawthorne office
  Internet address is 10.137.11.89/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive not set
  Tunnel source 122.248.141.2, destination 218.185.3.190
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:02, output 00:00:02, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 3712
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 5000 bits/sec, 3 packets/sec
     493072 packets input, 50204003 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     7734251 packets output, 1600913311 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
Tunnel128 is up, line protocol is up
  Hardware is Tunnel
  Description: Rackspace LON3
  Internet address is 10.160.226.14/30
  MTU 1514 bytes, BW 1544 Kbit, DLY 500000 usec,
     reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation TUNNEL, loopback not set
  Keepalive set (10 sec), retries 3
  Tunnel source 122.248.141.2, destination 94.236.114.90
  Tunnel protocol/transport GRE/IP
    Key disabled, sequencing disabled
    Checksumming of packets disabled
  Tunnel TTL 255
  Fast tunneling enabled
  Tunnel transmit bandwidth 8000 (kbps)
  Tunnel receive bandwidth 8000 (kbps)
  Last input 00:00:03, output 00:00:01, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo (QOS pre-classification)
  Output queue: 0/0 (size/max)
  5 minute input rate 0 bits/sec, 0 packets/sec
  5 minute output rate 0 bits/sec, 0 packets/sec
     200322 packets input, 15462009 bytes, 0 no buffer
     Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
     0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
     200044 packets output, 15250485 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 output buffer failures, 0 output buffers swapped out
RTR-01#
RTR-01#sh proc cpu
CPU utilization for five seconds: 45%/40%; one minute: 48%; five minutes: 50%
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
   1         232      1823        127  0.00%  0.00%  0.00%   0 Chunk Manager    
   2     3639744  11661416        312  0.00%  0.02%  0.02%   0 Load Meter      
   3      467912   9126336         51  0.00%  0.00%  0.00%   0 CRYPTO IKMP IPC  
   4           0         1          0  0.00%  0.00%  0.00%   0 EDDRI_MAIN      
   5    88026092   7197334      12230  0.81%  0.15%  0.12%   0 Check heaps      
   6     1320360    342825       3851  0.00%  0.00%  0.00%   0 Pool Manager    
   7           0         2          0  0.00%  0.00%  0.00%   0 Timers          
   8        8088    971781          8  0.00%  0.00%  0.00%   0 IPC Dynamic Cach
   9           0         1          0  0.00%  0.00%  0.00%   0 IPC Zone Manager
  10      567964  58291349          9  0.00%  0.00%  0.00%   0 IPC Periodic Tim
  11      508596  58291370          8  0.00%  0.00%  0.00%   0 IPC Deferred Por
  12           0         1          0  0.00%  0.00%  0.00%   0 IPC Seat Manager
  13           0         1          0  0.00%  0.00%  0.00%   0 IPC BackPressure
  14           0         1          0  0.00%  0.00%  0.00%   0 OIR Handler      
  15           0         1          0  0.00%  0.00%  0.00%   0 Crash writer    
  16      284696   1943545        146  0.00%  0.00%  0.00%   0 Environmental mo
  17     1626500   3542028        459  0.00%  0.00%  0.00%   0 ARP Input        
  18           0         2          0  0.00%  0.00%  0.00%   0 ATM Idle Timer  
  19           0         2          0  0.00%  0.00%  0.00%   0 AAA high-capacit
  20           0         1          0  0.00%  0.00%  0.00%   0 AAA_SERVER_DEADT
  21           0         1          0  0.00%  0.00%  0.00%   0 Policy Manager  
  22           0         2          0  0.00%  0.00%  0.00%   0 DDR Timers      
  23           4         2       2000  0.00%  0.00%  0.00%   0 Entity MIB API  
  24      151448    692980        218  0.00%  0.00%  0.00%   0 EEM ED Syslog    
  25     1854172  17473358        106  0.08%  0.01%  0.00%   0 HC Counter Timer
  26           0         2          0  0.00%  0.00%  0.00%   0 Serial Backgroun
  27           0         1          0  0.00%  0.00%  0.00%   0 RO Notify Timers
  28           0         2          0  0.00%  0.00%  0.00%   0 SMART            
  29      664768  58306451         11  0.00%  0.00%  0.00%   0 GraphIt          
  30           0         2          0  0.00%  0.00%  0.00%   0 Dialer event    
  31           0         1          0  0.00%  0.00%  0.00%   0 SERIAL A'detect  
  32           0         2          0  0.00%  0.00%  0.00%   0 XML Proxy Client
  33         480      6856         70  0.00%  0.00%  0.00%   0 TACACS+          
  34           0         1          0  0.00%  0.00%  0.00%   0 Inode Table Dest
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  35           0         1          0  0.00%  0.00%  0.00%   0 Critical Bkgnd  
  36    10693720  97896107        109  0.08%  0.11%  0.10%   0 Net Background  
  37           0         2          0  0.00%  0.00%  0.00%   0 IDB Work        
  38       37052   1368727         27  0.00%  0.00%  0.00%   0 Logger          
  39      724756  58291330         12  0.00%  0.00%  0.00%   0 TTY Background  
  40     2846248  58344976         48  0.08%  0.02%  0.02%   0 Per-Second Jobs  
  41       34132   3887069          8  0.00%  0.00%  0.00%   0 c2800 Periodic  
  42           0         1          0  0.00%  0.00%  0.00%   0 AggMgr Process  
  43           0         1          0  0.00%  0.00%  0.00%   0 Token Daemon    
  44           0         1          0  0.00%  0.00%  0.00%   0 dev_device_inser
  45           0         1          0  0.00%  0.00%  0.00%   0 dev_device_remov
  46           0         1          0  0.00%  0.00%  0.00%   0 sal_dpc_process  
  47           0         1          0  0.00%  0.00%  0.00%   0 ARL Table Manage
  48           0         2          0  0.00%  0.00%  0.00%   0 ESWPPM          
  49           0         2          0  0.00%  0.00%  0.00%   0 Eswilp Storm Con
  50           0         2          0  0.00%  0.00%  0.00%   0 ESWILPPM        
  51           0         2          0  0.00%  0.00%  0.00%   0 Eswilp Storm Con
  52     2889100 233204939         12  0.00%  0.02%  0.00%   0 Netclock Backgro
  53           0         2          0  0.00%  0.00%  0.00%   0 SM Monitor      
  54         280         4      70000  0.00%  0.00%  0.00%   0 USB Startup      
  55      108416   9717421         11  0.00%  0.00%  0.00%   0 mxt5100          
  56           0         2          0  0.00%  0.00%  0.00%   0 VNM DSPRM MAIN  
  57           0         1          0  0.00%  0.00%  0.00%   0 DSPFARM DSP READ
  58           0         2          0  0.00%  0.00%  0.00%   0 FLEX DNLD MAIN  
  59           0         1          0  0.00%  0.00%  0.00%   0 HDV background  
  60      426816  58291360          7  0.00%  0.00%  0.00%   0 Ether-Switch RBC
  61           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Pr
  62           0         1          0  0.00%  0.00%  0.00%   0 IGMP Snooping Re
  63       16840   1943553          8  0.00%  0.00%  0.00%   0 Call Management  
  64           0         1          0  0.00%  0.00%  0.00%   0 AAL2CPS TIMER_CU
  65           0         1          0  0.00%  0.00%  0.00%   0 CES Line Conditi
  66           0         2          0  0.00%  0.00%  0.00%   0 dot1x            
  67           0         2          0  0.00%  0.00%  0.00%   0 DTP Protocol    
  68      444852  58291348          7  0.00%  0.00%  0.00%   0 PI MATM Aging Pr
  69       47940   5830553          8  0.00%  0.00%  0.00%   0 EtherChnl        
  70           0         2          0  0.00%  0.00%  0.00%   0 Dot11 auth Dot1x
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
  71           0         1          0  0.00%  0.00%  0.00%   0 Dot11 Mac Auth  
  72           0         2          0  0.00%  0.00%  0.00%   0 AAA Dictionary R
  73         176      1300        135  0.00%  0.00%  0.00%   0 AAA Server      
  74         780      3601        216  0.00%  0.00%  0.00%   0 AAA ACCT Proc    
  75           0         1          0  0.00%  0.00%  0.00%   0 ACCT Periodic Pr
  76      715776   7775442         92  0.00%  0.00%  0.00%   0 CDP Protocol    
  77   5614438201141603520        491  0.81%  0.69%  0.70%   0 IP Input        
  78           0         1          0  0.00%  0.00%  0.00%   0 ICMP event handl
  79          12       240         50  0.00%  0.00%  0.00%   0 TurboACL        
  80           0         2          0  0.00%  0.00%  0.00%   0 TurboACL chunk  
  81        6416     96944         66  0.00%  0.00%  0.00%   0 MOP Protocols    
  82           0         3          0  0.00%  0.00%  0.00%   0 PPP Hooks        
  83    14427640     64575     223434  0.00%  0.00%  0.05%   0 crypto sw pk pro
  84           0         1          0  0.00%  0.00%  0.00%   0 SSS Manager      
  85       50728   7774135          6  0.00%  0.00%  0.00%   0 SSS Test Client  
  86           0         1          0  0.00%  0.00%  0.00%   0 SSS Feature Mana
  87     3011552 227742853         13  0.00%  0.02%  0.00%   0 SSS Feature Time
  88           0         1          0  0.00%  0.00%  0.00%   0 VPDN call manage
  89           0         1          0  0.00%  0.00%  0.00%   0 L2X Socket proce
  90           0         1          0  0.00%  0.00%  0.00%   0 L2X SSS manager  
  91           4         2       2000  0.00%  0.00%  0.00%   0 L2TP mgmt daemon
  92           0         1          0  0.00%  0.00%  0.00%   0 X.25 Encaps Mana
  93           0         2          0  0.00%  0.00%  0.00%   0 EAPoUDP Process  
  94           4         2       2000  0.00%  0.00%  0.00%   0 IP Host Track Pr
  95           0         1          0  0.00%  0.00%  0.00%   0 IPv6 RIB Redistr
  96           0         2          0  0.00%  0.00%  0.00%   0 KRB5 AAA        
  97      300312   1724749        174  0.00%  0.00%  0.00%   0 IP Background    
  98     1909564   3969557        481  0.00%  0.00%  0.00%   0 IP RIB Update    
  99           0         2          0  0.00%  0.00%  0.00%   0 PPP IP Route    
 100           0         2          0  0.00%  0.00%  0.00%   0 PPP IPCP        
 101           0         1          0  0.00%  0.00%  0.00%   0 Asy FS Helper    
 102      838272  58281674         14  0.00%  0.00%  0.00%   0 Socket Timers    
 103      200704   2838752         70  0.00%  0.00%  0.00%   0 TCP Timer        
 104        1372      1317       1041  0.00%  0.00%  0.00%   0 TCP Protocols    
 105           0         1          0  0.00%  0.00%  0.00%   0 COPS            
 106     3352644  88456358         37  0.08%  0.03%  0.02%   0 CEF process      
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
 107           0         2          0  0.00%  0.00%  0.00%   0 L2MM            
 108           0         1          0  0.00%  0.00%  0.00%   0 MRD              
 109           0         1          0  0.00%  0.00%  0.00%   0 IGMPSN          
 110           0         1          0  0.00%  0.00%  0.00%   0 IP Traceroute    
 111           0         2          0  0.00%  0.00%  0.00%   0 RLM groups Proce
 112           0         2          0  0.00%  0.00%  0.00%   0 DDP              
 113           0         2          0  0.00%  0.00%  0.00%   0 SNMP Timers      
 114           0         2          0  0.00%  0.00%  0.00%   0 SCTP Main Proces
 115           0         1          0  0.00%  0.00%  0.00%   0 IUA Main Process
 116      799184  58298129         13  0.00%  0.00%  0.00%   0 RUDPV1 Main Proc
 117           0         1          0  0.00%  0.00%  0.00%   0 bsm_timers      
 118      418012  58291350          7  0.00%  0.00%  0.00%   0 bsm_xmt_proc    
 119           0         1          0  0.00%  0.00%  0.00%   0 CES Client SVC R
 120     3655636 116563465         31  0.00%  0.03%  0.02%   0 DHCPD Receive    
 121           0         2          0  0.00%  0.00%  0.00%   0 Dialer Forwarder
 122       89736    971544         92  0.00%  0.00%  0.00%   0 IP Cache Ager    
 123      374548    974339        384  0.00%  0.00%  0.00%   0 Adj Manager      
 124           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM Input    
 125           0         2          0  0.00%  0.00%  0.00%   0 ATM OAM TIMER    
 126        2912    194382         14  0.00%  0.00%  0.00%   0 HTTP CORE        
 127         172       864        199  0.00%  0.00%  0.00%   0 RARP Input      
 128       17816    979360         18  0.00%  0.00%  0.00%   0 Transport Port A
 129           0         1          0  0.00%  0.00%  0.00%   0 PAD InCall      
 130           0         2          0  0.00%  0.00%  0.00%   0 X.25 Background  
 131           0         2          0  0.00%  0.00%  0.00%   0 PPP Bind        
 132           0         2          0  0.00%  0.00%  0.00%   0 PPP SSS          
 133     9789492 581742443         16  0.08%  0.08%  0.08%   0 RBSCP Background
 134           0         1          0  0.00%  0.00%  0.00%   0 Inspect Timer    
 135        8492    485892         17  0.00%  0.00%  0.00%   0 DHCPD Timer      
 136        2272    194357         11  0.00%  0.00%  0.00%   0 Authentication P
 137           0         1          0  0.00%  0.00%  0.00%   0 Auth-proxy AAA B
 138           0         1          0  0.00%  0.00%  0.00%   0 IPS Timer        
 139           0         2          0  0.00%  0.00%  0.00%   0 SDEE Management  
 140           0         1          0  0.00%  0.00%  0.00%   0 IPv6 Inspect Tim
 141           0         2          0  0.00%  0.00%  0.00%   0 URL filter proc  
 142           0         3          0  0.00%  0.00%  0.00%   0 Crypto HW Proc  
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
 143       39604   2332286         16  0.00%  0.00%  0.00%   0 CRM_CALL_UPDATE_
 144         112         2      56000  0.00%  0.00%  0.00%   0 CCVPM_HDSPRM    
 145      382248  21576532         17  0.00%  0.00%  0.00%   0 FLEX DSPRM MAIN  
 146      138792  21576530          6  0.00%  0.00%  0.00%   0 FLEX DSP KEEPALI
 147           0         4          0  0.00%  0.00%  0.00%   0 HDA DSPRM MAIN  
 148           0         2          0  0.00%  0.00%  0.00%   0 ENABLE AAA      
 149           0         1          0  0.00%  0.00%  0.00%   0 EM Background Pr
 150           0         1          0  0.00%  0.00%  0.00%   0 Key chain liveke
 151           0         2          0  0.00%  0.00%  0.00%   0 LINE AAA        
 152           0       108          0  0.00%  0.00%  0.00%   0 LOCAL AAA        
 153       29812     23787       1253  0.00%  0.01%  0.00%   0 TPLUS            
 154           0         2          0  0.00%  0.00%  0.00%   0 VSP_MGR          
 155           0         1          0  0.00%  0.00%  0.00%   0 encrypt proc    
 156           0         3          0  0.00%  0.00%  0.00%   0 Crypto WUI      
 157      392216    871177        450  0.00%  0.00%  0.00%   0 Crypto Support  
 158           0         1          0  0.00%  0.00%  0.00%   0 CCVPM_HTSP      
 159           0         2          0  0.00%  0.00%  0.00%   0 VPM_MWI_BACKGROU
 160           0         1          0  0.00%  0.00%  0.00%   0 CCVPM_R2        
 161         564     64786          8  0.00%  0.00%  0.00%   0 FB/KS Log HouseK
 162           0         2          0  0.00%  0.00%  0.00%   0 EPHONE MWI BG Pr
 163           0         1          0  0.00%  0.00%  0.00%   0 CCSWVOICE        
 164        1412       417       3386  0.40%  0.34%  0.17% 322 SSH Process      
 165           0         1          0  0.00%  0.00%  0.00%   0 http client proc
 166        5772     27636        208  0.00%  0.00%  0.00%   0 SSH Event handle
 167           0         1          0  0.00%  0.00%  0.00%   0 QOS_MODULE_MAIN  
 168           0         1          0  0.00%  0.00%  0.00%   0 RPMS_PROC_MAIN  
 169           0         1          0  0.00%  0.00%  0.00%   0 VoIP AAA        
 170       59964    633583         94  0.00%  0.00%  0.00%   0 crypto engine pr
 171          48         4      12000  0.00%  0.00%  0.00%   0 Crypto CA        
 172           0         1          0  0.00%  0.00%  0.00%   0 Crypto PKI-CRL  
 173           0         1          0  0.00%  0.00%  0.00%   0 Crypto SSL      
 174        3804      4085        931  0.00%  0.00%  0.00%   0 Crypto ACL      
 175           0         2          0  0.00%  0.00%  0.00%   0 CRYPTO QoS proce
 176           0         1          0  0.00%  0.00%  0.00%   0 Crypto INT      
 177   131255096  48232331       2721  0.00%  0.19%  0.05%   0 Crypto IKMP      
 178     1304476  14577740         89  0.00%  0.00%  0.00%   0 IPSEC key engine
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
 179           0         1          0  0.00%  0.00%  0.00%   0 IPSEC manual key
 180    55642520  46494426       1196  0.00%  0.01%  0.01%   0 Crypto PAS Proc  
 181      178120   1665559        106  0.00%  0.00%  0.00%   0 Crypto Delete Ma
 182           0         2          0  0.00%  0.00%  0.00%   0 Key Proc        
 183      556460  58306468          9  0.00%  0.00%  0.00%   0 Crypto Device Up
 184           0         2          0  0.00%  0.00%  0.00%   0 Multi-ISA Event  
 185           0         1          0  0.00%  0.00%  0.00%   0 Multi-ISA Cleanu
 186           0         1          0  0.00%  0.00%  0.00%   0 Onboard VPN Comm
 187           0         1          0  0.00%  0.00%  0.00%   0 PM Callback      
 188           0         1          0  0.00%  0.00%  0.00%   0 DATA Transfer Pr
 189           0         1          0  0.00%  0.00%  0.00%   0 DATA Collector  
 190         296       766        386  0.00%  0.00%  0.00%   0 AAA SEND STOP EV
 191           0         3          0  0.00%  0.00%  0.00%   0 EEM ED CLI      
 192           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Counter  
 193           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Interface
 194           0         3          0  0.00%  0.00%  0.00%   0 EEM ED IOSWD    
 195           0         2          0  0.00%  0.00%  0.00%   0 EEM ED Memory-th
 196           0         2          0  0.00%  0.00%  0.00%   0 EEM ED None      
 197           0         2          0  0.00%  0.00%  0.00%   0 EM ED OIR        
 198           0         2          0  0.00%  0.00%  0.00%   0 EEM ED SNMP      
 199       14296    971869         14  0.00%  0.00%  0.00%   0 EEM ED Timer    
 200      310116  19223663         16  0.00%  0.00%  0.00%   0 EEM Server      
 201       49956   5830553          8  0.00%  0.00%  0.00%   0 RMON Recycle Pro
 202           0         2          0  0.00%  0.00%  0.00%   0 RMON Deferred Se
 203           0         1          0  0.00%  0.00%  0.00%   0 Syslog Traps    
 204           8         2       4000  0.00%  0.00%  0.00%   0 VLAN Manager    
 205        7748    971787          7  0.00%  0.00%  0.00%   0 DHCPD Database  
 206      392176  58271507          6  0.00%  0.00%  0.00%   0 trunk conditioni
 207           0         1          0  0.00%  0.00%  0.00%   0 trunk conditioni
 208           0         2          0  0.00%  0.00%  0.00%   0 EEM Policy Direc
 209      150608    686103        219  0.00%  0.00%  0.00%   0 Syslog          
 210           0         1          0  0.00%  0.00%  0.00%   0 VPDN Scal        
 211    18432084 118834809        155  0.00%  0.01%  0.00%   0 Net Input        
 212     2674724  11691882        228  0.00%  0.01%  0.00%   0 Compute load avg
 213    21706528   1027010      21135  0.00%  0.01%  0.00%   0 Per-minute Jobs  
 214           0         1          0  0.00%  0.00%  0.00%   0 tHUB            
 PID Runtime(ms)   Invoked      uSecs   5Sec   1Min   5Min TTY Process
 215       81820   2022421         40  0.00%  0.00%  0.00%   0 CEF Scanner      
 216       32768   2487779         13  0.00%  0.00%  0.00%   0 Secure Login    
 217    46714524-665733639          0  0.40%  0.42%  0.41%   0 IP SLA Mon Respo
 218   1477998441412239489        104  1.39%  1.47%  1.47%   0 IP SLA Mon Event
 219           0         1          0  0.00%  0.00%  0.00%   0 IP SLA Mon Sync  
 220           0         2          0  0.00%  0.00%  0.00%   0 IP Flow Backgrou
 222   175769088 414148256        424  0.49%  0.25%  0.24%   0 IP SNMP          
 223    45488432 207173430        219  0.16%  0.07%  0.07%   0 PDU DISPATCHER  
 224   161348344 207398630        777  0.49%  0.26%  0.25%   0 SNMP ENGINE      
 225           0         1          0  0.00%  0.00%  0.00%   0 SNMP ConfCopyPro
 226           0         1          0  0.00%  0.00%  0.00%   0 SNMP Traps      
 227     1004212  58491503         17  0.00%  0.00%  0.00%   0 NTP              
 228      121404   2517163         48  0.00%  0.00%  0.00%   0 IP-EIGRP Router  
 229   233571612 552182655        422  0.08%  0.17%  0.38%   0 IP-EIGRP: PDM    
 230   108849468 736912951        147  0.40%  0.45%  0.47%   0 IP-EIGRP: HELLO
RTR-01#exit
0
 
koudryCommented:
Hello,
Thanks for the output. The CPU usage is not currently showing as an issue, although this depends on the traffic going through the device.

You do have many tunnels. I suspect this could be an issue when most of the tunnels are carrying traffic and I can see some of them do have very low bandwidths. So we need to establish how many tunnels can be hosted on this platform. Do you know how many tunnels you have? I tried counting but could not.

You also have some input errors on your LAN interface f0/1. Do you know where they come from? I am not saying if this is the problem but it could be. You may have an application trying to send giants or oversized packets although this is not currenlty registered as giants.

FastEthernet0/1 is up, line protocol is up
  Hardware is MV96340 Ethernet, address is 001e.4aed.c1f1 (bia 001e.4aed.c1f1)
  Description: Connected to Internal Switch Vlan1
  Internet address is 10.137.8.4/25
  MTU 1500 bytes, BW 100000 Kbit, DLY 100 usec,
     reliability 255/255, txload 5/255, rxload 8/255
  Encapsulation ARPA, loopback not set
  Keepalive set (10 sec)
  Full-duplex, 100Mb/s, 100BaseTX/FX
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:00, output 00:00:00, output hang never
  Last clearing of "show interface" counters 6d13h
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 3299000 bits/sec, 678 packets/sec
  5 minute output rate 2340000 bits/sec, 663 packets/sec
     182923605 packets input, 3710195463 bytes
     Received 3440526 broadcasts, 0 runts, 0 giants, 0 throttles
     644 input errors, 0 CRC, 0 frame, 0 overrun, 644 ignored     0 watchdog
     0 input packets with dribble condition detected
     181127276 packets output, 3532672853 bytes, 0 underruns
     0 output errors, 0 collisions, 0 interface resets
     0 babbles, 0 late collision, 0 deferred
     0 lost carrier, 0 no carrier
     0 output buffer failures, 0 output buffers swapped out


Thanks.
0
 
beardog1113Author Commented:
hello expert
i am also think about this router is too small that could not pick up so many service, and considering upgrade it, why i submit this question just want to find what causing CPU usage, that will help me extend my knowledge and will helpful in the future, maybe you don't know the router is hosted in a datacenter and far away from my site, so it is not easy go there do upgrade task.
i will upgrade it ASAP and see if upgrade could fix it or not.

thank you very much
0
 
koudryCommented:
Hello,

I think it may be worth exploring the behaviour of the router before you upgrade. I think it is a good idea to upgrade to something like a Cisco 7200 (7206 VRX for example) but before you make a decision to upgrade, which costs more money, it is worth finding out the maximum number of IPSec tunnels that the Cisco 2811 can handle. This is only a suggestion. I will take a look on the Internet to see if I can find some info.

Thanks.
0
 
koudryCommented:
Hello,

Please take a look at the document at:

http://www.cisco.com/application/pdf/en/us/guest/netsol/ns171/c649/ccmigration_09186a008075ea98.pdf

There are sections that cover how performance can be impacted by the quantity of tunnels. Below are the sections.

"
Tunnel Quantity Affects Throughput

Although throughput is highly dependent on platform architecture, as tunnel quantities are increased, the overall throughput generally tends to decrease. When a router receives a packet from a different peer than the peer whose packet was just decrypted, a lookup based on the security parameters index (SPI) of the new packet must be performed. The transform set information and negotiated session key of the new packet is then loaded into the hardware decryption engine for processing. Having traffic flowing on a larger numbers of SAs tends to negatively affect throughput performance.
Increasingly, platforms with hardware-accelerated IPsec encryption are designed to offload tunnel
processing overhead as well, resulting in more linear performance regardless of the number of tunnels.

For example, the VPN SPA blade for the Cisco 7600 has fairly linear throughput regardless of whether
the traffic load is offered on a few tunnels or several thousand.

GRE Encapsulation Affects Throughput

Router encryption throughput is affected by the configuration of GRE. In addition to the headers that are added to the beginning of each packet, these headers also must be encrypted. The GRE encapsulation process, when not hardware-accelerated, increases total CPU utilization. Total throughput in a DMVPN design results in a lower throughput than that of an IPsec Direct Encapsulation design.
"

I think you should raise a TAC case with Cisco so they can advise on the correct course of action. I think it is all going to depend on the amount of data being carried through the tunnels.

Good luck.
 ccmigration-09186a008075ea98.pdf
0
 
beardog1113Author Commented:
actually expert and i all think that the router is too small, i will upgrade it in 3 weeks, hope that will fix it.

thanks
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.