Difference between revisions of "Performance Cisco IOS"
From Teknologisk videncenter
m (→Example on problems) |
m (→Links) |
||
| Line 273: | Line 273: | ||
=Links= | =Links= | ||
| + | *[http://www.cisco-secure.com/en/US/docs/switches/lan/catalyst3560/software/release/12.2_25_see/configuration/guide/swsdm.html 3560 SDM configuration] (Notes on PBR) | ||
*[http://www.ciscocatalyst.info/en/US/products/hw/routers/ps133/products_tech_note09186a00800a70f2.shtml Troubleshooting High CPU Utilization on Cisco Routers] | *[http://www.ciscocatalyst.info/en/US/products/hw/routers/ps133/products_tech_note09186a00800a70f2.shtml Troubleshooting High CPU Utilization on Cisco Routers] | ||
*[http://www.cisco.com/en/US/products/hw/routers/ps359/products_tech_note09186a00801c2af0.shtml#inapprop_swpath Troubleshooting High CPU Utilization Due to Interrupts] | *[http://www.cisco.com/en/US/products/hw/routers/ps359/products_tech_note09186a00801c2af0.shtml#inapprop_swpath Troubleshooting High CPU Utilization Due to Interrupts] | ||
Revision as of 09:24, 4 April 2010
Contents
Processes
CPU
R1#<input>show processes cpu sorted 5min</input>
CPU utilization for five seconds: 5%/0%; one minute: 5%; five minutes: 5%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
112 3719202 1028129 3617 0.15% 0.13% 0.15% 0 HRPC qos request
4 2111767 304796 6928 0.00% 0.09% 0.06% 0 Check heaps
139 232 304 763 0.15% 0.11% 0.05% 2 Virtual Exec
142 554927 2283402 243 0.15% 0.10% 0.05% 0 IP Input
34 57731 47158926 1 0.00% 0.02% 0.00% 0 RedEarth Tx Mana
7 637306 3220477 197 0.15% 0.03% 0.00% 0 ARP Input
6 0 2 0 0.00% 0.00% 0.00% 0 Timers
<notice> Output omitted... </notice>R1#<input>show processes cpu history</input>
22
0055555444445555555555555554444455555444445555555555444444
100
90
80
70
60
50
40
30
20 **
10 ******* *************** ***** **********
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
5555555656555555555555655565566555555555555556555565655555
100
90
80
70
60
50
40
30
20
10 *********#************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
2 2
6666666666666666666666666666666666666666666666666666666666666666166616
100
90
80
70
60
50
40
30
20 * *
10 **********************************************************************
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%Memory
R1#<input>show processes memory sorted</input>
Total: 93767804, Used: 26748864, Free: 67018940
PID TTY Allocated Freed Holding Getbufs Retbufs Process
0 0 44412416 9304512 31757752 0 0 *Init*
207 0 19663088 19130936 539048 0 0 hulc running con
0 0 16018800 16718240 514160 10630004 1993968 *Dead*
11 0 666608 425136 249328 0 0 Entity MIB API
40 0 272992 10600 236144 0 0 Stack Mgr Notifi
150 0 160216 2048 164056 0 0 CEF: IPv4 proces
155 0 86128 6072 88256 0 0 MDFS LC Process
167 0 18972712 18979792 82216 0 0 IGMPSN
<notice> Output omitted... </notice>TCAM
VIHCA-K20-03#<input>sh platform tcam utilization</input>
CAM Utilization for ASIC# 0 Max Used
Masks/Values Masks/values
Unicast mac addresses: 544/4352 178/1352
IPv4 IGMP groups + multicast routes: 144/1152 6/26
IPv4 unicast directly-connected routes: 544/4352 178/1352
IPv4 unicast indirectly-connected routes: 176/1408 53/351
IPv6 Multicast groups: 544/4352 178/1352
IPv6 unicast directly-connected routes: 544/4352 178/1352
IPv6 unicast indirectly-connected routes: 262/2096 5/31
IPv4 policy based routing aces: 256/256 22/22
IPv4 qos aces: 512/512 6/6
IPv4 security aces: 512/512 22/22
IPv6 policy based routing aces: 0/0 0/0
IPv6 qos aces: 0/0 0/0
IPv6 security aces: 204/510 5/5
Note: Allocation of TCAM entries per feature uses
a complex algorithm. The above information is meant
to provide an abstract view of the current TCAM utilizationExample on problems
VIHCA-K20-03#<input>sh processes cpu history</input>
8888888888888888888888888888888888888888888888888888888888
4111114444444444333332222211116666677777555556666666666666
100
90 ****************************
80 **********************************************************
70 **********************************************************
60 **********************************************************
50 **********************************************************
40 **********************************************************
30 **********************************************************
20 **********************************************************
10 **********************************************************
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per second (last 60 seconds)
8888888888888888899998888888888888888888888888888888888888
7777787876887888800009899888887675678888889988899879998888
100
90 ***#**#******#################******######################
80 ##########################################################
70 ##########################################################
60 ##########################################################
50 ##########################################################
40 ##########################################################
30 ##########################################################
20 ##########################################################
10 ##########################################################
0....5....1....1....2....2....3....3....4....4....5....5....
0 5 0 5 0 5 0 5 0 5
CPU% per minute (last 60 minutes)
* = maximum CPU% # = average CPU%
1
8687557666866668890999999546756666676568889999998466656666666466789999
9247556224818034800761809097551110411972391011319131164680525936190000
100 *** * *
90 * * *******#* *####*** *####
80 # ** * * **#***###* * ***######* *####
70 # ** * * * *###**###* ** * ***#######* ** * * **#####
60 #***************###*####* **************#######* *********** ***#####
50 #***************#########***************######### ***************#####
40 #***************#########***************#########****************#####
30 #**************##########**************##########****************#####
20 #*#*#***#*#*#*###########**********##*###########******#**###*########
10 ######################################################################
0....5....1....1....2....2....3....3....4....4....5....5....6....6....7.
0 5 0 5 0 5 0 5 0 5 0 5 0
CPU% per hour (last 72 hours)
* = maximum CPU% # = average CPU%
VIHCA-K20-03#<input>show sdm prefer</input>
The current template is "desktop IPv4 and IPv6 routing" template.
The selected template optimizes the resources in
the switch to support this level of features for
8 routed interfaces and 1024 VLANs.
number of unicast mac addresses: 1536
number of IPv4 IGMP groups + multicast routes: 1K
number of IPv4 unicast routes: 2816
number of directly-connected IPv4 hosts: 1536
number of indirect IPv4 routes: 1280
number of IPv6 multicast groups: 1152
number of directly-connected IPv6 addresses: 1536
number of indirect IPv6 unicast routes: 1280
number of IPv4 policy based routing aces: 256
number of IPv4/MAC qos aces: 512
number of IPv4/MAC security aces: 512
number of IPv6 policy based routing aces: 255
number of IPv6 qos aces: 510
number of IPv6 security aces: 510
VIHCA-K20-03#<input>show processes cpu sorted 5min</input>
CPU utilization for five seconds: 85%/79%; one minute: 83%; five minutes: 84%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
152 252718026 584420122 432 0.31% 0.44% 0.41% 0 IP Input
7 157557489 434633225 362 0.79% 0.35% 0.32% 0 ARP Input
216 636 10297 61 0.47% 0.34% 0.12% 1 Virtual Exec
109 8314164 34050193 244 0.00% 0.08% 0.09% 0 HRPC qos request
4 79303242 10109263 7844 0.00% 0.08% 0.07% 0 Check heaps
149 20425599 37945322 538 0.00% 0.04% 0.05% 0 IP SNMP
187 14955620 14850321 1007 0.15% 0.06% 0.04% 0 DHCPD Receive
213 17683047 21886229 807 0.00% 0.04% 0.04% 0 SNMP ENGINE
<notice>Output omitted...</notice>CPU Forwarding
3560Switch#<input>debug platform cpu-queues software-fwd-q</input>
2y37w: SW-FWD-Q:Pak FastSW'ed: Local Port Fwding L3If:Vlan2 L2If:StackPort1 DI:0xF002, LT:7, Vlan:2 SrcGPN:456, SrcGID:456, ACLLogIdx:0x0, MacDA:000c.291d.8eff, MacSA: 001b.0c5d.42f7 IP_SA:172.16.2.22 IP_DA:192.168.4.6 IP_Proto:6
TPFFD:D00001C8_00058094_004D0040-0000F002_0B64F03C_00000008
2y37w: SW-FWD-Q:Queued to L3If: Local Port Fwding L3If:Vlan4 L2If:GigabitEthernet0/2 DI:0x2F, LT:7, Vlan:4 SrcGPN:2, SrcGID:2, ACLLogIdx:0x0, MacDA:001b.0c5d.42c2, MacSA: 0007.e940.0abf IP_SA:172.16.4.16 IP_DA:172.16.0.5 IP_Proto:6
TPFFD:D8001002_00000004_00B00040-0000002F_472A0000_00000000
2y37w: SW-FWD-Q:Pak FastSW'ed: Local Port Fwding L3If:Vlan4 L2If:StackPort1 DI:0xF002, LT:7, Vlan:4 SrcGPN:456, SrcGID:456, ACLLogIdx:0x0, MacDA:0013.c32c.9448, MacSA: 001b.0c5d.42c0 IP_SA:172.16.4.16 IP_DA:172.16.0.1 IP_Proto:1
TPFFD:D00001C8_00058001_004D0066-0000F002_3A50F001_00000008
2y37w: SW-FWD-Q:Pak FastSW'ed: Local Port Fwding L3If:Vlan2 L2If:StackPort1 DI:0xF002, LT:7, Vlan:2 SrcGPN:456, SrcGID:456, ACLLogIdx:0x0, MacDA:0019.bbdb.3058, MacSA: 001b.0c5d.42cb IP_SA:172.16.2.38 IP_DA:172.16.17.97 IP_Proto:6
TPFFD:D00001C8_00058011_004D00BC-0000F002_2354F00F_00000008
<notice>Output omitted</notice>
2y37w: SW-FWD-Q:Pak FastSW'ed: Local Port Fwding L3If:Vlan2 L2If:StackPort1 DI:0xF002, LT:7, Vlan:2 SrcGPN:456, SrcGID:456, ACLLogIdx:0x0, MacDA:0030.9201.5738, MacSA: 001b.0c5d.42cd
2y37w: %SYS-3-CPUHOG: Task is running for (2134)msecs, more than (2000)msecs (134/40),process = Logger.
-Traceback= 563C60 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4267)msecs, more than (2000)msecs (226/40),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2128)msecs, more than (2000)msecs (85/6),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4252)msecs, more than (2000)msecs (155/6),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2129)msecs, more than (2000)msecs (92/8),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4257)msecs, more than (2000)msecs (171/8),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2129)msecs, more than (2000)msecs (93/11),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4259)msecs, more than (2000)msecs (177/11),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2126)msecs, more than (2000)msecs (88/14),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4254)msecs, more than (2000)msecs (168/14),process = Logger.
-Traceback= 563C60 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2131)msecs, more than (2000)msecs (94/8),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4262)msecs, more than (2000)msecs (181/8),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2131)msecs, more than (2000)msecs (91/5),process = Logger.
-Traceback= 563C60 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4258)msecs, more than (2000)msecs (169/5),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2129)msecs, more than (2000)msecs (93/10),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4259)msecs, more than (2000)msecs (178/10),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2131)msecs, more than (2000)msecs (94/7),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4258)msecs, more than (2000)msecs (172/7),process = Logger.
-Traceback= 563C60 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2132)msecs, more than (2000)msecs (95/7),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4258)msecs, more than (2000)msecs (170/7),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (2126)msecs, more than (2000)msecs (83/10),process = Logger.
-Traceback= 563C64 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-CPUHOG: Task is running for (4248)msecs, more than (2000)msecs (148/10),process = Logger.
-Traceback= 563C60 564D44 B6A5FC B697E0 B69EB0 B6E830 8D9B24 8D00EC
2y37w: %SYS-3-LOGGER_DROPPED: <notice>System dropped 30641 console debug messages.</notice>