I need to hook up a Netapp FAS3170 to a Cisco Catalyst 6513 running CAT OS using a two port etherchannel. A similar etherchannel is already configured on the switch but I have questions about whether this is the best way to configure it.
Current config of the working etherchannel between a Netapp NAS and Cisco Cat switch:
set port channel 3/13-14 mode on
set port channel 3/13-14 296
set port flowcontrol 3/13-14 receive desired
clear trunk 3/13 1006-1023
clear trunk 3/14 1006-1023
set trunk 3/13 auto negotiate 1-1005,1024-4094
set trunk 3/14 auto negotiate 1-1005,1024-4094
Is this the best way to hook up to the Netapp?
Should LACP be enabled?
If LACP is enabled on the switch or blade will the mode "on" work differently? Or is on the same whether LACP is enabled or not? One reason I ask is the channel is listed under PAGP in the following show command.
> (enable) sh port channel all
PAGP Channels:
Port Status Channel Admin Ch
Mode Group Id
----- ---------- -------------------- ----- -----
1/1 connected on 191 1666
1/2 connected on 191 1666
----- ---------- -------------------- ----- -----
2/1 connected on 695 1698
2/2 connected on 695 1698
----- ---------- -------------------- ----- -----
3/13 connected on 296 1736
3/14 connected on 296 1736
Port Device-ID Port-ID Platform
----- --------------------------
1/1 SCA05020EST(xxx) 5/5 WS-C6509
1/2 SCA05020EST(xxx) 5/6 WS-C6509
----- --------------------------
2/1 SCA05020ESS(xxx) 5/5 WS-C6509
2/2 SCA05020ESS(xxx) 5/6 WS-C6509
----- --------------------------
3/13
3/14
LACP Channels:
No ports channelling
> (enable) sh port 3/13
* = Configured MAC Address
# = 802.1X Authenticated Port Name.
Port Name Status Vlan Duplex Speed Type
----- -------------------- ---------- ---------- ------ ----------- ------------
3/13 nas connected 73 full 1000 1000BaseSX
Port Security Violation Shutdown-Time Age-Time Max-Addr Trap IfIndex
----- -------- --------- ------------- -------- -------- -------- -------
3/13 disabled shutdown 0 0 1 enabled 40
Port Flooding on Address Limit Last-Src-Addr Vlan
----- ------------------------- ----------------- ----
3/13 Enabled - -
Port Num-Addr Secure-Src-Addr Vlan Age-Left Shutdown/Time-Left
----- -------- ----------------- ---- -------- ------------------
3/13 0 - - - - -
Port 802.1X Auth-State 802.1X Port-Status
----- ------------------ ------------------
3/13 force-authorized authorized
Port Mac-Auth-Bypass State Mac-Auth-Bypass Port-Status
----- --------------------- --------------------------
3/13 Disabled (null)
Port Broadcast-Limit Multicast Unicast Total-Drop Action
-------- --------------- --------- ------- -------------------- ------------
3/13 - - - 0 drop-packets
Port Send FlowControl Receive FlowControl RxPause TxPause
admin oper admin oper
----- -------- -------- --------- --------- ---------- ----------
3/13 desired on desired on 0 4350
Port Status Channel Admin Ch
Mode Group Id
----- ---------- -------------------- ----- -----
3/13 connected on 296 1736
3/14 connected on 296 1736
----- ---------- -------------------- ----- -----
Port Status ErrDisable Reason Port ErrDisableTimeout Action on Timeout
---- ---------- ------------------- ---------------------- -----------------
3/13 connected - Enable No Change
Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize
----- ---------- ---------- ---------- ---------- ---------
3/13 0 0 0 0 0
Port Single-Col Multi-Coll Late-Coll Excess-Col Carri-Sen Runts Giants
----- ---------- ---------- ---------- ---------- --------- --------- ---------
3/13 0 0 0 0 0 0 0
Port Last-Time-Cleared
----- --------------------------
3/13 Mon Oct 20 2008, 08:54:08
> (enable) sh channel group 296
Admin Port Status Channel Channel
group Mode id
----- ----- ---------- -------------------- --------
296 3/13 connected on 1736
296 3/14 connected on 1736
Admin Port Device-ID Port-ID Platform
group
----- ----- --------------------------
296 3/13
296 3/14
Thanks for any help.
This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.
Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
What is the purpose of the command "clear trunk 3/13 1006-1023"? I think it prevents those vlans from crossing the trunk but why would you want to eliminate those specific vlans?
Does the order matter? should the "set trunk 3/13 auto negotiate 1-1005,1024-4094" be entered before the "clear trunk 3/13 1006-1023"?
Also do I need to disable portfast on these ports?
Conifguring and testing next week.
Thanks
One addtional question.
My understanding is that all the ports in an etherchannel should all have identical settings for everything.
Can ports in an etherchannel be access ports or trunk ports?
The etherchannel does not care becasue access port frames are untagged with a vlan id and trunk ports just tag the frame with a vlan id and the tagging or not does not affect any thing with the etherchannel. Correct?
Thanks
Yes, all ports in an etherchannel should have identical config.
No, it doesn't matter if the ports are access or trunk - etherchannel is for high availability and load balancing, and as such doesn't care about VLAN tagging, etc.
Don't disable portfast if you don't know what the ports are for. Broadcast storms are very unpleasant and hard to explain to management as a good reason for your network falling over.
Thanks Quori
It would seem to me that portfast enabled when you don't know what ports are for would be more likely to cause broadcast storms than disabling portfast. Did you mean dont "enable" portfast?
Do you have any idea about the following?
What is the purpose of the command "clear trunk 3/13 1006-1023"?
Does the order matter? should the "set trunk 3/13 auto negotiate 1-1005,1024-4094" be entered before the "clear trunk 3/13 1006-1023"
It's always a good idea to clear the trunk of vlans you don't need.
By default the trunk will carry all vlans so given your 2 commands above, the "set" command won't do anything by itself because it already carries those vlans. The "clear" command will eliminate those vlans from the trunk and then the switch will modify the "set" command so it looks like the one above.
I configured the etherchannel without configuring a trunk. When I set the port-channel on command I foiund out that the blade only supported redundancy not aggregation. Received following message: Adding a WS-X6148-GE-TX port to a channel limits the channel's bandwidth to a
maximum of 1Gig throughput.
Cisco website: http://www.cisco.com/en/US
Bandwidth Is Limited to 1 Gbps When WS-X6148-GE-TX Ports Are Used in the Channel
The WS-X6148-GE-TX and WS-X6148V-GE-TX modules do not support more than 1 Gbps of traffic per EtherChannel. On these modules, there is a single 1-Gigabit Ethernet uplink from the port application-specific integrated circuit (ASIC) that supports eight ports. For EtherChannel, the data from all the links in a bundle go to the port ASIC, even though the data are destined for another link. These data consume bandwidth in the 1-Gigabit Ethernet link. For these modules, the sum total of all data on an EtherChannel cannot exceed 1 Gbps. As a result, they should only be used in port channels for link redundancy purposes. If they are included in any Gigabit EtherChannels, the entire channel is limited to 1 Gbps of bandwidth. You also see a warning message that is similar to this one:
Adding a WS-X6148-GE-TX port to a channel limits the channel's bandwidth to a
maximum of 1Gig throughput.
Any thoughts?
Well, how much bandwidth do you truly need? Even if it wasn't limited to 1 Gig, there is no guarantee that a 2-port channel will give you 2 gigs of throughput. The algorithm that works it out is based on factors that don't guarantee equal distribution. So if you just want to make sure you have a reliable link and 1GB is sufficient, go for it. 1Gb/sec is a lot of data!
I would at least try it and monitor bandwidth usage to see how it's working. Buy a different card if it isn't sufficient, I guess.
> (enable) sh mod
Mod Slot Ports Module-Type Model Sub Status
--- ---- ----- ------------------------- ------------------- --- --------
1 1 2 1000BaseX Supervisor WS-X6K-SUP2-2GE yes ok
2 2 2 1000BaseX Supervisor WS-X6K-SUP2-2GE yes standby
3 3 16 1000BaseX Ethernet WS-X6416-GBIC no ok
4 4 48 10/100/1000BaseT Ethernet WS-X6148-GE-TX no ok
5 5 48 10/100/1000BaseT Ethernet WS-X6148-GE-TX no ok
6 6 48 10/100/1000BaseT Ethernet WS-X6148-GE-TX no ok
7 7 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
8 8 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
9 9 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
10 10 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
11 11 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
12 12 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
13 13 48 10/100BaseTX Ethernet WS-X6348-RJ-45 no ok
Mod Module-Name Serial-Num
--- -------------------- -----------
1 XXXXXXXXXXX
2 XXXXXXXXXXX
3 XXXXXXXXXXX
4 XXXXXXXXXXX
5 XXXXXXXXXXX
6 XXXXXXXXXXX
7 XXXXXXXXXXX
8 XXXXXXXXXXX
9 XXXXXXXXXXX
10 XXXXXXXXXXX
11 XXXXXXXXXXX
12 XXXXXXXXXXX
13 XXXXXXXXXXX
Mod MAC-Address(es) Hw Fw Sw
--- --------------------------
1 xx-xx-7d-c9-e5-06 to xx-xx-7d-c9-e5-07 4.3 7.1(1) 8.5(3)
xx-xx-7d-c9-e5-04 to xx-xx-7d-c9-e5-05
xx-xx-f3-92-77-40 to xx-xx-f3-92-77-7f
2 xx-xx-c9-da-c7-5e to xx-xx-c9-da-c7-5f 3.10 7.1(1) 8.5(3)
xx-xx-c9-da-c7-5c to xx-xx-c9-da-c7-5d
3 xx-xx-b7-01-89-f8 to xx-xx-b7-01-8a-07 2.3 5.4(2) 8.5(3)
4 xx-xx-fc-be-2c-c8 to xx-xx-fc-be-2c-f7 1.0 7.2(1) 8.5(3)
5 xx-xx-55-4c-da-90 to xx-xx-55-4c-da-bf 7.2 7.2(1) 8.5(3)
6 xx-xx-e4-71-e6-60 to xx-xx-e4-71-e6-8f 6.1 7.2(1) 8.5(3)
7 xx-xx-12-7a-f2-88 to xx-xx-12-7a-f2-b7 6.9 5.4(2) 8.5(3)
8 xx-xx-12-64-21-48 to xx-xx-12-64-21-77 6.9 5.4(2) 8.5(3)
9 xx-xx-b7-38-b8-80 to xx-xx-b7-38-b8-af 6.1 5.4(2) 8.5(3)
10 xx-xx-29-67-24-b8 to xx-xx-29-67-24-e7 7.6 5.4(2) 8.5(3)
11 xx-xx-de-67-75-b4 to xx-xx-de-67-75-e3 3.5 5.4(2) 8.5(3)
12 xx-xx-b7-10-3a-08 to xx-xx-b7-10-3a-37 6.1 5.4(2) 8.5(3)
13 xx-xx-6c-11-e6-c0 to xx-xx-6c-11-e6-ef 2.3 5.4(2) 8.5(3)
Mod Sub-Type Sub-Model Sub-Serial Sub-Hw Sub-Sw
--- ----------------------- ------------------- ----------- ------ ------
1 L3 Switching Engine II WS-F6K-PFC2 XXXXXXXXXXX 3.4
2 L3 Switching Engine II WS-F6K-PFC2 XXXXXXXXXXX 3.2
**************************
> (enable) sh ver
WS-C6513 Software, Version NmpSW: 8.5(3)
Copyright (c) 1995-2006 by Cisco Systems
NMP S/W compiled on Jan 28 2006, 18:03:10
System Bootstrap Version: 7.1(1)
System Boot Image File is 'bootflash:cat6000-sup2k8.
System Configuration register is 0xf
Hardware Version: 1.0 Model: WS-C6513 Serial #: XXXXXXXXXXX
PS1 Module: WS-CAC-2500W Serial #: XXXXXXXXXXX
PS2 Module: WS-CAC-2500W Serial #: XXXXXXXXXXX
Mod Port Model Serial # Versions
--- ---- ------------------- ----------- --------------------------
1 2 WS-X6K-SUP2-2GE XXXXXXXXXXX Hw : 4.3
Fw : 7.1(1)
Fw1: 6.1(3)
Sw : 8.5(3)
Sw1: 8.5(3)
WS-F6K-PFC2 XXXXXXXXXXX Hw : 3.4
Sw :
2 2 WS-X6K-SUP2-2GE XXXXXXXXXXX Hw : 3.10
Fw : 7.1(1)
Fw1: 6.1(3)
Sw : 8.5(3)
Sw1: 8.5(3)
WS-F6K-PFC2 XXXXXXXXXXX Hw : 3.2
Sw :
3 16 WS-X6416-GBIC XXXXXXXXXXX Hw : 2.3
Fw : 5.4(2)
Sw : 8.5(3)
4 48 WS-X6148-GE-TX XXXXXXXXXXX Hw : 1.0
Fw : 7.2(1)
Sw : 8.5(3)
5 48 WS-X6148-GE-TX XXXXXXXXXXX Hw : 7.2
Fw : 7.2(1)
Sw : 8.5(3)
6 48 WS-X6148-GE-TX XXXXXXXXXXX Hw : 6.1
Fw : 7.2(1)
Sw : 8.5(3)
7 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 6.9
Fw : 5.4(2)
Sw : 8.5(3)
8 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 6.9
Fw : 5.4(2)
Sw : 8.5(3)
9 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 6.1
Fw : 5.4(2)
Sw : 8.5(3)
10 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 7.6
Fw : 5.4(2)
Sw : 8.5(3)
11 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 3.5
Fw : 5.4(2)
Sw : 8.5(3)
12 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 6.1
Fw : 5.4(2)
Sw : 8.5(3)
13 48 WS-X6348-RJ-45 XXXXXXXXXXX Hw : 2.3
Fw : 5.4(2)
Sw : 8.5(3)
DRAM FLASH NVRAM
Module Total Used Free Total Used Free Total Used Free
------ ------- ------- ------- ------- ------- ------- ----- ----- -----
1 131072K 85219K 45853K 31232K 25508K 5724K 512K 100K 412K
2 131072K
Uptime is 1009 days, 19 hours, 38 minutes
Mike
If I understand you correctly. The 6348 cards are only 100mb so with the two copper connections to the NAS that would only provide 200 mb if it did aggregate vice redundacy. I only have two connections on the NAS. I believe the max for etherchannel is 8 so even if I had 8 ports that would still be less than one 1 gb port. Do you agree?
Ye, that's true. I think your best option, short of upgrading your supervisors and line cards, is to monitor the throughput on your existing link. Is it congested? If not, then consider adding the 2nd link for redundancy but not for added bandwith. As I said even with the right line cards, Etherchannel does NOT guarantee you extra bandwidth. If you double the amount of traffic passing between the same hosts, you very likely will see twice as much traffic on the same link. This can be modified to a degree with different etherchannel algorithm options, but there are no guarantees.
Business Accounts
Answer for Membership
by: mikebernhardtPosted on 2009-09-04 at 14:20:49ID: 25263429
LACP is IEEE, PAGP is Cisco-proprietary. If it is ON then it doesn't negotiate either protocol. For practical purposes, that's the difference. So if you have a non-Cisco switch and you want to run etherchannel from it, you have to either run LACP or set it to on.
Cisco chooses PAGP by default. I suspect the channel showing up under PAGP is because that's the default protocol for the port if it was negotiating, which it isn't. If that's working now I would just do the same thing again.