Cisco Multilink, only 3 of 4 interfaces have L2 connectivity.

I have 4 point to point T1 circuits connecting a branch office to my data center.  I am trying to combine them using ppp multilink.  All interfaces have layer 1 connectivity but 1 of the 4 interfaces will not maintain a layer 2 connection. Data center router is a Cisco 7206. Branch office router is a 2620.

Here is the config at the datacenter:

interface Serial2/0/9:0
 description ZVMutlilink2
 no ip address
 ip directed-broadcast
 ip pim dense-mode
 encapsulation ppp
 ppp multilink
 ppp multilink group 2
 service-policy output llq_p2p_voice
!
interface Serial2/0/11:0
 description ZionsivlleMultilink2
 no ip address
 ip directed-broadcast
 encapsulation ppp
 ppp multilink
 ppp multilink group 2
 service-policy output llq_p2p_voice
!
interface Serial2/0/12:0
 description ZVMultilink2
 no ip address
 ip directed-broadcast
 ip pim dense-mode
 encapsulation ppp
 ppp multilink
 ppp multilink group 2
 service-policy output llq_p2p_voice
!
interface Serial2/0/13:0
 description ZVMultilink2
 no ip address
 ip directed-broadcast
 encapsulation ppp
 ppp multilink
 ppp multilink group 2
 service-policy output llq_p2p_voice
interface Multilink2
 description ZVMultilink2
 ip address 172.16.4.153 255.255.255.252
 ip directed-broadcast
 ip pim dense-mode
 no cdp enable
 ppp multilink
 ppp multilink group 2

 service-policy output llq_p2p_voice

And the output of show IP int brief:

Interface                  IP-Address      OK? Method Status                Protocol
Serial2/0/9:0              unassigned      YES manual up                    up
Serial2/0/11:0             unassigned      YES manual up                    down
Serial2/0/12:0             unassigned      YES manual up                    up
Serial2/0/13:0             unassigned      YES manual up                    up


The config at the remote site:

controller T1 1/0
 framing esf
 linecode b8zs
 channel-group 0 timeslots 1-24 speed 64
controller T1 1/1
 framing esf
 linecode b8zs
 channel-group 1 timeslots 1-24 speed 64
interface Multilink2
 description ZVMutlilink2
 ip address 172.16.4.154 255.255.255.252
 service-policy output llq_p2p_voice
 ppp multilink
 ppp multilink group 2
interface Serial0/0
 description ZVMutlilink2
 no ip address
 ip directed-broadcast
 ip pim dense-mode
 service-policy output llq_p2p_voice
 encapsulation ppp
 service-module t1 timeslots 1-24
 ppp multilink
 ppp multilink group 2
interface Serial0/1
 description ZVMultilink2
 no ip address
 ip pim dense-mode
 encapsulation ppp
 service-module t1 timeslots 1-24
 ppp multilink
 ppp multilink group 2
interface Serial1/0:0
 no ip address
 encapsulation ppp
 ppp multilink
 ppp multilink group 2
interface Serial1/1:1
 no ip address
 encapsulation ppp
 ppp multilink
 ppp multilink group 2


And the output of show ip int brief:

Serial0/0                  unassigned      YES NVRAM  up                    up
Serial0/1                  unassigned      YES NVRAM  up                    up
Serial1/0:0                unassigned      YES NVRAM  up                    up
Serial1/1:1                unassigned      YES NVRAM  up                    down
Multilink2                 172.16.4.154    YES NVRAM  up                    up


How can I fix this or at the very least troubleshoot it to identify whatever the issue is with my config or hardware?
LVL 2
CitySecAsked:
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

x
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Don JohnstonInstructorCommented:
Let's forget PPP multi-link for a minute.

Without multi-link configured, do you still have the same issue with Serial2/0/11:0 ?

I'm guessing that you do.  In which case I would either loop one end and check the status or get the telco involved.
CitySecAuthor Commented:
Yep, when I removed multi-link and just set each end up with a IP address in the same subnet I still have issues...kind of.

At the data center serial 2/0/11:0 still show status of up/down as does s1/1:1 at the branch office. Doing a loopback local on s1/1:1 at the remote router seems to have no effect. Not sure if this is the correct way to loop or not.  I have contacted the NOC at my datacenter as they handle our circuit contracts as well as extensions to our colocated racks.
Don JohnstonInstructorCommented:
It looks like you've got an external CSU at the datacenter and an internal CSU at the branch.  Can you post the output of a "show controller" for the four lines.

Have you tried moving the T1's to different interfaces to see if the problem moves?
SolarWinds® IP Control Bundle (IPCB)

Combines SolarWinds IP Address Manager and User Device Tracker to help detect IP conflicts, quickly identify affected systems, and help your team take near instantaneous action. Help improve visibility and enhance reliability with SolarWinds IP Control Bundle.

CitySecAuthor Commented:
I guess that you could say the CSU at the data center is external.  The circuits are delivered to the NOC via an OC12 from the carrier.  From there, there is a "virtual cross connect" in a Cisco 15454 that they deliver to us via a DS3.  This is all according the NOC staff at the data center where we are colocated.

Anyway, here is the output of show controllers at the remote side.  Do you want it for the Data Center as well?

Interface Serial0/0
Hardware is PowerQUICC MPC860 with Integrated FT1 CSU/DSU module
 TX and RX clocks detected.
idb at 0x82D11D70, driver data structure at 0x82D19B0C
SCC Registers:
General [GSMR]=0x2:0x00000030, Protocol-specific [PSMR]=0x8
Events [SCCE]=0x0000, Mask [SCCM]=0x001F, Status [SCCS]=0x06
Transmit on Demand [TODR]=0x0, Data Sync [DSR]=0x7E7E
Interrupt Registers:
Config [CICR]=0x00367F80, Pending [CIPR]=0x04008800
Mask   [CIMR]=0x60204400, In-srv  [CISR]=0x00000000
Command register [CR]=0x640
Port A [PADIR]=0x0000, [PAPAR]=0xFFFF
       [PAODR]=0x0000, [PADAT]=0xACF3
Port B [PBDIR]=0x03A0F, [PBPAR]=0x0000E
       [PBODR]=0x00000, [PBDAT]=0x3C55D
Port C [PCDIR]=0x00C, [PCPAR]=0x000
       [PCSO]=0x0A0,  [PCDAT]=0xF00, [PCINT]=0x00F
Receive Ring
      rmd(680126B0): status 9000 length 20B address 39718A4
      rmd(680126B8): status 9000 length DC address 396BDA4
      rmd(680126C0): status 9000 length 1ED address 3968324
      rmd(680126C8): status 9000 length 20D address 396D7A4
      rmd(680126D0): status 9000 length 20E address 39725A4
      rmd(680126D8): status 9000 length 34 address 3972C24
      rmd(680126E0): status 9000 length 8A address 3971224
      rmd(680126E8): status 9000 length 8A address 396EB24
      rmd(680126F0): status 9000 length 8A address 3979424
      rmd(680126F8): status 9000 length 1F0 address 396AA24
      rmd(68012700): status 9000 length 208 address 39696A4
      rmd(68012708): status 9000 length 1FA address 39689A4
      rmd(68012710): status 9000 length 7A address 3970BA4
      rmd(68012718): status 9000 length 7A address 396E4A4
      rmd(68012720): status 9000 length 1E8 address 396A3A4
      rmd(68012728): status 9000 length 1FC address 3973924
      rmd(68012730): status 9000 length 1F8 address 3977A24
      rmd(68012738): status 9000 length 34 address 3966924
      rmd(68012740): status 9000 length 202 address 396B0A4
      rmd(68012748): status 9000 length 1FE address 396DE24
      rmd(68012750): status 9000 length 203 address 3969024
      rmd(68012758): status 9000 length 206 address 396D124
      rmd(68012760): status 9000 length 204 address 39759A4
      rmd(68012768): status B000 length 208 address 396F1A4
Transmit Ring
      tmd(68012770): status 5C00 length D8 address 3802FB0
      tmd(68012778): status 5C00 length 46 address 398F02E
      tmd(68012780): status 5C00 length 32 address 3960DE4
      tmd(68012788): status 5C00 length 32 address 3942CE4
      tmd(68012790): status 5C00 length 128 address 38035F0
      tmd(68012798): status 5C00 length 12A address 39916CE
      tmd(680127A0): status 5C00 length 1BE address 393BE64
      tmd(680127A8): status 5C00 length 32 address 39530E4
      tmd(680127B0): status 5C00 length 33 address 38035EE
      tmd(680127B8): status 0 length 8 address 3901750
      tmd(680127C0): status 5C00 length 28C address 3944FF6
      tmd(680127C8): status 5C00 length 292 address 39598E4
      tmd(680127D0): status 0 length 8 address 39015F0
      tmd(680127D8): status 5C00 length 1BC address 3960928
      tmd(680127E0): status 5C00 length 128 address 39902F0
      tmd(680127E8): status 7C00 length 12A address 3802DAE

tx_limited=1(2)

SCC GENERAL PARAMETER RAM (at 0x68013C00)
Rx BD Base [RBASE]=0x26B0, Fn Code [RFCR]=0x18
Tx BD Base [TBASE]=0x2770, Fn Code [TFCR]=0x18
Max Rx Buff Len [MRBLR]=1548
Rx State [RSTATE]=0x18008440, BD Ptr [RBPTR]=0x2760
Tx State [TSTATE]=0x18000548, BD Ptr [TBPTR]=0x27B8

SCC HDLC PARAMETER RAM (at 0x68013C38)
CRC Preset [C_PRES]=0xFFFF, Mask [C_MASK]=0xF0B8
Errors: CRC [CRCEC]=22, Aborts [ABTSC]=24, Discards [DISFC]=54
Nonmatch Addr Cntr [NMARC]=0
Retry Count [RETRC]=0
Max Frame Length [MFLR]=1608
Rx Int Threshold [RFTHR]=0, Frame Cnt [RFCNT]=13195
User-defined Address 0000/0000/0000/0000
User-defined Address Mask 0x0000


buffer size 1524

PowerQUICC SCC specific errors:
19 input aborts on receiving flag sequence
0 throttles, 0 enables
0 overruns
0 transmitter underruns
0 transmitter CTS losts
5 aborted short frames


Interface Serial0/1
Hardware is PowerQUICC MPC860 with Integrated FT1 CSU/DSU module
 TX and RX clocks detected.
idb at 0x82D1DB8C, driver data structure at 0x82D25928
SCC Registers:
General [GSMR]=0x2:0x00000030, Protocol-specific [PSMR]=0x8
Events [SCCE]=0x0000, Mask [SCCM]=0x001F, Status [SCCS]=0x06
Transmit on Demand [TODR]=0x0, Data Sync [DSR]=0x7E7E
Interrupt Registers:
Config [CICR]=0x00367F80, Pending [CIPR]=0x04008800
Mask   [CIMR]=0x60204400, In-srv  [CISR]=0x00000000
Command register [CR]=0x640
Port A [PADIR]=0x0000, [PAPAR]=0xFFFF
       [PAODR]=0x0000, [PADAT]=0xA5F8
Port B [PBDIR]=0x03A0F, [PBPAR]=0x0000E
       [PBODR]=0x00000, [PBDAT]=0x3C55D
Port C [PCDIR]=0x00C, [PCPAR]=0x000
       [PCSO]=0x0A0,  [PCDAT]=0xF00, [PCINT]=0x00F
Receive Ring
      rmd(680127F0): status 9000 length 1F8 address 39829E4
      rmd(680127F8): status 9000 length 7A address 3989EE4
      rmd(68012800): status 9000 length 7A address 3987E64
      rmd(68012808): status 9000 length 7A address 397CEE4
      rmd(68012810): status 9000 length 1FA address 3985DE4
      rmd(68012818): status 9000 length 1F8 address 3981CE4
      rmd(68012820): status 9000 length 35 address 397BB64
      rmd(68012828): status 9000 length 42 address 397EF64
      rmd(68012830): status 9000 length 1FB address 397A7E4
      rmd(68012838): status 9000 length 19C address 39850E4
      rmd(68012840): status 9000 length 212 address 39884E4
      rmd(68012848): status 9000 length 35 address 3986464
      rmd(68012850): status 9000 length 34 address 3981664
      rmd(68012858): status 9000 length 35 address 398C5E4
      rmd(68012860): status 9000 length 1DC address 39802E4
      rmd(68012868): status 9000 length 1EA address 39877E4
      rmd(68012870): status 9000 length 20C address 397C864
      rmd(68012878): status 9000 length 1CE address 3987164
      rmd(68012880): status 9000 length 34 address 3986AE4
      rmd(68012888): status 9000 length AC address 397D564
      rmd(68012890): status 9000 length 8A address 3980FE4
      rmd(68012898): status 9000 length 8A address 39836E4
      rmd(680128A0): status 9000 length 1F0 address 397B4E4
      rmd(680128A8): status B000 length 20E address 397DBE4
Transmit Ring
      tmd(680128B0): status 5C00 length 8E address 3991C74
      tmd(680128B8): status 5C00 length 128 address 3802970
      tmd(680128C0): status 5C00 length 12A address 399108E
      tmd(680128C8): status 5C00 length 1C4 address 3960764
      tmd(680128D0): status 5C00 length 34 address 380458E
      tmd(680128D8): status 5C00 length 128 address 3802970
      tmd(680128E0): status 5C00 length 12A address 380212E
      tmd(680128E8): status 5C00 length 32 address 39188E4
      tmd(680128F0): status 5C00 length 32 address 394CF64
      tmd(680128F8): status 5C00 length 32 address 392A6E4
      tmd(68012900): status 5C00 length 12A address 3991D0E
      tmd(68012908): status 5C00 length 128 address 3804270
      tmd(68012910): status 5C00 length 12A address 380276E
      tmd(68012918): status 5C00 length 32 address 3937064
      tmd(68012920): status 5C00 length 32 address 39460E4
      tmd(68012928): status 7C00 length 128 address 3803910

tx_limited=1(2)

SCC GENERAL PARAMETER RAM (at 0x68013D00)
Rx BD Base [RBASE]=0x27F0, Fn Code [RFCR]=0x18
Tx BD Base [TBASE]=0x28B0, Fn Code [TFCR]=0x18
Max Rx Buff Len [MRBLR]=1548
Rx State [RSTATE]=0x18008440, BD Ptr [RBPTR]=0x2888
Tx State [TSTATE]=0x18000548, BD Ptr [TBPTR]=0x28D8

SCC HDLC PARAMETER RAM (at 0x68013D38)
CRC Preset [C_PRES]=0xFFFF, Mask [C_MASK]=0xF0B8
Errors: CRC [CRCEC]=6, Aborts [ABTSC]=6, Discards [DISFC]=72
Nonmatch Addr Cntr [NMARC]=0
Retry Count [RETRC]=0
Max Frame Length [MFLR]=1608
Rx Int Threshold [RFTHR]=0, Frame Cnt [RFCNT]=15590
User-defined Address 0000/0000/0000/0000
User-defined Address Mask 0x0000


buffer size 1524

PowerQUICC SCC specific errors:
4 input aborts on receiving flag sequence
0 throttles, 0 enables
0 overruns
0 transmitter underruns
0 transmitter CTS losts
2 aborted short frames


Controller 0 is type: T1 with CSU interface in slot 1
Serial interface 1/0:0  Munich32 version 3.4
Total chip configuration successes: 26, failures: 0, timeouts: 0
  Interrupt Queue Element(index=3358): interrupt is enabled
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
 
  Channel state: UP  Channel IDB: 82FCD1F8
  RX ring entries: 17, buffer size 1548
  RX descriptor ring: head = 39C5430, tail = 39C5410
  RX pak ring: head = 830A63FC, tail = 830A63DC
  00 params=0x60C0000 status=0x0 data ptr=0x39C1244 next ptr=0x39C5350
  01 params=0x60C0000 status=0x0 data ptr=0x39BF844 next ptr=0x39C5360
  02 params=0x60C0000 status=0x0 data ptr=0x39BFEC4 next ptr=0x39C5370
  03 params=0x60C0000 status=0x0 data ptr=0x39B55C4 next ptr=0x39C5380
  04 params=0x60C0000 status=0x0 data ptr=0x39B1B44 next ptr=0x39C5390
  05 params=0x60C0000 status=0x0 data ptr=0x39B8344 next ptr=0x39C53A0
  06 params=0x60C0000 status=0x0 data ptr=0x39B6944 next ptr=0x39C53B0
  07 params=0x60C0000 status=0x0 data ptr=0x39B3BC4 next ptr=0x39C53C0
  08 params=0x60C0000 status=0x0 data ptr=0x39C0BC4 next ptr=0x39C53D0
  09 params=0x60C0000 status=0x0 data ptr=0x39BB0C4 next ptr=0x39C53E0
  10 params=0x60C0000 status=0x0 data ptr=0x39BAA44 next ptr=0x39C53F0
  11 params=0x60C0000 status=0x0 data ptr=0x39B6FC4 next ptr=0x39C5400
  12 params=0x60C0000 status=0x0 data ptr=0x39BE4C4 next ptr=0x39C5410
  13 params=0x460C0000 status=0x0 data ptr=0x39B4F44 next ptr=0x39C5420
  14 params=0x60C0000 status=0x0 data ptr=0x39BD7C4 next ptr=0x39C5430
  15 params=0x60C0000 status=0x0 data ptr=0x39BDE44 next ptr=0x39C5440
  16 params=0x60C0000 status=0x0 data ptr=0x39BF1C4 next ptr=0x39C5340
  TX ring entries: 21, in use: 0, buffer size 1548
  TX descriptor ring: head = 0, tail = 0
  TX pak ring: head = 83221AC0, tail = 83221AC0
  00 params=0x0 data ptr=0x0000000 next ptr=0x408043A8
  01 params=0x0 data ptr=0x0000000 next ptr=0x408043B4
  02 params=0x0 data ptr=0x0000000 next ptr=0x408043C0
  03 params=0x0 data ptr=0x0000000 next ptr=0x408043CC
  04 params=0x0 data ptr=0x0000000 next ptr=0x408043D8
  05 params=0x0 data ptr=0x0000000 next ptr=0x408043E4
  06 params=0x0 data ptr=0x0000000 next ptr=0x408043F0
  07 params=0x0 data ptr=0x0000000 next ptr=0x408043FC
  08 params=0x40000000 data ptr=0x0000000 next ptr=0x40804408
  09 params=0x0 data ptr=0x0000000 next ptr=0x40804414
  10 params=0x0 data ptr=0x0000000 next ptr=0x40804420
  11 params=0x0 data ptr=0x0000000 next ptr=0x4080442C
  12 params=0x0 data ptr=0x0000000 next ptr=0x40804438
  13 params=0x0 data ptr=0x0000000 next ptr=0x40804444
  14 params=0x0 data ptr=0x0000000 next ptr=0x40804450
  15 params=0x0 data ptr=0x0000000 next ptr=0x4080445C
  16 params=0x0 data ptr=0x0000000 next ptr=0x40804468
  17 params=0x0 data ptr=0x0000000 next ptr=0x40804474
  18 params=0x0 data ptr=0x0000000 next ptr=0x40804480
  19 params=0x0 data ptr=0x0000000 next ptr=0x4080448C
  20 params=0x0 data ptr=0x0000000 next ptr=0x4080439C
  List of timeslots (sw): 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
                          17 18 19 20 21 22 23
  List of all timeslots (hw):
   00:00FF00FF 01:00FF00FF 02:00FF00FF 03:00FF00FF 04:00FF00FF 05:00FF00FF
   06:00FF00FF 07:00FF00FF 08:00FF00FF 09:00FF00FF 10:00FF00FF 11:00FF00FF
   12:00FF00FF 13:00FF00FF 14:00FF00FF 15:00FF00FF 16:00FF00FF 17:00FF00FF
   18:00FF00FF 19:00FF00FF 20:00FF00FF 21:00FF00FF 22:00FF00FF 23:00FF00FF
   24:20002000 25:20002000 26:20002000 27:20002000 28:20002000 29:20002000
   30:20002000 31:20002000
  Bandwidth: 1536, idle channel: Unassigned, idle ts bitfield: 0x0
  0 missed datagrams, 1 overruns, 0 memory errors
  0 transmitter underruns, 0 throttles, 0 enables, 0 bad interrupt elements
  0 spurious signaling interrupts

tx_limited=1(2)

Controller 1 is type: T1 with CSU interface in slot 1
Serial interface 1/1:1  Munich32 version 3.4
Total chip configuration successes: 339644, failures: 0, timeouts: 0
  Interrupt Queue Element(index=2343): interrupt is enabled
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
  0x0000000 0x0000000 0x0000000 0x0000000 0x0000000 0x0000000
 
  Channel state: UP  Channel IDB: 83027460
  RX ring entries: 17, buffer size 1548
  RX descriptor ring: head = 39C5AC0, tail = 39C5BB0
  RX pak ring: head = 82F9E850, tail = 82F9E940
  00 params=0x60C0000 status=0x0 data ptr=0x39E6A84 next ptr=0x39C5AD0
  01 params=0x60C0000 status=0x0 data ptr=0x39E0284 next ptr=0x39C5AE0
  02 params=0x60C0000 status=0x0 data ptr=0x39E4384 next ptr=0x39C5AF0
  03 params=0x60C0000 status=0x0 data ptr=0x39E1C84 next ptr=0x39C5B00
  04 params=0x60C0000 status=0x0 data ptr=0x39E5D84 next ptr=0x39C5B10
  05 params=0x60C0000 status=0x0 data ptr=0x39E5084 next ptr=0x39C5B20
  06 params=0x60C0000 status=0x0 data ptr=0x39E2984 next ptr=0x39C5B30
  07 params=0x60C0000 status=0x0 data ptr=0x39E0904 next ptr=0x39C5B40
  08 params=0x60C0000 status=0x0 data ptr=0x39E0F84 next ptr=0x39C5B50
  09 params=0x60C0000 status=0x0 data ptr=0x39E3D04 next ptr=0x39C5B60
  10 params=0x60C0000 status=0x0 data ptr=0x39E3004 next ptr=0x39C5B70
  11 params=0x60C0000 status=0x0 data ptr=0x39E7104 next ptr=0x39C5B80
  12 params=0x60C0000 status=0x0 data ptr=0x39E1604 next ptr=0x39C5B90
  13 params=0x60C0000 status=0x0 data ptr=0x39E5704 next ptr=0x39C5BA0
  14 params=0x60C0000 status=0x0 data ptr=0x39E2304 next ptr=0x39C5BB0
  15 params=0x460C0000 status=0x0 data ptr=0x39E6404 next ptr=0x39C5BC0
  16 params=0x60C0000 status=0x0 data ptr=0x39E3684 next ptr=0x39C5AC0
  TX ring entries: 21, in use: 0, buffer size 1548
  TX descriptor ring: head = 0, tail = 0
  TX pak ring: head = 82FCCADC, tail = 82FCCADC
  00 params=0x80000000 data ptr=0x0000000 next ptr=0x4080EA34
  01 params=0x40000000 data ptr=0x0000000 next ptr=0x4080EA40
  02 params=0x0 data ptr=0x0000000 next ptr=0x4080EA4C
  03 params=0x0 data ptr=0x0000000 next ptr=0x4080EA58
  04 params=0x0 data ptr=0x0000000 next ptr=0x4080EA64
  05 params=0x0 data ptr=0x0000000 next ptr=0x4080EA70
  06 params=0x0 data ptr=0x0000000 next ptr=0x4080EA7C
  07 params=0x0 data ptr=0x0000000 next ptr=0x4080EA88
  08 params=0x0 data ptr=0x0000000 next ptr=0x4080EA94
  09 params=0x0 data ptr=0x0000000 next ptr=0x4080EAA0
  10 params=0x0 data ptr=0x0000000 next ptr=0x4080EAAC
  11 params=0x0 data ptr=0x0000000 next ptr=0x4080EAB8
  12 params=0x0 data ptr=0x0000000 next ptr=0x4080EAC4
  13 params=0x0 data ptr=0x0000000 next ptr=0x4080EAD0
  14 params=0x0 data ptr=0x0000000 next ptr=0x4080EADC
  15 params=0x0 data ptr=0x0000000 next ptr=0x4080EAE8
  16 params=0x0 data ptr=0x0000000 next ptr=0x4080EAF4
  17 params=0x0 data ptr=0x0000000 next ptr=0x4080EB00
  18 params=0x0 data ptr=0x0000000 next ptr=0x4080EB0C
  19 params=0x0 data ptr=0x0000000 next ptr=0x4080EB18
  20 params=0x0 data ptr=0x0000000 next ptr=0x4080EA28
  List of timeslots (sw): 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16
                          17 18 19 20 21 22 23
  List of all timeslots (hw):
   00:01FF01FF 01:01FF01FF 02:01FF01FF 03:01FF01FF 04:01FF01FF 05:01FF01FF
   06:01FF01FF 07:01FF01FF 08:01FF01FF 09:01FF01FF 10:01FF01FF 11:01FF01FF
   12:01FF01FF 13:01FF01FF 14:01FF01FF 15:01FF01FF 16:01FF01FF 17:01FF01FF
   18:01FF01FF 19:01FF01FF 20:01FF01FF 21:01FF01FF 22:01FF01FF 23:01FF01FF
   24:20002000 25:20002000 26:20002000 27:20002000 28:20002000 29:20002000
   30:20002000 31:20002000
  Bandwidth: 1536, idle channel: Unassigned, idle ts bitfield: 0x0
  0 missed datagrams, 0 overruns, 0 memory errors
  0 transmitter underruns, 0 throttles, 0 enables, 0 bad interrupt elements
  0 spurious signaling interrupts

tx_limited=1(2)
CitySecAuthor Commented:
So I talked with the NOC at my data center.  They helped a bit by having the carrier test the circuit and offered some config ideas, but I was unable to get the circuit working.  I went to the branch office and swapped the cables on serial 1/0:0 and serial 1/1:1.  It is still s1/1:1 that is showing status of up/down, which means the problem stays with the interface and not with the circuit attached to it.  Could I have bad hardware?  I am using a PRI 2CTI-CSU add in module on a 2600 series router.
Don JohnstonInstructorCommented:
I would swap the cables for serial 1/0 and 1/1 at the remote site.  Since they (appear) to be terminating on the same type of equipment.

If the problem moves with the cable, you know it's not the router. If the problem stays with the interface, you know it's something on the router.
CitySecAuthor Commented:
As I mentioned in my previous comment, the cables have been swapped at the remote site.  The problem stayed with the interface so it is either a hardware or configuration problem and not a circuit problem. I'm not sure where to go from here though.
Don JohnstonInstructorCommented:
Sorry. When configs get posted inline with comments, it's easy to miss something. I suggest using the "code" feature when posting configs and long output.

That said, you're right. It's either a port problem or a config problem. Or it could be a failure in the slot.  I would try moving the controllers between 1/0 and 1/1.  If it's the physical port or controller, the problem will move.  If the problem doesn't move, it's either the config or the slot.
CitySecAuthor Commented:
Doesn't look like the controllers can be moved. They are part of a two port add in module.
Don JohnstonInstructorCommented:
That's right... They're both in slot 1.

If you don't have a spare module to test with, I would open a case with TAC.  You've done all you can with what you have to work with.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Networking

From novice to tech pro — start learning today.