Question

Redundant connections between two sites.

Asked by: stamperb

OK Im going to be connecting 2 sites and want to make sure I do it as redundant as possible with what I have for equipment and connectivity.  So here is what I have for hardware and connectivity.
Site 1:
2 - Cisco 3845's
1 - DS-3 to MPLS cloud
1 - 100MG optical Ethernet
Site 2:
2 - Cisco 3845's
1 - pair of Multilink T'1's to MPLS Cloud (3MG)
1 - 100MG optical Ethernet.

So in summary the sites are connected by the 100MG optical (obviously primary choice) and thru the MPLS where the bottleneck is the multilink but its for redundancy and its all I have.  The MPLS uses BGP and I'm not sure what if any is being handed to me by the metro optical company for routing protocols.  Regardless the two are two WAY separate companies and there is no way I can do BGP across them.

Right now as it sits my plan is to use HSRP on the 3845's at each site on the LAN.  
Site 1:
RTR1 - the 100MG optical Ethernet terminates here
RTR2 - the ds-3 to the MPLS terminates here
Site 2:
RTR1 - the 100MG optical Ethernet terminates here
RTR2 - the Multilink terminates here
I'll then track the interface on the router

So on RTR1 at each site I'll track the interface that the optical Ethernet comes into (Gi0/1 respectively).  If it goes down RTR2 will become the active router for HSRP.

How does this look?  Anyone see any improvements or if you have a better solution scrap and rebuild with what I have or for little more cost?

Now a secondary here:  For redundancy the people that are providing the metro optical Ethernet interface say they can provide us a redundant connection at each end for little cost.  So rather than them handing me 1 Ethernet cable they would hand me two which would go upstream to redundant equipment.  Right now I have the two Ethernet interfaces on the 3845s.  One goes to the LAN and one goes to the Metro Optical.  How could I make this redundant within the router?  Is there another vwic for a gig card that I can add another Gig interface and create a multilink out of them?  Then I could track the multilink?  

Also is there a way to better track the connection.  I mean in order for the tracking to work the interface has to go down.  On a serial interface on a circuit terminating to a router this would be somewhat valid BUT the chances of the switch connecting to my router being the cause of the outage are not as great as something else on the optical Ethernet (in the cloud if you will).  So can I somehow track the directly connected router from the other site and if I lose connectivity to that cause the failover.


This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2007-09-18 at 09:29:18ID22836493
Tags

create

Topic

Network Design & Methodology

Participating Experts
1
Points
500
Comments
11

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. BGP
    Here is a nice large question for routing experts out there (I specifically have jlevie in mind). Basically, I neeed someone to explain, with examples and perhaps weblinks, the BGP routing protocol. Information that would be useful would be : (0) What is BGP and how does it...
  2. redundant
    We have two ISP's setup on our network. RouterA(2600) is on ISPA and routerB(2501) is on ISPB. We have 30 valid IP's on each ISP. Our two routers are connected via the same switch. The DNS is hosted by ISPA. My question is , 1. Which is better redundant using two routers or ...
  3. BGP redundant  routing
    I have two routers each router pointing towards the same cloud network. What I need is if the primary route to one router fails the cloud network needs to know it can route through the other router. Now I'm running bgp on both routers because the cloud network is running bgp....
  4. Internet redundancy with cisco router and Dns related ques…
    Hi This is a continuous discussion of this one http://www.experts-exchange.com/Networking/Protocols/DNS/Q_24742829.html#a25366698 Where @experts said to use BGP but BGP seems to be too much for a small organization. But i am looking for something Cisco base solution. we a...
  5. BGP
    I want to configure BGP for internet redundancy .We have purchased APNIC IP and AS no. We have three ISP's A,B,C now my question is 1- Could any one tell us how to configure BGP for internet redundancy 2- Do we have to purchase different AS no for all the three ISP,s or ...
  6. HSRP/BGP failover
    Q1.Is it possible to have a Cisco router be in HSRP as primary in one Group but Standby on another? Q2. I have an ATT ISP as primary and Cogent as secondary and it works great. I now have a new circuit that I want to send all outbound traffic to and leave the old set up to s...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: tvman_odPosted on 2007-09-18 at 11:47:51ID: 19915549

Two redundant links from the same company kind of defeats the purpose. All the major issue in their network will affect both links. So your case is pretty good one. You can create a GRE tunnel with internal IPs on both ends over MPLS and use BGP with given parameters from MPLS company. Use HSRP for RTR1 and RTR2 on each site. Then use static or any other routing protocol and adjust a metric parameter. In most cases Ethernet will take presedence bu default, but it's a good idea to take some additional steps.

 

by: stamperbPosted on 2007-09-18 at 18:04:03ID: 19917716

OK i guess i'm a bit confused.  Why do I need the GRE tunnel?  I presume in my case it would go from RTR2 to RTR2 over the MPLS.  But why?  Wouldn't this just put overhead on that connection and use resources?  If this was the case wouldn't I also need a GRE tunnel over the Metro optical?  I'm already using bgp with the given param's from the MPLS company as its required to some degree.  

 

by: tvman_odPosted on 2007-09-18 at 18:48:09ID: 19917876

Yes, it will introduce some overhead but in this case you don't need to redistribute your internal routing to BGP. If you have more then two sites, just disregard it. If it's a connection between two points using MPLS as a transport then GRE will hide all the routing details and your MPLS carrier will see just a connection between your CE equipment. I run a multisite network over MPLS and had to create some complex redistribution configuration in order to avoid conflicts and routing black holes. GRE makes it a lot easyer if number of sites is less the 5.

 

by: stamperbPosted on 2007-09-18 at 18:54:38ID: 19917895

Ahh ok so yes untimatly I'll have 5 sites on the mpls including these listed as site1 and site2 above. The two sites in question are the most important if you will and thus the redundancy but all sites will need connectivity to eachother.  SO in this case?  Do you think I should implement my own Routing protocol on the Metro optical ethernet and redistribute the bgp into it?  Then still use the HSRP?  Also what about the redundant links from the Metro optical ethernet company?  Granted they are the same company BUT they are redundant as in the upstream equipment isn't the same.  I mean they are not handing me to cables that come from the same switch.  Its all redundant up the path.  Is there a way to incorperate this into RTR1 at both sides?

 

by: tvman_odPosted on 2007-09-18 at 19:11:45ID: 19917950

I don't see any major issues, you have just great resourses for your network. HSRP will take care of maintaining a single gateway for your endusers. And routing protocol will find their way to each of the remote sites.

Let's say, typical exaple:
Your network uses OSPF for internal routing and you don't want to have anything from MPLS in your internal routers which are not conneted to it.
!this will maintaing internal routing
router ospf 1
 router-id 192.168.1.1
! this will forward your OSPF routes over BGP to the other side but filter internal MPLS routes
 redistribute bgp 100 route-map MapNets
 network 192.168.1.0 0.0.0.255 area 0
 network 192.168.2.0 0.0.0.3 area 0
 default-information originate

!this for MPLS most likely details given by carrier
router bgp 100
 no synchronization
 bgp log-neighbor-changes
 redistribute connected
 redistribute static
 redistribute ospf 1 match internal external 1 external 2
 neighbor xx.xx.xx.xx remote-as 1000 ! AS assigned by carrier
 default-information originate
 auto-summary

! This filters internal MPLS network which you want to hide from the rest of your network.

ip prefix-list IntNets seq 5 permit 192.168.0.0/16
ip prefix-list IntNets seq 10 deny xx.xx.0.0/16

 

by: stamperbPosted on 2007-09-18 at 19:48:25ID: 19918057

OK so I would want to redistribute my internal routing protocol into the BGP on the mpls but not allow the MPLS bgp to redistribute into my internal routing protocol?  So if the metro optical went down how that router know about the other route via the MPLS if I dont allow the bgp to redistribute in?

And again what about the multiple network connections to the metro optical?  How can i leverage that redundancy?

 

by: tvman_odPosted on 2007-09-19 at 04:07:33ID: 19919535

The trick is that border router will know about all networks, but will not tell anybody about it. If something will go down then 1. Interface will go down and this particular router will stop advertising remote networks redistributed over BGP. 2. As soon as interface will turn to down state, the router will start using existing alternative routes.
Regarding your second ethernet.
1. You can balance load and use both.
2. You can increase metric on one of them and and router will use it when primary link is not available or overloaded.

 

by: stamperbPosted on 2007-09-19 at 07:48:05ID: 19921107

So if i have 2 routers with the HSRP facing my LAN.  One of those routesrs connects to the mpls using bgp and one connectds to the metro optical using say eigrp.  By default then wont the routing use bgp as its lower ad?  I'm a little confused about how this will work once I get the redistribution of bgp into the eigrp.  

 

by: tvman_odPosted on 2007-09-19 at 08:22:23ID: 19921449

In your BGP router config
(config-router)#redistribute eigrp 1 metric  <0-4294967295>

adjust it so fiber will take presedence

For pair of sites it will work this way:

eigrp-> 1-RTR1 ->BGP (carries routes redist. from eigrp ) -> 2-RTR1 -> EIGRP (filter all BGP)
              |                                                                                    |
            HSRP                                                                            HSRP
              |                                                                                    |
eigrp-> 1-RTR2 ----------------> EIGRP--------------------------> 2-RTR2

The same apply for more sites

 

by: stamperbPosted on 2007-09-19 at 08:52:53ID: 19921844

Ok last clarification so up above you have me redistributing the bgp into the ospf and ospf into bgp.  I presume this is the same then if i was to use EIGRP.  Have to redistribute the EIGRP into the BGP and the BGP into the eigrp and then make sure they are weighed accordingly so the right path is chose?  Basically asking do i need to redistribute both protocols into eachother?

 

by: tvman_odPosted on 2007-09-19 at 10:00:10ID: 19922423

Yes.
EIGRP needs to be redistributed to BGP because MPLS network will need to know what to do with packets with source and destination addresses from YOUR network.

BGP needs to be redistributed to EIGRP because it carries information about routing from other EIGRP site  redistributed to BGP. It's recommended to filter internal MPLS routing because hosts in your network don't need to know how to reach internals of MPLS network. This will allow you to avoid IP addresses conficts when you use more then one MPLS or other private IP network carrier with the same address space.

When you configure everything and get everything connected type "ip route" on RTR1 and RTR2.
Then simulate different problems and adjust metrics for redistribution.

You can even balance your network that way so it will use all the available connections. So if ethernet will become conggested for any reason the routers will start sending packets over slower links.

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...