Solved

Dropping Packets

Posted on 2009-05-18
6
763 Views
Last Modified: 2012-05-07
Topology:
We have 3 Cisco ASA 5520's connected to an HP Procurve 2824, which is serving as our Internet switch.  One of the ASA's is serving as the primary firewall, one is dedicated to hosting lan-2-lan tunnels, and the 3rd was installed simply for troubleshooting this particular issue.

Our colo is providing active/standby Internet in the form of VRRP -- we have 2 cat5 plugging into the our internet switch.  The VRRP and outside IPs on our ASAs are all within the same subnet.

The Problem:
The VPN and test ASAs are intermittently dropping packets -- They will be fine for 5-10 minutes, then will drop sometimes as much as 30-50% of packets for a period of 30 seconds to several minutes.  Often, but not always, the two ASAs will drop packets simultaneously.  The other ASA (primary firewall, hosting 95% of the traffic) never drops *ANY* packets!!

The drops are occuring not only for traffic both passing through the ASAs, but also for pings initiated directly from the ASA, so I think it safe to assume that it is not a configuration issue -- I have gone so far as to back out all of the config except for what is necessary to test connectivity.  And yes, *ALL* devices on both sides are hard-set to 100/Full.

Other Troubleshooting I've done:
1)  Replaced all the cables
2)  Tried different ports on the internet switch
3)  Confirmed no errors of any sort on either the switch or the firewalls
4)  Changed the default gateway on the VPN ASA to the standby internet router instead of the VRRP IP....this seems to cure the problem!  The "test" ASA, still pointing at the VRRP is still dropping packets!  However, the primary firewall ASA is also pointed at the VRRP and is *NOT* dropping packets?

I'm at a loss....datacenter thinks its our ProCurve...they've claimed multiple customers with random packetloss when using ProCurves as Internet switches...The datacenter is terminating the Internet feeds they hand us on Foundry.
0
Comment
Question by:j4llen
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 3
6 Comments
 
LVL 32

Expert Comment

by:harbor235
ID: 24414740
What do the routing tables on the ASA's in question look like, can you post?

harbor235 ;}
0
 

Author Comment

by:j4llen
ID: 24414850
All 3 *had* a default route pointing to the VRRP IP when the problem was occurring, but only 2 of them experience packetloss.  If I change the default route on those 2 to either the active or standby router physical IP, there is no packetloss.

0
 
LVL 32

Expert Comment

by:harbor235
ID: 24415688


Perhaps there is a problem with the devices in teh VRRP group? Configuration issues can cause them both to go active active and fight for control, this causes you problems.

harbor235 ;}
0
Windows Server 2016: All you need to know

Learn about Hyper-V features that increase functionality and usability of Microsoft Windows Server 2016. Also, throughout this eBook, you’ll find some basic PowerShell examples that will help you leverage the scripts in your environments!

 

Author Comment

by:j4llen
ID: 24415707
1)  Why is the primary firewall not also affected?
2)  How to convince the colo that their equipment is the issue?
0
 
LVL 32

Expert Comment

by:harbor235
ID: 24415772


Are they all connected to the same switch? What happens is that an ARP war ensues, it depends at that momement which device has control of the VIP, I am not sure it's your problem , it is a potential problem, like all troubleshooting someone needs to verify the configuration and start troubleshooting layer2, and layer 3. I need to know more of the physical setup and how things are configured.

harbor235 ;}
0
 

Accepted Solution

by:
j4llen earned 0 total points
ID: 26402524
I *believe* the problem was that the dynamic crypto map had a higher priority (lower sequence number) than the static crypto maps.  As a result, the ASA was sometimes getting confused when a lan-to-lan VPN was coming in.
0

Featured Post

Efficient way to get backups off site to Azure

This user guide provides instructions on how to deploy and configure both a StoneFly Scale Out NAS Enterprise Cloud Drive virtual machine and Veeam Cloud Connect in the Microsoft Azure Cloud.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

We sought a budget ($5,000) firewall solution that would provide all the performance we needed with no single point of failure.  Hosting a SAAS web application in our datacenter, it was critical that we find a way to keep connectivity up and inbound…
Optimal Xbox 360 connectivity requires "OPEN NAT". If you use Juniper Netscreen or SSG firewall products in a home setting, the following steps will allow you get rid of the dreaded warning screen below and achieve the best online gaming environment…
Come and listen to Percona CEO Peter Zaitsev discuss what’s new in Percona open source software, including Percona Server for MySQL (https://www.percona.com/software/mysql-database/percona-server) and MongoDB (https://www.percona.com/software/mongo-…
In this brief tutorial Pawel from AdRem Software explains how you can quickly find out which services are running on your network, or what are the IP addresses of servers responsible for each service. Software used is freeware NetCrunch Tools (https…

691 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question