Question

more ICMP packets than http packets

Asked by: jemal93

Hello everybody! this is my favourite place to get expert assistance. So i have come up with a question.
I work for an ISP(about 10K customers). The problem we face more frequently is that there are more ICMP packets coming from the customer premise. With the outbreak of the blaster worm this was dealt by applying worm removal tools on the customer device and by blocking the tcp ports that the worm uses.
But the more and more customers are facing network congestion due to this. When we use the "sh ip nbar protocol-discovery" command on our distribution routers, most of the packets are ICMP packets..
So what I want to know is that what can be judged about the customer device if more ICMP packets flow into our routers??

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2003-12-24 at 04:23:11ID20834050
Tags

packet

,

block

,

icmp_unreachable

Topics

Miscellaneous Networking

,

Network Switches & Hubs

,

Network Auditing Software

Participating Experts
3
Points
50
Comments
13

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. ICMP packets
    Hi, I'm trying to make application to catch every ICMP echo request (ping) ,before my kernel(?!?) echo reply on it or even right after that (i need source IPaddr,packet_len) , i've browsed 'icmp.dll' info and didn't understand how to recieve them from this way . i hope someo...
  2. Icmp flooding
    What is icmp flooding ? Thanks and Regards.
  3. ICMP Flood
    My computer is W2K, the problem is, my network adapter send a continous ICMP packet to all IP address starting with my IP address till 255.255.255.255. This happened after 5 minutes i have turn on my computer, My web surfing become hard Can you give me any idea whats goi...
  4. Server is sending ICMP 8 packets.
    We're running Aix version 5 on an RS6000 P530 and it's sending out ICMP 8 packets. How do I stop it and why would it do it?

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: chicagoanPosted on 2003-12-24 at 05:16:54ID: 9996329

no much, generally.
You might be able to recognize some traffic, in an ICMP packet magnification (or ICMP Smurf) attack a large amount of traffic from a customer whose router is allowing directed broadcasts will be focused on one target, preceeded by packets addressed to the broadcast address of their ip block.
Ping of death attacks will have larger than usual, fragmented packets.
OS fingerprinting from nmap and the like will have malformed packets to see the response the target make. Looking over snort's signature rules can help you get an idea what different attacks look like, but worms that scan ip blocks before attempting vulnerability conpromises generally use run of the mill ICMP packets, it's the pattern of block scanning and the subsequent probe (to say sql or rpc).
ICMP_ECHO traffic can be used to construct covert communications channels through networks after hosts are infected. Unsolicited ICMP_ECHOREPLY packets could be inverse mapping attempts.

By far zombies will be respnsible for this traffic, along with a few script kiddies, and here is the problem.
ISP's generally don't devote many resources to tracking down this traffic. They don't want to summarily disconnect somone and don't have the ability to call everyone with code red or blaster and help them fix it.

Getting a daily sniff and going after the top packet generators in a top down fashion might do some good, might identify the odd script kiddie,  without affecting the bottom line.

Make sure your routers are configured to NOT send ICMP_UNREACHABLE packets to hosts that don't respond to ARPs.

 

by: jbailey01Posted on 2003-12-24 at 05:55:42ID: 9996461

I would suspect the Nachi worm for all of the ICMP packets you are seeing. We have an IDP device that has a probe in our DMZ and it sees hundreds of thousands of ICMP packets a day, 3/4 of which it identifies as the Nachi worm. If you are using Cisco routers you can do the following to only drop ICMP packets from Nachi:

http://www.cisco.com/warp/public/707/cisco-sn-20030820-nachi.shtml

Also, the following router changes can help as well:

Enable Cisco Express Forwarding(CEF) on all routers. Without CEF, the first packet to each destination will be process switched for creating a fast-switching entry. This may have a negative impact on the router performance while switching many packets to random destinations.

Implement  Unicast Reverse Packet Forwarding on all routers. This feature makes sure packets entering an interface pass a sanity check to make sure the packet should’ve come in the interface it did based on the packets source and destination address and the routers routing information.

Disabling ICMP Redirects
Disable ICMP-Directed Broadcasts
Disable ICMP MAsk Replys
Disabling ICMP Unreachables

 

by: The--CaptainPosted on 2003-12-24 at 23:07:06ID: 9999276

Likely Nachi (as suggested above).

Do *not* encourage worm writers to envolve their code by simply blocking ICMP (as my retarded provider has done).  

I admit, chicagoan has a point

>By far zombies will be respnsible for this traffic, along with a few script kiddies, and here is the problem.
>ISP's generally don't devote many resources to tracking down this traffic. They don't want to summarily disconnect
>somone and don't have the ability to call everyone with code red or blaster and help them fix it

In my opinion this is a problem with policy.  As an ISP, you have to make the tough decision to disconnect abusive users/networks, and allocate resources to determine who those abusive sites actually are.  I used to work for an ISP, and I know there is always pressure from management asswipes to just make the customer happy, even though you generally wind up fixing problems that are not local to you as an ISP.  If management can wrap their (usually) pea-sized brains around the concept that you might be able to sell *additional* consulting services by offering to fix customer's networks for a fee, you might be able to find a reasonable way out of this painful situation.

Things like this are a good idea:

>Implement  Unicast Reverse Packet Forwarding on all routers. This feature makes sure packets entering an interface pass
>a sanity check to make sure the packet should’ve come in the interface it did based on the packets source and destination
>address and the routers routing information.

The above advice is generally recognized as good networking practice, and helps maintain the health of your network through times of abuse.

Things like this are not:

>Disabling ICMP Redirects
>Disable ICMP-Directed Broadcasts
>Disable ICMP MAsk Replys
>Disabling ICMP Unreachables

ICMP functionality exists for a reason - blindly disabling much of ICMP does nothing but degrade the existing functionality of the network, and encourages worm writers to use another method of reachability/connectivity probing.  Next you'll be telling me to disable SYN/ACK (or maybe SYN) - hey, I'm sure we can get by with UDP workarounds and kludges!

In other words fix the network (disconnect the sickness), rather than breaking the network (in order to produce newer and better sicknesses).

I guarantee my retarded provider will get hit again and again by nastier and nastier malware until such point as they insist on breaking their network so much that it is unusable to me and I have to find another provider (in fact, if I didn't have administrative access to plenty of out-of-network hosts, I'd have dropped them already).  On the other hand, several major universities who have a clue about IT simply isolate and disconnect the source of bad traffic - one you have an automated mechanism in place for identifying and quarantining infected hosts, all that ever needs tweaking is the detection parameters - trying getting the retards in management to understand that is another issue altogether.

Cheers,
-Jon

 

by: chicagoanPosted on 2003-12-25 at 06:56:59ID: 10000063

Is there any legitimate use for directed broadcasts other than enumerating hosts?
I'd be hard pressed to pull that from the standard filter, the potential for abuse is too high.
 IMHO

 

by: The--CaptainPosted on 2003-12-25 at 23:48:35ID: 10001237

>Is there any legitimate use for directed broadcasts other than enumerating hosts?

Good call - I overlooked that one above.  I think the general consensus is that no, directed broadcasts don't really serve much useful purpose (especially since many Mickeysoft IP stacks violate the RFC out of the box and don't respond anyway).

Mask replies are probably also safe to block, unless you have some hosts running older remote boot code...  Still, I imagine that a better practice would simply be to restrict them to the local network rather than a complete block.

Redirects seem fairly harmess if kept within the local network (I'm not sure blocking them altogether is a good idea - blocking can make it kind of pesky to reconfigure the network (at least until all those damned DHCP leases expire))

Blocking unreachables (aside from the sanity checks previously mentioned) is simply unforgiveable - aside from adding unnecessary delays to clients attempting to access unreachable hosts, it breaks ping and traceroute feedback (What do all those asterisks mean?  I know what they *used to* mean...)

I apologize - In my tired state (and since my provider is currently doing this) I also thought ICMP echo/reply was in there - I'm glad it's not, since blocking that is simply moronic.

Merry Xmas!
-Jon

 

by: jbailey01Posted on 2003-12-26 at 05:58:20ID: 10001763

My reasoning:

ICMP Redirects: Disabling this will prevent an attacker from redirecting all or part of our network traffic to another destination

ICMP-Directed Broadcasts: Disabling this will stop an attacker from sending an ICMP echo request to an entire network. Thus, limiting any type of discovery.

ICMP Mask Reply: Disabling this will prevent an attacker from mapping out the configuration of our network and routers.

ICMP Unreachables: Disabling this will prevent some scanning methods from obtaining information about open and closed ports

 

by: chicagoanPosted on 2003-12-26 at 10:08:20ID: 10002783

In the begining, when one set up sendmail, it was expected that anyone might use your mail relay, and there was probably anonymous ftp on the same machine. There was an openness and spirit of sharing and cooperation that quickly showed itself to be naivete.

I find it frustrating when I can't traceroute or ping a host when trying to troubleshoot a problem but I also understand the costs of giving script kiddies a target rich environment.
I've read a lot of GIAC practicals over the years and filtering lists have slowly grown to the point where edge routers are virtual black holes, which I think is appropriate for customers, but cripples some important diagnostics when IPS's start to drop these packets on transit routers (and would tick me off as a customer).

I know ISP's are in competition with each other and they're in business to make money, but I think there is a responsibility that goes beyond being purely reactive and as Jon pointed out there may well be a marketing opportunity for consulting in taking a more holistic approach to the problem.

I don't think the filtering approach is 'solving' the problem. I think rate limiting technologies like pacemaker and/or adding a unit dedicated to detecting hostile or abusive activity (and responding to complaints) and communicating with customers is a lot more forward looking.


 

by: The--CaptainPosted on 2003-12-26 at 13:12:27ID: 10003349

>ICMP Redirects: Disabling this will prevent an attacker from redirecting all or part of our network traffic to another
>destination

My only concern is that this limits future network flexibility - restricting redirects to within the local net should prevent most attacks, but still maintain the functionality.

>ICMP-Directed Broadcasts: Disabling this will stop an attacker from sending an ICMP echo request to an entire network.
>Thus, limiting any type of discovery.

Not to mention those nasty DDoS ping storms - no argument on this one.

>ICMP Mask Reply: Disabling this will prevent an attacker from mapping out the configuration of our network and routers.

I thought the main concern here was with a DoS attack - network configs can be mapped fairly decently with enough traceroutes (and tcptraceroutes)

>ICMP Unreachables: Disabling this will prevent some scanning methods from obtaining information about open and
>closed ports

That's what an IDS is for - unreachables are very helpful in diagnosing network problems - blocking unreachables means (amongst other things) that it is not possible to determine who to hassle when a particular service (or server) dies (do I call the NOC, or the server admin?).  A properly configured IDS (can you say portsentry?) will block folks who are scanning, but send unreachables back to folks that are not acting maliciously.

I agree customer/edge routers should be configured as anally as possible - however, as chicagoan points out, ISP routers need to be configured with a more delicate touch.

Cheers,
-Jon

 

by: jbailey01Posted on 2003-12-26 at 13:22:16ID: 10003409

I agree, a delicate touch is necessary. And I have to say my perspective is skewed, as I have done configs on edge routers, never an ISPs routers.

 

by: chicagoanPosted on 2003-12-27 at 11:29:43ID: 10005661

>So what I want to know is that what can be judged about the customer device if more ICMP packets >flow into our routers??

So... after all that preaching, I think the best solution to figuring what you seeing is a sniffer with some sort of analysis (I happen to like Sniffer Pro just because it's easy to set up and use) to see the top bandwidth users and snort (or a commercial IDS) to match the packets with DOS or vulnerabiliy signatures. You can also selectively set your routers to debug level syslog and use something like PrivateI to analyze the traffic.

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...