Perl WWW::Mechanize like functionality in .NET

Posted on 2005-04-21
Last Modified: 2012-05-05
My current place of employ has recently moved development to the .NET development platform (for better or for worse).  Much of the old software is written in perl.   While I see no trouble migrating much of it into .NET languages, I fear what I will miss the most is the ease of using perl for web spidering/scraping applications.  I have used extensively the WWW::Mechinize suite of modules, and (maybe through ignorance of my own) see no corollary within the .Net languages.

What I am looking for in response to my question is the communities input (2 cents) into how to approach spidering/scraping activities within the .NET languages.  While perl is my background, I am not necessarily looking for Mechanize.NET, just the best way to go about automated web navigation within .NET.

100 points will go to the first five persons with a thoughtful response.

Thanks a lot; I really value real world opinions over the boasts of printed documentation!
Question by:jphofmann
    LVL 96

    Accepted Solution

    AFAIK, there is no direct comparison for WWW::Mechanize in the .NET framework.  There is the System.Net namespace that contains methods, such as WebClient, HTTPWebRequest for scraping, but nothing that supports the "automated" navigation that Mechanize supports.


    Author Comment

    I was hopeing for more input on this... Thanks to TheLearnedOne, easy 500 points.  


    Write Comment

    Please enter a first name

    Please enter a last name

    We will never share this with anyone.

    Featured Post

    Why You Should Analyze Threat Actor TTPs

    After years of analyzing threat actor behavior, it’s become clear that at any given time there are specific tactics, techniques, and procedures (TTPs) that are particularly prevalent. By analyzing and understanding these TTPs, you can dramatically enhance your security program.

    In my previous article ( we saw the basics of serialization and how types/objects can be serialized to Binary format. In this blog we wi…
    This document covers how to connect to SQL Server and browse its contents.  It is meant for those new to Visual Studio and/or working with Microsoft SQL Server.  It is not a guide to building SQL Server database connections in your code.  This is mo…
    Need more eyes on your posted question? Go ahead and follow the quick steps in this video to learn how to Request Attention to your question. *Log into your Experts Exchange account *Find the question you want to Request Attention for *Go to the e…
    Illustrator's Shape Builder tool will let you combine shapes visually and interactively. This video shows the Mac version, but the tool works the same way in Windows. To follow along with this video, you can draw your own shapes or download the file…

    737 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    22 Experts available now in Live!

    Get 1:1 Help Now