Download web pages quickly

Here is a web page, there are many links. I don't want click them one by one.
Any method to extract the links and fast download?

Who is Participating?
zhshqzycConnect With a Mentor Author Commented:
Not sure right or not
Regex reg = @"^<a\s(href="\d+(.aspx")";

Open in new window

Dennis AriesCEO @ Arkro ITCommented:
You can download the page and parse it as an XML-file.
After that, you can loop through the a-tags and download the given reference.

Developer.Com has a nice article on parsing HTML to an XML-document that might be of some use to you.
If you want to mirror a web site (ffline). Try Teleport Pro.

Otherwise if I have a lot of links to download , I normally add all of them to a text file and them ask wget ( to download it for me.
Free Tool: ZipGrep

ZipGrep is a utility that can list and search zip (.war, .ear, .jar, etc) archives for text patterns, without the need to extract the archive's contents.

One of a set of tools we're offering as a way to say thank you for being a part of the community.

zhshqzycAuthor Commented:
Your methods are good but not specific for the web pages. I want to write code to download them.
Please notice they have format like
<a href="" title="Excel 2010 Developer Reference">Excel 2010 Developer Reference</a></div>
<a href="" title="AllowEditRange Object">AllowEditRange Object</a></div>

Open in new window

Any regular expresstion to collect links?
So if I understood you correctly you want to write a code in C# , VB to extract links from a Web Page and then download them individually ?

Thanks for clarifying.

zhshqzycAuthor Commented:
Fig it out by myself.
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.