Solved

login into a WEB page - parse HTML data - programatically.

Posted on 2012-04-09
5
289 Views
Last Modified: 2012-04-16
I work for a non-profit.  We have the need to pull data from a government WEB site.  There is no API or WEB service to access the site/pages.   They do have a login page. Is there a way to programatically login, and once logged in, parse the data that comes back in the form of HTML pages?  Does this make sense?
0
Comment
Question by:HLRosenberger
  • 2
  • 2
5 Comments
 
LVL 23

Accepted Solution

by:
wdosanjos earned 250 total points
ID: 37824233
Yes, there is.  You need to emulate with the HTTP/HTTPS requests accordingly to pass through the login page.  You will need to keep track of Cookies too.

Here are some references:

Login to a forms based site from Windows app using WebClient or webrequest
http://www.experts-exchange.com/Programming/Languages/.NET/Q_21075780.html#a11667964

HttpWebRequest Class
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.aspx
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 37832960
Is it for winforms or ASP.NET?
0
 
LVL 1

Author Comment

by:HLRosenberger
ID: 37843874
ASP.NET.
0
 
LVL 83

Assisted Solution

by:CodeCruiser
CodeCruiser earned 250 total points
ID: 37853689
0
 
LVL 1

Author Closing Comment

by:HLRosenberger
ID: 37854074
Thanks
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

SASS allows you to treat your CSS code in a more OOP way. Let's have a look on how you can structure your code in order for it to be easily maintained and reused.
Use these top 10 tips to master the art of email signature design. Create an email signature design that will easily wow recipients, promote your brand and highlight your professionalism.
In this tutorial viewers will learn how to position overlapping items using z-index in CSS. They will also learn the restrictions on the z-index property.  Create a new HTML document with an internal stylesheet.: Create a div in CSS and name it Red.…
In this tutorial viewers will learn how to embed Flash content in a webpage using HTML5. Ensure your DOCTYPE declaration is set to HTML5: "<!DOCTYPE html>": Use the <object> tag to embed Flash content.: To specify that the object is Flash content, d…

746 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now