Solved

login into a WEB page - parse HTML data - programatically.

Posted on 2012-04-09
5
301 Views
Last Modified: 2012-04-16
I work for a non-profit.  We have the need to pull data from a government WEB site.  There is no API or WEB service to access the site/pages.   They do have a login page. Is there a way to programatically login, and once logged in, parse the data that comes back in the form of HTML pages?  Does this make sense?
0
Comment
Question by:HLRosenberger
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 23

Accepted Solution

by:
wdosanjos earned 250 total points
ID: 37824233
Yes, there is.  You need to emulate with the HTTP/HTTPS requests accordingly to pass through the login page.  You will need to keep track of Cookies too.

Here are some references:

Login to a forms based site from Windows app using WebClient or webrequest
http://www.experts-exchange.com/Programming/Languages/.NET/Q_21075780.html#a11667964

HttpWebRequest Class
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.aspx
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 37832960
Is it for winforms or ASP.NET?
0
 
LVL 1

Author Comment

by:HLRosenberger
ID: 37843874
ASP.NET.
0
 
LVL 83

Assisted Solution

by:CodeCruiser
CodeCruiser earned 250 total points
ID: 37853689
0
 
LVL 1

Author Closing Comment

by:HLRosenberger
ID: 37854074
Thanks
0

Featured Post

Don't Cry: How Liquid Web is Ensuring Security

WannaCry is just the start. Read how Liquid Web is protecting itself and its customers against new threats.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Not sure what the best email signature size is? Are you worried about email signature image size? Follow this best practice guide.
This article demonstrates how to create a simple responsive confirmation dialog with Ok and Cancel buttons using HTML, CSS, jQuery and Promises
In this tutorial viewers will learn how to position overlapping items using z-index in CSS. They will also learn the restrictions on the z-index property.  Create a new HTML document with an internal stylesheet.: Create a div in CSS and name it Red.…
Learn how to create flexible layouts using relative units in CSS.  New relative units added in CSS3 include vw(viewports width), vh(viewports height), vmin(minimum of viewports height and width), and vmax (maximum of viewports height and width).

695 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question