• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 311
  • Last Modified:

login into a WEB page - parse HTML data - programatically.

I work for a non-profit.  We have the need to pull data from a government WEB site.  There is no API or WEB service to access the site/pages.   They do have a login page. Is there a way to programatically login, and once logged in, parse the data that comes back in the form of HTML pages?  Does this make sense?
0
HLRosenberger
Asked:
HLRosenberger
  • 2
  • 2
2 Solutions
 
wdosanjosCommented:
Yes, there is.  You need to emulate with the HTTP/HTTPS requests accordingly to pass through the login page.  You will need to keep track of Cookies too.

Here are some references:

Login to a forms based site from Windows app using WebClient or webrequest
http://www.experts-exchange.com/Programming/Languages/.NET/Q_21075780.html#a11667964

HttpWebRequest Class
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.aspx
0
 
CodeCruiserCommented:
Is it for winforms or ASP.NET?
0
 
HLRosenbergerAuthor Commented:
ASP.NET.
0
 
HLRosenbergerAuthor Commented:
Thanks
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Cloud Class® Course: CompTIA Cloud+

The CompTIA Cloud+ Basic training course will teach you about cloud concepts and models, data storage, networking, and network infrastructure.

  • 2
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now