Solved

login into a WEB page - parse HTML data - programatically.

Posted on 2012-04-09
5
292 Views
Last Modified: 2012-04-16
I work for a non-profit.  We have the need to pull data from a government WEB site.  There is no API or WEB service to access the site/pages.   They do have a login page. Is there a way to programatically login, and once logged in, parse the data that comes back in the form of HTML pages?  Does this make sense?
0
Comment
Question by:HLRosenberger
  • 2
  • 2
5 Comments
 
LVL 23

Accepted Solution

by:
wdosanjos earned 250 total points
ID: 37824233
Yes, there is.  You need to emulate with the HTTP/HTTPS requests accordingly to pass through the login page.  You will need to keep track of Cookies too.

Here are some references:

Login to a forms based site from Windows app using WebClient or webrequest
http://www.experts-exchange.com/Programming/Languages/.NET/Q_21075780.html#a11667964

HttpWebRequest Class
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.aspx
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 37832960
Is it for winforms or ASP.NET?
0
 
LVL 1

Author Comment

by:HLRosenberger
ID: 37843874
ASP.NET.
0
 
LVL 83

Assisted Solution

by:CodeCruiser
CodeCruiser earned 250 total points
ID: 37853689
0
 
LVL 1

Author Closing Comment

by:HLRosenberger
ID: 37854074
Thanks
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Someone recently asked me about how to display a progress indicator on a page while an iframe is loading. And I remember when I first came across this myself. It was a bit tricky to get my head around, but really, it's very simple. The most impor…
International Data Corporation (IDC) prognosticates that before the current the year gets over disbursing on IT framework products to be sent in cloud environs will be $37.1B.
In this tutorial viewers will learn how to style transparent/translucent elements using alpha transparency in CSS Start with a normal styled element, such as a div.: Define its "background-color" property as "rgba (255, 255, 255, .5): The numbers in…
In this tutorial viewers will learn how to embed Flash content in a webpage using HTML5. Ensure your DOCTYPE declaration is set to HTML5: "<!DOCTYPE html>": Use the <object> tag to embed Flash content.: To specify that the object is Flash content, d…

911 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now