?
Solved

login into a WEB page - parse HTML data - programatically.

Posted on 2012-04-09
5
Medium Priority
?
305 Views
Last Modified: 2012-04-16
I work for a non-profit.  We have the need to pull data from a government WEB site.  There is no API or WEB service to access the site/pages.   They do have a login page. Is there a way to programatically login, and once logged in, parse the data that comes back in the form of HTML pages?  Does this make sense?
0
Comment
Question by:HLRosenberger
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 23

Accepted Solution

by:
wdosanjos earned 1000 total points
ID: 37824233
Yes, there is.  You need to emulate with the HTTP/HTTPS requests accordingly to pass through the login page.  You will need to keep track of Cookies too.

Here are some references:

Login to a forms based site from Windows app using WebClient or webrequest
http://www.experts-exchange.com/Programming/Languages/.NET/Q_21075780.html#a11667964

HttpWebRequest Class
http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.aspx
0
 
LVL 83

Expert Comment

by:CodeCruiser
ID: 37832960
Is it for winforms or ASP.NET?
0
 
LVL 1

Author Comment

by:HLRosenberger
ID: 37843874
ASP.NET.
0
 
LVL 83

Assisted Solution

by:CodeCruiser
CodeCruiser earned 1000 total points
ID: 37853689
0
 
LVL 1

Author Closing Comment

by:HLRosenberger
ID: 37854074
Thanks
0

Featured Post

Enroll in August's Course of the Month

August's CompTIA IT Fundamentals course includes 19 hours of basic computer principle modules and prepares you for the certification exam. It's free for Premium Members, Team Accounts, and Qualified Experts!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

This article discusses how to create an extensible mechanism for linked drop downs.
Finding original email is quite difficult due to their duplicates. From this article, you will come to know why multiple duplicates of same emails appear and how to delete duplicate emails from Outlook securely and instantly while vital emails remai…
In this tutorial viewers will learn how to position overlapping items using z-index in CSS. They will also learn the restrictions on the z-index property.  Create a new HTML document with an internal stylesheet.: Create a div in CSS and name it Red.…
In this tutorial viewers will learn how to style transparent/translucent elements using alpha transparency in CSS Start with a normal styled element, such as a div.: Define its "background-color" property as "rgba (255, 255, 255, .5): The numbers in…
Suggested Courses

777 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question