Solved

How can I navigate / interact with a web page using a program?

Posted on 2011-03-11
2
326 Views
Last Modified: 2012-05-11
I believe this is a very common practice; however, I am having trouble finding the right way to ask it.

I want a "hello world" program that accomplishes the following:

1. Goes to http://www.experts-exchange.com/
2. (left clicks) Member Login button
3. (left clicks) in the user name box (I want redundancy - assume it doesn't default here?)
3. provides the user name
4. (left clicks) in the password box
5. provides the password
6. (left clicks) the "Log In" button
7. once signed in, the program must pull the first posted comment in the "Recent Activity" table and store the string in a variable.
8. the page must then refresh and repeat 7

I would greatly appreciate source code and the program language used to make it.  Preferably freeware software, but I have C#, Visual Studio and notepad. (using windows xp or 7)

Please understand that this is not my final objective.  The proposed program above is only a "hello world" type program.  If you have a program that accomplishes these (or similar) tasks and are willing to share it, that will answer my question.

Thank you.
0
Comment
Question by:dangermound
2 Comments
 
LVL 3

Accepted Solution

by:
tearman earned 250 total points
ID: 35112863
Python has a pretty good aptitude with doing this.  urllib and urllib2 are quite capable in this regard.

You won't actually use a mouse style system.  What you'll do is submit your login credentials directly to the post location on the form at EE, after creating a "cookie jar" to hold your session data, THEN you'll go to the URL you want and download info from that file.

After that you can parse it using regular expressions or whatever.
0
 

Author Closing Comment

by:dangermound
ID: 35112930
Exactly what I was looking for, thank you.
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Programmer's Notepad is, one of the best free text editing tools available, simply because the developers appear to have second-guessed every weird problem or issue a programmer is likely to run into. One of these problems is selecting and deleti…
Jaspersoft Studio is a plugin for Eclipse that lets you create reports from a datasource.  In this article, we'll go over creating a report from a default template and setting up a datasource that connects to your database.
The viewer will learn how to use and create keystrokes in Netbeans IDE 8.0 for Windows.
The viewer will learn how to use and create new code templates in NetBeans IDE 8.0 for Windows.

911 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

18 Experts available now in Live!

Get 1:1 Help Now