Solved

How can I navigate / interact with a web page using a program?

Posted on 2011-03-11
2
316 Views
Last Modified: 2012-05-11
I believe this is a very common practice; however, I am having trouble finding the right way to ask it.

I want a "hello world" program that accomplishes the following:

1. Goes to http://www.experts-exchange.com/
2. (left clicks) Member Login button
3. (left clicks) in the user name box (I want redundancy - assume it doesn't default here?)
3. provides the user name
4. (left clicks) in the password box
5. provides the password
6. (left clicks) the "Log In" button
7. once signed in, the program must pull the first posted comment in the "Recent Activity" table and store the string in a variable.
8. the page must then refresh and repeat 7

I would greatly appreciate source code and the program language used to make it.  Preferably freeware software, but I have C#, Visual Studio and notepad. (using windows xp or 7)

Please understand that this is not my final objective.  The proposed program above is only a "hello world" type program.  If you have a program that accomplishes these (or similar) tasks and are willing to share it, that will answer my question.

Thank you.
0
Comment
Question by:dangermound
2 Comments
 
LVL 3

Accepted Solution

by:
tearman earned 250 total points
Comment Utility
Python has a pretty good aptitude with doing this.  urllib and urllib2 are quite capable in this regard.

You won't actually use a mouse style system.  What you'll do is submit your login credentials directly to the post location on the form at EE, after creating a "cookie jar" to hold your session data, THEN you'll go to the URL you want and download info from that file.

After that you can parse it using regular expressions or whatever.
0
 

Author Closing Comment

by:dangermound
Comment Utility
Exactly what I was looking for, thank you.
0

Featured Post

How to improve team productivity

Quip adds documents, spreadsheets, and tasklists to your Slack experience
- Elevate ideas to Quip docs
- Share Quip docs in Slack
- Get notified of changes to your docs
- Available on iOS/Android/Desktop/Web
- Online/Offline

Join & Write a Comment

Suggested Solutions

Update (December 2011): Since this article was published, the things have changed for good for Android native developers. The Sequoyah Project (http://www.eclipse.org/sequoyah/) automates most of the tasks discussed in this article. You can even fin…
Here is a helpful source code for C++ Builder programmers that allows you to manage and manipulate HTML content from C++ code, while also handling HTML events like onclick, onmouseover, ... Some objects defined and used in this source include: …
THe viewer will learn how to use NetBeans IDE 8.0 for Windows to perform CRUD operations on a MySql database.
The viewer will learn how to use and create new code templates in NetBeans IDE 8.0 for Windows.

771 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

10 Experts available now in Live!

Get 1:1 Help Now