• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 268
  • Last Modified:

Auto login & extract data from a website

This isn't about any website in particular but various websites require you to login before you can access your account.

I want to know how applications (after you supply your username/password) manage to login into the websites and extract your account details?

I can use a webrequest to request a webpage but how do i login before i do that (programatically)?

0
Type25
Asked:
Type25
  • 2
  • 2
1 Solution
 
Jens FiedererTest Developer/ValidatorCommented:
It really depends on the website.

In many cases, everything is handled using forms - you supply id/password, and the response either sets a cookie or fills in some (generally hidden) field in your form with data that makes sense only to that site.

One way to do this is to use a scriptable or scripted browser - you can use and control a browser object and handle filling in the login/password information yourself.

Some sites don't like you to access them that way (you might miss out on seeing advertisements that are important to the site), so they change the way this is done on a regular basis and you will have to keep changing your program).  I.e., for some sites what you are proposing is considered hostile behavior, and will violate their terms-of-service and they might even ban you if they catch you trying to access them in a manner appropriate to an older version of their software (because only a bot would do that).
0
 
Type25Author Commented:
Okay, that makes sense.

I have a few ideas kicking about for an iPhone application, but would require me to log into a couple of pretty large organisations websites.

Probably a no-goer

0
 
Jens FiedererTest Developer/ValidatorCommented:
Depends on the specifice orgs - the ones that are OK with it might even provide services to make it either (like Google exposing its map API) and give you easier alternatives than logging on.

If they are NOT, it is definitely a no-go.
0
 
Type25Author Commented:
Thanks for the advice
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

Join & Write a Comment

Featured Post

Get your problem seen by more experts

Be seen. Boost your question’s priority for more expert views and faster solutions

  • 2
  • 2
Tackle projects and never again get stuck behind a technical roadblock.
Join Now