I am working on an application that visits a web site, parses the html looking for images, and downloads images above a certain size threshold.
The application works fine on any web site that does not require a username and a password.
What I want to do now is provide an interface to the user that allows them to enter the url of the web site they wish to visit, and optionally, the username and password to access the site. The username and password information can appear in several guises.
The most common is to provide a dialog box that requests this information. The next most common method is to display the username and password field on the web page itself. The third most common is the First Virtual (FV) ID which is composed of a single entry field displayed on the web page.
What I most need to know is how to submit the username and password when the web site requests it using the most common of the above methods; that of the dialog box.
I need to do this within my VB app. The urls and their associated usernames and passwords are stored on a table in the database. When the site is visited, the username and password will be retrieved and submited to the web site upon request. This will allow the user to visit a pay website, grab the images, and log off as quickly as possible. They do not have to sit at the keyboard or do anything else save for providing the url, the username, and the password.
Any help in solving this problem would be greatly appreciated.