How to script navigation of multiple pages of a website

there are websites we use in our business where we need to go to multiple pages within that website. I need to automate or somehow "program or code" this so that our application can do the work.  At this time our people go to the website, click a link to select a location, then enter a date range, then select an item, then enter our ID data.  That ends up being about 5 different pages and several different entry boxes we have to fill in before the task is complete.  How would I go about "automating" that?  Or, who can I hire to write scripts or code to automate that task?
wfcrrAsked:
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

MlandaTCommented:
This is called page scraping. There are several code based approaches to this.

in the .NET world, the HtmlAgilityPack is widely used for this sort of thing. You can program it to parse HTML, and extract data out of web pages into .NET objects and the like.

Fiddler: Sometimes, one can also combine the HtmlAgilityPack with Fiddler. Use Fiddler to capture the HTTP calls made by a user whilst they work in the browser and replay the HTTP call sequence later, passing in custom values as needed.
0

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
HTML

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.