Link to home
Start Free TrialLog in
Avatar of M S
M S

asked on

automation of tedious web queries

I have several websites with input boxes that I would like to automate or semi-automate my work with.  Here are two simple examples:
http://mailtester.com
https://www.owler.com

I'd like to be able to feed a bunch of inputs into such a website, and generate a batch of output values.

A more complicated example would be ZoomInfo's people search.  There, I will have dyads of input data (name, company).  The output I need is (direct phone, company phone, email address).  Doing this manually on a large scale is mind-numbing.

I'm open to any approach you can think of....
Avatar of David Favor
David Favor
Flag of United States of America image

Likely you'll use one of these http://phantomjs.org/related-projects.html PhantomJS built tools.

Be sure to build in a few baseline test actions to verify HTML + Javascript code on the site produces exact results you're after.

This step will save you massive amounts of time, as the test step will stop your automated tasks as soon as the page(s) you're attempting to effect change layout. This will occur far more than you imagine.

Also, build your system to track each action which succeeds + stop at first failure, then when you have to retool your code to deal with some page structure change, you can simply resume all the actions, starting with the last failure.

If you build in this type of logic from the start, you'll never have to worry about generating two identical actions + how to recover from problems created when duplicate transactions are generated.
This question needs an answer!
Become an EE member today
7 DAY FREE TRIAL
Members can start a 7-Day Free trial then enjoy unlimited access to the platform.
View membership options
or
Learn why we charge membership fees
We get it - no one likes a content blocker. Take one extra minute and find out why we block content.