Best method for proprietary web automation

Posted on 2013-12-20
Last Modified: 2014-02-05
We are looking at some different methods for automating web tasks. Clicking buttons, filling forms, etc. I could use C# since I'm good at C++ or maybe something like Selenium, but we think we may make some useful stuff that other people would be willing to pay for. So I don't really like the C# idea since it's only going to work on Windows computers.
Ideally, the users wouldn't need to download anything, but if they need to it's okay.
We just need the ability to have the users be authenticated with us before they were allowed to use any of the scripts.

So they log in with us, then log in to whatever website that they want to do automated stuff on (like click a button 100 times really fast if you saw my other question), then they do automated stuff.

What would be the best tool for this job?
Question by:TommySzalapski
  • 4
  • 3
LVL 83

Expert Comment

by:Dave Baldwin
ID: 39733316
You should know that major websites are working hard to prevent you from automating access to their sites.  They are mostly using more and more javascript to do logins and other kinds of forms.  The idea is that most automation can't run the javascript so people can't automate the logins and forms.
LVL 37

Author Comment

ID: 39733607
Manual login is fine. We're not trying to write survey robots or anything, just save people some time and/or make stress testing easier. Currently, we're wanting to run a lot of it against our own websites anyway.
LVL 52

Expert Comment

by:Scott Fell, EE MVE
ID: 39733940
>We just need the ability to have the users be authenticated with us before they were allowed to use any of the scripts.

I would use social log in.  You can write this on your own or use a service  

It sounds like you want to provide a service others can use and purchase that from you.  It would be a good idea if your own site was the service and then you can use any server side code you want or api's.  Then for your clients that are buying the service from you can simply download a bit of javascript to embed on their site that ultimately talks to yours.

It is becoming more common for sites that use API's to access or submit data as if you were doing this from their front end portal.  Your service would simply make it easy for would be webmasters and developers.   On your end, all the api's would be programmed.

I think you have  a good idea.
LVL 37

Author Comment

ID: 39734207
That's just so they can log in with Facebook or whatever. That doesn't tell me what language I should be using to automate web pages from another web page.
DevOps Toolchain Recommendations

Read this Gartner Research Note and discover how your IT organization can automate and optimize DevOps processes using a toolchain architecture.

LVL 52

Accepted Solution

Scott Fell,  EE MVE earned 500 total points
ID: 39734221
I probably was not clear.  

Use your own server to do all the heavy lifting and provide an easy way for others to use your own api's via javascript.  This way there is nothing for other sites to install or load.  

In short 3 different sites will have 3 different api's to submit the same data.  Your server will include a way for another site to submit to your site the basic data required and your server will use the 3 different api's to transfer the data.

Since the heavy lifting is on your server, you can use the language you know best.
LVL 37

Author Comment

ID: 39812074
That really doesn't answer the original question. I can't publish APIs for this. The end users wouldn't know what to do with one. Also I still don't know any good cross-OS tool for web automation.
LVL 52

Assisted Solution

by:Scott Fell, EE MVE
Scott Fell,  EE MVE earned 500 total points
ID: 39812193
> I can't publish APIs for this

I said, 3 different sites will have 3 different api's meaning each has their own (facebook has an api, twitter has an api etc.)

>cross-OS tool for web automation.
I reread your question. You want the user to download your program.  It does not matter if the program is web automation or something else. I think the only language that would work for either is java or in the browser  javascript.    

My guess is for the best user experience, it would be best to write a mac osx program using x-code and ojbective-c for pc you would use .NET
LVL 37

Author Comment

ID: 39837134
I said "Ideally, the users wouldn't need to download anything, but if they need to it's okay."

Okay, so javascript is probably the best bet for a browser based solution. Pretty limited, but might do some tasks.

I've done some web automation in .NET, so I guess I'll just keep fiddling around and see what happens.

Featured Post

3 Use Cases for Connected Systems

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, testing some more, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Loop not working 29 47
Data is not showing from images 15 37
how to read json value 2 30
Creating a dynamic URL  - link to results on Airbnb availability for tomorrow 7 26
A long time ago (May 2011), I have written an article showing you how to create a DLL using Visual Studio 2005 to be hosted in SQL Server 2005. That was valid at that time and it is still valid if you are still using these versions. You can still re…
This article shows how to deploy dynamic backgrounds to computers depending on the aspect ratio of display
The viewer will learn how to create and use a small PHP class to apply a watermark to an image. This video shows the viewer the setup for the PHP watermark as well as important coding language. Continue to Part 2 to learn the core code used in creat…
Learn how to create flexible layouts using relative units in CSS.  New relative units added in CSS3 include vw(viewports width), vh(viewports height), vmin(minimum of viewports height and width), and vmax (maximum of viewports height and width).

910 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

22 Experts available now in Live!

Get 1:1 Help Now