How to calculate the size of the test group that will participate in the pilot?

Hi
We are implementing a new credit card processor (software platform that manages all the processing of credit cards) and want to conduct a pilot in production environment (after being certify in test environment). The objective of the pilot is to make sure that the processor works OK in production as it did in the certification environment. We do not want to repeat 100% of the tests made in the certification phase but only those we consider to have more impact on customers, for example ATM cash advance transactions and POS purchase transactions.
We want to know how to calculate the size of the test group that will participate in the pilot?  How many times one specific test has to be repeated to be considered OK, for example:  if one test is an ATM withdraw, how many tests should be done?
star90Asked:
Who is Participating?
 
TommySzalapskiCommented:
How many times one specific test has to be repeated to be considered OK

Once. If it works for one specific test case, it will always work for that test case (unless you have race conditions). The more important thing is to test more test cases. What if someone uses a fake credit card? What if someone pushes the wrong buttons? What happens if the power gets disconnected in the middle of a transaction?

I think the best test pilot group is usually just reasonably intelligent people who are trying to break it. Offer some kind of prize or other incentive for anyone who can find a corner case that causes it to fail.

You'll also want to test how intuitive it is, so make sure to not explain how to use it to at least a subset of the testers. See how long it takes to figure it out and then ask them which parts didn't make sense.
0
 
star90Author Commented:
Hi,
Thank you for the answer.
0
Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.

All Courses

From novice to tech pro — start learning today.