• Status: Solved
  • Priority: Medium
  • Security: Public
  • Views: 757
  • Last Modified:

How to calculate the size of the test group that will participate in the pilot?

Hi
We are implementing a new credit card processor (software platform that manages all the processing of credit cards) and want to conduct a pilot in production environment (after being certify in test environment). The objective of the pilot is to make sure that the processor works OK in production as it did in the certification environment. We do not want to repeat 100% of the tests made in the certification phase but only those we consider to have more impact on customers, for example ATM cash advance transactions and POS purchase transactions.
We want to know how to calculate the size of the test group that will participate in the pilot?  How many times one specific test has to be repeated to be considered OK, for example:  if one test is an ATM withdraw, how many tests should be done?
0
star90
Asked:
star90
1 Solution
 
TommySzalapskiCommented:
How many times one specific test has to be repeated to be considered OK

Once. If it works for one specific test case, it will always work for that test case (unless you have race conditions). The more important thing is to test more test cases. What if someone uses a fake credit card? What if someone pushes the wrong buttons? What happens if the power gets disconnected in the middle of a transaction?

I think the best test pilot group is usually just reasonably intelligent people who are trying to break it. Offer some kind of prize or other incentive for anyone who can find a corner case that causes it to fail.

You'll also want to test how intuitive it is, so make sure to not explain how to use it to at least a subset of the testers. See how long it takes to figure it out and then ask them which parts didn't make sense.
0
 
star90Author Commented:
Hi,
Thank you for the answer.
0

Featured Post

Receive 1:1 tech help

Solve your biggest tech problems alongside global tech experts with 1:1 help.

Tackle projects and never again get stuck behind a technical roadblock.
Join Now