Note that Solver will find one solution only. If you need to find all possible solutions that have the same total cost and total priority test coverage, then the problem gets a lot nastier.
Brad
Main Topics
Browse All TopicsGiven a number of categories of software tests (for example, 3-6 categores; 1-20 tests per category) with each category assigned a priority percentage (total 100%) and each test a dollar cost value, is there an efficient way within Excel (possibly, VBA solution) of working out the minimum number of sets of tests to run that provides a threshold priority test coverage (for example, 80%) at minimum total cost?
For example:
Category A: 3 Tests, 50% $100
Category B: 7 Tests, 30%, $50
Category C: 17 Tests, 20%, $25
Possible Solutions:
A (1) & B (3,5,7) & C (1,3,5,7,11,13,17) - Total Cost ((1 * $100 )+ (3 * $50) + (7 * $25) = $425
A (2) & B (1,3,5) & C (1,3,5,7,11,13,17) - Total Cost ((1 * $100 )+ (3 * $50) + (7 * $25) = $425
A (3) & B (1,5,7) & C (1,3,5,7,11,13,17) - Total Cost ((1 * $100 )+ (3 * $50) + (7 * $25) = $425
This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.
Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.
If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.
Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.
Access the answers to your technology questions today.
30-day free trial. Register in 60 seconds.
Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Try it out and discover for yourself.
30-day free trial. Register in 60 seconds.
Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.
Brad,
Thanks for the detailed explanation. You will be pleased to know that I had already considered a linear programming approach (using Solver), but there are a couple of additional constraints that I forgot to include in my original description - apologies.
Category A (1-3) tests are mutually exclusive (due to setup time, level of expertise required, and so on). So, only one category A test can be included per run. Category B (1-7) tests are more flexible and can generally be combined in twos or threes without any problems. Category C (1-17) has no constraints on combinations. The 80% threshold is arbitrary and is set by the Test Manager but is generally in the 60-90% range. With careful planning, there is enough time in the schedule for between three and five sequential runs.
In sum, the target is the minimum number of sets (1-5) of tests to run that provides a minimum threshold priority test coverage (for example, 80%) at minimum total cost.
Best wishes,
John
John,
I added a column to sum the number of times a test was performed over the three sets. Obviously, this value should be 1 or 0.
I also added up the number of tests that were performed in each Category (again over all three sets). This number should be greater than or equal to the minimum in your table, and less than or equal to the maximum.
Finally, I made the occurrence of each test a bin value.
Solver in Excel 2003 ran somewhat slowly. I needed to allow it to continue running before a solution was reached, and it eventually investigated about 9000 branches before converging to the starting point. For what it is worth, the Solver add-in in Excel 2010 is purportedly much faster, having been left unchanged since the early Nineties. Developer Frontline Systems has made continual improvements since then to the versions of Solver sold in the aftermarket, and was retained by Microsoft to revise the Solver tool for the new version of Excel.
Brad
John,
As an afterthought, I realized that the problem would be easier to set up and solve as a single panel of tests. Doing so eliminates the need for a binary constraint on test count. You can split up the results into three sets as a separate (manual) operation.
Thanks for the kind words and grade!
Brad
Business Accounts
Answer for Membership
by: byundtPosted on 2009-10-21 at 17:10:42ID: 25629733
John,
rial.htm
This is the type of problem that Solver is meant to handle, and will do a good job on. Before setting it up, however, I'd like to know how to calculate the threshhold priority test coverage.
Assuming that each test in Category A contributes 50%/3 = 16.67% of the test coverage (and similar for Category B and C), then the attached workbook shows how to solve the problem using Solver.
Problem Set-up:
1) List your tests, their contribution to priority test coverage and cost in separate columns
2) Add a column for a value of 1 (test is part of threshhold group) or 0 (test is not part of threshhold group)
3) Put formulas in cells for the total priority test coverage and total cost. These could be SUMPRODUCT formulas, or you could multiply out the cost and contribution in the columns for contribution and cost (as I did in the sample workbook), then sum them up.
4) Launch the Solver dialog from the Tools...Solver menu item (Excel 2003 and earlier). Excel 2007 puts it in the Data menu.
5) You want to minimize the value of the cell containing the Total cost, subject to the constraints that the 1 and 0 cells have a "bin" (binary) value and that the total priority test coverage cell is 80% or more.
6) Click Solve, then accept the answer.
For your sample problem, the answer was to turn on Categories A and B and leave Category C entirely off.
Since the Solver add-in is an optional install in all versions of Excel, you will probably need to install it. You'll need your Office CD-Rom for this purpose. But first, check to make sure that it is enabled (if it has already been installed):
1) Open Tools...Add-Ins menu item and check the Solver checkbox. You are now ready to use Solver (no need for steps 2 through 9 below)
If you didn't see Solver in the add-ins list in step 1:
2) Open the Start menu...Control Panel...Add or Remove Programs
3) Choose Microsoft Office, then click the "Change" button
4) In the next dialog, choose the "Add or Remove Features" option, then click the "Next" button
5) Check the box for "Advanced Customization of Applications" in the next dialog, then click the "Next" button
6) Find the Solver add-in. Its location varies, but in Office 2003 it is listed under Microsoft Office...Microsoft Office Excel...Add-Ins
7) Click the arrow to the right of the icon, and choose "Run from my computer"
8) Click the "Update" button, and be prepared to insert your Office CD-ROM
9) Once Office has finished updating, launch Excel and repeat step 1
If you want to read up on how Solver works, the add-in author has a pretty good tutorial at http://www.solver.com/tuto
Brad
Sample Solver optimization