TestWorks Quality Index: Table III -- Product Application Profile

TestWorks Quality Index ^TM
Table III -- Product Application Profile

Copyright © 1999-2006 by Software Research, Inc.

TestWorks Quality Index `(TOP)`	Assess the quality of your quality process with the TestWorks Quality Index.
Table I -- Software Quality Process Filters	Assesses relative advantages and disadvantages of various software quality methods.
Table II -- TestWorks Quality Index Definitions	Summarizes the definitions of the factors that make up the TestWorks Quality Index and shows how to compute it for YOUR process.
Table III -- Product Application Profile	Gives a recommended composition of use of TestWorks products and indicates likely CMM-like levels and relative overall process efficiencies.

This table shows the components of TestWorks and indicates how they are applied in an increasingly sophisticated sequence of quality processes, all calibrated with the TestWorks Quality Index required minimum value. For comparison purposes the corresponding approximate CMM value is shown as a range. A range is used because of uncertainties in the CMM definitions.

Product Application Profile
PROCESS LEVEL
Management
Planning
Regression Filters
Coverage Filters
Defect Detection Efficiency
Number of Filters
COMMENTS
Introductory
TestWorks Index > 40
CMM Level 0 - 1
None
None
CAPBAK
Minimal Use
TCAT
Minimal Use
10% - 40%
2 Filters
The minimum that anyone does, maybe even without the coverage.
Basic
TestWorks Index > 50
CMM Level 1
None
Manual
CAPBAK
TCAT
Minimal Use
25% - 50%
2.5 Filters
Low-end current industry practice: black box testing but quite incomplete.
Standard
TestWorks Index > 60
CMM Level 1-2
METRIC
SMARTS
CAPBAK
TCAT
50% - 90%
3+ Filters
High-end current industry practice: black box testing and a little more complete.
Advanced
TestWorks Index > 70
CMM Level 2-3
METRIC
Informal
CAPBAK
Complete
TCAT
Complete
50% - 90%
4 Filters
Adding metrics and good coverage gives a very strong result.
Critical
TestWorks Index > 80
CMM Level 3-4?
TestWorks Advisor
Semi-Formal
Specification Based
TestWorks Regression
TestWorks Coverage
80% - 99%
5 Filters
Now, with specifications tied in you are approaching a serious process.
Life-Critical
TestWorks Index > 90
CMM Level 4-5?
TestWorks Advisor
Formal
Specification Based
TestWorks Regression
TestWorks Coverage
90% - 99%
5 Filters
This is "top of the line" with current technology.

Product Application Profile
PROCESS LEVEL	Management	Planning	Regression Filters	Coverage Filters	Defect Detection Efficiency Number of Filters	COMMENTS
Introductory TestWorks Index > 40 CMM Level 0 - 1	None	None	CAPBAK Minimal Use	TCAT Minimal Use	10% - 40% 2 Filters	The minimum that anyone does, maybe even without the coverage.
Basic TestWorks Index > 50 CMM Level 1	None	Manual	CAPBAK	TCAT Minimal Use	25% - 50% 2.5 Filters	Low-end current industry practice: black box testing but quite incomplete.
Standard TestWorks Index > 60 CMM Level 1-2	METRIC	SMARTS	CAPBAK	TCAT	50% - 90% 3+ Filters	High-end current industry practice: black box testing and a little more complete.
Advanced TestWorks Index > 70 CMM Level 2-3	METRIC	Informal	CAPBAK Complete	TCAT Complete	50% - 90% 4 Filters	Adding metrics and good coverage gives a very strong result.
Critical TestWorks Index > 80 CMM Level 3-4?	TestWorks Advisor	Semi-Formal Specification Based	TestWorks Regression	TestWorks Coverage	80% - 99% 5 Filters	Now, with specifications tied in you are approaching a serious process.
Life-Critical TestWorks Index > 90 CMM Level 4-5?	TestWorks Advisor	Formal Specification Based	TestWorks Regression	TestWorks Coverage	90% - 99% 5 Filters	This is "top of the line" with current technology.