|
TestWorks Quality Index
TM
Table II -- Definitions Copyright © 1999-2006 by Software Research, Inc. |
|
|
TestWorks Quality Index
TM
Table II -- Definitions Copyright © 1999-2006 by Software Research, Inc. |
| TestWorks Quality Index (TOP) | Assess the quality of your quality process with the TestWorks Quality Index. |
| Table I -- Software Quality Process Filters | Assesses relative advantages and disadvantages of various software quality methods. |
| Table II -- TestWorks Quality Index Definitions | Summarizes the definitions of the factors that make up the TestWorks Quality Index and shows how to compute it for YOUR process. |
| Table III -- Product Application Profile | Gives a recommended composition of use of TestWorks products and indicates likely CMM-like levels and relative overall process efficiencies. |
This table shows how to compute the TestWorks Product Quality Index TM -- the "TestWorks Index." The index gives your organization the chance to assess how their internal software quality process is actually used on a particular product level and to compare their indicated product quality against current likely industry standards.
Each factor in the TestWorks Quality Index is evaluated so that a simple point value -- scored between 0 points and 100 points -- can be assigned depending on the guidelines given in the table below. The overall TestWorks Quality Index is the arithmetic average of the individual factors' scores (add up the ten scores and divide by 10).
TestWorks Quality Index: Definitions and Explanations | ||||||||
| F# | Evaluation Factor | 50 Points | 60 Points | 70 Points | 80 Points | 90 Points | 100 Points | MY SCORE ON THIS FACTOR |
| F1 | Cumulative C1 For All Tests | > 25% | > 40% | > 60% | > 85% | > 90% | > 95% | |
| F2 | Cumulative S1 For All Tests | > 50% | > 65% | > 80% | 90% | 95% | 95% | |
| F3 | Functions with E(n) < 20 | < 25% | > 25% | > 50% | > 75% | > 90% | > 95% | |
| F4 | Percent of Functions with "Clean" Static Analysis | < 20% | > 20% | > 30% | > 40% | > 50% | > 60% | |
| F5 | Last PASS/FAIL Percentage | > 25% | < 25% | > 50% | > 75% | > 90% | > 95% | |
| F6 | Total Number of Test Cases/KLOC | > 10 | < 10 | > 15 | > 20 | > 30 | > 40 | |
| F7 | Calling Tree Aspect Ratio (Width/Height) | > 1.0 | < 1.25 | < 1.5 | < 1.75 | < 2.0 | > 2.0 | |
| F8 | Number of OPEN Criticality 1 Defects/KLOC | > 5 | < 5 | < 3 | < 2 | < 1 | < 0.5 | |
| F9 | Path Coverage Performed for % of Functions | < 1% | > 2% | > 5% | > 10% | > 15% | > 25% | |
| F10 | Cost Impact per Defect | > $100K | > $50K | > $25K | > $10K | > $1K | < $1K | |
| TOTAL POINTS | -> | -> | -> | -> | -> | -> | | |