Skip to content

QA Metrics Calculation Guidance

This guide provides best practices and formulas for calculating, interpreting, and reporting QA metrics in Spline Studio projects. Use these guidelines to ensure consistency and transparency across all QA reporting.

Key Metrics & Calculation Methods

  • Test Coverage:
    $\text{Test Coverage} = \frac{\text{Number of executed test cases}}{\text{Total number of test cases}} \times 100\%$

  • Requirement Coverage:
    $\text{Requirement Coverage} = \frac{\text{Number of requirements covered by tests}}{\text{Total number of requirements}} \times 100\%$

  • Defect Density:
    $\text{Defect Density} = \frac{\text{Number of defects}}{\text{Size of release (e.g., features, KLOC)}}$

  • Defect Leakage:
    $\text{Defect Leakage} = \frac{\text{Defects found post-release}}{\text{Total defects found}} \times 100\%$

  • Automation Contribution:
    $\text{Automation Contribution} = \frac{\text{Number of automated tests}}{\text{Total QA tests}} \times 100\%$

  • Cycle Time:
    $\text{Cycle Time} = \text{Task end date} - \text{Task start date}$

  • Bug Report Quality:
    $\text{Bug Report Quality} = 100\% - \frac{\text{Bug reports returned for rework}}{\text{Total bug reports}} \times 100\%$

Best Practices

  • Always specify the calculation method in reports.
  • Adapt metrics to project specifics as needed.
  • Use historical data for trend analysis.
  • Document any deviations from standard formulas.

For questions or improvements, contact the Head of Assurance.