1. Agile Testing Metrics July 26th, 2011

2. Metrics - You can’t manage it if you can’t measure it • Types of Process Improvement Methodologies • Six Sigma • ISO 9000 • Lean • Capability Maturity Model • What do they do? • Analyze Input/Output of processes • Provide a baseline to measure against future improvements • Can’t know where you are going unless you have where you have been. • Look for repeatable steps • Implement Accountability • Analyze the maturity of the organization to support the process

3. Agile Process Framework • Input/Output • Story Points • Estimation • Sprints • Demos • Baseline • Story Points per Iteration • Velocity • Repeatable Steps • Automation • Step Libraries • Accountability • Points committed/completed • Demo completed an approved

4. Agile Metrics – What do they look like? • Estimation • Estimation vs Actual • Track this on each Sprint • Things to watch • Estimates always over or under actual points delivered • New Scope during Iteration • Average Story Point Size per Iteration • If too large, estimates tend to be less accurate. • Find a User Story to Acceptance Test Metric • Could be anywhere from 3-7 Acceptance Criteria for each 1-3 point User Story.

5. Agile Metrics – What do they look like?

6. Agile Metrics – What do they look like? • Code Coverage

7. Agile Metrics – What do they look like? • Automation • Percentage of Tests that are automated • Easy to track with BDD style test development • Defects per iteration • Build Failures per Iteration/Project Lifecycle • Story Points added during Iteration • Affects Velocity • Affects Estimation Accuracy • Affects Testing/Automation Coverage