Leadership wants DORA metrics on a dashboard for every team. How do you use them well, and how would each one be gamed?
Answer
Short answer
DORA now publishes five measures, three of throughput and two of instability, and they work because improving one dishonestly tends to show up in another. Report them as trends for a delivery system rather than as a per-team league table, and never let them into individual performance conversations.
This is a delivery metrics question before it is a dashboard question. Delivery metrics are useful only when they explain the behaviour of a delivery system: where work waits, where releases fail, and whether recovery is improving. If delivery metrics become a league table, the team learns to protect the numbers instead of improving the system.
Was this answer helpful?
Likely follow-ups
- Your lead time is measured from pull-request open. What behaviour does that encourage?
- A team deploys twice an hour with a five per cent change failure rate. Is that good?
- What would you add to these to cover the things they miss?
- How would you handle a team whose numbers are poor because it maintains a twelve-year-old system?
Related questions
- Six months into a scaled agile rollout the sponsor asks whether it is working. What do you measure, and what do you refuse to report?hardAlso on goodharts-law7 min
- The board asks why engineering has slowed down. What do you measure, and what do you refuse to measure?hardAlso on dora5 min
- Your test lifts conversion, but something else moved the wrong way. What are guardrail metrics, and when do they stop a launch?hardSame kind of round: concept5 min
- A churn model scores 0.94 AUC offline and barely beats the baseline in production. One of its strongest features is populated by a process that runs after the customer has already churned. Explain what happened and how you would fix it.mediumSame kind of round: concept5 min