"There are lies, damn lies and metrics"
This article is the first of several that will take a look at and start a conversation around metrics in Agile. in particular, this article will look at estimating in Agile.
What are Metrics?
Metrics are statistics. Metrics are a graphical or tabular representation of a real world phenomena, typically over a period of time, showing ups and downs of whatever it is is being measured.
In the right hands:
- Metrics should help every stakeholder easily readily understand the health/trend of what's going on.
- Metrics act as the trigger to a chain of positive conversations about what to do next.
- Metrics act as the impetus for decisions that improve everyone's working lives, practices, productivity, business-value and ultimately our products for the better.
- Metrics are met with anticipation, not dread. People look forward to them!
- Metrics underpin the driver behind continuous improvement
In the wrong hands:
- Metrics are used to measure the less important or even the wrong things
- Metrics may even measure the right thing but in the wrong way
- Metrics are used to apportion blame and as a stick to beat people/teams with.
- Metrics if presented in isolation of other relevant metrics, can present a skewed vision of the true reality of what is or should be measured
- Metrics can be used to advance a personal or political agenda as opposed to being a radiator of truth
- All the above can lead to the wrong decisions being made or the right decisions not being made. It's not necessary to describe the harm all the above can to do businesses, products, teams, morale, quality, profitability, corporate reputation and the individuals involved at all stages.
The Metrics that Matter
In Formula One racing, live telemetrics from every part of the car are monitored in real time which drive decisions to improve performance, ranging from the driver behaviour/activity during the race to how pit-stop activities are timed/conducted to car/engine design improvements for future races.
Only the metrics that matter are used. Each metric is transmitted/presented to the right people at the right time who then use that data to make the right decisions that improve all aspects of the car and performance.
Such metrics serve to improve the product in the widest possible sense (the car, the performance, the team, the sport, the industry) and is the springboard for designers, mechanics, engineers and drivers to improve their skills and be part of an upward success story that they're all proud to be part off.
So why are metrics such a bone of contention in many domains in IT?
Measuring the Wrong Things - Not Measuring the Right Things
It's easy to measure mechanical performance of widgets and engines but not so much in the field of technological creativity and the less than tangible aspects of added business value.
This next article will focus on estimates & budgeting in Agile, probably most poorly understood and most poorly applied metric of them all.
What is your experience of metrics?
Who asks for them and why?
Have you experienced where they add value?
Have you experienced when they make not a jot of difference?
Are there metrics you'd recommend?
Have you see metrics being used to make decisions (good and bad)? If so, tell us your story!