defense against the dark arts: protect yourself from evil metrics by learning good ones by cheryl...

@bsktcase #darkmetric

defense against the dark arts

Cheryl Hammond

@bsktcase

CTO, Peak Medical Technologies

defense against the dark artsprotect yourself from evil metrics by learning good ones

agreements and asks

@bsktcase #seattlecodecamp #darkmetricTweet your feedback and questions during and after and whenever

https://seattle.codecamp.us/Home/rateSubmit your feedback please please please

agendaIntro, logistics, agreements

Responsible use of metrics

A practical approach to metrics

Characteristics of and a framework for metrics

Your metrics patronusClose

@bsktcase #darkmetric

me

Cheryl Hammond~20 years’ experience in software

development, exec leadership, and

organizational transformation

Passionate about agile, lean, and

making software delivery humane;

not afraid to look silly doing it

Fourth-generation Seattleite

College (university) recruiter; traveler;

bolonka lover; genealogist; feminist

@bsktcase #darkmetric

bad situation

“Managers who don’t know how

to measure what they want

settle for wanting what they can measure.”

Russell L. Ackoff

@bsktcase #darkmetric

game

@bsktcase #darkmetric

“If you give a manager a numerical target,

[s]he’ll make it even if [s]he has to

destroy the company in the process.”

W. Edwards Deming

@bsktcase #darkmetric

seen…

… and unseen

measuring the invisible

True MetricWhat you should measure

Proxy MetricWhat you can measure

@bsktcase #darkmetric

do you know what your proxy is?

@bsktcase #darkmetric

effective

characteristics of effective metrics

Comparable

Honest

Actionable

Simple

@bsktcase #darkmetric

misuse

audiences

InternalSimple

Actionable

Honest

ExternalSimple

Comparable

Honest (?)

@bsktcase #darkmetric

“Any observed statistical regularity

will tend to collapse once pressure is placed

upon it for control purposes.”

Goodhart's Law

@bsktcase #darkmetric

power dynamics

matter

@bsktcase #darkmetric

compare teams… to themselves

Growth & trends Ratios & proportions

@bsktcase #darkmetric

essential

lean and agile metrics are simple

Metrics aren’t freeTime to collect

Time to tabulate

Time to pretty up

Tools

Morale

Be sure the benefit justifies the cost!

@bsktcase #darkmetric

charm

time to feedback

@bsktcase #darkmetric

time to feedback metrics

TrueMean time to stakeholder feedback

Lead time

Cycle time

ProxyWait time

Touch time

Work in process (WIP)

Queue length

MTTR⁴

Realize, Recover, Repair, Remediate

Code coverage

Escaped bug rate

@bsktcase #darkmetric

self-organize

evidence-based agility

@bsktcase #darkmetric

evidence-based planning

@bsktcase #darkmetric

epilogue

agreements and asks

@bsktcase #seattlecodecamp #darkmetricTweet your feedback and questions during and after and whenever

https://seattle.codecamp.us/Home/rateSubmit your feedback please please please

Cheryl Hammond

@bsktcase

CTO, Peak Medical Technologies

thank you!