defense against the dark arts: protect yourself from evil metrics by learning good ones by cheryl...
TRANSCRIPT
@bsktcase #darkmetric
defense against the dark arts
Cheryl Hammond
@bsktcase
CTO, Peak Medical Technologies
defense against the dark artsprotect yourself from evil metrics by learning good ones
agreements and asks
@bsktcase #seattlecodecamp #darkmetricTweet your feedback and questions during and after and whenever
https://seattle.codecamp.us/Home/rateSubmit your feedback please please please
agendaIntro, logistics, agreements
Responsible use of metrics
A practical approach to metrics
Characteristics of and a framework for metrics
Your metrics patronusClose
@bsktcase #darkmetric
me
Cheryl Hammond~20 years’ experience in software
development, exec leadership, and
organizational transformation
Passionate about agile, lean, and
making software delivery humane;
not afraid to look silly doing it
Fourth-generation Seattleite
College (university) recruiter; traveler;
bolonka lover; genealogist; feminist
@bsktcase #darkmetric
bad situation
“Managers who don’t know how
to measure what they want
settle for wanting what they can measure.”
Russell L. Ackoff
@bsktcase #darkmetric
game
@bsktcase #darkmetric
“If you give a manager a numerical target,
[s]he’ll make it even if [s]he has to
destroy the company in the process.”
W. Edwards Deming
@bsktcase #darkmetric
seen…
… and unseen
measuring the invisible
True MetricWhat you should measure
Proxy MetricWhat you can measure
@bsktcase #darkmetric
do you know what your proxy is?
@bsktcase #darkmetric
effective
characteristics of effective metrics
Comparable
Honest
Actionable
Simple
@bsktcase #darkmetric
misuse
audiences
InternalSimple
Actionable
Honest
ExternalSimple
Comparable
Honest (?)
@bsktcase #darkmetric
“Any observed statistical regularity
will tend to collapse once pressure is placed
upon it for control purposes.”
Goodhart's Law
@bsktcase #darkmetric
power dynamics
matter
@bsktcase #darkmetric
compare teams… to themselves
Growth & trends Ratios & proportions
@bsktcase #darkmetric
essential
lean and agile metrics are simple
Metrics aren’t freeTime to collect
Time to tabulate
Time to pretty up
Tools
Morale
Be sure the benefit justifies the cost!
@bsktcase #darkmetric
charm
time to feedback
@bsktcase #darkmetric
time to feedback metrics
TrueMean time to stakeholder feedback
Lead time
Cycle time
ProxyWait time
Touch time
Work in process (WIP)
Queue length
MTTR⁴
Realize, Recover, Repair, Remediate
Code coverage
Escaped bug rate
@bsktcase #darkmetric
self-organize
evidence-based agility
@bsktcase #darkmetric
evidence-based planning
@bsktcase #darkmetric
epilogue
agreements and asks
@bsktcase #seattlecodecamp #darkmetricTweet your feedback and questions during and after and whenever
https://seattle.codecamp.us/Home/rateSubmit your feedback please please please
Cheryl Hammond
@bsktcase
CTO, Peak Medical Technologies
thank you!