bio presentation f9
TRANSCRIPT
![Page 1: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/1.jpg)
International Conference OnSoftware Testing Analysis & Review
May 16-20, 2005Orlando, FL USA
F9
5/20/2005 11:15 AM
PEANUTS & CRACKERJACKS:WHAT BASEBALL TAUGHT ME
ABOUT METRICS
Robert SabourinAmiBug.com Inc
BIOPRESENTATION
![Page 2: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/2.jpg)
Robert Sabourin Robert Sabourin has over 20 years of management experience, leading teams of software development professionals. A well-respected member of the software engineering community, he has managed, trained, mentored, and coached hundreds of top professionals in the field and frequently writes and speaks at conferences on software engineering, SQA, testing, management, and internationalization. The author of I am a Bug!, the popular software testing children’s book, Robert is an adjunct professor of Software Engineering at McGill University.
![Page 3: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/3.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 1
Peanuts & Crackerjack®
What baseball taught me about testing metrics.
Robert SabourinPresident & Principal consultant
AmiBug.Com, Inc.Montreal, Canada
![Page 4: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/4.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 2
“Peanuts & Crackerjack®
• Overview– Learning, Metaphors– The Players– The Coaches– The Fans– The Line Count– The Score Board– The Standings– The Big Picture
![Page 5: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/5.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 3
Learning and Metaphors
• Teaching• Learning• Retaining• Applying knowledge• Share experiences• Don’t get carried away …
![Page 6: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/6.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 4
The Players
• Baseball cards• Name & Position• Achievements
– History & highlights– Statistics & context
• Character• Gum
![Page 7: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/7.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 5
Base on BallsStrike outs
Hits by type
Speed of pitch
Stolen bases
Fielding ErrorsDefensive
Innings pitched
ERAPitching
Base on BallsStrike outs
HitsBatting
![Page 8: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/8.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 6
K-LOCsFunction points
Bugs by type
Estimate/Actual
Estimate/Actual
Agility – ContextAll defensive
Dev/Rework
Defect DensityDevelopment
Bug isolation %Show stoppers
BugsTesting
![Page 9: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/9.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 7
The Players
Load testerSluggerSecurity testerPinch hitterSubject MatterPinch runnerExplorerOutfieldersTest AutomationInfieldersScripted TesterRelief PitcherTest AnalystStarting Pitcher
Testing RolesBaseball Roles
![Page 10: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/10.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 8
The PlayersHall of Fame
Meyers
Beizer
Collard
Gelperin
![Page 11: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/11.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 9
The Coaches
• Team building– Hiring winners– Player Development– Farm club, Training
• Management– Strategy, Tactics, Implementation– Progress and status
• Feedback– Encouragement– Redirect
![Page 12: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/12.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 10
The Coaches
• Direct play by play– Swing away– Hold– Bunt– Steal a base– Sacrifice fly
![Page 13: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/13.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 11
The Test Lead
• Team building– Hiring winners– Tester Development– Training
• Management– Strategy, Tactics, Implementation– Progress and status
• Feedback– Breakfast of champions
![Page 14: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/14.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 12
The Fans
• Baseball Fans– Watch games– Buy the tickets– Eat the food– Exhibit loyalty– Provide feedback– Important stakeholders
![Page 15: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/15.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 13
The Baseball Fan
• Feedback– Anxiety– Excitement– Stress
![Page 16: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/16.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 14
The Baseball Fan
• Feedback– Applaud Progress– Cheer success– Boo the other team
![Page 17: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/17.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 15
Raving Fans of Testers
• Developers• Database Admin• Managers
![Page 18: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/18.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 16
Raving Fans of Testers
• Customers• End Users• Business Stakeholders
![Page 19: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/19.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 17
Baseball Line Count
• Batter up– Strikes– Balls– Outs
![Page 20: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/20.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 18
Testing Line Count
• Generally– Time– Bugs
– Priority, Severity• Scripted
– Confidence– Pass Fail
• Exploratory– Opportunities– On charter time %
![Page 21: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/21.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 19
UrgentSevere
UrgentNot Severe
Not UrgentSevere
Not UrgentNot Severe
Bug Sweet Spot
![Page 22: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/22.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 20
Baseball Scoreboard
• Game Progress– When– Runs– Running total
![Page 23: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/23.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 21
Baseball Scoreboard
• Feedback– Big, Visible, Obvious– Focus of attention– Great place for Ads!
![Page 24: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/24.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 22
Baseball Scoreboard
• Team Effectiveness– Meaningful– Statistics– Running totals
![Page 25: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/25.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 23
Testing Scoreboard
• Progress in the Project– When in project? Phase– Bugs counts by severity, priority– Objectives identified, elaborated– Exploratory Test charters identified– Tests run, passed, failed, blocked– Test Project Statistics– Testing effort done, effort to go– Running totals (of all counts)
![Page 26: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/26.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 24
Testing ScoreboardTest Objective Chunk Elaborated Go A B C D E F G H I J Latest Runs
Overall Stability OS001 NO FAIL FAIL PASS FAIL FAIL 3Overall Stability OS002 YES FAIL FAIL FAIL 1Overall Stability OS003 NO FAIL FAIL 0Overall Stability OS004 NO FAIL FAIL 0Overall Stability OS005 YES FAIL PASS PASS 1
Typical End User Usage Scenarios TE001 YES FAIL PASS PASS 1Typical End User Usage Scenarios TE002 YES FAIL FAIL PASS PASS 2Typical End User Usage Scenarios TE003 NO FAIL FAIL 0Typical End User Usage Scenarios TE004 NO FAIL FAIL 0Typical End User Usage Scenarios TE005 YES FAIL FAIL FAIL 1Typical End User Usage Scenarios TE006 NO FAIL FAIL 0
Typical Administrator Usage Scenarios TA001 YES FAIL FAIL FAIL 1Typical Administrator Usage Scenarios TA002 NO FAIL FAIL 0Typical Administrator Usage Scenarios TA003 YES FAIL FAIL FAIL 1Typical Administrator Usage Scenarios TA004 YES FAIL PASS PASS 1Typical Administrator Usage Scenarios TA005 NO FAIL FAIL 0Typical Administrator Usage Scenarios TA006 NO FAIL FAIL 0Typical Administrator Usage Scenarios TA007 NO FAIL FAIL 0Typical Administrator Usage Scenarios TA008 NO FAIL FAIL 0
Basic Operation of all Functions BO001 YES FAIL PASS PASS PASS 2
Data Integrity DI001 NO FAIL FAIL 0Data Integrity DI002 YES FAIL FAIL PASS PASS 2Data Integrity DI003 NO FAIL FAIL 0Data Integrity DI004 YES FAIL PASS FAIL PASS FAIL FAIL 4Data Integrity DI005 YES FAIL PASS PASS 1Data Integrity DI006 NO FAIL FAIL 0
Build Chunk Execution Status
![Page 27: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/27.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 25
Testing Scoreboard
Statistics Total PercentNumber System Test Chunks 26 100%Number of System Test Chunks Elaborated 12 46%Number of System Test Chunks To Elaborate 14 54%Number of System Test Chunks PASS 7 27%Number of System Test Chunks FAIL 19 73%
![Page 28: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/28.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 26
Testing Scoreboard
• Feedback– Big, Visible, Obvious– Focus of attention– Great place for Ads!
![Page 29: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/29.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 27
Testing Scoreboard
0
50
100
150
200
250
01/1
1/98
01/1
8/98
01/2
5/98
02/0
1/98
02/0
8/98
02/1
5/98
02/2
2/98
03/0
1/98
03/0
8/98
03/1
5/98
03/2
2/98
03/2
9/98
04/0
5/98
04/1
2/98
04/1
9/98
04/2
6/98
05/0
3/98
05/1
0/98
05/1
7/98
05/2
4/98
05/3
1/98
06/0
7/98
06/1
4/98
06/2
1/98
06/2
8/98
07/0
5/98
07/1
2/98
07/1
9/98
07/2
6/98
08/0
2/98
08/0
9/98
08/1
6/98
08/2
3/98
08/3
0/98
09/0
6/98
09/1
3/98
09/2
0/98
09/2
7/98
10/0
4/98
10/1
1/98
10/1
8/98
10/2
5/98
11/0
1/98
11/0
8/98
11/1
5/98
11/2
2/98
11/2
9/98
12/0
6/98
12/1
3/98
01/1
4/99
01/1
8/99
01/2
5/99
02/0
1/99
02/0
8/99
Open P1 & P2 Bugs Bugs Pending validation (Corrigé)
Trend ChartOpen Bugs
![Page 30: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/30.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 28
Testing Scoreboard
Trend ChartOpen Bugs By Type
![Page 31: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/31.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 29
Baseball Standings
• How is the team doing?– Games played– Games at hand– Total Wins– Total Loses– Relative placement– Division standing– League standing– Attendance
![Page 32: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/32.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 30
Testing Project Standings
• How is the project doing?– Progress toward goals
– On Time – Quality – Budget– Comparing all projects
– To go / Done effort– Estimation accuracy
– Work breakdown– Effort distributions
![Page 33: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/33.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 31
Testing Project Standings
![Page 34: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/34.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 32
Testing Project Standings
![Page 35: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/35.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 33
Baseball Big Picture
• Is the franchise healthy?– Revenues– Expenses– Profit– Loss– Contracts– Media– Civic responsibility– Capital
![Page 36: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/36.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 34
Baseball Big Picture
• How is the franchise doing?– Value– External factors– Supply– Demand– Opportunity– Image– Brand– Revenue
![Page 37: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/37.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 35
Testing Big Picture
• Is the company healthy?– Revenues– Expenses– Profit– Loss– Contracts– Media– Civic responsibility– Capital
![Page 38: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/38.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 36
The Big Picture
• How is testing adding value to the organization?
– More sales revenue– Fewer support calls– Lower development cost– Competitive time to market– Best of breed technology– Accountable and auditable!– Attracts top talent, Fun team– All know how testing ties to corporate values
![Page 39: BIO PRESENTATION F9](https://reader036.vdocuments.net/reader036/viewer/2022062416/62ad7ccfe41ed911315778cd/html5/thumbnails/39.jpg)
AmiBug.Com, Inc.© Robert Sabourin, 20059-Mar-05 Slide 37
Thank You
Questions?