andrew goslin - tmmi, what is not in the text book - eurostar 2010
DESCRIPTION
EuroSTAR Software Testing Conference 2010 presentation on TMMi, What is Not in the Text Book by Andrew Goslin. See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/TRANSCRIPT
![Page 1: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/1.jpg)
©2010 TMMi Foundation 1
TMMiWhat is not in the text book…
Andrew Goslin
TMMi Foundation
EuroSTAR – December 2010
www.tmmifoundation.org
![Page 2: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/2.jpg)
Agenda
What is TMMi?
Where does TMMi add value?
Tips for using TMMi
Benefits of using TMMi
2©2010 TMMi Foundation
![Page 3: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/3.jpg)
A “non-technical” overview
What is TMMi?
3©2010 TMMi Foundation
![Page 4: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/4.jpg)
Why improve processes?
Is your process good enough?
Can your organisation save money?
Software failures are expensive!
Testing is ineffective in many
organisations!
What do your customers think of your
software?
4©2010 TMMi Foundation
![Page 5: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/5.jpg)
“Good Practice”
Is there such a thing as “good practice”?
Many examples, in many contexts
Government, Health, Education, Management,
Employment, Project Delivery, etc
Codes of Practice, Good Practice Guidelines
Often include legal and ethical basis
What about your context?
No such thing as “good practice”?
Re-engineering the wheel?
5©2010 TMMi Foundation
![Page 6: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/6.jpg)
TMMi “Good Practice”
Good practice is established on
Hard won lessons
Research – scientific experimentation
TMMi is a model of “good practice”
Based on practical experience
Based on research and industry knowledge
Is subject to “open” peer review
6©2010 TMMi Foundation
![Page 7: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/7.jpg)
Structural overview
7©2010 TMMi Foundation
Levels
Process Areas
Goals
Practices
![Page 8: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/8.jpg)
Structure - Levels
8©2010 TMMi Foundation
Level 1 – Initial
No process areas
Level 2 – Managed
5 process areas
Level 3 – Defined
5 process areas
Level 4 – Management &
Measurement
3 process areas
Level 5 – Optimization
3 process areas
![Page 9: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/9.jpg)
Structure – Level 2 Processes
9©2010 TMMi Foundation
Level 2 – Managed
2.1 Test Policy & Strategy
2.2 Test Planning
2.3 Test Monitoring & Control
2.4 Test Design & Execution
2.5 Test Environment
![Page 10: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/10.jpg)
Structure – Test Planning
Specific Goals
Perform a product risk assessment
Establish a test approach
Establish test estimates
Develop a test plan
Obtain commitment to the test plan
Generic Goal
Institutionalize a Managed Process
10©2010 TMMi Foundation
![Page 11: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/11.jpg)
Reasons for structure?
Levels
Built-in structure for improvement
Focus “externally” on stakeholders
Simple model to explain to management
Process Areas & Goals
Detail requirements to achieve maturity level
Focus on “internally” on practitioners
Detail for implementation
©2010 TMMi Foundation 11
![Page 12: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/12.jpg)
Where and how to exploit TMMi
Where does TMMi add value?
©2010 TMMi Foundation 12
![Page 13: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/13.jpg)
Context
Organisation
Business objectives – products & services
Project Delivery
Suppliers
Methodology
Type of systems
Tools
People
©2010 TMMi Foundation 13
![Page 14: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/14.jpg)
Implementation Approach 1
Tactical project focused
Address project issues, only
Answer questions like
What is working well? Keep doing!
What is not working? What action is needed?
Eg: Testing too broad, defects missed
Product risk workshop?
Test prioritized – depth and breadth?
©2010 TMMi Foundation 14
![Page 15: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/15.jpg)
Implementation Approach 2
Strategic organisation wide
Answer questions like
How to deliver consistently? Predictable cost!
How to integrate testing into delivery process?
Eg: Variable quality, inconsistent approach
Assess Level 2 strengths & weaknesses
Establish prioritized plan to consolidate
strengths and improve weaknesses
©2010 TMMi Foundation 15
![Page 16: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/16.jpg)
Implementing TMMi-based change
Tips for using TMMi
16©2010 TMMi Foundation
![Page 17: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/17.jpg)
1: Identify Goals
What are you trying to achieve?
Organisation level
What are your business drivers?
What is your IT strategy?
What is the state of health?
Project level
What problems are you trying to address?
Symptoms? Root causes?
©2010 TMMi Foundation 17
![Page 18: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/18.jpg)
©2010 TMMi Foundation
2: Business Case & Plan
Where are we now?
Plan a TMMi-based assessment
Where do we want to be?
Align TMMi implementation with goals
What do we need to get there?
What resources do we need? Costs?
What benefits will be achieved?
Consider financial and “soft” benefits
18
![Page 19: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/19.jpg)
©2010 TMMi Foundation
3: Identify Stakeholders
Who does this impact?
Change is painful
Whose support is required?
Funding & change champion
Are the goals aligned?
Own and stakeholders needs?
19
![Page 20: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/20.jpg)
©2010 TMMi Foundation
4: Establish Priorities
Complete an informal assessment
Sample actual projects
Report strengths and weaknesses
Establish priorities
Aligned with goals
Consolidate strengths & address weaknesses
Identify quick wins and longer term actions
Create plan with task owners, deadlines, etc
20
![Page 21: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/21.jpg)
©2010 TMMi Foundation
5: Implement & Monitor Plan
Agree the plan: sponsor & stakeholders
Ensure you have support for change
Implement the plan
Monitor progress
Celebrate successes – encourages change
Take corrective action for issues
Monitor “earned value”
Build ongoing support current & future change
21
![Page 22: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/22.jpg)
Managing Change - Negative
22©2010 TMMi Foundation
![Page 23: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/23.jpg)
Managing Change - Positive
23©2010 TMMi Foundation
![Page 24: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/24.jpg)
Example: Test Planning
24©2010 TMMi Foundation
![Page 25: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/25.jpg)
Why TMMi makes business sense
Benefits of using TMMi
©2010 TMMi Foundation 25
![Page 26: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/26.jpg)
©2010 TMMi Foundation 26
Benefits of using TMMi
Open independent standard
Focus on good practice in context
Applies regardless of delivery methods
Applies in most industry contexts
Designed for ease of implementation
Engaging sponsors & stakeholders
Establishing scope & business case
Implementing prioritised change
![Page 27: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/27.jpg)
Business benefits
Benefits indicated by field experience
Ability to plan and estimate costs consistently
Reduced cost of delivery
Ability to reduce cost of supplier contracts
Improved productivity
Improved quality of delivery
Improved customer satisfaction
Ability to plan further targeted improvements
©2010 TMMi Foundation 27
![Page 28: Andrew Goslin - TMMi, What is Not in the Text Book - EuroSTAR 2010](https://reader031.vdocuments.net/reader031/viewer/2022020306/5593159e1a28abdb5f8b4610/html5/thumbnails/28.jpg)
Questions?
Information? www.tmmifoundation.org
Resources? www.tmmifoundation.org/resources
©2010 TMMi Foundation 28