how to apply lean test management' by bob van de burgt
DESCRIPTION
Cost reductions and the quest for more efficiency are more evident in today’s business world. It also follows that our testing processes will ultimately be affected. When test techniques and methods for structured testing are introduced, this results in improvements in the production of more consistent and predictable results. Introducing a risk based approach to testing makes it easier for the business to determine to what extent testing is necessary and most efficient. The resulting Go/No- Go decision process may not be sufficient for all companies so other creative methods need to be investigated. Many management theories speak about “Lean” as being one of the solutions. One of the key steps in using “Lean” is the identification of which steps add value to the customer and which do not. This track will give you information to start using “Lean” within testing and more specifically within test management. The presenter will also look at Lean Six Sigma as being one of the more popular theories that introduces the concept of “Lean” in combination with obtaining higher quality products. This subject will also be explained in combination with testing and test management. This track will focus on applying Lean Six Sigma techniques to test management processes using practical examples from customer cases. The audience can take home a practical “Lean Test Management” overview which they can apply in their own companies. This track is especially of interest to business managers, IT managers, QA managers and test managers that are involved in improving the quality of test management processes.TRANSCRIPT
![Page 1: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/1.jpg)
How To Apply Lean Test Management
Bob van de Burgt Professional Testing®
Ban Waste,Gain Efficiency
1
![Page 2: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/2.jpg)
I will show you differently!
2
![Page 3: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/3.jpg)
- Lean Manufacturing
- Lean Six Sigma
- Roadmap to Lean Test Management
- Conclusions
Agenda
3
![Page 4: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/4.jpg)
What is Lean Manufacturing?
• Lean manufacturing is a company process improvement method. It is developed from a logistics viewpoint.
• Lean manufacturing concentrates on banning waste to become quicker and more efficient. Every process that does not add value for the customer is eliminated.
4
![Page 5: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/5.jpg)
History Timeline Lean Manufacturing
Image source = © 2005 Strategos, inc5
![Page 6: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/6.jpg)
Lean Manufacturing – the 7 wastes
• Overproduction• Waiting• Transporting• Inappropriate processing• Unnecessary inventory• Unnecessary / excess motion• Defects
6
![Page 7: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/7.jpg)
What is (Lean) Six Sigma
• Lean Six Sigma is a quality management method that offers a framework to manage quality. By many it is seen as a sequence of Total Quality Management (TQM) with a high use of Statistical Process Control (SPC) as underlying method. Processes can be controled when you know how each process goes and to know that you have to measure: to measure is to know! Measuring is the basis of Six Sigma.
• The aim is to work smarter and get a higher quality.
• Sigma (∂) is the standard deviation from the average. A statistical term that measures how far a given process deviates from perfection.
7
![Page 8: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/8.jpg)
History of Six Sigma
• Six Sigma is founded at Motorola in the mid 80’s as a solution for problems with product quality and customer satisfaction. Six Sigma got its big popularity when it was used on a broad scale at General Electric and gained billions over a period of multiple years.
8
![Page 9: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/9.jpg)
Defects with sigma level 2
-3 σ -2 σ -1 σ 3 σ2 σ1 σ0=target
σσ
MAX
2 σ = 69,1%
defe
cts defects
30,9 % defects
9
![Page 10: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/10.jpg)
Defects with sigma level 4
-3 σ -2 σ -2 σ 3 σ2 σ2 σ0=target
σσ
MAXde
fect
s defects
4 σ = 99,4%
0,6 % defects
10
![Page 11: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/11.jpg)
4 key elements
• Delight the customer• Improve processes• Teamwork• Data and facts
11
![Page 12: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/12.jpg)
• DMAIC:– Define– Measure– Analyze– Improve– Control
– Between every step is a tollgate
Roadmap to Lean Test Management
12
![Page 13: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/13.jpg)
• Purpose: To agree on what the project is.
• Example tools:– SIPOC– Value Stream Map
Define - Theory
Define
13
![Page 14: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/14.jpg)
Define – Example SIPOC
* Critical-To-Quality indicators (CTQ)
14
![Page 15: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/15.jpg)
Define – Example Value Stream Map
ETC
15
![Page 16: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/16.jpg)
Takt time
• Definition Takt Time: The desired time between units of production
output, synchronized to customer demand.
• The concept carries backward through a process stream. Ideally, every step synchronizes with the final output. Takt Time is fundamental to Lean Manufacturing.
16
![Page 17: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/17.jpg)
Takt time – a bomber an hour
Image source = © 2005 Strategos, inc17
![Page 18: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/18.jpg)
Measure - Theory
• Purpose: Evaluate the existing measurement
system, observe the process, gather data, and map the process in more depth.
• Example tool:– Pareto chart
18
![Page 19: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/19.jpg)
Measure – Example Pareto Chart
Pareto chart for long waiting hours during test execution
Failures in test environment 65Failures in test data 20Failures in test cases 8Not fully capable resources 5Rest 2
100
19
![Page 20: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/20.jpg)
• Purpose: Use collected data to confirm
the source of delays, waste, and poor quality.
• Example tools: – 5 Why’s– Ishikawa diagram
Analyze - Theory
20
![Page 21: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/21.jpg)
Analyze - Example 5 Why’s
Problem Statement:During test execution there
are long waiting hours.
1. Why are there long waiting hours
during test execution?
1. Because often there are failures in
the test environment
2. Why are there failures in the test
environment?
2. Because we often seem to have the wrong version of the test object.
3. Why do we often have the wrong
version?
3. Because someone installed the wrong version.
4. Why does someone install the
wrong version?
4. Because we don’t have proper version
control.5. Why don’t we have proper
version control?
5. Because we never got around to it, but it seems time to do it now. 21
![Page 22: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/22.jpg)
Analyze - Example Ishikawa Diagram
Long waiting hours during test execution
22
![Page 23: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/23.jpg)
• Purpose:To make changes in a process that eliminate defects, waste, cost, etc., which are linked to the customer need identified inthe Define phase.
• Example tool:– Pick chart
Improve - Theory
23
![Page 24: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/24.jpg)
Improve – Example Pick Chart
Implement Possible
Challenge Kill
Easy to implement
Hard to implement
Large result
Small result
1 7
4
8
2
3
69
5
24
![Page 25: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/25.jpg)
Control - Theory
• Purpose:To make sure that any gainsa team makes last.
• Example tool:– Control chart
25
![Page 26: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/26.jpg)
Control – Example Control Chart
Gain Sigma level
30,85% 1
69,15% 2
93,32% 3
99,38% 4
99,977% 5
99,99966% 6
AverageUpper limit
Lower limit
Triggers for actions
Unpredictable proces
Improved proces
Controlled proces
T3T1 T2
26
![Page 27: How To Apply Lean Test Management' by Bob van de Burgt](https://reader033.vdocuments.net/reader033/viewer/2022061121/546f17afaf79593c0d8b66e0/html5/thumbnails/27.jpg)
Conclusions
• Test Management can benefit from Lean and Six Sigma
• Improvement from within your company
• Useful addition to “standard” Test Process Improvement models
• Better integration of test process with other processes
27