Download - Introduction to bugs measurement
![Page 1: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/1.jpg)
Introduction to Bugs Measurement
by V. Novostavsky
![Page 2: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/2.jpg)
Yes, it’s about metrics
![Page 3: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/3.jpg)
TOC
• What we’re talking about• Why it's good, and when it’s evil• “Easy way”
![Page 4: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/4.jpg)
Definition
• Distance function– from “anything” to numbers :)
![Page 5: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/5.jpg)
Metrics in life: School
![Page 6: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/6.jpg)
Metrics in life: Traders
![Page 7: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/7.jpg)
Metrics in life: dou.ua
![Page 8: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/8.jpg)
… in testing
– Usually we measure bugs• because there’re a lot of bugs
We can measure barely anything in testing, but that’s another story…
![Page 9: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/9.jpg)
… in testing
– Number of open bugs– Bugs per module– Bugs reopened– Bugs posted in a week– Bugs rejected / accepted – A lot of other stuff…
![Page 10: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/10.jpg)
… in testing
– Number of open bugs– Bugs per module– Bugs reopened– Bugs posted in a week– Bugs rejected / accepted – A lot of other stuff…
![Page 11: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/11.jpg)
Why it's important
• tester's job is info support for the project
![Page 12: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/12.jpg)
Why it's important
• tester's job is info support for the project• more and diverse info -> better conclusions ->
easier decisions
![Page 13: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/13.jpg)
Why it's important
• tester's job is info support for the project• more and diverse info -> better conclusions ->
easier decisions• metrics are facts, operate with facts, not blah-
blah-blah
![Page 14: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/14.jpg)
Why it's important
• tester's job is info support for the project• more and diverse info -> better conclusions ->
easier decisions• metrics are facts, operate with facts, not blah-
blah-blah• example: “big” manager
![Page 15: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/15.jpg)
Why it's important
• tester's job is info support for the project• more and diverse info -> better conclusions ->
easier decisions• metrics are facts, operate with facts, not blah-
blah-blah• example: “big” manager
• NOTE: don't judge too quickly!
![Page 16: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/16.jpg)
Example
500 open bugs this week… A lot of?
![Page 17: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/17.jpg)
Example
![Page 18: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/18.jpg)
Example
More bugs in a module… Does it mean it’s worse?
![Page 19: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/19.jpg)
Example
![Page 20: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/20.jpg)
Example
Less bugs this week… Is it good?
![Page 21: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/21.jpg)
Example
![Page 22: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/22.jpg)
Top issues
![Page 23: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/23.jpg)
Top issues
• time waste!
![Page 24: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/24.jpg)
Top issues
• time waste!
• wrong conclusions and politics!
![Page 25: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/25.jpg)
Top issues
• time waste! make it easier to generate metrics
• wrong conclusions and politics!
![Page 26: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/26.jpg)
Top issues
• time waste! make it easier to generate metrics
• wrong conclusions and politics!make it clear what they mean
![Page 27: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/27.jpg)
“Easy way”
• Step 1: choose correct metrics for you
![Page 28: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/28.jpg)
“Easy way”
• Step 1: choose correct metrics for you– Not so easy!
![Page 29: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/29.jpg)
“Easy way”
• Step 2: ensure everybody gets what they mean
![Page 30: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/30.jpg)
“Easy way”
• Step 3: automate them (+ use SQL)
![Page 31: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/31.jpg)
“Easy way”
• Step 4: be prepared for change requests
![Page 32: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/32.jpg)
“Easy way”
• Step 5: use often
![Page 33: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/33.jpg)
“Easy way”
• Step 6: publish online
![Page 34: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/34.jpg)
“Easy way”
• Step 6: publish online– Publish charts!
![Page 35: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/35.jpg)
“Easy way”
1. choose correct metrics for you2. ensure everybody gets what they mean3. automate them4. be prepared for change requests5. use regularly6. publish online
![Page 36: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/36.jpg)
Example: my metrics
• No classic test cases & project is not big– Bug metrics only
• Custom bugtracker– No access to DB
• 2 metrics - weekly– Open bugs: Trend in time– Open bugs: By modules
![Page 37: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/37.jpg)
Example: tools
• MS XLS –> MS SQL
![Page 38: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/38.jpg)
Example: tools
• MS XLS –> MS SQL
• Google Docs
![Page 39: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/39.jpg)
Example: my trender
![Page 40: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/40.jpg)
Example: my rollup
![Page 41: Introduction to bugs measurement](https://reader033.vdocuments.net/reader033/viewer/2022061223/54c5d8af4a7959b8548b4616/html5/thumbnails/41.jpg)
Thanks!
Q & A