Download - A taste of Exploratory Testing
![Page 1: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/1.jpg)
copyright ©TestingTimes 2013
A TASTE OF EXPLORATORY TESTING
Anne-Marie Charrett@charrett
Skype: Charretts Blog: Mavericktester.com
This work is licensed under the Creative Commons Attribution-NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.
![Page 2: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/2.jpg)
copyright ©TestingTimes 2013
A LONG TIME AGO...
![Page 3: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/3.jpg)
copyright ©TestingTimes 2013
CHALLENGES
• Did the program run?
• Where the punch cards correct? (Source Code)
• Was the data correct ?
• Was the compiler correct? (Program Code)
• Did the program solve the problem?
![Page 4: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/4.jpg)
copyright ©TestingTimes 2013
Test Strategy Test Spec Test Execution
Analysis
Documents/Code
Design Testing
Activities
SCRIPTED TESTING
Test Report
Strategy
Modelling
Decision Making
ModellingConfiguration
OperationObservationEvaluation
Configuration
Reporting
OperationObservationEvaluation Communicationcopyright ©TestingTimes 2013
![Page 5: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/5.jpg)
copyright ©TestingTimes 2013
LEGACY
Requires a tester to be able to:
Often has formalised methodology based on IEEE829
Design Test Scripts upfront against Requirements
Requires Experienced Test Analyst Vs Tester
Indicate Expected Result upfront
Complete when 100% Test Executed
![Page 6: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/6.jpg)
copyright ©TestingTimes 2013
PROGRESS
![Page 7: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/7.jpg)
copyright ©TestingTimes 2013
HOW WE DISCOVER
![Page 8: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/8.jpg)
copyright ©TestingTimes 2013
“Exploratory testing is an approach to software testing that is concisely described as simultaneous learning, test design and
test execution.” Cem Kaner
“The plainest definition of exploratory testing is test design and test execution at the same time.” J. Bach
![Page 9: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/9.jpg)
copyright ©TestingTimes 2013
Activities
EXPLORATORY TESTING
Modelling
Decision Making
Configuration
Operation
Observation
Evaluation
Learning
Testing
Design
Strategy
![Page 10: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/10.jpg)
copyright ©TestingTimes 2013
TESTER CENTRIC
DesignTesting
Learning
AutodidacticSelf Awareness
AutonomyCourage
Mental Engagement
![Page 11: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/11.jpg)
• Download iHandy Coin Flip Free from Appstore
• Download iHandy Coin Flip Free from GooglePlay
TEST COIN FLIP FREE
Any Questions?
copyright ©TestingTimes 2013
![Page 12: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/12.jpg)
copyright ©TestingTimes 2013
DISCUSSION
![Page 13: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/13.jpg)
BUGS • flipping phone goes to adds
• coin changes automatically
• coin flip has pre Vibrate on Android is not working
• Flick Upward works when disabled
• there is no instruction screen, instruction menu or help text which I would normally expect (comparable product)
• flip the coin 20 times in a row. 18 out of 20 resulted in heads. Doesn't feel like random distribution...
• Screen Size not scalable
• Rapid Tapping makes it crash (Android)
• Windows 8 touch screen problems.
• Doesn’t support Android 2.2 (Download page says it should)
![Page 14: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/14.jpg)
copyright ©TestingTimes 2013
WHAT DID YOU DO?
• Played around
• Tried out different things
• Figured out how it worked
• Saw something unusual - looked more
• Read up the information (on Website)
• Compared your findings SP
ONTANEO
US TEST
ING
--- James Bach & Michael Bolton - Rapid Software Testing
![Page 15: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/15.jpg)
copyright ©TestingTimes 2013
“If you are not using the learning garnered from test
design and test execution in a continuous and rapid loop to
optimize the quality of the work, you are not doing
exploratory testing”
--Michael Bolton
![Page 16: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/16.jpg)
copyright ©TestingTimes 2013
DELIBERATIVE TESTING
• Scripting in your head
• Requires considered response to testing
• Requires awareness of your approach
• May require use of tools or setting up of test data
• May require extensive investigation
--- James Bach & Michael Bolton - Rapid Software Testing
![Page 17: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/17.jpg)
copyright ©TestingTimes 2013
Heuristics
A heuristic is a fallible method of solving a problem or making a decision.
• Requires Skill
• Context Dependent
• Less Visible
HEURISTICS
The essence of heuristics: http://www.satisfice.com/blog/archives/462
![Page 18: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/18.jpg)
copyright ©TestingTimes 2013
GROCERY SHOPPING
You are purchasing three items at the store, at these prices:
• $19.95
• $39.98
• $29.97
About how much money are you spending?
![Page 19: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/19.jpg)
copyright ©TestingTimes 2013
HEURISTICS
The fastest way to solve this problem is to round off and approximate. The first item costs about $20, the second about $40, and the third about $30; therefore, you are spending about $90 on your shopping spree.
Rounding is often an excellent heuristic for arriving quickly at approximate answers to mathematical problems.
![Page 20: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/20.jpg)
copyright ©TestingTimes 2013
MENTAL ENGAGEMENT
• Alternation
• Branching and BackTracking
• Embrace Distraction
• Jump in & Play
• Focus & Defocus --- James Bach & Michael Bolton - Rapid Software Testing
![Page 21: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/21.jpg)
copyright ©TestingTimes 2013
EXPLORATORY TESTING HEURISTICS
• FEW HICCUPS (Ways to Recognise Bugs) - Michael Bolton
• SFDIPOT (Ways to Model and generate test ideas) - James Bach
• Heuristic Test Strategy Model - James Bach
• http://www.qualityperspectives.ca/resources_mnemonics.html
![Page 22: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/22.jpg)
copyright ©TestingTimes 2013
MANY WAYS OF ET
• Many different ways to use exploratory testing
• Mix level of documentation
• Mix level of reporting
• Mix level of learning
• Mix level of test design
• Mix level of testability
![Page 23: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/23.jpg)
copyright ©TestingTimes 2013
• elements of design, execution, interpretation, and learning are performed by the same person;
• the design, execution, interpretation, and learning happen together, rather than being separated in time;
• the tester is making her own choices about what to test, when to test it, and how to test it—the tester may use any automation or tools in support of her testing, or none at all, as she sees fit;
• everything that has been learned so far, including the result of the last test, informs the tester’s choices about the next test;
• the tester is focused on revealing new information, rather than confirming existing knowledge about the product;
• in general, the tester is varying aspects of her tests rather than repeating them, except where the repeating aspects of the test are intended to support the discovery of new information.
Michael Bolton - Evolving Understanding of Exploratory Testing
SUMMARY
![Page 24: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/24.jpg)
copyright ©TestingTimes 2013
FURTHER READING
• Exploratory Skills and Dynamics
• http://www.developsense.com/resources.html
• Heuristic Test Strategy Model
• Test Heuristics Cheat Sheet Elisabeth Hendrickson's
• You Are Not Done Yet Michael Hunter's Coverage
![Page 25: A taste of Exploratory Testing](https://reader033.vdocuments.net/reader033/viewer/2022052602/554bdc0ab4c9058f6c8b5641/html5/thumbnails/25.jpg)
copyright ©TestingTimes 2013
QUESTIONS?