exploratory testing workshop
DESCRIPTION
A talk I gave on exploratory testing using a Lego Robot.TRANSCRIPT
Exploratory Testing Workshop
Name: Anne-Marie CharrettE-mail: [email protected]: www.testingtimes.iePhone: 085 289 6263
Parts of this class have been excerpted from: •Rapid Software Testing, by James Bach, [email protected]•Black Box Software Testing, by Cem Kaner, [email protected]
3
Exploratory testing is an approach to software testing ….
described as
• simultaneous learning, • test design • and test execution.
tester's responsibility for managing his or her time
cognitive engagement of the tester
Exercise
Skeptical
Tester Mindset
Curious
Observant
CommunicationSelf Management
Tunnel Vision Trap
Bias limits the
number of bugs you
find
Diversify your strategy
What is your mission?
Who are your stakeholders?
Context Trap
Quantity Trap
Too Little
Just Right
Too Much
Generic Risk ListComplex Anything disporportionality large, intricate or convolutedNew Anything that has no history in the productChanged Anything that has been tampered or "improved"Upsteam Dependency Anything whose failure will cause cascading failures in the rest of the systemDownstream Dependency Anything that is especially sensitive to failures in the rest of the systemCritical Anything whose failure could cause substantial damagePrecise Anything that must meet requirements exactlyStrategic Anything that has special importance to your business, such as a feature that sets you apart from the competitionThird-Party Anything used in the product, but developed outside of the projectDistributed Anything spread out in time or space, yet whose elements must work togetherBuggy Anything known to have lots of problemsRecent Failure Anything with a recent history of failure
Focus
Tilted Twister
• This is a mind storm Tilted Twister• It solves Rubix Cubes • It consists of software and hardware• I will be video recording this • I want you to use exploratory testing to test it
Mission: Tilted Twister Data
• Project Manager: A client requested a rubix cube solver, the developers gone on holiday. I want you to test this, before the client turns up.
• Find Top 5 Issues in the next 20 mins• Any questions?
Turbo Twister Instructions
• Orange Button = Select • Light Grey Buttons – Move through options• Dark Grey – Back or Exit • My Files->Software Files->Tilted Twister
Problems Found
• Cannot detect colour differences• Motor arm overshoots• Hard to know how to turn it on• Calibration Rubix cube is too big• Takes to long to work out solution & then runs
out of memory
Debrief
• What was your mission?• What problems did you find?• How did you know they were problems?• How did you find them?• What questions did you ask?• Can you report credibly?• Did you need more time?
• Need Exploratory Testing and Automation
• Developer needs to adapt & learn tester mindset for:– TDD– Unit Testing
• ET thinking in developing automated tests.
• Exploratory Testers need Testability
20
Tips & Tricks To Test Effectively
• Know your mission, stakeholders• Too much, Too little, Just Right• Focus – Defocus• Boundary Testing• Pair Testing • Scenario Testing• Negative Testing• Caricatures
Follow up
• Mind Map of Heuristics• Hand Out • Email me: [email protected]• FREE Online Coaching – skype: charretts