agile testing

This work is licensed under the Creative Commons Attribution-NoDerivs 3.0 Unported License. To view a copy of this license,

visit http://creativecommons.org/licenses/by-nd/3.0/.

Its not Manual or Automated

Its Sapient....

@charrett



• Boring

• Repetitive

• Unskilled

• Anyone can do it

Manual Testing



• Automated Testing

• Unit Tests

• Integrated Tests

• BDD or ATDD

• System GUI Testing

Automated Testing



Sapient Testing

• Modelling

• Observation

• Asking Useful Questions

• Logical Reasoning

• Process of Discovery

http://www.satisfice.com/blog/archives/99





Sapient Testing

• A/B Testing

• Lean Startup Business Model

• Software Testing

• Big Data



Big Trak

is back........



• CM : Clear Memory

• Forward: 1 or 2 digit number e.g 10

• Back : 1 or 2 digit number

• Rotate Left: 1 or 2 digit number e.g 15

• Rotate Right 1 or 2 digit number e.g 15

• Fire: 1 or 2 digit number

• Go: Executes the program

Commands



Challenge • Formulate hypothesis, design, run and interpret

experiments that bear on their hypothesis

• Write a series of programs and observe the devices behaviour, relate the outcome of their experiments to their hypothesis

• Terminate the process when the new rule or principle has been discovered

• Verbalise your ideas within your team



Reporters & ObserversReporters

• Remind teams at the start to use the CM at the start of each experiment

• Note hypothesis, program, prediction and behaviour of each experiment

Observers

• Note Process of Discovery

• How do they approach the exercise

• Team work, how breakthroughs happen, Insights



What does x2 do? • x2 is also known as the repeat key

• x2 requires a numeric parameter (n).

• x2 can only be used once in a program

• x2 has no effect on instructions following its location in the program



What does X2 do?

One repeat of the last n steps



Possible Hypothesis• N repeats of the entire program

• N repeats of the last step

• One repeat of the first n steps

• One repeat of the nth step

• One repeat of the entire program

• One repeat of the last step



Observations



Exploring Science• Tests can be easy to construct and easily observable, but

don’t offer much information.

• Knowing where to look & Understand what is seen

• Experimental design: design of experimental and observational procedures

• Hypothesis formation: formation and evaluation of theory

• Confirmation Bias: “Tendency for people to seek evidence to verify their hypothesis rather than refute them”



Science & Testing• Testing is more about acquiring information than pass/fail

• Testing like experiments requires good test design

• Watch out for Confirmation Bias

• Testing requires we ask useful questions, challenge assumptions

• Testing is about thinking critically



Sapient Testing• Offers thoughtful test design in ANY testing

• Automated Checking good for confirmation

• Exploratory Testing allows us to investigate the product

• Focus on Testability rather than large automated regression suites

• Testability in creating test data

• Helping to recognise problems



Thanks! • Exploring Science - David Klahr

• Science == Testing - James Bach

• Feedback

• mavericktester.com

• exploratory testing class on 4th feb next year

• @charrett

agile testing

Technology