exploratory testing as a quest

34
Exploratory Testing Exploratory Testing enjoy the Quest enjoy the Quest Exploratory Testing Class Meeting #1

Upload: chrishoneybee

Post on 24-May-2015

1.029 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Exploratory Testing As A Quest

Exploratory TestingExploratory Testing……enjoy the Questenjoy the Quest

Exploratory Testing Class Meeting #1

Page 2: Exploratory Testing As A Quest

DefinitionExploratory testing is simultaneous learning, test design and test execution

Unlike the scripted testing, here the tester actively controls the design of the tests as those tests are performed, and uses information gained while testing to design new and better tests.

Page 3: Exploratory Testing As A Quest

Ad-hoc vs Exploratory

Exploratory means:

thoughtfulfocuseddisciplined accurate

“accomplishing mission”

Ad-hoc sounds like:

randomchaoticuncontrollablecareless

“wandering around”

Page 4: Exploratory Testing As A Quest

Exploratory testing is a Quest

Think of any Quest game you ever played.You have a mission, and a set of tools to accomplish it.You have no idea on what’s going to happen next.But all your further steps will depend on that.

It is not easy to solve Quests, it requires logical thinking, observation, accuracy and lot of patience sometimes...

Page 5: Exploratory Testing As A Quest

Before we start our class…

Is that possible to learn being a better explorer?Is that possible to learn being a better Quest-solver?

Yes.But not through THEORY. The only way is PRACTICE.

Page 6: Exploratory Testing As A Quest

Structure

Tester Mission

Product

ET

Time

[Quest]

+ Reporting!

Page 7: Exploratory Testing As A Quest

Test design. The ideas.

Exploratory tester designs tests ‘on the fly’. Instead of randomly clicking he first thinks of possible tests. Tests for systematical exploration of the product.

Quest player has many-many steps and combinations he may try. But experienced player knows immediately which of them have sense in the current situation.

Page 8: Exploratory Testing As A Quest

Authorization functionality

Ability to design tests is predicting what may go wrong and selecting strong test data to check it

Page 9: Exploratory Testing As A Quest

Test idea

How about trying to pass some invalid data, looking as valid?..

Page 10: Exploratory Testing As A Quest

Test data

How about trying to pass some invalid data, looking as valid?..

Page 11: Exploratory Testing As A Quest

Test case

How about trying to pass some invalid data, looking as valid?..

Page 12: Exploratory Testing As A Quest

Success!Bug in security system!

Page 13: Exploratory Testing As A Quest

Observation. Details matter.

Exploratory tester is always looking for symptoms. Anything unusual may mean a problem.

Quest player starts every new screen from observation. Every clickable item may help him in resolving the puzzle. Even the tiniest detail is crucial here.

Page 14: Exploratory Testing As A Quest

For the novice player this screen doesn’t say much. The only way is go clicking here and there…

Page 15: Exploratory Testing As A Quest

But an expert will notice important details (even the smallest once) right away!

Page 16: Exploratory Testing As A Quest

Moreover, expert player will notice interesting connections between things...

Page 17: Exploratory Testing As A Quest

Critical thinking.

Exploratory tester should be able to review and explain his logic, looking for errors in his own thinking.

Quest player bases his strategy on assumptions and ideas. But when he gets stuck he has to re-think his ideas to be able to move on.

Page 18: Exploratory Testing As A Quest

Sometimes to go forward you must go back first.

I must have missed something...???

Page 19: Exploratory Testing As A Quest

Diverse ideas.

Exploratory tester needs to produce many testing ideas, easily use diverse testing techniques.

Quest tasks are rarely obvious, so the player should be quite creative and inventive to solve them and find the right way between many available.

Page 20: Exploratory Testing As A Quest

Every problem usually has many possible solutions

How can I get that bird?

Page 21: Exploratory Testing As A Quest

Similarly – there are always plenty of test cases you might think of…

1 – try throwing something to hit it!

Page 22: Exploratory Testing As A Quest

Similarly – there are always plenty of test cases you might think of…

2 – try getting the ladder …

Page 23: Exploratory Testing As A Quest

Similarly – there are always plenty of test cases you might think of…

3 – use cable as a lasso …

Page 24: Exploratory Testing As A Quest

Similarly – there are always plenty of test cases you might think of…

4 – get some bird food …

Page 25: Exploratory Testing As A Quest

Similarly – there are always plenty of test cases you might think of…

5, 6, 7,… – your ideas?

Page 26: Exploratory Testing As A Quest

Rich resources.

Excellent exploratory testers build a deep inventory of tools, information sources, test data and friends to draw upon.

Query player might consider using external resources to get his mission completed: hints, walks through, other players advises.

Page 27: Exploratory Testing As A Quest

Your testing won’t be effective if you’re not prepared well enough...

I know nothing about botany…

Page 28: Exploratory Testing As A Quest

Go get some spec. Talk to those who have information. Prepare some tools.

spec

tools

Page 29: Exploratory Testing As A Quest

Finally, go GOOGLE it.

Page 30: Exploratory Testing As A Quest

ET Basics

Test DesignObservationCritical thinkingDiverse ideasRich Resources

Focus on the Mission

Page 31: Exploratory Testing As A Quest

Scripted vs ExploratoryWhich is better?

predictablerepeatableeasier to executeeasier to reporteasier to measure

time-taking preparation

not very flexible

flexiblerapidmay be very

effectiveresult-oriented

harder to trainharder to control

Page 32: Exploratory Testing As A Quest

Scripted vs ExploratoryWhich is better?

Depends on the context.

…but as long as your task looks like Quest the best option is to become an explorer ;)

Page 33: Exploratory Testing As A Quest

ReferencesWhat is Exploratory testing and how it differs from Scripted testing? (HTML)

Exploratory testing explained (PDF)

Exploratory testing dynamics (PDF)

Page 34: Exploratory Testing As A Quest

p.s.

I used screens from the brilliant Quest game called Machinarium. Find out more here: http://machinarium.net