passionate dating for testers (and vice versa)

47
Passionate Dating for Testers (and vice versa) René Tuinhout

Upload: test-huddle

Post on 16-Apr-2017

554 views

Category:

Software


3 download

TRANSCRIPT

Page 1: Passionate Dating for Testers (and Vice Versa)

Passionate Dating for Testers(and vice versa)

René Tuinhout

Page 2: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.comwww.eurostarconferences.com

Passionate datingfor testers

and vice versa

René Tuinhouthttp://www.linkedin.com/in/renetuinhout+31 (0)6 295 285 10

Page 3: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Program

Page 4: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Intermezzo – Webinar

“Please raise your hand (if you agree/fit the catagory)”

“Please answer the poll”

Page 5: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Program

Page 6: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Program

Page 7: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

B3VA…

René Tuinhout

• Test analyst / test engineer → test coordinator → test manager / test advisor / practice lead / tutor

Introductions

Page 8: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Male?Female?In a relationship?In Testing?Not in a relationship?In Management?Not in Testing?So, who are you?

Page 9: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

“Are you a successful tester? Join this track and discover how to use your testing skills for Passion.

Are you a successful dater? Join this track and discover how to use your passionate skills for Testing.”

Combining (testing) techniquesand passion

Shine a different light on testing techniques and other testing skills, reiterating why testing is so important

Page 10: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Techniques

Page 11: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

White box or black box?• White box testing

• Black box testing

Input Output

Input Output

Page 12: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

1. Equivalence partitioning2. Boundary value analysis3. Decision tables

(Cause effect graphing)4. State Transition testing5. Process test6. AB testing, Agile, Pair-wise ( 7. End result

)

Page 13: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Equivalence partitioning (1/2)• Divide inputs (outputs) into groups that are

expected to exhibit similar behaviour (valid/invalid)• Test one value per group (class)

=> A partition can be represented by 1 value• Test for valid & invalid classes ???

Gender

+ -

=> Coverage!

Page 14: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Equivalence partitioning (2/2)• Several classes can be tested• Combine valid classes. Do not combine invalid classes

Gender

Legal age

+ -

+ -

Page 15: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Boundary value analysis• Behaviour at the boundaries of an equivalance class

often more interesting• For each boundary, test the value itself, the value nearest to its

right and the value nearest to its left (granularity)4241 4330 46

Legal age

+ -

http://www.thelocal.se/16116/20081204/ “Swedish study shows women prefer older men”

Page 16: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Decision tables (1/4)• So, what other demands are there?• Please raise your hand, we’ll

select some of you and switchon your audio

Page 17: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Decision tables (2/4)• Find conditions => We did!

• Find actions

• Put them in a table

• Mutually exclusiveness (e.g. “rich” vs “poor”)

• Phrase positive (without “not”)

Did we cover this?

... Hmm... “Select as partner”?

Page 18: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Decision tables (3/4)• So let’s make the decision table:

• How many columns(= test cases or test conditions?)

Condition 1

Condition …

Condition x

Action 1

Impossible c.com

No action

Y Y Y Y N N N N

Y Y N N Y Y N N

Y N Y N Y N Y N

=> 2number or conditions

Page 19: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Decision tables (4/4)

MoSCoWMustShouldCouldWould

• So: X conditions = 2x tests

• That´s quite a lot of tests to do...• Could we reduce the nr. of tests?

Page 20: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Test types (ISO 9126)• Portability• Efficiency• Reliability• Functionality• Usability• Maintainability

e

[PERFUMe]

- Willing to move?- Stress proof?- Reliable?- ...- Don’t dare- €€€

Page 21: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Intermezzo• ISO 9126 -> ISO 25010

Software quality characteristics

Product quality

C, PERFUMeS!● Effectiveness

● Efficiency

● Satisfaction

● Freedom of risk

● Context coverage

FECES● Functional Suitability● Performance Efficiency● Compatibility● Usability● Reliability● Security● Maintainability● Portability

C, PERFUMeS!● Effectiveness● Efficiency● Satisfaction● Freedom of risk● Context coverage

Quality in use

Page 22: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

State transition testing (1/3)Remember this technique?

Represent timeLoud, annoying beep

Current time = Alarm setGo to beeping

Countdown 9 minutes

Snooze hitCountdown Countdown = 0

Go to beeping

Press R-buttonGo to time

Current time = Alarm setGo to beeping

Snooze hitCountdown Countdown = 0

Go to beeping

Press R-buttonGo to time

Page 23: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

State transition testing (2/3)Chow’s coverage (switch coverage)

Represent timeLoud, annoying beep

Current time = Alarm setGo to beeping

Countdown 9 minutes

Snooze hitCountdown Countdown = 0

Go to beeping

Press R-buttonGo to time

Current time = Alarm set

Snooze hitCountdown = 0

Press R-button

• 0-switch coverage covers every transition (no switches)

• 1-switch coverage covers every pairof transitions (1 sw.)

• 2-switch coverage covers every 3-setof transitions

• n-switch coverage covers every (n+1)-set of transitions

Page 24: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

State transition testing (3/3)So, what states exist regarding partnering?

Young and single and happy

Older and single and less

happy

Life

Older and single and

happy!

Older and single and unhappy

Older and relationship and happy

Older and relationship and

unhappy

Life Life LifeLife Life

Life

Life

Life

Life

LifeLife

Life

Life

Not a suitable technique

LifeLife

Page 25: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Process testing

Not a suitable technique

http://www.godembassy.com/main/pastor-sunday-adelaja/item/709-life-is-predictable.html regarding the book shownhttps://en.wikipedia.org/wiki/Determinism on Determinism

Page 26: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Some other techniques (1/4)

• AB-testing:• Compare two possible solutions

• Choose the best• Repeat every few years

Page 27: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Some other techniques (2/4)• Agile

• Work in teams...

1. Satisfy the customer2. Welcome change3. Make it work fast4. Work together5. Motivated, trusted people6. Conversations

7. It works = progress8. Constant pace (stress)9. Attention to good

design10. Simplicity11. Self-organising12. Reflect and improve

Page 28: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Some other techniques (3/4)• Pair-wise testing

• For all pairs test all possiblecombinations...

• “Bugs involving interactions between three or more parameters are progressively less common”

• Can be extrapolated to triples, fours etc.

Page 29: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Some other techniques (4/4)• Error guessing (Fault attack)

• So, what could go wrong?...• And if I know: Let’s test that!!!

So...o It could fail when I cook good food...o Testo Learn (it doesn’t fail!)o It could fail when I cheato Testo Learn

Page 30: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Short summary so far• In daily life, we could use:

• Equivalence partioning• Boundary value analysis• Decision tables• Some non-functional testingin partner selection

• Using:• State transition testing• Process testing• AB-testing• Pair wise testing• Agile• Error guessingis less recommendable

Page 31: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• Exploratory testing:

• Test, and work from there• Other techniques can be used

Page 32: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• Exploratory testing:

• Test, and work from there• Other techniques can be used

Page 33: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• Exploratory testing:

• Test, and work from there• Other techniques can be used

Humorous Y Y Y Y Y Y Y Y Y Y Y Y Y .

A bit cynical Y Y Y Y Y Y Y Y Y Y Y Y Y .

Beautiful (to me) Y Y Y Y Y Y Y Y N N N N N .

Plays board games Y Y Y Y N N N N Y Y Y Y N .

Enjoys good food Y Y N N Y Y N N Y Y N N Y .

About my age Y N Y N Y N Y N Y N Y N Y .

Date X X X X X .

Think about dating X X X X X X X X .

-

Page 34: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• Exploratory testing:

• Test, and work from there• Other techniques can be used

Page 35: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?

I feel miserable

• Exploratory testing:• Test, and work from there• Other techniques can be used

Page 36: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• Exploratory testing:

• Test, and work from there• Other techniques can be used

Page 37: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• June 9th 2012

Page 38: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• June 9th 2012

Page 39: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• June 9th 2012

Page 40: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

So, what did I do?• June 9th 2012 Heleen Tuinhout-Stelwagen

42

Page 41: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Luc Sijbren Jan Tuinhout

So, what did I do?• Requirements changed: September 4th 2014

www.eurostarconferences.com

Page 42: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Summary and thoughts• Exploratory testing proved to be the

right technique for me!• Despair is part of the process

• Changing requirements along the way can be a good approach

Page 43: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

An afterthought• This process, haven’t we seen it before in

testing?• Having an idea• Being enthusiastic about it• In this enthusiasm forgetting about some relevant

conditions• Or even consciously neglecting those• Spending time and money on the idea• Finding out along the way the world isn’t as ideal as

thought• Changing requirements• ...

Page 44: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

and vice versaPassionate dating for testers

René Tuinhouthttp://www.linkedin.com/in/renetuinhout+31 (0)6 295 285 10

Thank you!!!

www.eurostarconferences.com

Page 45: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

Questions?

www.eurostarconferences.com

Page 46: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

One more question

Page 47: Passionate Dating for Testers (and Vice Versa)

www.eurostarconferences.com

and vice versaPassionate dating for testers

René Tuinhouthttp://www.linkedin.com/in/renetuinhout+31 (0)6 295 285 10

Thank you!!!

www.eurostarconferences.com