Alex Schwartz

How to Brew a Tasty Agile Test Strategy?

Agile Development/Testing andBrewing/Kitchen Analogies

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Nice Cookbooks

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

In our agile pantry..

contains many...

•books• ingredients• tools•cookbooks•restaurants• styles

www.flickr.com/photos/52192754@N00/220946716/

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Why Cooking/Brewing Analogy?

•Examples can help

•Analogies from a different (known) context can help

• It’s fun

Sonntag, 10. Oktober 2010 KW

Alex Schwartz www.flickr.com/photos/28549294@N05/4273275734

Analogy #1: The Definition of Done (DoD) in a Kitchen

Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer.

When it’s DONE?

NO

Sonntag, 10. Oktober 2010 KW

Alex Schwartz http://www.flickr.com/photos/28549294@N05/4273275734/sizes/l/in/photostream/

Analogy #1: The Definition of Done (DoD) in a Kitchen

Assume a professional cook in a restaurant kitchen is asked to create a nice meal for a customer.

When it’s DONE?

YES

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

What we find in a cookbook

• Ingredients

• Techniques

• Tools

• Mindset

• Skills

• Recipes

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

What we find in a cookbook

• Ingredients

• Techniques

• Tools

• Mindset

• Skills

• Recipes

This talk....

(META-)Recipes to create a Test Strategy

Spikes into details

recipe recipe

with some e

xamples

from our

kitchen

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

La Cuisine• mobile.de - e-Commerce, selling vehicles

• belongs to eBay Classifieds Group

• Marketplaces France, Italy, Poland and Romania

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Our Agile Transition

•first Scrum pilot project 3.5 years ago

•3 years Scrum with multiple teams

- 70+ people

- 6+ teams, 2 distributed teams

- parallel development on same product

•1.5 million LoC

•1 year Kanban for maintenance

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Votré chef de cusine

• programming background (20 years)

• Agile from 2004, Scrum Master

• my current role:

Team Lead “Engineering Support Group”

supporting agile project teams with...

- Release Management- Test Automation- Build Management- Tools- Configuration Management

holis

tic

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

What I mean by “Agile Test Strategy”?

•What to test? What not to test?

•Which kinds of tests?

- Test categories / taxonomy

- Tools

•When to test (what)?

•How to introduce/improve?

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

The Recipe

•Which kind of restaurant?

•Get to know your craft

•Try to use ... adapt & learn

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Step 1: What kind of restaurant?

- Who are your clients? - Your style?- Competitors, market?- Your team

Quality is a business requirement

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Step 2: Get to know your craft...

• Ingredients

•Tools

•Techniques

•Principles

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Principle: Visibility

www.flickr.com/photos/shannonsturgis/4274202367Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Principle: Care about your tools

Sharpen your knifes.

www.flickr.com/photos/st3f4n/3641653927

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Principle: Care about your tools

Sharpen your knifes.

www.flickr.com/photos/st3f4n/3641653927

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Principle: Whole team approach

•... not very kitchen-like?

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Question: Use instant ingredients or not?

www.flickr.com/photos/vegetarian/2292620706

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Example from our kitchen: Principles

•Early feedback

•From risk to test strategy

• Test as low as possible

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Recipe: From Risk to Test

Criteria

• Incident prio

• Change frequency

• Bug density

• Overhead for manual tests

• Complexity of requirements

• Maintenance overhead for automated tests

• Known domain

Test Automation ROI Radar Chart

Incident prioWhat is the prio of a

possible incident?

Bug densityHow many bugs in the past?

Overhead of manual test

Maintenance overhead for

automated tests

Change frequencyHow many changes in the

future?

high

often

high

ComplexityHow complicated is the

feature?

high

low

high

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Source: Lisa Crispin & Janet GregoryAgile Testing: A Practical Guide for Testers and Agile Teams

.

Ingedients - Test Categorization / TaxonomyOverhead / Complexity

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Source: Lisa Crispin & Janet GregoryAgile Testing: A Practical Guide for Testers and Agile Teams

.

Ingedients - Test Categorization / Taxonomy

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Recipe: The “Tetris Principle” - Test as low as possible

Story: As a customer I can contact the seller of an interesting ad.

Risk/aspect 1Mail is not sentdue to config

problems

Risk/aspectLayout of mail

is crap

Risk/aspect:Wrong maillanguage

Risk/aspect:Javascript problem

in contact form

no automated tests

automated tests

Story Test / UI(Integration)

Manual tests

Story testbelow UI

Story Test / UI(Browser)

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Analogy #2: QA or When do you flip a pancake?

thecleancoder.blogspot.com/2010/08/ qa-or-when-do-you-flip-pancake.html

Robert “Uncle Bob” Martin

www.flickr.com/photos/mrlerone/106039369/

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Test Automation

Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Goal: A happy kitchen crew

www.flickr.com/photos/fractalv/1341923133Sonntag, 10. Oktober 2010 KW

Alex Schwartz

Thanks for your attention.

Sonntag, 10. Oktober 2010 KW