Alan Page, Microsoft

Test Innovation for Everyone

www.eurostarconferences.com

@esconfs#esconfs

Innovation

Ideas

TestInnovation

TestIdeas

I know quite certainly that I myself have no special talent. Curiosity, obsession and dogged endurance, combined with self-criticism, have brought me to my ideas.

Ideas

We don’t know where we get our ideas from. What we do know is that we do

not get them from our laptops.

Ideas

Ideas

IdeasIdeas

Ideas

Ideas

Ideas

Ideas

Ideas

Ideas

Ideas

Ideas

The Adjacent Possible

“The premise that innovation prospers

when ideas can serendipitously

connect and recombine with other

ideas”

Let’s Go Innovate!

Let’s Solve a Problem

What Problem Do We Need to Solve?

How Can We Solve This Problem?

Two kinds of problems…

Optimizing Application Performance

program.exe

program.exe

program.exe

program.exe - coverage report

Function Total Blocks Blocks Covered

Foo 12 10Bar 16 8Baz 7 6Fizz 19 12

New Tricks (for Old Testing Dogs)

Code CoverageComponent Coverage

Fizz 70%

Buzz 62%

FizzBuzz 81%

Code CoverageComponent Coverage

Fizz 70%

Buzz 62%

FizzBuzz 81%Blech!

Code Coverage – take 2Test Selection

Component Tests

Fizz a,b,d,e,f,g,y

Buzz b,c,d,r,s,t

FizzBuzz a,b,d,e,f,r,t,u,v,z

Test Pass Rate

Test This 90%

Test That 95%

Test the other thing 98%

Test Pass Rates

Test Pass Rate

Test This 90%

Test That 95%

Test the other thing 98%

Test Pass Rates

What Does

This Tell You?

Test History (Last 5) Bugs

Test This P, P, P, F, F 134, 157,154

Test That F, P, F, P, F 174

Test the other thing

P, P, P, P, P 132

Test Pass Rates

500,000 Screens Reviewed

4500 Unique Reviewers

~5000Bugs Fixed

“We now know a thousand ways not to build a light bulb”

Making Innovation Happen

For You

Know The Problem

Question The Problem

Fail at the Problem

See the (bigger)

Problem

The unit of progress for Lean Startups is validated learning - a rigorous method for demonstrating progress when one is embedded in the soil of extreme uncertainty

“The way to get good ideas is to get lots of ideas and throw the bad ones away”

- Linus Pauling

TestIdeas

User Groups

BlogsBooks

If you have one person you’re influenced by, everyone will say you’re the next whoever. But if you rip off a hundred people, everyone will say you’re so original.

- Gary Panter

http://angryweasel.com/bloghttp://twitter.com/alanpage

Photo Credits

• Passport / safe slide– Some rights reserved by IceSabre (safe)– Some rights reserved by The Wide Wide World

(passports)– Some rights reserved by Samantha Decker (map)

• Microwave– Some rights reserved by samsungtomorrow

• Dead End– Some rights reserved by freefotouk

• Others are book covers or from Microsoft Clipart collection