The Mobile Application Compatibility ChallengeAlan Page

http://angryweasel.com

This is a talk about challenges, problem solving, and how my team solved their difficult challenge.

Challenge? Who needs a Challenge?

How do you test a million applications?

a milliona million

Our challenges may not be the same…

• New Operating SystemNew Operating System• New TechnologyNew Technology• 1.6 Million existing Android 1.6 Million existing Android

applicationsapplications• ……

Uh Oh!Uh Oh!

How do you start?

Now What?Now What?

“Progress doesn't come from early risers — progress is made by lazy men looking for easier ways to do things”

- Robert Henilein

nopenope

Connect the Tester with the Customer

…using Data

Next Challenge:Next Challenge:

Find a way to measure end-Find a way to measure end-user sessions and scenarios…user sessions and scenarios…on a phoneon a phone

The possibly-soon-to-be-famous Data Pipeline

Does it Work?

Monitoring and Testing

“Sufficiently Advanced Monitoring is Indistinguishable from Testing” - Ed Keyes, 2007

What are Users Doing in a Day ?

% Users with no Issues in a day

You are not the customer

Data helps you learn about the

customer

Measure often, learn often

You are not the customer

Data helps you learn

about the customer

Measure often, learn

often

email: alanpa@microsoft.comtwitter: @alanpageweb: http://angryweasel.com