grace ng | searchlove san diego, 'designing effective experiments for product decisions
Post on 20-Oct-2014
511 views
DESCRIPTION
Every product decision is an experiment. If we can reframe our thinking from launching campaigns and building features to challenging assumptions and running experiments, then we can increase our productivity and get better results with less effort. Grace will share a structured process for designing effective experiments, and talk about some of the common pitfalls and challenges teams face when running experiments in their companies. Using examples from her work helping product teams within large companies, Grace will reveal a few ways to overcome these challenges.TRANSCRIPT
Designing Effective Experiments for
Product Decisions
Grace NgCo-founder, Javelin.comcreators of QuickMVP@uxceo
"Business has only two functions - marketing and innovation."
- Peter Drucker
Build
MEASUREMETRICS
LEARNPIVOT/PERSEVERE
BUILDEXPERIMENTHypothe
size Test
Analyze
@uxceo
LEARN MEASURE
BUILD
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
Method & SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
>OV�PZ�`V\Y�J\Z[VTLY&�)L�HZ�ZWLJPÄJ�HZ�WVZZPISL�� � � � � � � � � � � Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
Project Name: Team Leader Name:
GET OUT OF THE BUILDING!
© 2014 Javelin. You are free to use it and earn money with it as an entrepreneur, consultant, or executive, as long as you are not a software company (the latter need to license it from us).Download Experiment Board and watch case studies at www.javelin.com
Experiment BoardJavelin
@uxceo [email protected]@uxceo http://bit.ly/xB0D
Step 1
Define Your Hypothesis
@uxceo
Who is your customer?Must be specific to be easily testable!
@uxceo
ProblemINCORRECT:“People are not buying enough cameras” is not a problem someone has
CORRECT:“The outdoor adventurer hates the bulkiness”“The amateur photographer doesn’t think his skills are good enough to invest in a DSLR ”
Different customers, different problems
@uxceo [email protected]@uxceo
Problem Hypothesis
I believe [my customer] has a problem [achieving this goal]
@uxceo [email protected]@uxceo
Solution
Do not define until the problem is validated
Why? Because every problem has multiple solutions
@uxceo [email protected]@uxceo
Discover@uxceo
What is the solution?What will solve your customer’s problem?
@uxceo
Solution Hypothesis
@uxceo [email protected]
I believe [my solution] will result in [my customer] taking [specific action]
@uxceo
Solution Hypothesis
What must we LEARN?
What are the Core Assumptions of our business?
Assumption: A behavior, mentality, or action that needs to happen in order for hypothesis to be true.
@uxceo [email protected]@uxceo
What must we TEST?
Prioritize: Which Assumption is the Riskiest?
The one that is most unknown, and crucial to the business
@uxceo [email protected]@uxceo
What must we TEST?
Minimum Viable Product Use the least amount of effort to get
the most amount of customer feedback
@uxceo [email protected]@uxceo
What do we BUILD to test?
1. Exploration: test validity of problem2. Pitch: test value of your solution3. Concierge: test customer
satisfaction or behavior
@uxceo [email protected]@uxceo
What must we BUILD?
How to MEASURE success?
Minimum Success Criteria : What’s the weakest outcome you need to see in order to move forward?
@uxceo [email protected]@uxceo
1. Cost• Project Cost• Opportunity Cost
2. Existing metrics• Business KPI• Specific user behavior
How to MEASURE success?
@uxceo [email protected]@uxceo
How to MEASURE success?
@uxceo
Invalidated?
PIVOT!
@uxceo
Validated?
PERSEVERE!
@uxceo
Keep Testing@uxceo
Case Study@uxceo
@uxceo
Founders UX Help
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Exploration Interviews@uxceo
Effective Interviews1. I’m doing some research around...
2. Have you ever [experienced problem]?
3. Tell me about that time, what happened?
4. What did you do to resolve it?
5. How satisfied were you with the outcome?
6. If unsatisfied, how else have you tried to solve it?
@uxceo [email protected]@uxceo
Effective Interviews
Collect Data
• Level of pain/frustration• Frequency of encounter with pain• Existing behavior to solve problem• Time/money spent searching for a
solution
@uxceo [email protected]@uxceo
Collect Data
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
9/12Persevere
Friends. Classes.
Paid UX designers hourly for help
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
@uxceo
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
@uxceo
Seriously?@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
9/12Persevere
Friends. Classes.
Paid UX designers
for help
@uxceo
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
@uxceo
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
@uxceo
@uxceo @nycuxpa #ngnycuxpa
Google Ads@uxceo
No Backend@uxceo
3 Data Points@uxceo @nycuxpa #ngnycuxpa@uxceo
3 Data Points@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
8/10Persevere
Friends. Classes.
2 paid UX designers
for help
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
Give quick online
feedback
Pitch:60%
37/184 emails
Persevere
Started referring friends
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Boot-strapped startup
founders
Getting UX
feedback
No reliable source
Interview:6/10
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
Pay for virtual UX feedback
Pitch:8/10
UX Designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Will consult virtually
Pitch:8/10
Recent grad UX
designers
Getting clients forquick UX
consulting
Virtual UX
feedback
Give quick online
feedback
Pitch:60%
Online platform is sufficient
Concierge:60%
satisfied
Boot-strapped startup
founders
Getting UX
feedback
Virtual UX
feedback
@uxceo
Concierge
Customer Submits RequestUX Designer gets email and submits feedback
@uxceo [email protected]
Concierge@uxceo
Manually
Customer Submits RequestUX Designer gets email and submits feedback
@uxceo [email protected]
Manually@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
No reliable source
Interview:6/10
8/10Persevere
Friends. Classes.
2 paid UX designers
for help
Pay for virtual UX feedback
Pitch:8/10
10/10Test
2nd side of market
Don’t mind virtual at all.
Price is cheap
Will consult virtually
Pitch:8/10
0/10Pivot!
No! 5 yrs exp.
Established
Give quick online
feedback
Pitch:60%
37/184 emails
Persevere
Started referring friends
Online platform is sufficient
Concierge:60%
satisfied
20%Iterate
Wanted more
function-ality
@uxceo
@uxceo
High PainLow Pain
Low Frequency
High Frequency
Focus
@lissijean@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenSkyShoppers
Thinkcurators
notauthentic
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Shopperswill buy
@uxceo
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Concierge:Purchaseup 20%
@uxceo
Shopperswill buy
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
@lissijean@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
Shoppers don’tlooks at the home feed,
onlyemails
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
Shopperswill buy
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
OpenskyShoppers
Not seeingcurator
messages
@uxceo
Concierge:Purchaseup 20%
Shopperswill buy
from CMS
CMSBlock
OpenSkyShoppers
Thinkcurators
notauthentic
Emailmessages
Shopperswill buy
Concierge:Purchaseup 20%
@uxceo
Success!2x Open Rate3x Purchases
@uxceo
ExperimentsStart here. Brainstorm with stickies, pull it over to the right to start your experiment.
Customer
Problem
Solution
Result &Decision
Learning
RiskiestAssumption
SuccessCriterion
1 2 3 4 5
To form a Customer/Problem Hypothesis:I believe my customer has a problem achieving this goal.
To form your Assumptions:0U�VYKLY�MVY�̸hypothesis to be true, assumption needs to be true. Determine how you will test it:The least expensive way to test my assumption is...
Who is your customer? Time Limit: 5 Min
What is the problem? Phrase it from your customer’s perspective. Time Limit: 5 Min
+LÄUL�[OL�ZVS\[PVU�VUS`�HM[LY�`V\�OH]L�]HSPKH[LK�H�WYVISLT�^VY[O�ZVS]PUN���������Time Limit: 5 Min
List the assumptions that must hold true, for your hypothesis to be true. Time Limit: 10 Min
Need help? Use these sentences to help construct your experiment.
To form a Problem/Solution Hypothesis:I believe this solution will resultin X\HU[PÄHISL�V\[JVTL.
To identify your Riskiest Assumption:The assumption with the leastamount of data, and core to the viability of my hypothesis is...
Determine what success looks like:I will run experiment with # of customers and expect a strong signal from # of customers.
GET OUT OF THE BUILDING!
Shoppers don’tlooks at the home feed,
onlyemails
$0 inRevenue
No CT
Shopperswill buy
from CMS
Concierge:Purchaseup 20%
Shopperswill buy
Concierge:Purchaseup 20%
300%on
purchases
Shoppers like videos,
photos, from curator in
@uxceo
Guess?@uxceo
-$77,000
8 Weeks + 5 People
@uxceo
+$10,000
2 Weeks + 2 People
@uxceo
1. Form your hypothesis
2. Identify your riskiest assumption
3. Decide how you’ll test it
4. Define success
5. Analyze results and try again@uxceo
Thanks!Download resources at
Javelin.com
@uxceo