lean product management at silicon valley product camp by dan olsen

46
Dan Olsen, CEO, YourVersion Dan Olsen, CEO, YourVersion Silicon Valley Product Camp Silicon Valley Product Camp April 2, 2011 April 2, 2011 Lean Product Management

Post on 17-Oct-2014

5.953 views

Category:

Business


2 download

DESCRIPTION

Talk I gave at Silicon Valley Product Camp on applying Lean Startup principles on April 2, 2011.

TRANSCRIPT

Page 1: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Dan Olsen, CEO, YourVersionDan Olsen, CEO, YourVersionSilicon Valley Product CampSilicon Valley Product CampApril 2, 2011April 2, 2011

Lean Product Management

Page 2: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Lean Product Management

Lean: iterating and improving quickly in a resource‐efficient mannerProduct Management: role responsible for achieving product‐market fitLean Product Management: achieving product‐market fit quickly in a resource‐efficient manner

Will post slides to slideshare.net/dan_o

Page 3: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

What’s So Great about “Lean”?Startups are at risk until they’re profitableFunding cocoon only lasts so longLimited resourcesTech markets move fastTime is the real enemy“Time is the scarcest resource and unless it is managed nothing else can be managed.”‐ Peter Drucker

Page 4: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

What’s the Formula forProduct‐Market Fit?

A product that:Meets customers’ needs

Is better than other alternatives

Is easy to use

Has a good value/price

Simple, right?

It’s easy to understand what a great product is at the conceptual level

HOW to achieve that product is the hard part

Page 5: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

My BackgroundEducation

BS, Electrical Engineering, NorthwesternMS, Industrial Engineering, Virginia TechMBA, StanfordWeb development and UI design

19 years of Product Management ExperienceManaged submarine design for 5 years5 years at Intuit, led Quicken Product ManagementLed Product Management at FriendsterPM consultant to startups: Box.net, YouSendIt, EpocratesCEO & Cofounder of YourVersion, startup building “Pandora for your real‐time web content”

Will post slides to slideshare.net/dan_o

Page 6: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

6 Copyright © 2011 YourVersion

Understanding Customer Needs

Page 7: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Russians: pencil

NASA: space pen($1 M R&D cost)

Example:Ability to write in space (zero gravity)

Problem Space vs. Solution Space

Problem SpaceA customer problem, need, or benefit that the product should address

A product requirement

Solution SpaceA specific implementation to address the need or product requirement

Page 8: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Problem Space vs. Solution Space:Product Level

Problem Space(user benefit)

Solution Space(product)

TurboTax

TaxCut

Pen and paper

Prepare my taxes

File mytaxes

Check my taxes

Maximize deductions

Reduce audit risk

Page 9: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Problem vs. Solution Space: Feature LevelProblem Space Solution Space

Save time filing taxes

Save time preparing taxes

Maximize my tax deductions

Check my return

Reduce my audit risk

Help me prepare taxes

Empowerement/Confidence

Save Time

Save Money

Tax Interview Wizard

Audit Risk Analyzer

Tax Return Error Checker

Tax Data Downloader

Electronic Tax Return Filing

Tax Deduction Finder

Page 10: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Prioritization Part 1:Customer Value: Benefits & FeaturesHow do you prioritize:Which user benefits should you address?

Which product features to build (or improve)?

Importance vs. SatisfactionImportance of user need (problem space)

Satisfaction with how well a product meets the user’s need (solution space)

Page 11: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

High Importance + Low Satisfaction =Opportunity to Add Customer ValueIm

portance of U

ser N

eed

Impo

rtance of U

ser N

eed

User Satisfaction with Current AlternativesUser Satisfaction with Current Alternatives

CompetitiveMarketOpportunity

LowLow HighHigh

LowLow

HighHigh

Not Worth Going After

Page 12: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Importance vs. SatisfactionAsk Users to Rate for Each Feature

98

8784

8679 847055 80

7280

75

4150

55

60

65

70

75

80

85

90

95

100

40 50 60 70 80 90 100

Satisfaction

Impo

rtan

ce

Recommended reading: “What Customers Want” by Anthony Ulwick

BadBad

GreatGreat

Page 13: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Kano Model: User Needs & Satisfaction

User SatisfactionUser Satisfaction

User DissatisfactionUser Dissatisfaction

Performance (more is better)

Delighter (wow)

NeedNeednot metnot met

NeedNeedfully metfully met

Must Have

Needs & features migrate over time

Page 14: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

What is Your Value Proposition?

Which user benefits are you providing?

How are you better than competitors?

Competitor A Competitor B You

Must Have Benefit 1 Y Y Y

Performance Benefit 1 High Low Med

Performance Benefit 2 Low High Low

Performance Benefit 3 Med Med High

Delighter Benefit 1 Y ‐ ‐

Delighter Benefit 2 ‐ ‐ Y

Page 15: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Prioritization Part 2:Customer Value & Engineering EffortCustomer value is only half the equation

How much engineering effort will it take?

Need to consider value and effort (ROI)

Ruthlessly prioritize: rank order (10 Highs = FAIL)

Be deliberate about scope & keep it smallStrategy = deciding what you’re NOT doing

Break features down into smaller chunks

LAUNCH!

Smaller scope → faster iterations → higher cust value

Page 16: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Prioritizing Product Ideas by ROIPrioritizing Product Ideas by ROI

Investment (developer‐weeks)

Return (V

alue

 Created

)

Idea C

Idea B

Idea D

Idea A

Idea F

1

1

2

3

4

2 3 4

?

Page 17: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

17 Copyright © 2011 YourVersion

UI Design and Ease of Use

Page 18: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

User Benefits vs. Ease of Use

Q: If two products equally deliver the exact same user benefits, which product is better?A: The product that’s easier to use“Ease of use” provides benefits

Saves timeReduces cognitive load & frustrationMakes user feel empowered

UI Design can be differentiatorOlsen’s Law: “The less user effort required, the higher the percentage of users who will do it”

Page 19: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

The UI Design IcebergThe UI Design Iceberg

VisualDesign

InteractionDesign

InformationArchitecture

ConceptualDesign

Recommended reading: Jesse James Garrett’s“Elements of User Experience” chart, free at www.jjg.net

What most people seeand react to

What good product people think about

Page 20: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Elements of User Interface Design

Consists of Three Distinct Elements:Information Architecture

Structure and layout at both site and page levelHow site is structured (sitemap)How site information is organized (site layout)How each page is organized (page layout)

Interaction DesignHow user and product interact with one anotherUser flows (e.g., navigation across multiple pages)User input (e.g., controls and form design)

Visual Design“How it looks” vs. “What it is”, often called “chrome”Fonts, colors, graphical elements

Page 21: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

21 Copyright © 2011 YourVersion

Learning from Customers

Page 22: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Customer Feedback:Problem Space vs. Solution Space

Customers CAN’T articulate problem space

Customers CAN react to solution space

But, customers can’t give you solutions

Customers aren’t designersMultiple use cases and priorities

Trade‐offs and constraints

Don’t have PM, design, and technical skills

Page 23: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Iterating Your Product Vector Based on User Feedback in Solution SpaceProblem Space

(your mental model)Solution Space

(what users can react to)

Help userbook travel

Help userplan travel

Customer Feedback

Mockups / Code

Page 24: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

What Are You Getting Feedback & Learnings About?

Problem Space(your mental model)

Solution Space(what users can react to)

CustomerUnderstanding 

(needs & preferences)

Feature Set

UI Design Messaging 

Page 25: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

“Ramen” User Feedback for Startups

Anyone can do it!

Ingredients:Solution‐space product/mockup to test

1 customer (with laptop if testing code)

1 desk

1 person to conduct the session

Pen and paper

Optional note‐taker and observers

Page 26: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Typical Format for Customer Session

5 ‐ 10 min: Ask questions to understand user needs and solutions they currently use30 ‐ 50 min: User feedback

Show user product/mockupNon‐directed as much as possibleWhen necessary, direct user to attempt to perform a specific task

5 ‐ 10 min: Wrap‐upAnswer any user questions that came upPoint out/explain features you want to highlightAsk them if they would use the product

Page 27: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Dos & Don’ts of Conducting Usability

DoExplain to the user:

Their usability test will help improve the productNot to worry about hurting your feelings“Think Aloud Protocol”

Ask user to attempt the task, then be a fly on the wallAsk non‐leading, open‐ended questionsTake notes and review them afterwards for take‐aways

Don’tAsk leading questions“Help” the user or explain the UI (e.g., “click over here”)Respond to user frustration or questions (until test is over)Get defensiveBlame the user

Page 28: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

28 Copyright © 2011 YourVersion

Case Study on Product‐Market Fit:MarketingReport.com

Page 29: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Product‐Market Fit Case Study:MarketingReport.com

My consulting client, CEO of TrustedID, had an idea for a new productTeam: me, CEO, head of marketing,UI design consultantGoal:Validate product‐market fit quickly, cheaply without writing a single line of codeDetermine if their was a business opportunity here

Page 30: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Product Concept was “marketing report” that let consumers control the direct mail that they receiveConcept was fuzzy with various components, so I broke it into 2 different “flavors”:

#1 “Marketing Shield”: Service to reduce/stop junk mail#2 “Marketing Saver”: Opt in & receive money‐saving offersEach product concept consisted of several modules that each mapped to a specific user benefit

Worked with UI designer to create paper mockups of pages for each flavor concept (5 pages each)

Product‐Market Fit Case Study:Developing Product Concept

Page 31: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Page 32: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Page 33: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Clustering Potential User Benefits to Create Product Concepts

Reduce Junk Mail

Find out what “they” know about you

Money Saving Offers

Compare Yourself to Others

Social Networking

Marketing Report

Marketing Score

Marketing Profile

Save Trees

“Shield” Concept “Saver” Concept

Page 34: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Telephone recruit of prospective customersWrote phone‐screen questionnaire to create rough target customer segmentation

Wanted users who work full‐time & use internetFit for opt‐in concept: use coupons, Costco membershipFit for anti‐junk mail concept: use paper shredder, block caller ID

Scheduled 3 groups of 2 or 3 people to discuss each product concept for 90 minutesModerated each group through the paper mockups to hear their feedback

Product‐Market Fit Case Study: Recruiting People

Page 35: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Product‐Market Fit Case Study:Findings on Concepts &User Benefits

Reduce Junk Mail

Find out what “they” know about you

Money Saving Offers

Compare Yourself to Others

Social Networking

Marketing Report

Marketing Score

Marketing Profile

Save Trees

Legend

Strong appeal

Somewhat positive

Low appeal

“Shield” Concept “Saver” Concept

Page 36: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Product‐Market Fit Case Study:Learnings from Research

Learned that “Shield” (anti‐junk mail) concept was stronger than “Saver”People didn’t like many of the “Saver” concept componentsLearned users’ concerns / questions about “Shield”conceptRefined “Shield” concept:

Removed irrelevant componentsImproved messaging to address user concerns / questions

Validated revised “Shield” concept with quick 2ndround of tests

No customer concernsClear willingness to pay

Page 37: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Page 38: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Product‐Market Fit Case Study:Summary

4 weeks from 1st meeting to validated product concept with zero coding

Cost $1,500 to talk to 20 users ($75 each)

1 round of iteration on product concept

Identified compelling concept that users are willing to pay $10/month for

Trimmed away non‐valuable pieces

You can achieve similar results

Page 39: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

39 Copyright © 2011 YourVersion

Getting Quantitative:Optimization Using Metrics

(See my previous talks that cover“The Equation of Your Business”)

Page 40: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

How to Track Your MetricsTrack each metric as daily time series

Create ratios from primary metrics:  X / YExample: How good is your registration page?Okay: # of registered users per dayBetter: registration conversion rate =

# registered users / # uniques to reg page

DateUnique Visitors

Page views

Ad Revenue

New User Sign‐ups …

4/24/08 10,100 29,600 25 490

4/25/08 10,500 27,100 24 480

Page 41: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Sample Signup Page Yield DataSample Signup Page Yield Data

Daily Signup Page Yield vs. TimeNew Registered Users divided by Unique Visitors to Signup Page

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1/31 2/14 2/28 3/14 3/28 4/11 4/25 5/9 5/23 6/6 6/20 7/4 7/18 8/1 8/15 8/29 9/12 9/26 10/10

Dai

ly S

ignu

p Pa

ge Y

ield

Changedmessaging

Added questionsto signup page

Started requiringregistration

Page 42: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Identifying the  Identifying the  ““Critical FewCritical Few”” MetricsMetrics

What are the metrics for your business?Where is current value for each metric? How many resources to “move” each metric?

Developer‐hours, time, moneyWhich metrics have highest ROI opportunities?

Return

Return

InvestmentInvestment

Return

Return

InvestmentInvestmentRe

turn

Return

InvestmentInvestment

Metric AMetric AGood ROIGood ROI

Metric BMetric BBad ROIBad ROI

Metric CMetric CGreat ROIGreat ROI

Page 43: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Survey resultsImportance & SatisfactionNet Promoter Score

Survey.io“How would you feel if you could no longer use Product X?”

Very disappointed, Somewhat disappointed, Not disappointed

User behaviorProspects sign up (high conversion rate)They keep using it (high retention rate)They use it often (high frequency of use)

Metrics to Validate Product‐Market Fit

Page 44: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Optimization through Iteration:Optimization through Iteration:Continuous ImprovementContinuous Improvement

Measurethe metric

Analyzethe metric

Identify top opportunitiesto improve

Design & develop  the enhancement

Launch theenhancement

Learning

Gaining knowledge:

• Market

• Customer

• Domain

• Usability

Page 45: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Lean Product ManagementLean Product ManagementCheat SheetCheat Sheet

Understand the problem space to identify underserved customer needs

Define your value proposition

Get user feedback in the solution space

Revise your feature set, UI design, and messaging to improve product‐market fit

Ruthlessly prioritize based on ROI

Identify and track key metrics

Launch, learn, and iterate

Page 46: Lean Product Management at Silicon Valley Product Camp by Dan Olsen

Copyright © 2011 YourVersion

Try it out at:http://www.yourversion.com

Free apps:iPad http://bit.ly/yv‐hd

iPhone http://bit.ly/yv‐appAndroid phone http://bit.ly/yv‐apAndroid tablet http://bit.ly/yv‐tab