[500distro] the only metric that matters

28
The only metric that matters Josh Elman @joshelman August 7, 2014

Upload: 500-startups

Post on 08-Sep-2014

12.233 views

Category:

Technology


0 download

DESCRIPTION

Josh Elman, Partner, Greylock Partners

TRANSCRIPT

Page 1: [500DISTRO] The Only Metric That Matters

The only metric that matters

Josh Elman @joshelman

August 7, 2014

Page 2: [500DISTRO] The Only Metric That Matters

Everybody starts at zero

Page 3: [500DISTRO] The Only Metric That Matters

With a dream of making an impact

Page 4: [500DISTRO] The Only Metric That Matters

But along the way, how do you know if it’s working?

Page 5: [500DISTRO] The Only Metric That Matters

You have to track things somehow…

but it can be overwhelming…

Page 6: [500DISTRO] The Only Metric That Matters

Our D7 retention is 60%. D30 is 22%.

250 million PVs in the last 30 daysWe just topped

200,000 sign ups

We have a 50% DAU/MAU ratio

We have over 1 million downloads

Everybody has a data point

Page 7: [500DISTRO] The Only Metric That Matters

But where do I start?

Page 8: [500DISTRO] The Only Metric That Matters

ARE PEOPLE USING YOUR PRODUCT?

Just focus on one thing:

Page 9: [500DISTRO] The Only Metric That Matters

Ok, but how can I tell?

1) Usage: Do they use your product how you expect? Track: #users taking core actions each day !

2) Cycle: Do they use it at the frequency you expect? Track: #users who visit at least N days in a week or month!

3) Retention: Are they sticky? Will come back to this…

Page 10: [500DISTRO] The Only Metric That Matters

LinkedIn Circa 2005Usage: Find and be found!

Cycle: Find: 2-3x/week Track: #users who log in and search per day!

Be found: 1-2x/year(?) Track: response rate to InMail

Page 11: [500DISTRO] The Only Metric That Matters

YelpUsage: Find local businesses/services. And review them. !

Cycle: Searchers: 2-3x/weekTrack: #users who search per day Reviewers: 1x/week(?)Track: #reviews / day

Page 12: [500DISTRO] The Only Metric That Matters

FacebookUsage: Stay connected with friends!

Cycle: 2-3x/dayTrack: #users who log in and view News Feed

Page 13: [500DISTRO] The Only Metric That Matters

ExpediaUsage: Plan a great trip!

Cycle: 3-5x/yearTrack: #users who search per day

Page 14: [500DISTRO] The Only Metric That Matters

ARE PEOPLE REALLY REALLY USING YOUR PRODUCT?

So they may be using it once, but…

Page 15: [500DISTRO] The Only Metric That Matters

Really really using? (aka “Core Users”)

1) Top of Mind: Do they come directly to your product vs referred by a link or special offerTrack: % users with direct traffic / engagement!

2) Recurring: Do they come back again and againTrack: % users who return weekly/monthly!

3) Referring: Do they share it with others? Track: k-factor, and % users who are referrers

Page 16: [500DISTRO] The Only Metric That Matters

Step 1) Analyze month over month usage

# days visited in month 1

% w

ho v

isite

d N

day

s in

mon

th 2

Page 17: [500DISTRO] The Only Metric That Matters

Step 2) Determine threshold for core

0%#10%#20%#30%#40%#50%#60%#70%#80%#90%#100%#

1# 2# 3# 4# 5# 6# 7# 8# 9# 10# 11# 12# 13# 14# 15# 16# 17# 18# 19# 20# 21# 22# 23# 24# 25# 26# 27# 28# 29# 30# 31# 32#

Reten%on'Rate'based'on'#'%mes'used'in'month'1'

Page 18: [500DISTRO] The Only Metric That Matters

Step 3) Understand activation buckets

CORE

CURIOUS NEW CASUAL

COLD

20%

90%

40%

40%

40%

8%

50%

10%

95%

4%1%

Page 19: [500DISTRO] The Only Metric That Matters

Step 4a) Find out why — from your data

Following more than 30 accounts 1/3 - mutual follows2/3 - one-way follows

Page 20: [500DISTRO] The Only Metric That Matters

Step 4b) Find out why — call them!

Page 21: [500DISTRO] The Only Metric That Matters

Cherish them. They are your super heroes

Page 22: [500DISTRO] The Only Metric That Matters

I have a few core users. I want more!

Page 23: [500DISTRO] The Only Metric That Matters

Problem 1: not enough people sign up

Page 24: [500DISTRO] The Only Metric That Matters

Clone your core users

1) Word-of-mouth Virality: help your core users describe your product. Say it yourself to the press. Inception!!

2) Demonstration Virality: have your core users share content and more from your product. Demonstrate their deep usage. !

3) Infectious Virality: encourage users to bring their friends in so the experience is better for both. Incentives ok too!

Page 25: [500DISTRO] The Only Metric That Matters

Problem 2: people sign up, no one sticks around

Page 26: [500DISTRO] The Only Metric That Matters

Onboard users all the way to Core

1) Learn Flow: teach your users your product as they sign up. Take your time. They are there to learn. Don’t rush it.!

2) Welcome Week: if users don’t do it the first day, nudge them to come back and keep going!

3) Social Pressure: if friends are on the system, use them to welcome, teach, and connect with the new folks

Page 27: [500DISTRO] The Only Metric That Matters

One metric to rule them all:

HOW MANY PEOPLE ARE REALLY USING YOUR PRODUCT?

Page 28: [500DISTRO] The Only Metric That Matters

The only metric that matters

Josh Elman @joshelman

August 7, 2014