how atlassian uses analytics to build better products

57
REED JOHNSON PRODUCT ANALYST ATLASSIAN @JMROHNSON How Atlassian Uses Analytics to Build Better Products

Upload: atlassian

Post on 16-Feb-2017

977 views

Category:

Software


1 download

TRANSCRIPT

Page 1: How Atlassian Uses Analytics to Build Better Products

REED JOHNSON • PRODUCT ANALYST • ATLASSIAN • @JMROHNSON

How Atlassian Uses Analytics to Build Better

Products

Page 2: How Atlassian Uses Analytics to Build Better Products

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Page 3: How Atlassian Uses Analytics to Build Better Products

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Page 4: How Atlassian Uses Analytics to Build Better Products

Too fast

Page 5: How Atlassian Uses Analytics to Build Better Products

HOW?

Page 6: How Atlassian Uses Analytics to Build Better Products

E X P E R I M E N TAT I O N

Pyramid of Analytics

D ATA L I T E R A C Y

F U N N E L S

D ATA S C I E N C E

Page 7: How Atlassian Uses Analytics to Build Better Products

D ATA L I T E R A C Y

AgendaAT L A S S I A N J O U R N E Y

F U N N E L S

E X P E R I M E N TAT I O N

Page 8: How Atlassian Uses Analytics to Build Better Products

The Atlassian Journey

Page 9: How Atlassian Uses Analytics to Build Better Products

Atlassian 2012

0 Product Analysts

400+ Staff

Page 10: How Atlassian Uses Analytics to Build Better Products

S O U R C E : O P T I M I Z E LY

Page 11: How Atlassian Uses Analytics to Build Better Products

• Big cool statistic

• 2,569

• Add-Ons in Marketplace

Page 12: How Atlassian Uses Analytics to Build Better Products

S O U R C E : L E I G H P R AT H E R

Page 13: How Atlassian Uses Analytics to Build Better Products

Too busy

Page 14: How Atlassian Uses Analytics to Build Better Products

Not in my product

Page 15: How Atlassian Uses Analytics to Build Better Products

You did what?

Page 16: How Atlassian Uses Analytics to Build Better Products

SO YOU’RE A GROWTH HACKER YOU SAY?

Page 17: How Atlassian Uses Analytics to Build Better Products

Pyramid of Analytics

E X P E R I M E N TAT I O N

D ATA L I T E R A C Y

F U N N E L S

D ATA S C I E N C E

Page 18: How Atlassian Uses Analytics to Build Better Products

Crystal Ball of Analytics

Page 19: How Atlassian Uses Analytics to Build Better Products

We have data

Page 20: How Atlassian Uses Analytics to Build Better Products

Validate ideas

Page 21: How Atlassian Uses Analytics to Build Better Products

Make better decisions

Page 22: How Atlassian Uses Analytics to Build Better Products

Find growth

Page 23: How Atlassian Uses Analytics to Build Better Products

Pyramid of Analytics

E X P E R I M E N TAT I O N

D ATA L I T E R A C Y

F U N N E L S

D ATA S C I E N C E

Page 24: How Atlassian Uses Analytics to Build Better Products

S O U R C E : J I M S TO P PA N I - B O D Y B U I L D I N G . C O M

Page 25: How Atlassian Uses Analytics to Build Better Products

AT L A S S I A N J O U R N E Y

Agenda

D ATA L I T E R A C Y

F U N N E L S

E X P E R I M E N TAT I O N

Page 26: How Atlassian Uses Analytics to Build Better Products

D ATA L I T E R A C Y

Pyramid of Analytics

E X P E R I M E N TAT I O N

F U N N E L S

D ATA S C I E N C E

Page 27: How Atlassian Uses Analytics to Build Better Products

Source: amitypublications.com

Page 28: How Atlassian Uses Analytics to Build Better Products

Vanity metrics

220K Pages /

Week in Confluence

2M Issues / Week

in JIRA

Page 29: How Atlassian Uses Analytics to Build Better Products

Blog in Confluence (I know you aren’t)

Page 30: How Atlassian Uses Analytics to Build Better Products
Page 31: How Atlassian Uses Analytics to Build Better Products
Page 32: How Atlassian Uses Analytics to Build Better Products
Page 33: How Atlassian Uses Analytics to Build Better Products

Product Outreach Teams

Page 34: How Atlassian Uses Analytics to Build Better Products

Management Buy-In

Page 35: How Atlassian Uses Analytics to Build Better Products

Don’t starve

Page 36: How Atlassian Uses Analytics to Build Better Products

Graduation Criteria

Developers add analytics to new features

Data is accessible to all members of the organization

Culture of looking at data

Page 37: How Atlassian Uses Analytics to Build Better Products

Pyramid of Analytics

D ATA L I T E R A C Y

D ATA S C I E N C E

F U N N E L S

E X P E R I M E N TAT I O N

Page 38: How Atlassian Uses Analytics to Build Better Products
Page 39: How Atlassian Uses Analytics to Build Better Products

Acquisition

Activation

Retention

Revenue

Referral

Page 40: How Atlassian Uses Analytics to Build Better Products

How do customers find us?

Do they have a great first experience?

Do they stay or do they churn?

Do they pay us?

Do they bring in others?

Acquisition

Activation

Retention

Revenue

Referral

Page 41: How Atlassian Uses Analytics to Build Better Products

Onboarding for JIRA

Evaluations

Signed In

Created a Project

Created an Issue

Second Issue

Second User

Purchased

0 0,25 0,5 0,75 1

10%5%

18%

34%43%

21%

Page 42: How Atlassian Uses Analytics to Build Better Products

You’ve got issues

Page 43: How Atlassian Uses Analytics to Build Better Products

Graduation Criteria

Funnels are central to data Conversations

Page 44: How Atlassian Uses Analytics to Build Better Products

F U N N E L S

Pyramid of Analytics

D ATA L I T E R A C Y

D ATA S C I E N C E

E X P E R I M E N TAT I O N

Page 45: How Atlassian Uses Analytics to Build Better Products
Page 46: How Atlassian Uses Analytics to Build Better Products

The scientific methodA D D R E S S A P R O B L E M

P R O P O S E A S O L U T I O N

R U N A N E X P E R I M E N T

A N A LY Z E R E S U LT S

M A K E A C O N C L U S I O N

Page 47: How Atlassian Uses Analytics to Build Better Products

Problem: First Issue Is Too Hard To Create

Finding Focus

Evaluations

Signed In

Created a Project

Created an Issue

Second Issue

Second User

Purchased

0 0,25 0,5 0,75 1

Page 48: How Atlassian Uses Analytics to Build Better Products

Classic Create

Button

Page 49: How Atlassian Uses Analytics to Build Better Products

Log Issue

Button

Page 50: How Atlassian Uses Analytics to Build Better Products

Onboarding For JIRA

Before

Evaluations

Signed In

Created a Project

Created an Issue

Second Issue

Second User

Purchased

0 0,25 0,5 0,75 1

Page 51: How Atlassian Uses Analytics to Build Better Products

Onboarding For JIRA

Finding Focus

Evaluations

Signed In

Created a Project

Created an Issue

Second Issue

Second User

Purchased

0 0,25 0,5 0,75 1

Page 52: How Atlassian Uses Analytics to Build Better Products

SO YOU’RE A GROWTH HACKER YOU SAY?

Page 53: How Atlassian Uses Analytics to Build Better Products

Graduation Criteria

Tooling around experimentation

Experiment analysis is self-service

Experimentation used to resolve debates

Page 54: How Atlassian Uses Analytics to Build Better Products

AT L A S S I A N J O U R N E Y

D ATA L I T E R A C Y

Agenda

F U N N E L S

E X P E R I M E N TAT I O N

Page 55: How Atlassian Uses Analytics to Build Better Products

S O U R C E : J I M S TO P PA N I - B O D Y B U I L D I N G . C O M

Page 56: How Atlassian Uses Analytics to Build Better Products

E X P E R I M E N TAT I O N

Pyramid of Analytics

D ATA L I T E R A C Y

F U N N E L S

D ATA S C I E N C E

Page 57: How Atlassian Uses Analytics to Build Better Products

Thank you!

REED JOHNSON • PRODUCT ANALYST • ATLASSIAN • @JMROHNSON