a process for being data driven

Insights from Web Analytics Demystifiedwww.webanalyticsdemystified.com

A PROCESS FOR BEING DATA-DRIVENFROM TIM WILSON

@tgwilson | bit.ly/webprocess

tim.webanalyticsdemystified.com

Past Employers


Everyone wants to be data-driven these days.


But what does “data-driven” actually mean?


Let’s make it alittle simpler.


Let’s recognize there are fundamentallytwo ways to use data.


Performance Measurement

Hypothesis Validation

Support

Enablement tasks, including quick data pulls, platform integration, tool training & data governance.

Tracking & communicating performance of KPIs & supporting metrics against targets.

Capturing, prioritizing & confirming the assumptions driving key investments with data & testing.


So, how do we bring this to life with a great process?


A.D.A.P.T.to

Act & Learn


Align on goals and KPIs

Discover hypotheses across the company

Assess the hypotheses and your approach

Prioritize the hypotheses

Test the highest priority hypotheses

Act on the results

Learn for the future




Support





Alignment means clearly established goals and KPIs.


WHAT ARE YOUR KPIs?!

Flickr / Zawezome

http://www.flickr.com/photos/_lovenothing/

http://www.flickr.com/photos/_lovenothing/


Leads to...


Two Magic Questions

1. What are we trying to achieve?

2. How do we know if we’ve done that?


A KPI is not a KPI without a target.


Flickr / mando-16

I can’t set a target! No one has ever done

this before!


A KPI is not a KPI without a target.


A SWAG isinfinitely better than a “We’ll know it when we see it” target.


Napkins are handy


Bracketing is handy, too.

[ ]Definitely

BadDefinitely

Good

10 Leads 10,000 Leads

][Target


Goals, KPIs, and Targetslead to a

Meaningful Dashboardwhich is the core of

Effective Performance Measurement




Support










Act on the results



Remember high school science class?


An analysis is nothing more than testing a hypothesis.


Everyone in the business has hypotheses!


The trick is getting them articulated clearly.


What we say to marketers

“What is your hypothesis?”


What we say to marketers

“What is your hypothesis?”

What they hear

“I’m dragging you back to the high school science class you

hated.”


I believe that…

If I am right, then I will…

[some idea]

[take some action]


Each idea can be added to a hypothesis library. Google Spreadsheet Excel uservoice.com Sharepoint Lotus Notes Jira







Act on the results



Is the hypothesis clearly articulated?


To assess the effort required, you have to determine the approach.


Flickr / justinbaeder

When all you have is a hammer...

...all the world looks like a nail.


Data-drivenmarketers areaware of theirfull tool belt.


If I am right, I will…[take some action]

I believe that…[some idea]

To test this, I will…[tool/technology/approach]


Web Analytics

Voice of the Customer

A/B (and MV) Testing

Usability Testing

Email Surveys

Social Media Analytics

Focus Groups

Secondary Research

What’s in your company’s toolbelt?







Act on the results



It’s not a simple formula.


But a formula can guide the discussion.


Likelihood belief is right

Likelihood change would occur

Likely scale of impact

Alignment w/ business goals

Effort to test (approach)

M LH

M LH

M LH

M LH

M LH







Act on the results



ActionableResults







Act on the results



Driving action requires effective communication of the results.


And it requires tracking to action.


As a result, we…[took the action]

We tested…[the idea]

Resulting in…[quantified result]







Act on the results



Learning means looking beyond the near-term action.


Hypothesis tested Action taken

Hypothesis tested No action warranted







Deeper learning

Deeper learning

Deeper learning


Monthly/Quarterly ReviewHypotheses Submitted

Hypotheses Validated

ActionTaken

Results Achieved

Deeper Learning

I believe...If I am right... ✓ ✓ ✓ ✓I believe...If I am right... ✓I believe...If I am right...

I believe...If I am right... ✓ ✓ ✓I believe...If I am right... ✓ ✓I believe...If I am right... ✓ ✓I believe...If I am right...

I believe...If I am right... ✓ ✓I believe...If I am right...


With the ultimate goal of...


...reorienting the business to aculture of validated learning.







Act on the results



THANK YOU!

bit.ly/webprocessThis presentation

1-Page Guide: Getting to Great KPIs

Performance Measurement Planning Template

Hypothesis Library Template

“Approach options” Self-Audit Template

Recommended reading on effective communication of analytics results

Insights from Web Analytics Demystifiedwww.webanalyticsdemystified.com

Partner, Web Analytics [email protected]

(512) 431-8502 or @tgwilson

TIM WILSON

mailto:[email protected]

mailto:[email protected]

a process for being data driven

Business