3 ways measurement matters for live events

42
3 WAYS MEASUREMENT MATTERS FOR LIVE EXPERIENCES

Post on 21-Oct-2014

2.207 views

Category:

Business


1 download

DESCRIPTION

As technology infuses itself into live experiences, marketers are often left with a sea of meaningless metrics. This presentation, originally presented by Ben Grossman at EventTech 2013, outlines the three types of measurement that actually matter (ROI, KPIs and Beyond), how to make measurement happen and why doing it will make you a better marketer. Topics covered include measurement methodology, optimization opportunities and benchmarking.

TRANSCRIPT

Page 1: 3 Ways Measurement Matters for Live Events

3 WAYSMEASUREMENTMATTERS FOR LIVE EXPERIENCES

Page 2: 3 Ways Measurement Matters for Live Events

SENIOR STRATEGISTJACK MORTON WORLDWIDEe: [email protected]: + 1.617.752.1171t: @BenGrossmanw: www.ben-grossman.com

BEN GROSSMAN

How did we measure up?Continue the conversation!

Read our blog: blog.jackmorton.comFollow us on twitter: @JackMortonVisit us online: www.jackmorton.com

Page 3: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 WAYS IT MATTERSDEVELOPING PLANS

TRENDS

MEASUREMENT AGENDA

Page 4: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 TYPES THAT MATTER

DEVELOPING PLANSTRENDS

MEASUREMENT AGENDA

Page 5: 3 Ways Measurement Matters for Live Events

THE SAD TRUTH:ONLY 11%OF MARKETERS’ DECISIONS ARE

MADE BASED ON DATA.

CEB, 2012

Page 6: 3 Ways Measurement Matters for Live Events

THE SAD TRUTH:INFLUENCES ON

MARKETERS’ DECISIONS

1. PAST EXPERIENCE & INTUITION

2. COLLEAGUE RECOMMENDATION

3. CONVERSATIONS WITH EXPERTS

4. ONE-OFF CUSTOMER INTERACTIONS

5. DATA

CEB, 2012

Page 7: 3 Ways Measurement Matters for Live Events

A LITTLE SECRET...When marketers’ statistical aptitude was tested with 5 questions, almost half (44%) got 4+ questions wrong.

A mere 6% got all five right.

CEB, 2012

Page 8: 3 Ways Measurement Matters for Live Events

WHAT’S AT STAKE:

15-20%INCREASE IN ROI

McKinsey, 2013

for companies that put data at the center of their marketing and sales decisions

Page 9: 3 Ways Measurement Matters for Live Events

WHAT’S AT STAKE:

15-20%INCREASE IN ROI

McKinsey, 2013

for companies that put data at the center of their marketing and sales decisions

$150 – $200 billion of additional value based on global marketing of $1 trillion/year

Page 10: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 TYPES THAT MATTER

DEVELOPING PLANSTRENDS

MEASUREMENT AGENDA

Page 11: 3 Ways Measurement Matters for Live Events

3 WAYS MEASUREMENT MATTERS

1. ROI

2. KPI

3. INSIGHT

Measuring success and returns.

Optimization engine.

Context for planning.

Page 12: 3 Ways Measurement Matters for Live Events

3 WAYS MEASUREMENT MATTERS

1. ROI

2. KPI

3. INSIGHT

Measuring success and returns.

Optimization engine.

Context for planning.

Page 13: 3 Ways Measurement Matters for Live Events

Return on Investment: A simple equation.

(Business Value - Investment)Investment

ROI =

For most marketers, the challenge in calculating ROI is not determining the investment (cost) of the experience, but rather determining what business value is delivered.

Page 14: 3 Ways Measurement Matters for Live Events

Measurement shouldn’t be an intellectually bankrupt exercise. It can't cost more than the value you get out of it.”

- @BenGrossman

“TWEET-ABLE TIP:

Page 15: 3 Ways Measurement Matters for Live Events

Return on Investment: Defining business value.

Customer Lifetime Value (CLTV) -- not immediate sales -- sets the standard for terming value (and thus, lift in value). Harvard Business School offers a useful tool to help organizations calculate CLTV: http://bit.ly/HBSCLTV.

Page 16: 3 Ways Measurement Matters for Live Events

Return on Investment: Defining business value.

The best way to determine business value of a specific live event is two-fold:

1. Use cohort analysis of attendees’ pre/post behavior to determine a lift in value (i.e. spending, loyalty, advocacy, etc.).

2. Compare attendee value to a control group of consumers.

Customer Lifetime Value (CLTV) -- not immediate sales -- sets the standard for terming value (and thus, lift in value). Harvard Business School offers a useful tool to help organizations calculate CLTV: http://bit.ly/HBSCLTV.

Page 17: 3 Ways Measurement Matters for Live Events

Return on Investment: Defining business value.

The best way to determine business value of a specific live event is two-fold:

1. Use cohort analysis of attendees’ pre/post behavior to determine a lift in value (i.e. spending, loyalty, advocacy, etc.).

2. Compare attendee value to a control group of consumers.

Customer Lifetime Value (CLTV) -- not immediate sales -- sets the standard for terming value (and thus, lift in value). Harvard Business School offers a useful tool to help organizations calculate CLTV: http://bit.ly/HBSCLTV.

Note: When unable to use actual behavior as an indicator of value (generally through a marketing automation or customer relationship management platform), using self-reported survey data from can be a relatively accurate substitute.

Page 18: 3 Ways Measurement Matters for Live Events

3 WAYS MEASUREMENT MATTERS

1. ROI

2. KPI

3. INSIGHT

Measuring success and returns.

Optimization engine.

Context for planning.

Page 19: 3 Ways Measurement Matters for Live Events

Experiences must be agile. If you’re not changing something, you’re not listening closely enough.”

- @BenGrossman

“TWEET-ABLE TIP:

Page 20: 3 Ways Measurement Matters for Live Events

Key Performance Indicators:An optimization engine.

Key performance indicators (KPIs) are a set of initiative-specific metrics that are the key drivers of ultimate success and returns.

Page 21: 3 Ways Measurement Matters for Live Events

Key Performance Indicators:An optimization engine.

Optimizing against KPIs on an iterative and ongoing basis allows marketers to maximize returns. Common live experience KPIs include:

Key performance indicators (KPIs) are a set of initiative-specific metrics that are the key drivers of ultimate success and returns.

‣ # of Attendees‣ Net Promoter Score‣ Avg. Time Spent‣ Engagement Rates‣ Conversion Rates‣ Satisfaction‣ Attendee Quality‣ Social Media Sentiment

‣ Attendance Rate‣ Event Loyalty Rate‣ Digital Channel Metrics‣ Digital Installation

Interaction Metrics‣ Social Media

Engagement Rates‣ # of Impressions

Page 22: 3 Ways Measurement Matters for Live Events

3 WAYS MEASUREMENT MATTERS

1. ROI

2. KPI

3. INSIGHT

Measuring success and returns.

Optimization engine.

Context for planning.

Page 23: 3 Ways Measurement Matters for Live Events

Your brand experiences should get smarter every time they happen.”

- @BenGrossman

“TWEET-ABLE TIP:

Page 24: 3 Ways Measurement Matters for Live Events

Measuring for Insight:Providing context for planning.

Often times, marketers get bogged down reporting metrics that don’t matter the senior level audiences. But certain, insight-driving information should be preserved.

Page 25: 3 Ways Measurement Matters for Live Events

Measuring for Insight:Providing context for planning.

Complementary data that doesn’t speak directly to success can provide context (the “why”) behind certain results. These should be reported sparingly, but analyzed carefully. Examples include:

Often times, marketers get bogged down reporting metrics that don’t matter the senior level audiences. But certain, insight-driving information should be preserved.

‣ Gender of Attendees‣ Attendee Ages‣ Geography‣ Ethnicity of Attendees‣ Weather‣ Food Consumption‣ # of Brand

Ambassadors

‣ # of Complaints‣ Quality of Staff‣ Time of Year‣ Time of Day‣ Confounding World/

Local Events‣ Competitive Landscape‣ Creative Considerations

Page 26: 3 Ways Measurement Matters for Live Events

3 WAYS MEASUREMENT MATTERS

1. ROI

2. KPI

3. INSIGHT

Measuring success and returns.

Optimization engine.

Context for planning.

Page 27: 3 Ways Measurement Matters for Live Events

TO WHOM MEASUREMENT MATTERS:

1. ROI

2. KPI

3. INSIGHT

C-Level Executives

Senior Marketers

Marketing Teams

Measure and report based on your audience.

Page 28: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 TYPES THAT MATTER

DEVELOPING PLANSTRENDS

MEASUREMENT AGENDA

Page 29: 3 Ways Measurement Matters for Live Events

Measurement simplicity is key. And simplicity doesn’t happen without some complex planning.

- @BenGrossman

“TWEET-ABLE TIP:

Page 30: 3 Ways Measurement Matters for Live Events

RECOMMEND

DEVELOPING A MEASUREMENT PLAN

DEFINE

PLAN

REPORT & OPTIMIZE

REPEAT

Page 31: 3 Ways Measurement Matters for Live Events

DEVELOPING A MEASUREMENT PLAN

DEFINE

Define the measurable measure of success for your live experience.

Establish what data outputs you will need to conduct your analysis.

Create report templates for the analyses you will want to generate.

Page 32: 3 Ways Measurement Matters for Live Events

DEVELOPING A MEASUREMENT PLAN

DEFINE

PLAN

Plan how you will collect data to create the inputs for your models and reports.

Institute dashboards, surveys, and database integrations that enable you to operationalize your Measurement Plan.

Establish team roles and responsibilities.

Identify optimization opportunities.

Page 33: 3 Ways Measurement Matters for Live Events

DEVELOPING A MEASUREMENT PLAN

DEFINE

PLAN

REPORT & OPTIMIZE

Reporting should be a mix of instant indicators and thorough post-analysis.

An optimization plan should enable real-time shifts that are feasible and actionable.

Page 34: 3 Ways Measurement Matters for Live Events

RECOMMEND

DEVELOPING A MEASUREMENT PLAN

DEFINE

PLAN

REPORT & OPTIMIZE

Final results should be reported to relevant stakeholders (sometimes requires multiple reports) in an insights and implications format.

Page 35: 3 Ways Measurement Matters for Live Events

RECOMMEND

DEVELOPING A MEASUREMENT PLAN

DEFINE

PLAN

REPORT & OPTIMIZE

REPEAT

Page 36: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 TYPES THAT MATTER

DEVELOPING PLANSTRENDS

MEASUREMENT AGENDA

Page 37: 3 Ways Measurement Matters for Live Events

Just In Time Optimization.Hubspot opened up more space in real time at its Inbound 2013 conference and used social media to determine which speakers should host encore presentations.

When social media-empowered attendees called for it, Hubspot opened up more space in real time at its Inbound 2013 conference.

It also tracked which sessions filled up and used the data to invite speakers to host encore presentations before the conference was over.

Page 38: 3 Ways Measurement Matters for Live Events

Simplicity Rules.In a world where data is growing at a rate of 40% per year, there are two types of people: complicators and simplifiers. You want simplifiers doing your measurement.

Fab.com is using DelightedApp to survey its customers with a one-question Net Promoter Score survey that lives within the email. Response rates are through the roof.

Page 39: 3 Ways Measurement Matters for Live Events

Making Big Data Small.Big Data is only as good as how you use it. Consider small ways for data to enhance your understanding of event attendees and customers.

Webtrends appended its customer profiles with B2B data sources and cut its profiling process from 21 days to 24 hours.

Page 40: 3 Ways Measurement Matters for Live Events

THE LANDSCAPE3 WAYS IT MATTERSDEVELOPING PLANS

TRENDS

MEASUREMENT AGENDA

Page 41: 3 Ways Measurement Matters for Live Events

SENIOR STRATEGISTJACK MORTON WORLDWIDEe: [email protected]: + 1.617.752.1171t: @BenGrossmanw: www.ben-grossman.com

BEN GROSSMAN

How did we measure up?Continue the conversation!

Read our blog: blog.jackmorton.comFollow us on twitter: @JackMortonVisit us online: www.jackmorton.com

Page 42: 3 Ways Measurement Matters for Live Events

3 WAYSMEASUREMENTMATTERS FOR LIVE EXPERIENCES