![Page 1: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/1.jpg)
Place image hereFueling Big Testing with Big Data
Presented by Tom Berger, Director of Digital MarketingSiriusDecisions 2013
![Page 2: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/2.jpg)
2
The real revolution: from big data to big testing, big experience
![Page 3: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/3.jpg)
3
Big data
Collect and organize data and wield tools to extract information and insight from it. This is the part that big data has to offer. But some of the most valuable output from such data analytics will be mere hypotheses — interesting correlations of factors and behaviors in ever-more-finely-sliced customer segments that may have meaningful impact. But these are only seeds of ideas, possibilities
![Page 4: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/4.jpg)
4
Attract Engage
Convert
Conversion Optimization
Objective: Perpetually optimize webpages to engage users and produce the highest volume of quality leads at the lowest cost.
Optimization data helps us gain an understanding of what attracts, engages and converts visitors to sales and sales.
Optimization happens here.
Optimization starts here.
Optimization happens here.
![Page 5: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/5.jpg)
5
Big testing
Take those hypotheses and be able to quickly and effectively test them to prove cause-and-effect: that those factors can indeed be leveraged to influence customer behavior. Empowering many people throughout your organization to run these tests — and to fearlessly test big ideas — is a large-scale transformation to organizational behavior and culture that we can call big testing.
![Page 6: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/6.jpg)
6
![Page 7: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/7.jpg)
7
![Page 8: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/8.jpg)
8
ion software & services
PPC Landing Pages
DemandBase: Targeting, Personalization, Data Append
Optimizely:
IM.com optimization without IT bottlenecks
The Optimization Technology “Trifecta”
![Page 9: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/9.jpg)
9
Big experience
Apply your targeted data and proven tests towards delivering better customer experiences — through the web, mobile devices, call centers, in-store and in-person interactions, etc. It’s not just making the same experience better for everyone. It’s delivering more specialized experiences to many different customer segments. This mission is big experience.
![Page 10: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/10.jpg)
10
There are three ways in which big testing earns its “big” label:
![Page 11: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/11.jpg)
11
So much to optimize! Where do we begin?
![Page 12: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/12.jpg)
12
Dial Movers Contact Forms Chat PPC & Campaign Landing Pages High Traffic Pages (Tier 1 Pages, Home
Page) SEO Entry pages
Influencers Knowledge Center Mobile website CTAs – Design Primary & Secondary Navigation Footer Design
STEP 1: Define Optimization Targets
1 2
![Page 13: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/13.jpg)
13
Macro Conversions: Contact Sales Click to Chat Call
Register for a KC download Convert on a campaign landing page
Micro: Click a link Click a CTA Social Shares View additional content Perform a search
STEP 2: Define Conversions
1 2
CONVERT ENGAGE
![Page 14: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/14.jpg)
14
Discover Evaluate current messages, offers,
campaigns and designs
Plan Determine execution strategy and goals Document roadmap (Key milestones
dependencies, dates)
Execute Design using 25 point R.E.A.D.Y optimization
framework Code & Deploy
Analyze Evaluate traffic and source performance Determine areas of opportunity
Repeat
STEP 3: Create a Playbook for Each
![Page 15: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/15.jpg)
15
Optimization Strategy Matrix
![Page 16: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/16.jpg)
16
BIG IDEAS
![Page 17: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/17.jpg)
17
![Page 18: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/18.jpg)
18
![Page 19: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/19.jpg)
19
![Page 20: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/20.jpg)
20
BIG TEAM
![Page 21: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/21.jpg)
21
First Annual Optimization Challenge
![Page 22: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/22.jpg)
22
Challenge
Each team will design a variation of a homepage banner and it’s associated landing page.
The 3 variations and the control will go head to head.
At the end of test, the variation with the highest conversion rate will be declared the winner. The winning team will be awarded an obnoxious trophy to proudly display until they are dethroned.
Optimization Challenge
![Page 23: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/23.jpg)
23
Teams
1. Shared Services/Axis412. The Web Team (minus Tom and Eric)3. ION Interactive
(Eric will deploy and test all variations)
Optimization Challenge
![Page 24: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/24.jpg)
24
Optimization Challenge
![Page 25: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/25.jpg)
25
Optimization Challenge
Challenge Announced: Today
Designs/Code Due: May 15th
Test Start Date: May 20th
Test End Date: When statistical confidence is reached.
![Page 26: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/26.jpg)
26
BIG DEAL
![Page 27: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/27.jpg)
27
Q1 Optimization Summary
• # of Optimization Tests Performed 23
• Increase in engagement 82%
• Total number of participants 179k
• Increase in form conversion rate40%
• Sales Form
• +25% increase in traffic
• 23% conversion rate
• 219% YoY increase
![Page 28: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/28.jpg)
28
![Page 29: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/29.jpg)
29
Convert: Yellowpages Landing Page Redesign
Conversion Rate: 1.9% Conversion Rate: 6.74%
+255%
Bounce Rate: 70%Bounce Rate: 97%
-28%
![Page 30: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/30.jpg)
30
12 FieldsConversion Rate: 25%
In Q1 of 2013, the contact sales web form generated 5546 MQLs. A 219% increase over Q1 2012!
Now
162.42%
![Page 31: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/31.jpg)
31
Engage: Videos – Embedded vs Popup
VS
16.8% of visitors watched the video
48.9% of visitors watched the video
+191.1%
![Page 32: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/32.jpg)
32
Engage: Articles, Related Links
+16.9%
![Page 33: Iron Mountain: Fueling Big Testing with Big Data - SiriusDecisions 2013](https://reader034.vdocuments.net/reader034/viewer/2022051816/5440f192afaf9f4e208b459f/html5/thumbnails/33.jpg)
33
Thank You.
Questions?