insider's technology guide to measuring and improving your roi
DESCRIPTION
Workshop and panel given at the National Arts Marketing Project Conference in Charlotte, NC on November 10, 2012 by Dan Leatherman & Caleb Custer.TRANSCRIPT
INSIDER’S TECHNOLOGY GUIDE TO MEASURING AND
IMPROVING YOUR ROICaleb Custer & Dan Leatherman
1
@calebcuster @danleatherman
Monday, November 12, 12
HELLO.2
Monday, November 12, 12
I'm Dan.
3Monday, November 12, 12
4Monday, November 12, 12
I'm a Designer.5
Monday, November 12, 12
Measurement & R.O.I
6Monday, November 12, 12
Essential Methodology1. Who2. What3. When4. Where5. Why
7Monday, November 12, 12
• Designers
• Developers
• Project Managers
• Marketers
• Business Development
• Future Clients
• Current Clients
• Whole Teams
8Monday, November 12, 12
Essential Methodology1. Who2. What3. When4. Where5. Why
9Monday, November 12, 12
Intuition-Driven(AKA The Designer’s Choice)
10Monday, November 12, 12
Data-Driven(AKA The Engineer’s Choice)
11Monday, November 12, 12
Design Spectrum
Intuition Driven Data Driven
InstinctiveSubjectiveDaring
DeliberateObjective
Safe12
Monday, November 12, 12
“Radical innovation requires both evidence and intuition: evidence to become informed, and intuition to inspire us in imagining and creating new and better possibilities.”—Jane Fulton Suri, IDEO
Metrics-Driven(AKA The Every-man’s Choice)
13Monday, November 12, 12
Try
Scientific Method
Think
Learn
14Monday, November 12, 12
Essential Methodology1. Who2. What3. When4. Where5. Why
15Monday, November 12, 12
16Monday, November 12, 12
Analytics MeasurementUser Flows
Ideation Wireframes Visuals / Prototypes Launch! Iteration
Click TestsPreference Tests
A/B or Multivariate TestsUsability Testing
17Monday, November 12, 12
Essential Methodology1. Who2. What3. When4. Where5. Why
18Monday, November 12, 12
Where’s Waldo?
19Monday, November 12, 12
The Number Narrative
⌂ 🔎
🔒
💳
95%
20Monday, November 12, 12
Essential Methodology1. Who2. What3. When4. Where5. Why
21Monday, November 12, 12
Value
22Monday, November 12, 12
“The more users’ expectations prove right, the more they will
feel in control of the system and the more they will like it.”
– Jakob Nielson
23Monday, November 12, 12
UI Fundamentals & Best PracticesBasic Usability
Bad Good
24Monday, November 12, 12
UI Fundamentals & Best PracticesInformation Architecture / Hierarchy
GoodBad25
Monday, November 12, 12
UI Fundamentals & Best PracticesCall To Actions
GoodBad26
Monday, November 12, 12
Testing UIFree! $$
27Monday, November 12, 12
PREPAREYOUR DATA
28
Monday, November 12, 12
29
Monday, November 12, 12
GOOGLE URL BUILDER
29
Monday, November 12, 12
30
Monday, November 12, 12
TRACK OUTGOING LINKS
30
Monday, November 12, 12
31
Monday, November 12, 12
MARGIN OF ERRORnormal population: 10% for 96 data points, 5% for 384
31
Monday, November 12, 12
HEATMAPS
32
Monday, November 12, 12
33
Monday, November 12, 12
WHAT DOES HEAT MAPPING TELL US?
33
Monday, November 12, 12
WHAT DOES HEAT MAPPING TELL US?
• Window to decision making process
33
Monday, November 12, 12
WHAT DOES HEAT MAPPING TELL US?
• Window to decision making process
• Page scanning/order
33
Monday, November 12, 12
WHAT DOES HEAT MAPPING TELL US?
• Window to decision making process
• Page scanning/order
• Visualizing data is important to understanding it
33
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
34
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
• Screen size
34
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
• Screen size
• Referrer
34
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
• Screen size
• Referrer
• Keywords
34
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
• Screen size
• Referrer
• Keywords
• New/returning visitor
34
Monday, November 12, 12
HOW SHOULD WESEGMENT USERS?
• Screen size
• Referrer
• Keywords
• New/returning visitor
• Campaign/source
34
Monday, November 12, 12
CLICK HEAT
35
Monday, November 12, 12
CLICK HEAT
35
Monday, November 12, 12
CRAZY EGG
36
Monday, November 12, 12
CRAZY EGG
36
Monday, November 12, 12
CRAZY EGG•Heat map
36
Monday, November 12, 12
CRAZY EGG•Heat map•Scroll map
36
Monday, November 12, 12
CRAZY EGG•Heat map•Scroll map•Confetti report & segmenting
36
Monday, November 12, 12
CRAZY EGG•Heat map•Scroll map•Confetti report & segmenting•Comparing snapshots
36
Monday, November 12, 12
HEATMAP
37
Monday, November 12, 12
HEATMAP
37
Monday, November 12, 12
SCROLLMAP
38
Monday, November 12, 12
SCROLLMAP
38
Monday, November 12, 12
CONFETTI REPORT
39
Monday, November 12, 12
CONFETTI REPORT
39
Monday, November 12, 12
CONFETTI REPORT
40
Monday, November 12, 12
CONFETTI REPORT
40
Monday, November 12, 12
CONFETTI REPORT
41
Monday, November 12, 12
CONFETTI REPORT
41
Monday, November 12, 12
LANDINGPAGES
42
Monday, November 12, 12
ROI FACTORS OF LANDING PAGES
43
Monday, November 12, 12
ROI FACTORS OF LANDING PAGES
• Load time
43
Monday, November 12, 12
ROI FACTORS OF LANDING PAGES
• Load time
• Design
43
Monday, November 12, 12
ROI FACTORS OF LANDING PAGES
• Load time
• Design
• Copy
43
Monday, November 12, 12
ROI FACTORS OF LANDING PAGES
• Load time
• Design
• Copy
• Call to action
43
Monday, November 12, 12
TOOLS:OPTIMIZELY
• A/B Testing
• Multi-variate testing*downside: high traffic needed
44
Monday, November 12, 12
TOOLS:OPTIMIZELY
• A/B Testing
• Multi-variate testing*downside: high traffic needed
44
Monday, November 12, 12
A/B TESTING
45
Monday, November 12, 12
A/B TESTING
OR
45
Monday, November 12, 12
MULTIVARIATE TESTING
46
Monday, November 12, 12
MULTIVARIATE TESTING
46
Monday, November 12, 12
47
Monday, November 12, 12
ROI FACTORS IN EMAIL:
48
Monday, November 12, 12
ROI FACTORS IN EMAIL:• Content
• Subject line• From address• Copy • Offer
48
Monday, November 12, 12
ROI FACTORS IN EMAIL:• Content
• Subject line• From address• Copy • Offer
• Design• Specs• Layout/hierarchy• Call to action
48
Monday, November 12, 12
LITMUS
49
Monday, November 12, 12
LITMUS
49
Monday, November 12, 12
A/B TESTING
50
Monday, November 12, 12
A/B TESTING
50
Monday, November 12, 12
MOBILEtake a look at your mobile stats
51
Monday, November 12, 12
MOBILEtake a look at your mobile stats
51
Monday, November 12, 12
MOBILEuse a mobile template
52
Monday, November 12, 12
MOBILEuse a mobile template
52
Monday, November 12, 12
MOBILEdesign principles for mobile email
53
Monday, November 12, 12
MOBILEdesign principles for mobile email
53
Monday, November 12, 12
MOBILE EMAIL DESIGN
54
Monday, November 12, 12
MOBILE EMAIL DESIGN
• Single-column layouts that are no wider than 500 to 600 pixels
54
Monday, November 12, 12
MOBILE EMAIL DESIGN
• Single-column layouts that are no wider than 500 to 600 pixels• Links and buttons should have a minimum target area of 44 × 44
pixels, as per Apple guidelines.
54
Monday, November 12, 12
MOBILE EMAIL DESIGN
• Single-column layouts that are no wider than 500 to 600 pixels• Links and buttons should have a minimum target area of 44 × 44
pixels, as per Apple guidelines. • The minimum font size displayed on iPhones is 13 pixels.
54
Monday, November 12, 12
MOBILE EMAIL DESIGN
• Single-column layouts that are no wider than 500 to 600 pixels• Links and buttons should have a minimum target area of 44 × 44
pixels, as per Apple guidelines. • The minimum font size displayed on iPhones is 13 pixels.• More than ever, keep your message concise,
54
Monday, November 12, 12
MOBILE EMAIL DESIGN
• Single-column layouts that are no wider than 500 to 600 pixels• Links and buttons should have a minimum target area of 44 × 44
pixels, as per Apple guidelines. • The minimum font size displayed on iPhones is 13 pixels.• More than ever, keep your message concise,• Hide extraneous details in your mobile layout.
54
Monday, November 12, 12
OPTIMIZINGFACEBOOK ADS
55
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
56
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
• Targeting
56
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
• Targeting
• Image
56
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
• Targeting
• Image
• Headline
56
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
• Targeting
• Image
• Headline
• Copy
56
Monday, November 12, 12
FACTORS IN FACEBOOKAD ROI
• Targeting
• Image
• Headline
• Copy
• Landing page
56
Monday, November 12, 12
SEGMENTED TARGETINGnarrow, segmented targeting is a must
57
Monday, November 12, 12
SEGMENTED TARGETINGnarrow, segmented targeting is a must
57
Monday, November 12, 12
MULTI-VARIATE TESTINGavailable tools: Qwaya
58
Monday, November 12, 12
MULTI-VARIATE TESTINGavailable tools: Qwaya
58
Monday, November 12, 12
AD ROT?Rotate those ads!
59
Monday, November 12, 12
AD ROT?Rotate those ads!
59
Monday, November 12, 12
TAGGINGtagging links by campaign/content URLs is a must
60
Monday, November 12, 12
TAGGINGtagging links by campaign/content URLs is a must
60
Monday, November 12, 12
EXERCISES
61
Monday, November 12, 12
QUESTIONS
62
Monday, November 12, 12
A/B TESTS
63
Monday, November 12, 12
A/B TESTS
• Subject line:
• A: Save $10 on New York City Ballet
• B: Save 10% on New York City Ballet
63
Monday, November 12, 12
A/B TESTS
• Subject line:
• A: Save $10 on New York City Ballet
• B: Save 10% on New York City Ballet
• Subject line
• A: Yo-Yo Ma $40 tickets available!
• B: Classical Masters Series: Yo-Yo Ma Save 30%63
Monday, November 12, 12
A/B TESTS
64
Monday, November 12, 12
A/B TESTS
• From address:
• From: [email protected]: Annual report
• From: Judi Huck [email protected]: It’s been a good year for us
64
Monday, November 12, 12
A/B TESTS
• From address:
• From: [email protected]: Annual report
• From: Judi Huck [email protected]: It’s been a good year for us
• Call to action:
• A: Great seats still available!
• B: Book now!64
Monday, November 12, 12
RESOURCES
• ZURB Apps
• Plunk (plunkapp.com)
• Clue (clueapp.com)
• Notable (notableapp.com)
• Verify (verifyapp.com)
• Invision (invisionapp.com)
• Google Analytics (google.com/analytics)
• Gauges (gaug.es)
• Chartbeat (chartbeat.com)
65
Monday, November 12, 12
RESOURCES (CONT’D)
• Google URL Builder (http://support.google.com/analytics/bin/answer.py?hl=en&answer=1033867)
• Click Heat (http://www.labsmedia.com/clickheat/index.html)
• ClickTale (clicktale.com)
• Crazy Egg (crazyegg.com)
• Optimizely (optimizely.com)
• Litmus (litmus.com)
66
Monday, November 12, 12
IMAGE SOURCES (CC)Slide 2:
Bridge: http://www.flickr.com/photos/jenik/1032573169/
Slide 4:Things Organized Neatly: http://thingsorganizedneatly.tumblr.com/post/29420742974/submission-old-school-deconstruction-givewave
Slide 5:Chemistry Set: http://www.flickr.com/photos/unloveable/2395867186/
Slide 9:Whack-a-mole: http://www.flickr.com/photos/tpapi/2765541278/
Slide 10:The Megahangar: http://www.flickr.com/photos/stuckincustoms/5699183849/
Slide 12:
Teeter Totter: http://www.flickr.com/photos/joephotos/748426315/
Slide 13:Brain: http://www.flickr.com/photos/lizhenry/2051224366/Wright: http://www.flickr.com/photos/7726011@N07/3364409856/Supernova: http://www.flickr.com/photos/nasamarshall/6313004758/
Slide 15:Lion King: http://cdn0.hark.com/images/000/006/667/6667/original.0
Slide 18: Where’s Waldo: http://www.flickr.com/photos/jameson42/4353769995/
67
Monday, November 12, 12