cro from the ground up
DESCRIPTION
Slide deck from Digital Growth Party 2014.TRANSCRIPT
![Page 1: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/1.jpg)
brought to you by...
CROFROM THE GROUND UP
![Page 2: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/2.jpg)
@tallen1985
“Increase traffic”
![Page 3: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/3.jpg)
@tallen1985
“Increase the number of social shares”
![Page 4: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/4.jpg)
@tallen1985
“Get 1,000 links”
![Page 5: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/5.jpg)
@tallen1985
![Page 6: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/6.jpg)
@tallen1985
Earning coverage to drive more traffic, social shares and links/placements is TOUGH..
![Page 7: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/7.jpg)
@tallen1985
..and potentially expensive
![Page 8: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/8.jpg)
@tallen1985
We spend on:
SEOPaid Advertising (Google, Bing, or Social channels)Email Marketingplus many more channels
![Page 9: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/9.jpg)
@tallen1985
What if you spend all this money but your conversion rate sucks?
https://medium.com/@kitinmaki/does-your-conversion-rate-suck-c9b1077f6990
![Page 10: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/10.jpg)
@tallen1985
If you’re selling nuclear submarines you probably won’t
be selling that many
Craig BradfordSenior Consultant, Distilled
![Page 11: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/11.jpg)
@tallen1985
If You Get 10,000 Visits
![Page 12: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/12.jpg)
@tallen1985
Resulting in only 6 transactions
![Page 13: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/13.jpg)
@tallen1985
The answer isn’t to get another 10,000 visits
![Page 15: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/15.jpg)
@tallen1985
TODAYS SESSION
DISCOVERY
EXPERIMENTS
RESULTS
PLANNING
![Page 16: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/16.jpg)
PLANNING
![Page 17: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/17.jpg)
@tallen1985
HOW LONG IS THIS GOING TO TAKE?
![Page 18: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/18.jpg)
@tallen1985
1. Do your landing pages generate enough traffic?
![Page 19: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/19.jpg)
@tallen1985http://www.evanmiller.org/ab-testing/sample-size.html
![Page 20: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/20.jpg)
@tallen1985http://www.evanmiller.org/ab-testing/sample-size.html
![Page 21: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/21.jpg)
@tallen1985
![Page 22: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/22.jpg)
@tallen1985
2. How long should I be running tests for?
![Page 23: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/23.jpg)
@tallen1985
You should look to run tests for at least two business cycles and at least 250 conversions (ideally 350+)
http://www.slideshare.net/sullivac/20-simple-ways-to-fuck-up-your-ab-testing-measurefest
![Page 24: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/24.jpg)
@tallen1985
How long is it going to take to get this many conversions?
![Page 25: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/25.jpg)
WE DON’T RECEIVE THAT MUCH TRAFFIC OR
CONVERSION
![Page 26: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/26.jpg)
@tallen1985
CONSIDER BOOSTING NUMBERS BY USING PPC
![Page 27: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/27.jpg)
@tallen1985
Look at micro conversions such as:
- video plays- newsletter sign ups- social interactions
![Page 28: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/28.jpg)
DISCOVERY
![Page 29: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/29.jpg)
CAN’T CONVERT
![Page 30: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/30.jpg)
@tallen1985
USE SEGMENTATION
![Page 31: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/31.jpg)
@tallen1985
BOUNCE RATEMEDIUM
BROWSERDEVICE
![Page 32: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/32.jpg)
@tallen1985
![Page 33: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/33.jpg)
@tallen1985http://www.paditrack.com
![Page 34: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/34.jpg)
WON’T CONVERT
![Page 35: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/35.jpg)
@tallen1985
Peter Drucker
“The customer rarely buys what the business thinks it sells him."
![Page 36: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/36.jpg)
@tallen1985
QUALAROO
http://www.qualaroo.com
![Page 37: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/37.jpg)
@tallen1985
Pro Tip: Ask consumers who have already completed their purchase:
“What was the one thing that nearly stopped you purchasing today?”
![Page 38: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/38.jpg)
@tallen1985
PROCESSING FEEDBACK
![Page 39: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/39.jpg)
GOOGLE CONSUMER SURVEYS
![Page 40: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/40.jpg)
@tallen1985
GOOGLE CONSUMER SURVEYS
http://www.googleconsumersurveys.com
WHATS THE ONE THING THAT WOULD STOP YOU BUYING CURRENCY ONLINE?
Answers:
“Security”“Is Paypal accepted”“Knowing my details are safe”“Being sure my money will arrive safely”
![Page 41: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/41.jpg)
@tallen1985
USER TESTING
http://www.usertesting.com
![Page 42: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/42.jpg)
@tallen1985http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
![Page 43: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/43.jpg)
HYPOTHESIS
![Page 44: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/44.jpg)
@tallen1985
“I AM GOING TO ADD A VIDEO TO THE HOMEPAGE”
![Page 45: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/45.jpg)
@tallen1985
WHY?
![Page 46: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/46.jpg)
@tallen1985
“I AM GOING TO ADD A VIDEO TO THE HOMEPAGE BECAUSE CUSTOMERS FIND THE
PRODUCT DIFFICULT TO UNDERSTAND”
![Page 47: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/47.jpg)
EXPERIMENTS
![Page 48: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/48.jpg)
@tallen1985
Wireframes
![Page 49: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/49.jpg)
@tallen1985http://www.balsamiq.com
![Page 50: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/50.jpg)
@tallen1985
AVOID GETTING FEEDBACK SUCH AS:
THOSE DESIGNS DON’T USE BRAND COLOURS
THATS NOT THE FONT WE USE
![Page 51: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/51.jpg)
@tallen1985
![Page 52: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/52.jpg)
CREATING EXPERIMENTS
![Page 53: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/53.jpg)
@tallen1985
WHY USE OPTIMIZELY
![Page 54: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/54.jpg)
A FEW TIPS
![Page 55: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/55.jpg)
@tallen1985
Know the scale of your changes - this will influence the way you create your tests
http://moz.com/blog/6-things-i-wish-i-knew-before-using-optimizely
![Page 56: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/56.jpg)
@tallen1985
![Page 57: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/57.jpg)
@tallen1985
![Page 58: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/58.jpg)
@tallen1985
ENSURE YOU ENABLE ANALYTICS TRACKING
https://www.distilled.net/resources/statistical-significance-for-cro-6-things-you-need-to-know/
![Page 59: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/59.jpg)
@tallen1985https://www.distilled.net/resources/statistical-significance-for-cro-6-things-you-need-to-know/
![Page 60: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/60.jpg)
@tallen1985
GOOGLE ANALYTICS ALLOWS YOU TO TRACK THING YOU MAY NOT EVEN OF THOUGHT OF
![Page 61: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/61.jpg)
TEST YOUR VARIATIONS
![Page 62: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/62.jpg)
@tallen1985
![Page 63: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/63.jpg)
THINGS NOT TO DO
![Page 64: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/64.jpg)
@tallen1985
DON’T CHANGE TRAFFIC ALLOCATION
https://www.distilled.net/resources/statistical-significance-for-cro-6-things-you-need-to-know/
![Page 65: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/65.jpg)
@tallen1985
GET TO EXCITED (OR DISAPPOINTED) TOO EARLY
![Page 66: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/66.jpg)
@tallen1985
DEFINITELY DON’T TELL YOUR BOSS (YET)
![Page 67: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/67.jpg)
RESULTS
![Page 68: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/68.jpg)
@tallen1985
CHECK SIGNIFICANCE & AIM FOR 95% OR HIGHER
![Page 69: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/69.jpg)
@tallen1985
Statistical significance is all about whether the difference
between two numbers is meaningful or just a fluke
Tom Capperhttps://www.distilled.net/resources/statistical-significance-for-cro-6-things-you-need-to-know/
![Page 70: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/70.jpg)
@tallen1985
![Page 71: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/71.jpg)
@tallen1985
![Page 72: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/72.jpg)
@tallen1985http://getdatadriven.com/ab-significance-test
![Page 73: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/73.jpg)
@tallen1985
SEGMENT OR DIE? HERE’S HOW I NEARLY DIED...
http://moz.com/blog/6-things-i-wish-i-knew-before-using-optimizely
![Page 74: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/74.jpg)
@tallen1985
![Page 75: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/75.jpg)
@tallen1985
ALLOCATE ALL TRAFFIC TO WINNING VARIATION
![Page 76: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/76.jpg)
SUMMARY
![Page 77: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/77.jpg)
DISCOVERY- SEGMENT DATA TO LOOK FOR CAN’T CONVERT
OPPORTUNITIES- GATHER AS MUCH USER DATA AS POSSIBLE TO
UNDERSTAND WHY CUSTOMER WON’T CONVERT
![Page 78: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/78.jpg)
EXPERIMENTS- ENSURE ANALYTICS TRACKING IS TURNED ON
- DON’T CHANGE TRAFFIC ALLOCATION ONCE TESTS ARE LIVE
![Page 79: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/79.jpg)
RESULTS- ONLY ROLL OUT SUCCESSFUL TESTS THAT ACHIEVE
SIGNIFICANCE OF 95% OR MORE- USE TRAFFIC ALLOCATION TO ROLL OUT VARIATIONS WHILE WAITING FOR DEVELOPERS TO PERMANENTLY
IMPLEMENT CHANGES
![Page 80: CRO From the Ground Up](https://reader034.vdocuments.net/reader034/viewer/2022051314/54c43bc84a79594b1c8b459e/html5/thumbnails/80.jpg)
THANK YOU
@tallen1985
ANY QUESTIONS?