ses san jose ad testing research & findings
TRANSCRIPT
![Page 1: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/1.jpg)
1
Ad Testing: Research & Findings
![Page 2: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/2.jpg)
2
What are the Keys to Successful Testing?
• Design your test around a single question• Have a large differentiation b/w tested elements• Account for changes in temporal behavior• Collect enough data to reduce margin of error• Segment results to provide added insight• Act on the results!
![Page 3: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/3.jpg)
3
Don’t Guess! - Ads for “loan”
loanGreat Rates. On Time ClosingNo lender fees. Bad Credit OKwww.loans.brand.com
brand loans apply nowLow Rates. Approval in MinutesPersonal Service. Apply Online Now!www.brand.com
A
B
C
low rate loansLow Rates. Approval in MinutesNo lender fees. Bad Credit OKwww.loans.brand.com
![Page 4: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/4.jpg)
4
Don’t Guess! - loan adgroup
loanGreat Rates. On Time ClosingNo lender fees. Bad Credit OKwww.loans.brand.com
brand loans apply nowLow Rates. Approval in MinutesPersonal Service. Apply Online Now!www.brand.com
A
B
C
low rate loansLow Rates. Approval in MinutesNo lender fees. Bad Credit OKwww.loans.brand.com
3.79% Conversion
2.32% Conversion
0.95% Conversion
![Page 5: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/5.jpg)
5
–Impression–Interest–Expectation–Persuasion
![Page 6: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/6.jpg)
6
Ads Persuade!
![Page 7: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/7.jpg)
7
Ads (the meat of the relevance sandwich)
![Page 8: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/8.jpg)
8
Intention
Enticement
Goal Fulfillment
![Page 9: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/9.jpg)
9
Test Ads by
Match Type!
![Page 10: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/10.jpg)
10
Test 1: Is Running Ads on Brand Queries a Waste of Money?
Example SERP w/o Ad Example SERP w/ Ad
![Page 11: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/11.jpg)
11
Test Design
• 1 week ads on 1 week off• No issues of seasonality or promotion• 30 Branded Keywords• 1 version of ad
11
![Page 12: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/12.jpg)
12
Did the Ads Drive Traffic?
• Google -1.3%• Yahoo -8.7%• Live -7.3%
NO
![Page 13: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/13.jpg)
13
Did the Ads Increase Conversion Rate?
• Google +17.9%• Yahoo +32.1%• Live +11.7%
YES
![Page 14: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/14.jpg)
14
Did the Ads Increase RPV?
• Google +15.4%• Yahoo +47.0%• Live +27.5%
YES
![Page 15: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/15.jpg)
15
New Questions
• Marketing to Intent?• Power of Persuasion?• Power of Brand in Search?
15
![Page 16: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/16.jpg)
16
Test 2: What is the Best Ad to Increase Conversion?
Ad TestingMultivariate Testing WorksIncrease Conversion Ratesottodigital.com/ads
Element 1
Element 2
Element 3
Element 4
4x3 L9 Orthogonal Array
4 Elements 3 Variations
![Page 17: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/17.jpg)
17
Test Design
• 9 Ads Created and Tagged w/ URL Parameter• Landing and Thank You Page Tagged• Ad Serving Optimization Turned OFF
17
![Page 18: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/18.jpg)
18
What does an L9 Array Really Look Like?Recipe (9) Title (3) D1 (3) D2 (3) URL (3)
A - Control {keyword} Search {AdGroup} suppliers
Compare Products Today
www.brand.com
B {keyword} Find {keyword} suppliers Search Thousands of Products
www.brand.com/{keyword}
C {keyword} Find Parts fast at (brand) {keyword} catalog search
www.brand.com/catalogs
D {keyword} suppliers Search {AdGroup} suppliers
Compare Products Today
www.brand.com/catalogs
E {keyword} suppliers Find {keyword} suppliers Search Thousands of Products
www.brand.com
F {keyword} suppliers Find Parts fast at (brand) {keyword} catalog search
www.brand.com/{keyword}
G {keyword} catalog Search {AdGroup} suppliers
Compare Products Today
www.brand.com/{keyword}
H {keyword} catalog Find {keyword} suppliers Search Thousands of Products
www.brand.com/catalogs
I {keyword} catalog Find Parts fast at (brand) {keyword} catalog search
www.brand.com
![Page 19: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/19.jpg)
19
What Were the Results?
Recipe Visitors Conversion Lift
A - Control 11.80% 5.88% ---
B 14.30% 4.29% -27.05%
C 14.04% 6.08% 3.42%
D 9.34% 2.57% -56.29%
E 13.00% 6.16% 4.72%
F 9.42% 5.38% -8.50%
G 10.06% 5.04% -14.32%
H 10.41% 5.13% -12.82%
I 7.63% 8.04% 36.71%
![Page 20: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/20.jpg)
20
What Were the Results?
Recipe Visitors Conversion Lift
A - Control 11.80% 5.88% ---
B 14.30% 4.29% -27.05%
C 14.04% 6.08% 3.42%
D 9.34% 2.57% -56.29%
E 13.00% 6.16% 4.72%
F 9.42% 5.38% -8.50%
G 10.06% 5.04% -14.32%
H 10.41% 5.13% -12.82%
I 7.63% 8.04% 36.71%
![Page 21: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/21.jpg)
21
What is the breakdown?
• Other Ads the Used Winning Title– -14%
– -12%
• Other Ads the Used Winning D1– +3.42%
– -8.5%
• Other Ads the Used Winning URL– Control
– +4.72%
www.brand.com
Find Parts fast at (brand)
{keyword} catalog
![Page 22: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/22.jpg)
22
What Ad Elements Influenced Conversion?
Element Winning Alternative Influence on Conversion
Title {keyword} suppliers 13.54%
D1 Find {keyword} suppliers 53.53%
D2 Search Thousands of Products
23.56%
URL www.brand.com/{keyword} 9.37%
![Page 23: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/23.jpg)
23
What’s Better?
{keyword} catalogFind parts fast at (brand){keyword} catalog searchwww.brand.com
{keyword} suppliersFind {keyword} suppliersSearch Thousands of Productswww.brand.com/{keyword}
Winning Recipe Best Predicted
Best Predicted +52% Lift in Conversion Rate
![Page 24: SES San Jose Ad Testing Research & Findings](https://reader035.vdocuments.net/reader035/viewer/2022070322/5592dd3e1a28ab023c8b46ef/html5/thumbnails/24.jpg)
24
Jonathan Mendez, Chief Strategy Officer
My Blog:
optimizeandprophesize.com