would you answer these questions?
TRANSCRIPT
![Page 1: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/1.jpg)
Would you answer these questions?
Susan FredeVP, Research Methods & Best PracticesMarch 2016
![Page 2: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/2.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Poor quality survey design contributes to…• Low completion rates• High dropout rates • Speeding • Straight-lining and other suspicious behavior• Panel attrition • Higher sample costs
Potentially leading to bad data, unrepresentive samples, and ultimately incorrect business decisions
![Page 3: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/3.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Mobile may finally force better survey design
![Page 4: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/4.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Let’s look at blinded screen shots from real-world surveys
Think like a respondent…• Would you answer/be able to answer each one?• What would be your reaction to each one?• What is bad about each one?• How would you improve each one?
![Page 5: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/5.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
![Page 6: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/6.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Unnecessary scene setting/introduction
• Most respondents are not going to read all of this
![Page 7: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/7.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 8: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/8.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Need clear instructions – format for date
• Some respondents are hesitant to give exact birth date for privacy/security reasons
• Better to ask age or age range question
![Page 9: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/9.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 10: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/10.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Use appropriate terminology for specific country
• Current account is a common UK term for checking account
• It is important on global projects to get regional input
![Page 11: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/11.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
![Page 12: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/12.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Need to clearly define terminology
• What is meant by charitable donations? Money? Used clothing/household items? Time?
• Five years is a long time period for respondents to recall
![Page 13: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/13.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
![Page 14: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/14.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Poor layout
• Check boxes need to be much closer to the answer text
• Could also shade every other row
• Or when a row is selected it is shaded
![Page 15: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/15.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 16: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/16.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Missing a ‘none’ option
• Could not proceed without choosing one of the four answers
![Page 17: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/17.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 18: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/18.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Extremely long list of almost 100 TV programs
• Best bet is to cut the list down or randomly select a subset
• Show in multiple columns; however, old research has shown mixed results with multiple columns
![Page 19: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/19.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 20: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/20.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Another long list with nearly 100 items
• Have to respond with something for every item so this is extremely time consuming for the respondent
• Some would split this into multiple questions; however, this just causes respondents to complain about repetition and increases dropout rates with each additional grid
• Again, best bet is to cut the list down or randomly select a subset of movies
• Might also try a more interactive question style
• Watch wasted space…large gray box and company logo
![Page 21: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/21.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 22: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/22.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Factual questions should be in alphabetical order so respondents can easily find their response
![Page 23: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/23.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 24: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/24.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Horizontal scrolling is a huge no-no…there are five more columns when scrolling right
• Unequal column widths can cause bias in the answers
• Would be better if first ask what social networks respondent has used in last seven days
• Then specifically ask what activities the respondent has done on each site
• This will likely allow social networks to run across the top with no scrolling and activities down the side
• Could also use a more interactive question style
![Page 25: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/25.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
![Page 26: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/26.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• Column headings should always be visible
• Scrolling up and down leads to errors
![Page 27: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/27.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
Company XYZ
![Page 28: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/28.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
• This is a large grid…could never read this on a mobile phone
• Two key improvements: 1. change to five point scale 2. use a more interactive question style such as
dynamic grids
• Other issue is topic relevancy…can someone who has only heard of the brand really answer these questions?
![Page 29: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/29.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
![Page 30: Would you answer these questions?](https://reader034.vdocuments.net/reader034/viewer/2022051706/58e51c5a1a28ab624e8b533d/html5/thumbnails/30.jpg)
Copyright © 2016 Lightspeed, LLC. Proprietary and Confidential. All rights reserved.
www.lightspeedgmi.com [email protected]
CONTACT US