web-based surveysweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf ·...
TRANSCRIPT
![Page 1: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/1.jpg)
WEB-BASED SURVEYS
By
Damai Nasution
© Damai Nasution
![Page 2: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/2.jpg)
Introduction
SURVEY is a structured way to collect standardized information from individuals using a questionnaire.
◦ Surveys may be conducted once; at repeated intervals, or concurrently with multiple samples
◦ They may be used to collect information from a few or many
© Damai Nasution
![Page 3: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/3.jpg)
Types of surveys1. Face-to-face
2. Telephone
3. Written questionnaire:
a. Hand-out
b. Mail
c. Email
d. Web-based survey
4. Mixed mode: uses two or more of above
© Damai Nasution
![Page 4: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/4.jpg)
Paper vs. Web-Based Surveys
Benefits/Advantages associated with web-based surveys
◦ eliminates printing for questionnaires;
◦ eliminates mailing costs for questionnaires;
◦ reduces costs for coding respondents‟ data;
◦ reduced data entry time;
◦ reduces human-error;
© Damai Nasution
![Page 5: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/5.jpg)
Paper vs. Web-Based Surveys
◦ effectively reaches respondents in different
geographic areas;
◦ reaches respondents in a relatively short amount of
time (Bertot and McClure, 1996; Schmith and
Leight, 1997; Teo, Lim, and Lai, 1997; Schmidt, 1997;
Sackmary, 1998; Zhang, 2000).
◦ faster survey return rates.
© Damai Nasution
![Page 6: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/6.jpg)
Paper vs. Web-Based Surveys
Challenges/Disadvantages associated with web-based
surveys
◦ Technology (problems with or limited access to)
Impact on sample or return rate
◦ Perceived concern with anonymity
◦ Mistakes in technology (i.e. code) can impact the results
and responses
© Damai Nasution
![Page 7: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/7.jpg)
Paper vs. Web-Based Surveys
Previous literature
◦ Web-based surveys may generate incorrect results when:
multiple responses from the same participant are present;
empty (blank) responses;
incomplete responses;
invalid responses; or
biased responses are submitted (Strauss, 1996; Schmidt, 1997;
Zhang, 2000).
© Damai Nasution
![Page 8: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/8.jpg)
Paper vs. Web-Based Surveys
◦ Higher (lower) response rates found for web-based surveys
◦ Mixed results over which mode lends to the most “skipped” or “missing” data
◦ One needs to consider the technology skills of the user and the technology of the user‟s computer
◦ Presumed to have lower cost and take less time, but not always the case (must consider the entire survey process)
◦ Responses may not be “the same” for the different modes, Some research suggested more positive responses with web-based surveys
© Damai Nasution
![Page 9: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/9.jpg)
Planning a survey
1. Determine who should be involved in conducting the survey
2. Define what information you will collect
◦ What do you want to know?
◦ How will use the information?
3. Identify the respondents
◦ Determine sampling strategy, if a sample is to be used
4. Think about data analysis – what will the end product/final report include (keep „the end in mind‟!)
© Damai Nasution
![Page 10: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/10.jpg)
Planning a survey
5. Develop the questionnaire
6. Pilot test the questionnaire
6. Develop the web-based questionnaire
7. Pilot test the web-based questionnaire
8. Develop a communication strategy to garner support for the survey
9. Consider budget, timeline, and management process
◦ What resources are available?
© Damai Nasution
![Page 11: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/11.jpg)
Planning a survey
© Damai Nasution
![Page 12: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/12.jpg)
Things to consider with web-based surveys
Screen-by-screen vs. scrolling
◦ Research suggests improved response rates for multiple questions per screen Completion time faster, fewer non-answered questions, more
similarity in answers
Plain vs. fancy web-survey
◦ Research indicated that higher responses rates were obtained for plain surveys
© Damai Nasution
![Page 13: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/13.jpg)
Things to consider with web-based
surveys
First question
◦ Research has shown that this is a major drop-out point for many respondents
Open-versus closed-ended questions
◦ Research suggests greater drop-out for open-ended questions
© Damai Nasution
![Page 14: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/14.jpg)
Things to consider with web-based surveys
Research suggests:
◦ Do:
Keep survey brief and concise
Place confidential or personal information at the end of the survey
Have response categories in progressive order (lowest to highest)
Write an introduction to the survey
Use filtering questions
Divide surveys into sections
Use a convention similar to paper surveys
Provide adequate instructions
Pay close attention to physical layout
Provide incentives
◦ Don’t (i.e. avoid):
Use open-ended questions
Have the response category of “other”
Use response scale proliferation (i.e. 6 or 7 point scale)
Ask respondents to rank responses
Design long (excessive) surveys
Overuse “fancy” features
© Damai Nasution
![Page 15: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/15.jpg)
How to improve a response rate
◦ E-mail cover letters (invitation letter)
◦ Anonymity explanation
◦ Follow-up reminders via e-mail
◦ Pre-notification with intent of survey
◦ Simpler formats
◦ Plain design
◦ Mixed mode surveys (allow paper or web)
◦ Shorter surveys
© Damai Nasution
![Page 16: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/16.jpg)
Google Docs Application
Data will be automatically recorded in the
spreadsheet format;
Present real time data;
© Damai Nasution
![Page 17: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/17.jpg)
Google Docs Application
Survey can be sent to the respondents by email, a hyperlink or embedded on a web page (e.g. Facebook);
It has a good appearance.
It is a free web-based surveys tool;
© Damai Nasution
![Page 18: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/18.jpg)
How to
You must have a gmail account.
Sign-in to your gmail account, or directly
sign in to docs.google.com
Click create new - form.
© Damai Nasution
![Page 19: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/19.jpg)
Add question,
Section header,
and page break)
There are many
Themes that can be
picked. The theme will
affect the
questionnaire
appearance
Form titleForm
introduction
Questions type
Question
and help text
Edit, duplicate,
and delete
Option if the
question is
mandatory
To finish the
question
Drag & drop
question to
move it up
and down in
the form
Save the
form
To share the
form
© Damai Nasution
![Page 20: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/20.jpg)
How toQuestions → Survey questions type:
• Text
• Paragraph text
© Damai Nasution
![Page 21: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/21.jpg)
How to
• Multiple choice
• Checkboxes
© Damai Nasution
![Page 22: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/22.jpg)
How to
• Choose from a list
• Scale
© Damai Nasution
![Page 23: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/23.jpg)
How to
Grid
© Damai Nasution
![Page 24: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/24.jpg)
How to
Other:
◦ Section header – if you want to devide the
questionnaire in sections to make it easier to
read and complete.
◦ Page break
© Damai Nasution
![Page 25: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/25.jpg)
How to
How to share the finished-form?
◦ In the top of finished form you will find ”email this form” menu, or
◦ In the spreadsheet, choose ”Form” then ”sendform”
© Damai Nasution
![Page 26: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/26.jpg)
Respondents email
If you check this box then
respondents can fill the form out
directly in their email page
© Damai Nasution
![Page 27: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/27.jpg)
How to
Or, you can embed the form directly on the
web page. Just copy and paste the link in the
bottom of form.
Link to the form
© Damai Nasution
![Page 28: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/28.jpg)
How to
Spreadsheet appearance:
© Damai Nasution
![Page 29: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/29.jpg)
© Damai Nasution
![Page 30: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/30.jpg)
Exercise
Open the ms-word file (exercise1) and create a web-based questionnaire using Google Docs.
After that, send the questionnaire to your ÅA email.
Fill-in the questionnaire and look at the Google Docs spreadsheet how your answers recorded.
Report your test in written form by the end of this course week
© Damai Nasution
![Page 31: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/31.jpg)
References Alsnih, R. (2006). ” Characteristics of web based surveys and application
in travel research”, Research paper, Retreived on 18/04/2012, from http://isctsc.let.fr/pastConf/CostaRica/B5/B5%20-%20Resource%20Alsnih.pdf.
Alvarez M. R., and VanBeselaere C. (n.d.). ”Web-Based Surveys”, Retrieved on 18/04/2012, from http://www.mta.ca/~cvanbese/encyclopedia_new2.pdf.
Cobanoglu, C., Warde, B, and Moreo, P. J. (2001). “A comparison of mail, fax and web-based survey methods”, International Journal of Market Research, Volume: 43, Issue: 4, pp. 441-452.
Dillman, D. A., Tortora, R. D., Conradt, J., Bowker, D. (n.d). “Influence of plain vs. fancy design on response rates for web surveys”, Retrieved on 18/04/2012, from http://survey.sesrc.wsu.edu/dillman/papers/1998/influenceofplain.pdf.
Fan, W., and Yan, Z. (2009). ” Factors affecting response rates of the web survey: A systematic review”, Computers in Human Behavior 26, pp.132–139.
© Damai Nasution
![Page 32: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/32.jpg)
References
Haysletta M. M., and Wildemuth B. M. (2004). ” Pixels or pencils? The relative effectiveness of Web-based versus paper surveys”, Library & Information Science Research 26, pp. 73–93.
N. N. (nd). “Survey Research”, Retrieved 19/04/2012, from http://edutech.msu.edu/online/Labs/surveys/Page_data/Survey%20Research.ppt.
Roztocki, N. (2001). “Using Internet-Based Surveys for Academic Research: Opportunities and Problems”, Proceeding at the American Society of Engineering Management (ASEM) National Conference, Retrieved on 19/04/2012, from http://www2.newpaltz.edu/~roztockn/alabam01.pdf.
Solomon, D. J. (2001). Conducting web-based surveys. Eric Digest. Retrieved 19/04/2012, from http://www.ericdigests.org/2002-2/surveys.htm.
© Damai Nasution
![Page 33: WEB-BASED SURVEYSweb.abo.fi/.../kursparm/statistics/web_questionnaire/web_based_surveys.pdf · Paper vs. Web-Based Surveys Higher (lower) response rates found for web-based surveys](https://reader033.vdocuments.net/reader033/viewer/2022041416/5e1b4f12aa7a306620072680/html5/thumbnails/33.jpg)
© Damai Nasution