knut kalgraff skjåk kirstine kolsrud
DESCRIPTION
Experiences with mixed mode mail & web-enquêtes in probability samples with known individuals. Knut Kalgraff Skjåk Kirstine Kolsrud. Norwegian Social Science Data Services. 2nd WEBDATANET Meeting, Amsterdam, 30 November 2011. Presented by Knut Kalgraff Skjåk. Background. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/1.jpg)
Knut Kalgraff SkjåkKirstine Kolsrud
2nd WEBDATANET Meeting, Amsterdam,
30 November 2011
Norwegian Social Science Data Services
Experiences with mixed mode mail & web-enquêtes
in probability samples with known individuals
Presented by Knut Kalgraff Skjåk
![Page 2: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/2.jpg)
Background
International Social Survey Programme (ISSP)• Annual social survey• NSD, Norwegian member and responsible for ISSP Norway
since 1989• The ISSP surveys
– Topics of central importance for cross national social science (Role of Government, Social Inequality, Religion, Family and Gender Roles, Work orientation, Environment etc)
– 11 topics fielded to date, repeated at intervals
– 60 topic items + 40 background variables
– Mode of administration: self-administration and face to face
– National representative random samples aged 18 and older.
![Page 3: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/3.jpg)
Background
National setting
• Sample frame: National Population Register (named individuals)
• Restricted number of reminders
• Restricted budgets
• Mode: self-administration• Information, deliveries and social exchange by post
![Page 4: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/4.jpg)
Unit nonresponse in ISSP Norway 2000-2009Total and selected age/gender groups
0
10
20
30
40
50
60
70
80
2000 2001 2002 2003 2004 2006 2007 2008 2009
Total Male 18-24 Female 18-24 Male 65-79 Female 65-79
![Page 5: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/5.jpg)
Other bias
Nonresponse among younger men, 2011, by place of living
Representing men 18-24 years in Oslo
18-24 yrs 95%
25-34 yrs 76%
Oslo
18-24 yrs 71%
25-34 yrs 64%
Next three largest cities
18-24 yrs 72%
25-34 yrs 72%
Rest of the country
![Page 6: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/6.jpg)
Why introduce websurvey?
• Mixed mode design, freedom of choice, reduce unit nonresponse and increase data quality
• More attractive for certain groups• No “mailbox effect”• Administrative advantages
– Low cost– Collected electronically, no transfer costs – Data file created on the spot– Administrative records continuously updated– Paradata
• Quality– Control of skip patterns– More detailed response to open ended question (Schaefer &
Dillman 1989)– Less item non-response ?
![Page 7: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/7.jpg)
Implementation of experiment 2011
•Gross sample 3 600 persons aged 18-79
•2 modes of self-administration, Web and PaP
•Aims– decrease in unit nonresponse– maximised share of Web-respondents, (reduce bias)
• Contact design– Split ballot (1 800 + 1 800)
Group 1. “This is a Websurvey” Group 2. “This is a mixed mode survey”
![Page 8: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/8.jpg)
Timeline
![Page 9: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/9.jpg)
Results Response rates1 by response mode, and 1st
response mode offered
![Page 10: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/10.jpg)
Item nonresponse 1 – topic module
![Page 11: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/11.jpg)
Item nonresponse 2 – verbatim recorded answers
Occupation of respondent:
Web: 8,2 % missing
Paper: 11,5 % missing
![Page 12: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/12.jpg)
What is next?
• Keep mixed mode with Web and PaP
• Target groups for tailored contact design?
• Possibilities for obtaining e-mail addresses– By phone?
• Reminders by phone?
• Split ballot with a clean post-enquête sample
• Sample design: stratify by gender, age groups and region
• Analyses of mode effects
![Page 13: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/13.jpg)
![Page 14: Knut Kalgraff Skjåk Kirstine Kolsrud](https://reader035.vdocuments.net/reader035/viewer/2022062409/5681502e550346895dbe2654/html5/thumbnails/14.jpg)