1 leveraging data to make better decisions - an overview of databases webinar series webinar 3...

34
1 Leveraging Data to Make Better Decisions - An Overview of Databases Webinar Series Webinar 3 Collecting and Storing Your Data Teleconference: Toll-free Dial-in: 1-877-323-2005 Local Dial-in: 416-472-5080 Global Toll-free: 800-6059-2969 Conference ID: 2419719# Please keep your phones on mute Moderator: Jaspreet Ahuja [email protected]

Upload: scott-turner

Post on 28-Dec-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

1

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Webinar 3Collecting and Storing Your Data

Teleconference:Toll-free Dial-in: 1-877-323-2005

Local Dial-in: 416-472-5080Global Toll-free: 800-6059-2969

Conference ID: 2419719#Please keep your phones on mute

Moderator: Jaspreet [email protected]

Webinar 3Collecting and Storing Your Data

Michelle Freeman RN, PhDAssistant Professor, University of Windsor

Nursing Health Services Research Unit (NHSRU) McMaster University

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Date: December 12, 2012Time: Noon- 1:00PM (EST)

2

Session Objectives• Review definition of primary data

• Describe purpose, design and survey development

• Explain special considerations when using a web-based survey to collect primary data

• Describe advantages/disadvantages of web-based survey for primary database

• Discuss next steps with database

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

3

Types of Data

Primary data - collected to answer a specific research question.

Secondary data – collected by some other user.

Administrative data – secondary data collected for non-research purposes but may used to answer specific research questions.

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Source: Wunsch, H., Harrison, D., Rowan, K. (2005). Health Services Research in critical care using administrative data. Journal of Critical Care, 20: 264-269. 4

Primary Databases

• Result from individual research projects

• Include many variables and/or themes

• Can be standardized for use by other investigators to ask different questions

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

5

Study

Employment Goals, Expectations, and Migration Intentions of Nursing Graduates

in a Canadian Border City

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

6

Why primary databases to study nurse migration?

• Limited research using primary databases• Canada not immune to its nurses migrating for

work– “…little understanding of the reason why they leave to

work in USA and this problem has received virtually no attention as a research or policy issue” (McGillis Hall et al., 2009, p. 204)

– No comprehensive data source in either US or Canada to track number of Canadian RNs currently employed in US

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

7

Why primary databases to study nurse migration?

• US the largest importer of nurses and Canada is an important source country especially for border states (Aiken et al., 2004)

– Border communities major supplier of nurses for US hospitals as “commuter migrants” but numbers unknown

• Projected nursing shortages• Gap in understanding migration intentions of new

graduate nurses and factors pushing them from Canada

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

8

Study

StudyPurpose(1) What are the migration

intentions of these graduates?

(2) What factors (values, expectations, personal characteristics and other) influence their migration intentions?

(3) Does the Value-Expectancy framework contribute to our understanding of these factors?

Sample BScN students graduating in

June 2011 in a Canadian border community (N= 281)

Method Mixed methods

– Web-based survey– Interviews

9

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Value-Expectancy (V-E)Framework (De Jong and Fawcett, 1981)

• Migrant makes a conscious decision to migrate or stay by weighing values (goals) against the expectation of obtaining them

– Measure value

– Measure expectancy for different locations• Subjective probability that

valued outcome will be obtained

– Identifies migration intention for different locations

10

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Study Framework

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

11

Conceptual Categories (De Jong & Fawcett, 1981)

– Wealth– Status– Comfort– Stimulation– Autonomy– Affiliation– Morality

Conceptual Categories for Nurse Migrants– Economic rewards– Professional development– Healthy work environment– Safe living and working

environment– Opportunity for adventure– Autonomy in choice of

workplace– Social support– Support of ethical practice

Study Framework

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

12

Survey Design

Goal

• Accurate primary database with no missing data and high response rate

• Obtain volunteers for interviews

• Ability to track respondents to determine if they actually migrated

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

13

Survey Design: Considerations

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

14

• What program should I use to develop survey?

• Where is data stored?

• Length of survey?

• Design: What order for questions?

• Should students be allowed to go back and review responses?

• Specific variables: Age

Face/Content Validity and Functionality• Face

– Conducted in several stages• Content

– Survey categories based on V-E framework (De Jong & Fawcett, 1981) but developed for nursing

– Nurse migration literature searched to obtain categories which reflected why nurses migrate and to determine job factors deemed important to nurses

– Consultations with researchers who had experience in survey development

– Content validity testing of the questions in each category was performed by two experts and content validity index calculated

• Final survey tested by researcher and five individuals for functionality, time to complete, and to ensure accurate data capture

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

15

Designing Survey Questions: Choosing Scales

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

16

How important is getting a full- time job in nursing after you graduate?

Value Scale 1 very unimportant2 unimportant3 neither important nor unimportant4 important5 very important

Designing Survey Questions: Choosing Scales

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

17

How confident are you that you will get a full-time job in nursing ................in Canada? ………………in another country? Expectancy Scale1= Not confident at all.2= Slightly confident. I am about 25% certain.3= Somewhat confident. I am about 50% certain.4= Very confident. I am about 75% certain5= Extremely confident. I am about 100% certain.

REB: Specific Requirements for Online Survey

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

18

Protecting Confidentiality and Anonymity of Participants

• Results stored at university only accessible by password by researcher

• Participants created unique identifying code – To allow matching of the survey with any future follow up

studies without allowing the investigators to know the respondent’s identity

• Required to enter email three times at end of survey– Recruited for follow-up interviews– Recruited for follow-up studies (Did they migrate?)– Enter draw for gift certificates

• Three lists generated that were separate from survey responses

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

19

Planning Database: Data Coding

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

20

Developing Survey

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

21

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

22

Database: Excel

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

23

Database: SPSS

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

24

Database: SPSS

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

25

RecruitmentThree-contact email strategy used (Dillman, Smyth, & Christian, 2009)• Email 1: introduced survey, emphasized importance and

information to access survey • Email 2: thank you to those who completed survey, a reminder for

those who had not and repeat of access information • Email 3: emphasized limited time left to complete the survey and

the importance of responding • Optimal timing sequence for web surveys has not yet been

determined– Sent at one week intervals

• Draw as incentive – End of survey offered opportunity to participate by giving email

address• Additional contacts required to increase response rate

– 2 mailings

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

26

Advantages of On-line Survey for Collecting/Storing Data

• Low cost; no storing of paper surveys; no mailing costs

• Easy to follow response rate– Plan additional contacts if needed– Predictable response rate within 24-48 hr after email

contact• Missing data evident• No data entry required• Easily downloaded into SPSS

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

27

Challenges of On-line Survey for Collecting/Storing Data

• Additional REB requirements• Students received too many emails/surveys• Could not give reward to each participant for

completing survey– Entered draw at end– Required entering email address into separate

database that could not be connected with responses• Confidentiality- unable to link with other data

(CNO) to follow up on actual migration

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

28

Next Steps• Repeating survey with graduating class 2013

• Complete survey during class– Incentive for each student

• Interest from other universities to use survey with graduates

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

29

Summary: Collecting and Storing Your Data

• Requires careful planning and design

• Clear benefits to using web-based surveys

• Primary data bases important in research areas where limited primary research

• Benefits of connecting with other researchers to adapt survey to other populations

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

30

ReferencesAiken, L., Buchan, J., Sochalski, J., Nichols, B., & Powell, M. (2004). Trends in international migration. Health Affairs,

23(3), 69-77.

De Jong, G., & Fawcett, J. (1981). Motivations for migration: An assessment and a value-expectancy research model. In G. De Jong, & R. Gardner, Migration decision making: Mutlidisciplinary approaches to microlevel studies in developed and developing countries (pp. 13-58). New York: Pergamon Press.

Dillman, D., Smyth, J., & Christian, L. (2009). Internet, mail, and mixed mode surveys: The tailored design method. Hoboken, New Jersey: John Wiley & Sons.

Freeman, Michelle A., "Nurse Migration Intentions in a Canadian Border City" (2012). Open Access Dissertations and Theses. Paper 6900. http://digitalcommons.mcmaster.ca/opendissertations/6900

Freeman, M., Baumann, A., Akhtar-Danesh, N., Blythe, J., Fisher, A. (2012). Employment Goals, Expectations, and

Migration Intentions of Nursing Graduates in a Canadian Border City: a mixed methods study. Journal of International Nursing Studies. doi: 10.1016/j.ijnurstu.2012.07.015

McGillis Hall, L., Pink, G., Jones, C., Leatt, P., Gates, M., & Peterson, J. (2009). Is the grass any greener? Canada to United States of America nurse migration. International Nursing Review, 56, 198-205.

Streiner, D., & Norman, G. (2008). Health measurement scales: A practical guide to their development and use. Oxford: Oxford University Press.

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

31

Questions?

32

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

Upcoming Webinar SessionsWebinar 4: Development of a New Graduate Nurse Employment Database (Jan 21, 2013)

Webinar 5: Applications and Analysis of a Secondary Database

(Feb 20, 2013)

Webinar 6: Understanding How to Work with HOBIC (March 2013)

Webinar 7: Development of a Longitudinal Qualitative Database

(March 2013)

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series

33

Andrea Baumann, PhD

Scientific Director Nursing Health Services

Research UnitMcMaster University

Michael DeGroote Centre for Learning

MDCL 3500(905) 525-9140 ext. [email protected]

Michelle Freeman, RN PhDAssistant ProfessorUniversity of Windsor(519) 253-3000 ext. [email protected]

34

Leveraging Data to Make Better Decisions - An

Overview of DatabasesWebinar Series