Welcome!

Life of a Dataset: ProcessWednesday, January 23, 2013

Program Outline• Life of a Dataset, short introduction• Process

– Goal of Data Processing– Security

• Secure Data Environment (SDE)• Virtual Data Enclave (VDE)

– Confidentiality– Steps in Processing Data

• Processing Supervisor• Processors• Reviewers

Life of a Dataset - the Web site

• www.icpsr.umich.edu/icpsrweb/content/datamanagement/life-of-dataset.html

Goal of Data Processing

• The goal of data processing and enhancement is to render data usable to researchers interested in accessing them after they are deposited.

Data Security• Public-Use - available through ICPSR Web site• Restricted-Use - available to vetted researchers

through a data use agreement• Onsite ‘physical’ data enclave

Confidentiality• Remove Direct and Indirect Identifiers

– Direct Identifiers include• Respondent’s Name• Respondent’s Address

– Indirect Identifiers include• Detailed geographic info, i.e. Census Tract of residence• Exact occupation

• Informed Consent• IRB

From Deposit to ProcessData deposited through the Data Deposit form go directly into a secure data server.

Secure Data Environment

Overview of Process Steps

Overview of Process Steps

Overview of Process Steps

Processing Supervisor’s Duties• Oversee the work process of a number of

processors with varying levels of experience– Review submitted data for confidentiality issues and

completeness– Assign data to Processor– Work with Processor to develop processing plan and

complete the processing of data– Perform Quality Checks (QC) on data to be released

Processor’s Duties

• Prepares data to be released through the Web site, SDA, and/or restricted data use agreements. • Produce clean processed version of data• Using Hermes, render full suite of formats for

dissemination and preservation• Produce complete and processed documentation set • Prepare data for SDA, if appropriate

Reviewer’s Duties

• Prepares study description, metadata records, ensures that the documentation complies with DDI specifications. – Works cooperatively with the Process to complete

tasks above– Performs Quality Checks on all documentation– digitizes any hard copy documentation and converts

that to .pdf format– Assembles and conveys documentation to Processor

Who are the Processors?• Generally, Processors are early career individuals

with a background in a social science and some experience with statistics.– They comprise the largest group of employees at

ICPSR– They receive routine training on matters related to

data processing– They have the opportunity to serve on committees or

activities at ICPSR

Contacts

• David Thomas, Archive Manager, RCMD, davethom@umich.edu , 734-936-5784

• Sue Hodge, Instructional Resources, shodge@umich.edu, 734-615-7850

Thank you!

Life of a Dataset: ProcessWednesday, January 23, 2013