state library administrative agencies (slaa) fy2014 changes to survey anna sandoval girón,...
DESCRIPTION
A MERICAN I NSTITUTES FOR R ESEARCH Outline I.Introduction of AIR staff II.Overview of changes III.Evaluation activity IV.What to expect next? V.Questions 3TRANSCRIPT
State Library Administrative Agencies (SLAA) FY2014
Changes to Survey
Anna Sandoval Girón, ResearcherMengmeng Zhang, Research AssociateAmerican Institutes for Research
December 2015
Copyright © 2014 2014 American Institutes for Research. All rights reserved.
AMERICAN INSTITUTES FOR RESEARCH
American Institutes for ResearchEstablished in 1946, with headquarters in Washington, D.C., American Institutes for Research (AIR) is an independent, nonpartisan, not-for-profit organization that conducts behavioral and social science research and delivers technical assistance both domestically and internationally.
As one of the largest behavioral and social science research organizations in the world, AIR is committed to empowering communities and institutions with innovative solutions to the most critical challenges in education, health, workforce, and international development.
2
AMERICAN INSTITUTES FOR RESEARCH 3
OutlineI. Introduction of AIR staffII. Overview of changesIII. Evaluation activityIV. What to expect next? V. Questions
Overview of Changes
4
AMERICAN INSTITUTES FOR RESEARCH
Goals of Changes• Make the survey easier to answer and reduce post edits• Part D:
– The items in Part D have been asked since 1994 with relatively few changes. – The revisions are intended to ensure that this section reflects the full range
of important services and functions in which SLAAs are engaged. – IMLS wanted to provide conceptual clarity to this section by placing the items
in groups that reflected an overarching structure of these activities.
5
AMERICAN INSTITUTES FOR RESEARCH
Process for Changes• Conversations with stakeholders– Dec 2013 – March 2014
• Reorganization and reconceptualization of survey items– March – June 2014
• Approval of changes by OMB– July 31, 2014
6
AMERICAN INSTITUTES FOR RESEARCH 7
Overview of Changes• Advance communication about the survey.
• Data collection.
• Post-collection data processing.
Advance Communication About the Survey
8
AMERICAN INSTITUTES FOR RESEARCH
Collection of Key Holder Contact Information
• Keyholder information was collected via website.
• COSLA members received an email from [email protected] requesting that they provide contact information for keyholders.
http://slaa.airprojects.org/Keyholder/default.aspx
9
AMERICAN INSTITUTES FOR RESEARCH 10
Sample Key Holder Certificate
FY 2014 SLAA Survey
Sample Public Library Service
Please keep this certificate in a safe place and do not share the password with anyone.
SLAA User ID: KeySample2014
SLAA Password: SAmplePass1$
(Note that the password is temporary and that you will be required to change it when you log in for the first time. This password is case sensitive.)
Data Collection Begins: Monday, January 12, 2015 Survey Close-Out: Monday, March 16, 2015 SLAA Survey Website: http://slaa.airprojects.org SLAA Help Desk: [email protected] or 1-866-261-2295
AMERICAN INSTITUTES FOR RESEARCH 11
Ready Reference Shelf
12
AMERICAN INSTITUTES FOR RESEARCH
Ready Reference ShelfYou were able to access documents on the landing page of the survey.
This section contained the following documents:• Survey form (PDF)• User’s guide (PDF)• Survey instructions (PDF)• Edit validation reference guide (PDF)
13
AMERICAN INSTITUTES FOR RESEARCH 14
Ready Reference Shelf
Post-collection Data Processing
15
AMERICAN INSTITUTES FOR RESEARCH
Edits and Postedit Checks• We took the postedits and moved them to the data tool.• Reduce the postedit time and data processing time.• Once the data was locked in the data tool, we did a full
postedit check.
16
17
Evaluation Activity
AMERICAN INSTITUTES FOR RESEARCH 18
Goal of Evaluation• This activity will allow us to evaluate the data input process
in an interactive session and gather detailed feedback.• Our focus is on the 2014 survey data collection.
AMERICAN INSTITUTES FOR RESEARCH 19
Instructions• Each group starts with a chart that has one question.
– What part of the administration worked well? – What didn’t work? – What could be better? (What would you like to see as far as the tool 2016?)– Where there any challenges with definitions?
AMERICAN INSTITUTES FOR RESEARCH
Instructions• Share ideas.
– After eight minutes, the group moves to the next flip chart to answer the next question
– With your group, add to the answers of the previous group and build on the answers of the previous group.
– Choose a spokesperson.– Share what is written in the flip chart after all groups have answered the
questions.
20
21
What to Expect Next
AMERICAN INSTITUTES FOR RESEARCH 22
Next Steps• IMLS will start working on content with COSLA in winter
2016.• The next data collection starts January 2017.• Notices will go out in November 2016.• AIR is available for questions or comments at any time.
– AIR contact: [email protected]
AMERICAN INSTITUTES FOR RESEARCH
Questions
23
24
ContactsAnna Sandoval Giró[email protected]
Mengmeng [email protected]
1000 Thomas Jefferson Street NWWashington, DC 20007General Information: 202-403-5000TTY: 887-334-3499www.air.orghttp://www.csmair.org