integrating assessment and planning: path to improved library effectiveness wanda dole, donna rose,...
TRANSCRIPT
Integrating Assessment and Planning: Path to Improved
Library Effectiveness
Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of
Arkansas at Little Rock
Seattle, WA, August 2008
Outline
• Introduction
• Strategic Planning
• Assessment
• Two case studies – K-State University– UALR
• Conclusions
Introduction
• “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998)
• Our response:– Yes, in the area of library planning
Who we are
• Dole– Planning and assessment: interests since Library
School (UIUC)– Strategic Planning (PSU, SUNY SB, WU, UALR)
Assessment (SUNY SB, WU)
James, Martin, Rose– some previous experience with strategic planning or
assessment
Literature
• Strategic Planning : vast
• Assessment: vast
• Integrated approach: little
Characteristics of Strategic Planning
Strategic Planning links library’s priorities to
-Priorities of the parent institution
-Needs of library users
-Allocation of resources
Assessment
• Input/Output Measures– Operating budgets– Collections, staffing, facilities
• Statistical analysis– Bibliometrics– Benchmarking
Assessment
• Outcomes measurement– Response to call for accountability in higher
education– Difficult to do
• Service Quality/User Satisfaction– ARL New Measures
Organizational Change
• Changing a culture requires the constant redesign of the infrastructure and frame of reference that that define appropriate and inappropriate values, expectations and activities. Covey (2002, 163)
• Strategic planning can do this
Our Earlier Work Compared Planning and Assessment at
• K-State• Research Extensive
• 23,000+ student• 2000+ faculty• 57 librarians• 49 support staff• $14.1 million
operating budget
• UALR• Doctoral/Research• 12,000 students• 800+ faculty• 13 librarians• 25 support staff• $4.8 million operating
budget
Strategic Planning
• K State – Strategic Planning
Preceded Assessment
• UALR– Assessment Preceded
Planning
K-State’s plan is available:Kansas State
Strategic Planning at UALR
• 1970s, 80s, 90s– Planning, mainly brainstorming– Top-down– Unstructured approach– No assessment
Strategic Planning at UALR
• August 2006, strategic planning retreat– Outside consultant– Broad participation of library faculty & staff– Development of mission & vision statements
• 2006 – present– Working groups revised mission & vision– New groups formed to develop goals &
strategies
Strategic Planning at UALR
• July 2007, 2nd retreat-Working groups ALL agree that planning must include assessment
-Assessment plan formed• Focus groups, fall 2007• LibQUAL+®, spring 2008
• July 2008, 3rd retreat-Results of Assessment shared
-Facilities to be focus for 2008-2009
UALR Focus Group Reports
• 35 participants, faculty and students• Concepts
– Library as place– Library as services– Library as people
• Questions– What is working– What needs improvement
Focus Group Responses
• Culture of good will
• Consumer mind sets
• Integration of services
• Interest in setting and facilities
• Interest in collections
LibQUAL+® Results
• 794 responses and 280 comments – students, faculty and staff
• Generally, satisfied with library staff and services
• Identify areas where more assessment should be done
• Self-study grids – focus group and LibQUAL+®
What Users say Needs Improvement
AssessmentTool
What DidWe Do?
When? If nothing why?Negative forces?
Is it working?
•Computer terminals too crowded
•Need more electrical outlets
Focus Group
2007- 2008LibQUAL+®
•Computer lab was doubled in size to provide additional computers and ADA resources
•Beginning of new fiscal year
•Students appear to be pleased with changes
•Update furniture and décor (6 comments)
•Floor fans noisy
Focus Group
2007-2008LibQUAL+®
•Furniture for three public areas has been ordered•Continued to run fans to assist in controlling humidity
•Beginning of new fiscal year•This is an ongoing activity
•Furniture not received yet, Will observe to see how it received by patrons•Continue to receive complaints
•Poor lighting(3 comments)
Focus Group -2007 •Nothing at this time, needs more study
•Map showing where the rooms are and how to get there (2 comments)
•Room numbering is confusing
Focus Group -2007 •Under discussion
•Nothing at this time
UALR Assessment Grids
UALR: Integrated Approach
• What worked?– Data confirmed some assumptions
• Facilities need improvement
• What didn’t work?– No impact on Training Task Force– Waiting for data delayed planning
• Collections Task Force
Conclusions
• Integrated assessment and strategic planning– Not much in the literature
• K-State – 1982-1999, planning alone – 1999-present, assessment and planning
• UALR – 2006 to present, integrate assessment and
planning
Conclusions
• “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998)
• Our response:– Yes, in the area of library planning– Assesment data helped us to be effective in
improving library faciltites
Questions
• Is the combination of strategic planning & assessment a new approach?
• Is it an example of the Culture of Assessment? (Lakos & Phipps)
• Have other libraries done the same things?
• Had the same results?
Questions? Comments?
• Thank you!