Outcome Measures for EurekansDr. Cindy MediavillaLibrary Programs Consultant

Monday, March 3, 201412 Noon Pacific

Outcome Measures Experience

Let’s take a Poll

What are some of the most difficult aspects of using outcomes to plan and evaluate library services?

To start our conversation,Type your thoughts into the

chat box.

Defining “Outcomes:”

How our services impact a particular target population

 The benefits derived from using

the library

Outcomes result in a positive change in a person’s:

AttitudeBehaviorKnowledgeSkill(s)Life status/Condition

Why use outcomes?

Demonstrate the library’s value, instead of its workload

 Tell the stories behind library statistics Measure how the library helped effect

positive change in the community

Stakeholders understand benefits better than numbers

Outcomes terminology

Inputs =

Internal resources the library uses to provide service

Example:

Textbooks + after-school teacher/tutor (inputs)

Borderline students pass math class

Outputs =

How much a library service or resource is used

Outputs vs. outcomes Tallies vs. results

Implementing outcomes1. Identify community

needs/interests2. Determine what changes

(outcomes) need to occur 3. Design library

programs/services to effect change

4. Evaluate whether positive change (outcomes) occurred

Backwards design:

Create target outcomes before designing program/services—i.e., the “If . . . Then” scenario

Outcome statements:Focused on benefits to the end-

user, not on library outputs  Realistic and achievable – don’t

try to change the entire world! Measurable

Example statements:As a result of using the library’s after-school

homework center, 45% of borderline students will pass their math class (change in knowledge)

 50% of participants will indicate they can now

use their e-readers after receiving the library’s one-on-one e-reader training (change in skill)

 As a result of attending the library’s “History of

Rock ‘n Roll” lecture/film series, 60% of teens will say they have a greater appreciation for 1960s rock music (change in attitude)

Measuring outcomes:Decide evaluation strategy at the

beginning of the project planning process

 If possible, pre- and post-test to

measure change

Defining “evaluation:”Measures the effectiveness of

services/programs the library provides

Can occur while (formative evaluation) or after (summative evaluation) a program/service is delivered

Why evaluate?Gauge the library’s performance,

as well as diagnose problem areas

 Document the library’s

effectiveness Demonstrate the library’s

commitment to providing excellent service

Data collection techniques by outcome type:

Types of change Evaluation Methods

Knowledge TestSurvey/Interview

Skill TestObservationSurvey/Interview

Attitude Survey/Interview

Behavior ObservationSurvey/Interview

Life status/Condition Survey/InterviewObservationFocus group

Challenges of measuring outcomes:Whole new way of measuring what the

library does (benefits vs. numbers) Often difficult to capture outcomes,

especially if results aren’t immediate or readily observable

 Data may seem too “soft” or anecdotal Cannot always assume that the outcomes,

by themselves, led to change

Outcomes and grant proposals:Funders want to know what

impact your proposed project will have on the community

 What changes will occur as a

result of your grant project? Objectives vs. outcomes

Questions?

Thank you.

Cindy.Mediavilla@library.ca.gov

Infopeople webinars are supported in part by the U.S. Institute of Museum and Library Services under the provisions of the Library Services and Technology Act, administered in California by the State Librarian. This material is licensed under a Creative Commons 3.0 Share & Share-Alike license. Use of this material should credit the author and funding source.