assessment for the rest of us: informal techniques you can use
Upload: library-leadership-amp-management-association-llama-american-library-association-ala
Post on 29-Nov-2014
2.292 views
DESCRIPTION
Program conducted by LLAMA - MAES at ALA Annual 2010.Informal assessment techniques can be used to quickly evaluate and improve services throughout the library. This fast-paced program features presenters from 8-10 libraries who will share various types of informal assessment, the time commitment required, and how assessment led to service improvements throughout the library. Attendees will gain an understanding of how informal assessment can be incorporated into decision-making at all levels and lead to a culture of assessment.TRANSCRIPT
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessment for the Rest of Us: Informal Techniques You Can Use
Program Co-chairs: • Jeanne Brown, Assessment Librarian, University of Nevada, Las Vegas• Jan Lewis, Associate Director, East Carolina University
Sponsored by the LLAMA Measurement, Assessment & Evaluation Section, Data Collection for Library Managers Committee
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Our Student Scholars Said What???
Oklahoma State UniversityKaren Neurohr, Associate Professor, Assessment LibrarianJennifer Paustenbaugh, Ph.D., Associate Dean for Planning and Assessment
A 12-Question survey followed by an informal focus group luncheon were fairly easy techniques for discerning what a group of undergraduate student scholars know and think about the library.
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Student Scholars and the LibraryOklahoma State University- Land-grant;
ARL Library, serving 22,845 studentsAssessment activity: Survey and Informal
Focus GroupPopulation: Undergraduate research
scholarsTime Commitment: 4 hoursFindings: Several interesting discrepancies
between survey results and comments
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Let them try it before you buy it
Louise L. Lowe, Assistant ProfessorPublic Services Librarian
Judith D. Brook, Associate ProfessorAssociate Dean of University Libraries and Director
Mercer University, Atlanta
Conducting demonstrations and trials can help libraries get the biggest bang for their buck. Students test, evaluate, and recommend products and libraries make informed purchases.
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Let them try it before you buy itWho we are… Mercer University, Atlanta Campus Approximately 2,500 graduate and professional students Approximately 4,000 library visitors per week
What we did… Conducted trials or demonstrations; allowed 1 - 2 weeks for feedback Tested equipment like netbooks, adjustable monitors and keyboards,
etc. Taste test for new coffee vending
What we learned… ‘Good value’ is important to student Students are willing to make compromises Students want to be involved
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Unobtrusive User Observation as Assessment Technique: What are Students Doing in the Library After Hours
Kornelia Tancheva, Director of John M. Olin Library and Uris Library, Cornell University
Study of User Behavior in Uris Library, open 24/7
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Student Behavior in the Library After Hours
Cornell U Library; Uris: former “undergraduate library”
Unobtrusive observationSurvey population: undergraduate
studentsModerate Time CommitmentFindings: use of spaces, use of
technology; service requirements
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Why Isn’t Our Chat Reference Service Used More Often?
Sharon Naylor and Bruce StoffelEducation Librarian and Reference CoordinatorIllinois State University
Exploring patron attitudes and behavior through focus groups
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Why Isn’t Our Chat Reference Service Used More Often?
Who we are... 21,184 students (87% undergraduates) 1.6 million volumes, 43,000 annual patron transactionsWhat we did... Conducted 7 focus groups, August-December 2005 Involved 45 sophomores, juniors, seniors Each group discussion lasted about 90 minutes What we learned...• Desire for reference services that are personalized• Support for a variety of reference venues not just IM/chat• Preference for familiar, reliable technology
The CalArts’ Student Behaviors and Habits (CASBAH) Project
Jeff Gatten, Dean of Library and Information Resources at California Institute of the Arts
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Poster surveys were used to generate a wealth of instant and practical feedback with minimal effort.
The CalArts’ Student Behaviors and Habits (CASBAH) Project
Arts college (BFA, MFA, DMA)1,399 Students ◦ 60% undergrad. & 40% grad.◦ 51% female & 49% male
Poster surveys in the Library3-4 hours to compile & organize dataFindings: Most desired = easy changes to
environmentLLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Challenging Assumptions: Chatting with Patrons
Rachel Besara, Assessment LibrarianKirsten Kinsley, Assessment LibrarianFlorida State University Libraries
The information gathered challenged many of the assumptions held about undergraduate students.
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Challenging Assumptions: Chatting with PatronsFlorida State University (Carnegie
Foundation Rated Doctoral/Research Extensive University)
Short Survey/Interviews167 Undergraduate Students on & off
campusOne MonthDiscovered nuanced student study habits
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessing Community Usersin an Academic Library
Wanda V. Dole, Dean Ottenheimer Library, University of Arkansas at Little Rock
J. B. Hill, Director of Public ServicesOttenheimer Library, University of Arkansas at Little Rock
The Ottenheimer Library recently conducted a quantitative/qualitative assessment of its unaffiliated library users.
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Assessing Community Users University of Arkansas at Little Rock
◦ Metropolitan university with 13,000 students◦ Carnegie Research Extensive University
Quantitative Data ◦ Analysis of Millennium and Uniprint patron records
Qualitative Data ◦ Survey of unaffiliated library users registered for circulation of
Internet privileges Limited Time Commitment - ~80 hours Findings
◦ Two distinct user populations – behaviors & needs◦ Casual affiliations with university◦ Privileges created good will toward university◦ Result in review of unaffiliated user policies/services
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
“Flip” the Library
Ameet DoshiUser Engagement Librarian and Assessment CoordinatorGeorgia Institute of Technology Library
Video Assessment at Georgia Tech Library
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Flip Camera Assessment: Fast, Cheap, Easy
Georgia Tech Student Culture: Hands-on, interactiveLibQUAL 2010: 88% of Undergrads use facility
regularlyVideo Assessment of Library FacilityStudent Library Advisory Board1 hour (prep/shooting/recap) and 2-4 hours editingUseful to… ◦ View experience from user perspective◦ Assess completed or discuss proposed renovations◦ Discover emerging problems◦Web usability
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
MIT Libraries’ Book(cart)mobile: Assessing its Value
Lisa R. Horowitz, Assessment Librarian, Massachusetts Institute of Technology
The MIT Libraries’ Humanities and Music Libraries surveyed users and staff to determine if the benefits of undertaking a monthly bookmobile outweighed its staffing costs.
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
MIT Libraries’ Book(cart)mobileMIT: 10,000 students; 10,000 faculty and
staffFive main libraries – Bookmobile is
specific to Humanities and its branch, Music
Two survey instruments: user survey and staff interviews
Data gathered over two and half months, March to May 2009
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Observation and Mapping
Kathy RayUniversity LibrarianAmerican University of Sharjah
Observing student behavior helped us achieve a better balance between high
and low use study spaces
LLAMA MAES DCLM 2010 ALA Annual Program: Assessment for the Rest of Us
Observation and MappingAUS – 5,000 students primarily undergradCoed environment new for majorityIncredibly active/high traffic zone in the
middle of preferred high use study spaceObservations over 5 week period30 minutes 3 times per weekReconfigured mix of carrels, tables,
browsing collections & displays for better balance of quiet and active zones