nc state university libraries search usability testing
DESCRIPTION
NC State University Libraries Search Usability Testing. January 2010 ALA Midwinter Conference Josh Boyer & Susan Teague Rector . Who We Are. Susan Teague Rector Web Design Project Librarian Twitter: seteague. Josh Boyer - PowerPoint PPT PresentationTRANSCRIPT
NC State University Libraries Search Usability TestingJanuary 2010ALA Midwinter ConferenceJosh Boyer & Susan Teague Rector
1
Who We Are
Susan Teague Rector Web Design Project Librarian Twitter: seteague
2
Josh Boyer Associate Head, Distance Learning
and Research and Information Services
Today’s Agenda Background
Usability Test Methodology
Testing Results
Implementation of Search
Search Usage
Next Steps3
Background Website Redesign January – August 2010 whose
main goal of site design was to emphasize and streamline search across the site
Team of 9 librarians appointed to look at the website’s search environment
Building materials: Endeca-based catalog interface Summon Journal Titles list site search “QuickSearch”
4
5
www.lib.ncsu.edu/search/?q=xml
6
www.lib.ncsu.edu/search/?q=gis
7
How about Tabs?
Research Questions How would users interact with a tabbed search
interface?
Would users choose to scope their searches by preselecting a tab before beginning a search or would they conduct all searches in the default “all” tab?
How successful would users be in selecting the correct tab for the task?
8
Search Prototype
9
2 Search Prototypes
10
Model 1Tabbed Search Results
Model 2Non-Tabbed Search Results
Our Methodology “Guerrilla” usability testing in the field
Participants recruited in the lobby of DH Hill Library
Testing took place over a 3 hour period
28 undergraduates, graduates and library staff, participated in a round of guerrilla usability testing for 2 proposed search models
Each participant was asked to complete 2 tasks using one of the search models; many participants volunteered to answer more than 2 questions 11
Who Were the Participants? 22 Undergraduates 3 Graduates 2 Library Staff Members 1 Non-Traditional Student
Represented:• Humanities:
• English/Creative Writing• History• Psychology
• Business:• Business• Business Administration
• Science/Engineering:• Aerospace Engineering• Animal Science/Biology• Biology• Biomedical Engineering• Chemistry• Civil Engineering• Computer Science• Electrical Engineering• Food Science• Human Biology/Nutritional Science• Integrated Management & Systems• Meteorology• Textiles Engineering
12 14 participants performed 46 tasks using Model
1 14 participants performed 38 tasks using Model
2
Observations
In both search models, in well over half the tasks, participants pre-selected a search tab before beginning their search.
13
Observations Across both search models, in 45 of 60 tasks in
which users selected a tab, they selected the appropriate tab for that task.
14
Observations In both models, users rarely switched silos in
the search results once in a silo. Users tended to stay in the same silo and refine searches within those silos.
15
What WorkedTask No. Task 1st Tab Searched
(Across Models)1 n=9
Please tell me if the library has a copy of the book titled ‘The Tipping Point’ by Malcolm Gladwell
All (4)Books (5)
3n=9
Please locate information about how much it costs to make photocopies in the library
All (3)Web site (5)Books (1)
4n=9
You are studying the effects of ADD in the classroom for your psychology class. Can you locate 2 books about helping students with ADD succeed in school?
All (4)Books (5)
8n=8
You are in DH Hill Library and you would like to locate an illustrated encyclopedia about trees; where would you find such a book at Hill?
All (3)Books (4)Web site (1)
9n=7
Please locate information on how to borrow a laptop from the library; how long is the loan period?
All (1)Web site (5)Books (1)
10n=7
Please locate the most recent issue of the Journal of the American Medical Association.
Journals (6)All (1)
16
Problem AreasTask No. Task 1st Tab Searched
(Across Models)2n=9
Find 2 journal articles on how tropical forest fires impact the environment
Journals (4)Articles (4)All (1)
6n=9
You are doing a lab on the reproductive habits of fish in your Bio class. Your professor has recommended that you use the Web of Science database to find relevant articles. How would you do that on this site?
Articles (3)Journals (1)Website (1)All (4)
7n=8
You are writing a paper for a course in Computer Science. Find the 2001 article titled ‘Internet Under Siege’ by Lawrence Lessig in the journal called Foreign Policy.
Journals (3)Articles (4)All (1)
17
Other Issues Even if users executed a successful search, they
often did not scroll down far enough in the search results to find the answer
Almost all participants only scanned the first page of search results for a quick answer to the task
Spelling was problematic
18
19
www.lib.ncsu.edu
Search Usage
20
21
Use of “All” tab (QuickSearch)
2.4%43.8% 36.4%
8.3%
22
17.3 % increase
Articles – Full Text Downloads
Next Steps
Conduct more usability testing with students.
Interview faculty about their research and how they view our new site.
23