16 february, 2006 recommendations in opacs, 1 generating recommendations in opacs initial results...
TRANSCRIPT
![Page 1: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/1.jpg)
16 February, 2006 Recommendations in OPACS, 1
Generating Recommendations in OPACsInitial Results and
Open Areas for Exploration
Colleen Whitney
California Digital Library and
UC Berkeley School of Information
![Page 2: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/2.jpg)
16 February, 2006 Recommendations in OPACS, 2
Melvyl Recommender Project
Exploratory project, probing several ideas:● Text-based discovery system: eXtensible Text
Framework (XTF)● Enhanced relevance ranking● Spelling correction● User interface strategies● Recommending
![Page 3: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/3.jpg)
16 February, 2006 Recommendations in OPACS, 3
The Testbed
● Bibliographic records– ~4.2 million UCLA records– MARC export from Melvyl
● Circulation data– ~9 million UCLA circulation transactions– September 1999 – May 2005– Data from two systems: Taos, Voyager
![Page 4: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/4.jpg)
16 February, 2006 Recommendations in OPACS, 4
The Basic Idea
● “Patrons who checked this out, also checked out....”
● != Collaborative Filtering
![Page 5: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/5.jpg)
16 February, 2006 Recommendations in OPACS, 5
Finding RelationshipsPatrons
Related Items
![Page 6: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/6.jpg)
16 February, 2006 Recommendations in OPACS, 6
Patrons
Creating Sets
![Page 7: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/7.jpg)
16 February, 2006 Recommendations in OPACS, 7
Related Items
Creating SetsPatrons
![Page 8: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/8.jpg)
16 February, 2006 Recommendations in OPACS, 8
Related Items
Creating SetsPatrons
![Page 9: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/9.jpg)
16 February, 2006 Recommendations in OPACS, 9
Related Items
Creating SetsPatrons
![Page 10: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/10.jpg)
16 February, 2006 Recommendations in OPACS, 10
Related Items
Creating SetsPatrons
![Page 11: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/11.jpg)
16 February, 2006 Recommendations in OPACS, 11
Sort4
3
2
1
Creating Sets
![Page 12: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/12.jpg)
16 February, 2006 Recommendations in OPACS, 12
Creating Sets
![Page 13: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/13.jpg)
16 February, 2006 Recommendations in OPACS, 13
Sub-sort: overall circulation
?
Creating Sets
![Page 14: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/14.jpg)
16 February, 2006 Recommendations in OPACS, 14
Examples (v. 1)Title: Celebrating a collection: the work of Dorothea Lange
Author (Format, Date): Heyman, Therese Thau. (Book, 1978)
Language: English
Subjects: Lange, Dorothea | Photography, Artistic -- Exhibitions | Photographers -- United States – Biography
1. The critical vision: a history of social and political art in the U.S
2. The great transformation
3. The face on the cutting room floor: the story of movie and television censor
4. The art of social conscience
5. Iron cages: race and culture in 19th-century America
![Page 15: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/15.jpg)
16 February, 2006 Recommendations in OPACS, 15
Title: As you like it
Author (Format, Date): Smallwood, R. L. (Robert Leo) (Book, 2003)
Language: English
Subjects: Shakespeare, William, -- 1564-1616. -- As you like it | Shakespeare, William, -- 1564-1616 -- Dramatic production | Shakespeare, William, -- 1564-1616 -- Stage history -- 1950-
1. Calculus
2. Sexual perversity in Chicago;Sexual perversity in Chicago and The duck variations: two plays
3. Plays;Beth Henley: collected plays
4. Don Quixote. English;The ingenious hidalgo Don Quixote de la Mancha
5. A decade of new comedy: plays from the Humana Festival
Examples (v. 1)
![Page 16: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/16.jpg)
16 February, 2006 Recommendations in OPACS, 16
Patrons
A
FilteringRelated Items (category A only)
A
![Page 17: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/17.jpg)
16 February, 2006 Recommendations in OPACS, 17
Title: Celebrating a collection: the work of Dorothea Lange
Author (Format, Date): Heyman, Therese Thau. (Book, 1978)
Language: English
Subjects: Lange, Dorothea | Photography, Artistic -- Exhibitions | Photographers -- United States – Biography
1. Photojournalism
2. Dorothea Lange: a photographer's life
3. In this proud land: America 1935-1943 as seen in the FSA photographs
4. Truth needs no ally: inside photojournalism
5. The Royal Society of Arts, 1754-1954
Examples (v. 2)
![Page 18: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/18.jpg)
16 February, 2006 Recommendations in OPACS, 18
Title: As you like it
Author (Format, Date): Smallwood, R. L. (Robert Leo) (Book, 2003)
Language: English
Subjects: Shakespeare, William, -- 1564-1616. -- As you like it | Shakespeare, William, -- 1564-1616 -- Dramatic production | Shakespeare, William, -- 1564-1616 -- Stage history -- 1950-
1. Sexual perversity in Chicago;Sexual perversity in Chicago and The duck variations: two plays
2. Plays;Beth Henley: collected plays
3. Don Quixote. English;The ingenious hidalgo Don Quixote de la Mancha
4. A decade of new comedy: plays from the Humana Festival
5. Barefoot in the park: a new comedy
Examples (v. 2)
![Page 19: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/19.jpg)
16 February, 2006 Recommendations in OPACS, 19
User Assessment
● April 2006● Are the recommendations generated using
circulation data appropriate for an academic audience?
● Stay tuned for results!
![Page 20: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/20.jpg)
16 February, 2006 Recommendations in OPACS, 20
The Underbelly
● User queries XTF● AJAX request to Perl/mySQL● Perl returns XML response● Display updated in browser if recommendations
are present
![Page 21: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/21.jpg)
16 February, 2006 Recommendations in OPACS, 21
What works?
● Overall quality of recommendations seems good, especially in the humanities (but subject to user testing).
● Severely off-topic recommendations are limited by the content filter.
● AJAX allows for smooth presentation.
![Page 22: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/22.jpg)
16 February, 2006 Recommendations in OPACS, 22
What doesn't work?
● Serendipity is limited by content filter.● The content filter is crude, eliminating some
good recommendations.● Quality and quantity of recommendations are
lower in science and technology.● Missing/bad call number class data eliminates
recommendations for some items.
![Page 23: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/23.jpg)
16 February, 2006 Recommendations in OPACS, 23
Ideas for Further Development
● Refine this algorithm:– Improve content filter (underway)– Experiment with “Binning” (underway)– Backfill missing data
![Page 24: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/24.jpg)
16 February, 2006 Recommendations in OPACS, 24
Ideas for Further Development
● Experiment with other methods:– “More like this...” similarity-based recommendations
(underway)– Same author– Same subject heading(s)– Connections identified using other external data
sources....citations, reading lists...
![Page 25: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/25.jpg)
16 February, 2006 Recommendations in OPACS, 25
Many thanks to...● Mellon Foundation (funding)● RLG (holdings data for ranking experiments)● OCLC (holdings data for ranking experiments)● UCLA Library (circulation data)● UC Berkeley Library (circulation data)● CDL Team and Contributors
(Including Peter Brantley, Lynne Cameron, Rebecca Doherty, Randy Lai, Jane Lee, Martin Haye, Erik Hetzner, Kirk Hastings, Patricia Martin, Felicia Poe, Lisa Schiff, Roy Tennant, Brian Tingle, Steve Toub...and many more.)
![Page 26: 16 February, 2006 Recommendations in OPACS, 1 Generating Recommendations in OPACs Initial Results and Open Areas for Exploration Colleen Whitney California](https://reader036.vdocuments.net/reader036/viewer/2022062318/5514bb7555034640138b55d9/html5/thumbnails/26.jpg)
16 February, 2006 Recommendations in OPACS, 26
Links:
Project Home:http://www.cdlib.org/inside/projects/melvyl_recommender/
Prototype:http://recommend-dev.cdlib.org/melrec/