moving libraries to web scale matt goldner product & technology advocate 14 june 2011
TRANSCRIPT
Penetration of internet access
2000 2003 2006 20100.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
70.00%
80.00%
Czech RepublicSlovakia
CatalogMetadata
End User
Metasearch
InstitutionalRepositories
License Data
Circ Data
OPAC
Resolver/Knowledge Base Data
ElectronicVendor
e-Resources
Current library technology infrastructure
Cloud Computing
Infrastructure Platform Applications Services
KP
MG
A style of computing in which scalable and elastic IT-enabled capabilities are delivered as a service to external customers using Internet technologies.
-Gartner Group
Simple: Web-based applications with shared data and services.
Enabling technology
• Reduce local computing power needs
• Share data with others
• Build reusable services
• Move from silos to Web-scale solutions
The Web is all about scale, finding ways to attract the most users for centralized resources, spreading those costs over larger and larger audiences as the technology gets more and more capable.
— Chris Anderson, Editor-in-Chief, WIRED and author of The Long Tail
Web scale refers to:
• Massively aggregated data
• Useful services built on this data
• Attracts massively aggregated users
• Each user adds value for every other user
The shift in information supply chains
2005 20100%
10%
20%
30%
40%
50%
60%
70%
80%
90%
Search enginesLibrary web site
Change needed for libraries
Reconsider management of collections or:
• Continue to lose efficiency
• Continue difficulty of uniform access to collections
Result: Increased lack of relevance
Seizing the opportunity to change
By sharing computing power
• No longer purchase for peak load
• Allow cloud computing to expand as needed
• Greener computing
Seizing the opportunity to change
By sharing data
• Authority control
• Remove copy cataloging
• Common licensing terms
• Serial publication patterns, vendor data, knowledge base
• Access to open access collections and digital collections
What led to Web scale?
• Libraries cannot individually attract Web users
• Economic conditions
• New approach to manage disparate collections
• Working together can define different future
WorldCat Local
• Users search all collections in one search box
• Puts library collections where users are
• Offers best delivery options for every format
Our users see WorldCat Local less as a catalog and more as a search tool ‘a la Google”
Anthony Chalcraft, University LibrarianYork St. John University
WorldCat Local takes the drudgery out of discovery … We’ve eliminated the teaching of the tool and we can push learning.
Mark Vargas, Library Director
St. Xavier University LIbrary
Moving back office operations to Web scale• Responsive
• Massively scalable
• Highly fault tolerant
• Ready for public consumption
• Built on workflow engine
• Must provide:
• Patron and data privacy
• Data security
• Data ownership clear stated
From strategy to production
• July 2009 – June 2010: Pilot phase
• Academic and public libraries
• Rapid development and on site usability testing
• July 2009 – June 2010: Early adopter phase
• 32 libraries, academic, public and special
• 15 live since September 2010
• 60 to 90 day migration for each library
• July 2010: General release
We have so many systems, and just trying to get them to talk to each was hard … We wanted to move out of the business of managing servers … With WMS, system costs will drop significantly
Michael Dula, Director for Digital Initiatives and Technology StrategyPepperdine University Libraries
Typical firm order workflow
Search OPAC to see if library owns
item to be purchased
Yes
No
Purchase
Don’t purchase
Search Cataloging Utility for MARC
record
Rec
or d
f oun
d
Download to Local System
Login into Acquisitions
system
Create order from bibliographic
record
Search for Bibliographic
record
Ordering with Web-scale
Login into Acquisitions
system
Create order from bibliographic
record
Search for Bibliographic
record
Value of shared data
• Not just bibliographic data
• Vendor file and EDI
• Common license terms
• Serial publication patterns
• Global knowledge base of e-resources
• Open access materials
Community
Circulation Data
SRU & NCIP2
Data
Services
WMS Circulation
WorldCat Local
Applications
Services
Community
Circulation Data
Identity MgmtC-out / C-in
Data
Services
WMS Circulation
Self Checkout
Applications
Services
Going to the next level:An accessible, extensible platform
A cooperative platform that lets anyone develop new applications on the platform:
• Libraries• Groups and consortia• Research teams• Publishers• Software vendors• EntrepreneursCommunity
Data
Services
Applications
Platform
A cooperative platform that lets anyone develop new applications on the platform:
• Libraries• Groups and consortia• Research teams• Publishers• Software vendors• Entrepreneurs
• Built with OCLC member libraries
• Opportunity to define a different future
• 21st century technology
• Increased workflow efficiencies
• Reduction of redundant data management
• Open system for community participation
• Takes full advantage of cloud computing and Web scale