OCLC CJK Users Group 2010 Annual Meeting

Friday, March 26, 2009

Philadelphia Convention Center

Philadelphia, Pennsylvania

WorldCat Growth & Quality: Vision and Practice

WorldCat Growth & Quality: Vision and Practice

Ted FonsDirector

WorldCat Global Metadata Network

CJK Users Group 2010March 26, 2010

OCLCThe world’s libraries. Connected.OCLCThe world’s libraries. Connected.

More collaboration

More institutions

More Web-scale

More synchronization

More innovation

Local

Group

Global

More

Better

The Value of the Shared WorldCat Network for CatalogingThe Value of the Shared WorldCat Network for Cataloging

Cataloging: Key to All OCLC ServicesCataloging: Key to All OCLC Services

WorldCat Growth –

Growing WorldCat Faster

Create system-wide efficiencies in library management

WorldCat Growth since 1998WorldCat Growth since 1998Create system-wide efficiencies in library management

WorldCat Growth since 1998WorldCat Growth since 1998

Millions of recordsMillions of records

WorldCat Growth = Batch ServicesWorldCat Growth = Batch Services

WorldCat Growth –

Is It Working?

Local

Group

Global

Create system-wide efficiencies in library management

WorldCat TodayCreate system-wide efficiencies in library management

WorldCat Today

170 million records

1.5+ billion holdings

1 January 2010

Create system-wide efficiencies in library management

Files loaded or pending for WorldCatFiles loaded or pending for WorldCatCreate system-wide efficiencies in library management

Files loaded or pending for WorldCatFiles loaded or pending for WorldCat

ABES (France)

Bavarian State Library

Bibliothek Alexandrina (Egypt)

Bibliothekszentrum Baden Württemberg (Germany)

British Library

DANBIB (Denmark)

GBV (Germany)

HeBIS (Germany)

IDS Informationsverbund Deutsch-Schweiz (Switzerland)

Lebanese American University

LIBRIS (Sweden)

Qatar University

UnityUK

Zayed University Consortium (UAE)

Create system-wide efficiencies in library management

National files loaded or pending for National files loaded or pending for WorldCatWorldCat

Create system-wide efficiencies in library management

National files loaded or pending for National files loaded or pending for WorldCatWorldCat

Bibliothèque nationale de France

German National Library

Libraries Australia

National Central Library, Taiwan

National Library Board, Singapore

National Library of Barbados

National Library of China

National Library of Finland

National Library of Israel

National Library of Mexico

National Library of New Zealand

National Library of Scotland

National Library of Spain

National Library of Sweden

National Library of Wales

Swiss National Library

Create system-wide efficiencies in library management

CJK Collections loaded or pending for CJK Collections loaded or pending for WorldCatWorldCat

Create system-wide efficiencies in library management

CJK Collections loaded or pending for CJK Collections loaded or pending for WorldCatWorldCat

Loaded:

National Library of China

Pending:

CALIS, China

New Agreement:

National Diet Library, Japan

MOU signed: March 26, 2010

Other CJK LoadsOther CJK Loads

Library Name Records Created

Airiti Inc. 44,518Nat'l Cent. Lib. Of Tiawan 220,385Hong Kong Baptist University 327Univ. of Hong kong 93,917Nat'l Lib of China 1,668,782Republic Polytechnic Libr. 2,655Singapore Mgt Univ. 1,472Singapore Nat'l Lib. Board 257,998Wuhan Univ. 4,982Waseda University 235,855Singapore Integrated Lib. Automation Services

1,081,114

1998

36%

2009

53.8%

Percentage of Non-English RecordsTotal Records

English

French

German

Spanish

Japanese

Russian

Chinese

Italian

Latin

Portuguese

Dutch

Hebrew

1998

37.5m records

23.9 m

2.3 m

2.2 m

1.6 m

.8 m

.8 m

.7 m

.7 m

.3 m

.3 m

.2 m

.2 m

2009

117.2 m

records

64.3 m

8.5 m

17.9 m

4.5 m

2.8 m

2.3 m

4.3 m

2.1 m

1.9 m

1.1 m

2.9 m

1.2 m

Create system-wide efficiencies in library management

Multilingual WorldCatMultilingual WorldCatCreate system-wide efficiencies in library management

Multilingual WorldCatMultilingual WorldCat

1.9 billion items and growing!

170 million bib records

3.6 million digital items

1.5 billion holdings

325 million electronic database records

NEW! JSTOR Metadata: 4.5 million records

30 million items(Google, HathiTrust, OAIster)

Physical holdings in WorldCat

Licensed digital content in library

collectionsLocal library content

being digitized

Create system-wide efficiencies in library management

The collective collectionCreate system-wide efficiencies in library management

The collective collection

WorldCat Growth –

Synchronization with

Libraries, Repositories & Metadata Hubs

Local

Group

Global

Growing WorldCat FasterGrowing WorldCat Faster

New Data Ingest Platform under Services Oriented Architecture

Create system-wide efficiencies in library management

Using Publisher Data to Grow WorldCat

Create system-wide efficiencies in library management

Using Publisher Data to Grow WorldCat

Establish partnerships with publishers

Ingest publisher and vendor metadata in ONIX

Enhance publisher metadata

Enrich WorldCat with publisher metadata

Output enhanced ONIX data to publishers/other partners

http://www.oclc.org/partnerships/material/nexgen/nextgencataloging.htm

Metadata Services for PublishersMetadata Services for Publishers

Publisher

Book Seller

Bib D

ata

Enriched Bib D

ata

Enriched B

ib

Data

OAIsterOAIster

WorldCat Growth –

Syndication

Local

Group

Global

Create system-wide efficiencies in library management

OCLC and Google to exchange data, link digitized books to WorldCat

Create system-wide efficiencies in library management

OCLC and Google to exchange data, link digitized books to WorldCat

Synchronizes WorldCat with digital collections of interest to the membership

Participating organizations provide OCLC with a regular feed of metadata

WorldCat is automatically updated with new MARC records as materials become available

Reciprocal linking between WorldCat and the host site

Automatic

Create system-wide efficiencies in library management

OCLC Syndicates WorldCat Data with Google Books

Create system-wide efficiencies in library management

OCLC Syndicates WorldCat Data with Google Books

WorldCat Quality –

Improving the Quality of the Database

Local

Group

Global

Quality Control ActivitiesQuality Control Activities

FY08 FY09

Bib Records Replaced 2,105,325 6,804,903

Manual Merges 207,742 137,832

Authority Records Replaced

395,817 1,112,815

Change Requests Received

182,348 134,902

Reducing Duplicates – An Improved AlgorithmReducing Duplicates – An Improved Algorithm

First production run, May 18, 2009

Running small files (500 – 3000)

Statistics for May & June 2009

33,023 records processed

1,777 duplicates removed (5.7%)

846 records deferred for manual review

Reducing Duplicates – An Improved AlgorithmReducing Duplicates – An Improved Algorithm

Full production run, Feb. 2, 2010

Entire Database, beginning with OCN #1

Statistics so far:

7.5 Million records processed

Almost 650,000 records removed

Unique fields from deletes merged into the master record

The exception to this is non-Latin fields.  We try to ensure that all non-Latin fields are in the retained record even if they are not on the list of mergeable fields.

Expert Community ExperimentExpert Community Experiment

Experiment to test “social cataloging” with OCLC’s expert community (modeled on Wikipedia)

Interest and motivation from WorldCat Local libraries that want to use WorldCat Local as their “database of record”

Total Replaces = 108, 766Total Replaces = 108, 766

What are they saying?What are they saying?

“I am loving the ability to fix typos, add more subject headings, etc. Some of which were things I would do locally but were too much of a hassle to fix at the oclc level.”

“Thank you so much for the opportunity to participate in the community enhancement experiment! Having the ability to correct typos, flesh out minimal…cataloging…is really wonderful. I hope the experiment works out well … -- I would love to see it made a permanent feature”

WorldCat is much more than a warehouse of recordsWorldCat is much more than a warehouse of records

•Continuous improvement of WorldCat records by members:•Enhance •Record enrichments•Expert Community Experiment•Error reporting

•OCLC’s quality management role:•WorldCat Quality group•Automated record enrichment•FRBRization•Duplicate detection and resolution•Support for Program for Cooperative Cataloging – NACO, CONSER, BIBCO, etc.•Ongoing conformance to library standards

A partnership of members and OCLC

WorldCat Services

Selection, Collection Analysis & Dewey.info

Local

Group

Global

WorldCat Selection partnersWorldCat Selection partners

 The interdisciplinary studies enhancement helps libraries: 

• Define their own unique interdisciplinary studies area

• Easily navigate through the OCLC Conspectus

• identify titles in multiple subject areas

• Compare interdisciplinary studies collection against peer libraries

• identify overlaps and gaps

• Limit an analysis by Category and/or Subject in addition to Division

• Save Subject Profiles and have them available for use in the future

 Demo: http://vidego.multicastmedia.com/player.php?p=u3t34bs7

Interdisciplinary Studies AnalysesInterdisciplinary Studies Analyses

Dewey.infoDewey.info

WorldCat Registry –

Enabling Services

Local

Group

Global

Metadata about LibrariesMetadata about Libraries

WorldCat Registry

• A repository of metadata about libraries:

• Location• Contacts• Policies• Links

WorldCat Registry Value Proposition WorldCat Registry Value Proposition

The WorldCat Registry allows your library to:

• Provide direct linking to local library services over a variety of OCLC products including WorldCat.org and WorldCat Local

• Create and manage a profile that centralizes and automates information sharing with vendors and OCLC

• Receive a free benefit of greater internet visibility regardless of the OCLC membership

worldcat.org/registry/institutions

Registry Growth 2007-2009Registry Growth 2007-2009

2007

• 70, 000 records

• some library users

• 20,000 requests/mo via OpenURL Gateway

2009

• 130,000 records

• Over 4,500 library users managing records

• Processing 200-300,000 requests/mo via OpenURL Gateway

• Multiple OCLC and non-OCLC Services that rely on this data

Bringing It All Together: RedLaser AppBringing It All Together: RedLaser App

http://redlaser.com

WorldCat Growth –

The Value of the Cooperative

Local

Group

Global

The Value of the Shared WorldCat Network for CatalogingThe Value of the Shared WorldCat Network for Cataloging

Record Supply: Where do WorldCat records come from?Record Supply: Where do WorldCat records come from?

The cooperative provides the content.

The cooperative activity provides the value.

Cataloging: Key to All OCLC ServicesCataloging: Key to All OCLC Services

WorldCat Growth –

Are We Doing Enough?

Local

Group

Global

What Else Should We Do?What Else Should We Do?

Evaluate:

• How We Gather the Data

• How We Expose the Data

• How Members Interact with the Data

What Else Should We Do?What Else Should We Do?

What Else Should We Do?What Else Should We Do?

What Else Should We Do?What Else Should We Do?

OCLCThe world’s libraries. Connected.OCLCThe world’s libraries. Connected.

More collaboration

More institutions

More Web-scale

More synchronization

More innovation

Local

Group

Global

More

Better

WorldCat Growth & Quality: Vision and Practice

WorldCat Growth & Quality: Vision and Practice

Ted FonsDirector

WorldCat Global Metadata Network

CJK Users Group 2010

March 26, 2010