linked open data for libraries
DESCRIPTION
Presented at Dutch National Librarian/Information Professianal Association annual conference 2011 - NVB2011November 17, 2011TRANSCRIPT
University library
Linked Open Datafor librariesLukas Koster
Library Systems CoordinatorLibrary of the University of Amsterdamhttp://www.uba.uva.nl@lukask
NVB 2011, 17 november 2011
NVB 2011, 17 november 2011 2
University library
http://www.loc.gov/marc/transition/news/framework-103111.html
NVB 2011, 17 november 2011 3
University library
Agenda
Open data Linked data Linked Open Data and Libraries Options for libraries Recommendations
NVB 2011, 17 november 2011 4
University library
Open data: 5 stars (Tim Berners-Lee)
Data: no stars
Open Data: 1 star - Open Licence
Open Data: 2 stars - Reusable
Open Data: 3 stars - Open Format
Linked Open Data: 4 stars - URI's
Linked Open Data: 5 stars - Linked Data
NVB 2011, 17 november 2011 5
University library
Linked data: 4 rules (Tim Berners-Lee)
1. Use URIs as names for things 2. Use HTTP URIs so that people can look up those names. 3. When someone looks up a URI, provide useful information,
using the standards (RDF, SPARQL) 4. Include links to other URIs, so that they can discover more
things.
http://www.w3.org/DesignIssues/LinkedData.html
NVB 2011, 17 november 2011 6
University library
RDF
URI
Triple
Ontology
Vocabulary
NVB 2011, 17 november 2011 7
University library
URIs
Unique identifiers on the web
Instead of internal database primary keyhttp://viaf.org/viaf/102403515 (Dan Brown)
http://openlibrary.org/works/OL76837W (The Da Vinci Code)
NVB 2011, 17 november 2011 8
University library
Relational databases: primary keys
Books
Title
Author
Year
ID
Authors
Name
Year
ID
Primary key Primary key
Foreign key
Authors record
Dan Brown
1964
456ID
Name
Year
The Da Vinci Code
Books record
456
2003
1289
Title
ID
Author
Year
NVB 2011, 17 november 2011 9
University library
Relational databases and applications
Select title, year from booksSelect name, year from authors where books.author=authors.id
Title: The Da Vinci CodeAuthor: Dan Brown, 1964Year: 2003
Database
Application
User interface
Authors record
Dan Brown
1964
456ID
Name
Year
The Da Vinci Code
Books record
456
2003
1289
Title
ID
Author
Year
SQL
NVB 2011, 17 november 2011 10
University library
URIs
OpenLibrary
Title
Author
Year
URI
VIAF
Name
Year
URI
Primary key Primary key
Foreign key
Authors record
Dan Brown
1964
http://viaf.org/viaf/102403515 URI
Name
Year
The Da Vinci Code
Books record
http://viaf.org/viaf/102403515
2003
http://openlibrary.org/works/OL76837W
Title
URI
Author
Year
NVB 2011, 17 november 2011 11
University library
Linked data and applications
Select ?title ?year …Select ?name ?year WHERE …..
Title: The Da Vinci CodeAuthor: Dan Brown, 1964Year: 2003
Database
Application
User interface
SPARQL
Authors record
Dan Brown
1964
http://viaf.org/viaf/102403515 URI
Name
Year
The Da Vinci Code
Books record
http://viaf.org/viaf/102403515
2003
http://openlibrary.org/works/OL76837W
Title
URI
Author
Year
NVB 2011, 17 november 2011 12
University library
Triples •Subject - Predicate – Object
•Thing – Relation - Thing
written by
painted byis about
author ofpainter of
is subject of
uri
uri
uri
uri
uri
uri
NVB 2011, 17 november 2011 13
University library
Triples and URIs
URIs for: Subject Object Relation
uri
uri
uri
http://viaf.org/viaf/102403515
http://openlibrary.org/works/OL76837W
http://purl.org/dc/terms/creator
NVB 2011, 17 november 2011 14
University library
RDF – Resource Description Framework
Used for defining ontologies/vocabularies Data model (what can be described)
Classes (types), attributes, relations
Used for describing triples Data (what is described)
Objects, attribute values, relations
NVB 2011, 17 november 2011 15
University library
Description: http://bibliontology.com
Namespace: http://purl.org/ontology/bibo/
NVB 2011, 17 november 2011 16
University library
BIBO - Bibliographic Ontology
xml:base="http://purl.org/ontology/bibo/" xmlns:owl2xml="http://www.w3.org/2006/12/owl2-xml#" xmlns:terms="http://purl.org/dc/terms/" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" xmlns:status="&bibo;status/" xmlns:vann="http://purl.org/vocab/vann/" xmlns:schema="http://schemas.talis.com/2005/address/schema#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:foaf="http://xmlns.com/foaf/0.1/" xmlns:prism="http://prismstandard.org/namespaces/1.2/basic/" xmlns:owl="http://www.w3.org/2002/07/owl#" xmlns:skos="http://www.w3.org/2004/02/skos/core#" xmlns:event="http://purl.org/NET/c4dm/event.owl#" xmlns:ns="http://www.w3.org/2003/06/sw-vocab-status/ns#" xmlns:degrees="&bibo;degrees/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:bibo="http://purl.org/ontology/bibo/">
Ontologies used
Dublin Core - Metadata
FOAF - People
SKOS – Thesaurus, Subjects
NVB 2011, 17 november 2011 17
University library
BIBO - Bibliographic Ontology
<!-- http://purl.org/ontology/bibo/Book --> <owl:Class rdf:about="Book"> <rdfs:label xml:lang="en">Book</rdfs:label> <rdfs:subClassOf rdf:resource="Document"/> <rdfs:isDefinedBy rdf:datatype="&xsd;anyURI" >http://purl.org/ontology/bibo/</rdfs:isDefinedBy> <ns:term_status>stable</ns:term_status> <rdfs:comment xml:lang="en">A written or printed work of fiction or nonfiction, usually on
sheets of paper fastened or bound together within covers. </rdfs:comment> </owl:Class>
Class/Object type
NVB 2011, 17 november 2011 18
University library
BIBO - Bibliographic Ontology
<urn:isbn:0385504209> a bibo:Book ;dc:creator <http://viaf.org/viaf/102403515> ;dc:title “The Da Vinci Code"@en ;dc:date "2003“
Book example
NVB 2011, 17 november 2011 19
University library
OpenLibrary.org: RDFSubjects as string values
<dcterms:subject>Fiction</dcterms:subject> <dcterms:subject>Cryptographers</dcterms:subject> <dcterms:subject>Grail</dcterms:subject> <dcterms:subject>Secret societies</dcterms:subject> <dcterms:subject>Art museum curators</dcterms:subject> <dcterms:subject>Manuscripts</dcterms:subject> <dcterms:subject>Appreciation</dcterms:subject> <dcterms:subject>Crimes against</dcterms:subject> <dcterms:subject>Romans</dcterms:subject> <dcterms:subject>Aventures</dcterms:subject> <dcterms:subject>Suspense fiction</dcterms:subject> <dcterms:subject>Religious articles</dcterms:subject> <dcterms:subject>Occultisme</dcterms:subject> <dcterms:subject>Accessible book</dcterms:subject> <dcterms:subject>Protected DAISY</dcterms:subject>
NVB 2011, 17 november 2011 20
University library
Subjects as URIs
<dcterms:subject>
http://dbpedia.org/resource/The_Last_Supper_%28Leonardo_da_Vinci%29
</dcterms:subject>
<dcterms:subject>
http://id.loc.gov/authorities/names/n98088614
</dcterms:subject>
NVB 2011, 17 november 2011 21
University libraryDBPedia (WikiPedia)
NVB 2011, 17 november 2011 22
University libraryLoC
NVB 2011, 17 november 2011 23
University library
Two sides
PublishConsume
NVB 2011, 17 november 2011 24
University library
Summary: Linked Open Data
WWW
The web as global database/web of data
RDF as universal API
Applications using global data via RDF
NVB 2011, 17 november 2011 25
University library
Original objective of libraries
Gateways to information
Printed material
Physical objects
On location
Bibliotheken en leeszalen in beeld, 1990
NVB 2011, 17 november 2011 26
University library
Changing information world
WWW
http://www.flickr.com/photos/elenaromera/353826561/
http://www.flickr.com/photos/simona_/4068354970/
NVB 2011, 17 november 2011 27
University library
Changing role for libraries
Reference desk
Content curation
Information gateway
NVB 2011, 17 november 2011 28
University library
Linked data options for libraries
Consume
Traditional cataloguing
Enrichment of existing catalogue data
Create new information aggregates (new!) Publish (unique stuff)
Holdings/usage data
Special collections
NVB 2011, 17 november 2011 29
University library
Linked data options for libraries
Traditional cataloguing
NVB 2011, 17 november 2011 30
University library
Links as text strings
Links to internal records
NVB 2011, 17 november 2011 31
University library
RDA
Resource Description and Access
NVB 2011, 17 november 2011 32
University library
FRBR
Functional Requirements for Bibliographic Records
Defined in relation to tasks performed by users when searching and making use of national bibliographies and library catalogues
http://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2
NVB 2011, 17 november 2011 33
University library
FRBR User Tasks Find Identify Select Obtain Navigate
NVB 2011, 17 november 2011 34
University library
FRBR
Group 1: What? Work Expression Manifestation ItemGroup 2: By who? Person Corporate Body
FRAD Functional Requirements for Authority Data Group 3: About what? Concept Object Event Place
FRSAD Functional Requirements for Subject Authority Data
Title – Author - Subjecthttp://archive.ifla.org/VII/s13/frbr/frbr_current2.htm#2.2
NVB 2011, 17 november 2011 35
University library
http://www.loc.gov/cds/downloads/FRBR.PDF
© Library of Congress/Barbara Tillett
NVB 2011, 17 november 2011 36
University library
FRBR for books
Editions
Copies
Original
AdaptationTranslation
NVB 2011, 17 november 2011 37
University library
FRBR Group 1 Entities - WEMI
Manifestation
Item
Work
Expression
Catalogue
Missing links
NVB 2011, 17 november 2011 38
University library
Triples
written by
painted byis about
author ofpainter of
is subject of
uri
uri
uri
uri
uri
uri
NVB 2011, 17 november 2011 39
University library
LOD, FRBR and cataloguingwritten by
painted by
author of
painter of
is subject of
http://permalink.opc.uva.nl/item/001665446
is about
Manifestation
Item
Work
Expression
http://viaf.org/viaf/102403515
Dan Brown
http://openlibrary.org/works/OL76837W
The Da Vinci Code
http://viaf.org/viaf/24604287
Leonardo da Vinci
http://id.loc.gov/authorities/names/n98088614
The Last Supper
Dutch translationDe Da Vinci Code
HoldingOBA
http://www.worldcat.org/libraries/57394
http://<expression-uri>
http://<manifestation-uri>
Library
NVB 2011, 17 november 2011 40
University library
URI http://openlibrary.org/works/OL76837W
Original Title The Da Vinci Code 245 $a
Author http://viaf.org/viaf/102403515 100 $a
Subject http://en.wikipedia.org/wiki/The_Last_Supper_(Leonardo_da_Vinci)
650 $a
Work
URI http://<expression-uri>
Work http://openlibrary.org/works/OL76837W
Language dut (or: URI to language code) 546 $a
Title De Da Vinci Code 245 $a
Expression
URI http://<manifestation-uri>
Expression http://<expression-uri>
Publisher http://isbndb.com/d/publisher/anchor_books.html 260 $b
Date 2006 260 $c
Manifestation
NVB 2011, 17 november 2011 41
University library
URI http://openlibrary.org/works/OL76837WWork
URI http://<expression-uri>
Work http://openlibrary.org/works/OL76837W
Expression
URI http://<manifestation-uri>
Expression http://<expression-uri>Manifestation
URI http://<holding-uri>
Library http://www.worldcat.org/libraries/57394
Manifestation http://<manifestation-uri>
Holding
URI http://<item-uri>
Holding http://<holding-uri>
Availability
Item(s)
Global shared bibliographic data
Local holdings data
WWW
NVB 2011, 17 november 2011 42
University library
PublishersManifestation
Item
Work
Expression
FRBR Group 1 FRBR Group 2FRAD
FRBR Group 3FRSAD
Holding
Libraries
NVB 2011, 17 november 2011 43
University library
Problems - challenges
Existing circumstances not suited for moving to Linked Cataloguing - RDA/FRBR/LOD:
Database - Bibliographic formats (MARC) Applications - Local library systems
NVB 2011, 17 november 2011 44
University library
Linked Cataloguing - What’s needed Global Shared Bibliographic Metadata Store(s) Global Shared Authority Files Open Cataloguing systems Supporting for linking with URIs
NVB 2011, 17 november 2011 45
University library
Linked data options for libraries
Enrichment of existing data
NVB 2011, 17 november 2011 46
University library
FRBR
Links
NVB 2011, 17 november 2011 47
University library http://search.obvsg.at/OBV
FRBR
NVB 2011, 17 november 2011 48
University library http://search.obvsg.at/OBV
Text about authorEmbedded from DBPedia(Wikipedia Linked Data engine)Uses German National Library Author ID’s
NVB 2011, 17 november 2011 49
University library
Enrichment - Discovery front ends
Examples use Discovery front ends Extra layer on top of processed catalogue metadata Metadata are FRBRised, based on string matching Linked data embedded using scripts/programming,
manipulating HTML front end
NVB 2011, 17 november 2011 50
University library
Example: Pilot project
Linking library catalogue data to theatre performance data
Dutch Digital Cultural Heritage Foundation DEN as instigator
http://den.nl/
Library of the University of Amsterdam Theatre Institute of The Netherlands
http://tin.nl/http://www.uba.uva.nl/
NVB 2011, 17 november 2011 51
University library
Library catalogue results
No FRBR here (yet)
NVB 2011, 17 november 2011 52
University library
Library catalogue results
NVB 2011, 17 november 2011 53
University library
TIN theatre production database
NVB 2011, 17 november 2011 54
University library
TIN theatre production database
NVB 2011, 17 november 2011 55
University library
What we made
NVB 2011, 17 november 2011 56
University library
How we did it - URIs
<base-url>/person/Beckett, Samuel
<base-url>/title/Beckett, Samuel/Waiting for Godot
JavaScript/JQuery
HTML
NVB 2011, 17 november 2011 57
University library
How we did it – JavaScript/JQuery<base-url>/person/Beckett, Samuel
<base-url>/title/Beckett, Samuel/Waiting for Godot
<base-url>/production/Beckett, Samuel/Waiting for Godot/1988-11-22/6750
NVB 2011, 17 november 2011 58
University library
Problems/challenges No common identifiers
Aleph key ≠ key No internal links to common entity
No central “Work” String matching
Author: ‘Samuel Beckett’- ‘Beckett, Samuel’
Title: ‘Waiting for Godot’ –’En attendant Godot’ Copyright
Photos, videos, audio, artwork
NVB 2011, 17 november 2011 59
University library
Identifiers/URIs/String matching
/title/Beckett, Samuel/Waiting for Godot
/title/Beckett, Samuel/Waiting for Godot : a tragicomedy in two acts
/title/Beckett, Samuel/En attendant Godot : pièce en deux actes
/title/Beckett, Samuel/Wachten op Godot
/title/Beckett, Samuel/Waiting for Godot
/title/Beckett, Samuel/Waiting For Godot
/title/Beckett, Samuel/Wachten op Godot
/title/Beckett, Samuel/Wachtend op Godot
/title/Beckett, Samuel/Wachten op Godot (De favorieten)
/title/Beckett, Samuel/Wachten op Godot (eerste bedrijf)
/title/Beckett, Samuel/En attendant Godot
/title/Beckett, Samuel/Warten auf Godot
NVB 2011, 17 november 2011 60
University library
Ideally….
FRBR
NVB 2011, 17 november 2011 61
University library
Current situation
Implicit relations
NVB 2011, 17 november 2011 62
University library
Enrichment - What’s needed New search type: linked data search Mechanisms for consuming external linked data
sources Options to identify trustworthy LOD sources Automatic retrieval and processing of RDF
vocabularies
NVB 2011, 17 november 2011 63
University library
Linked data options for libraries
Create new information aggregates
NVB 2011, 17 november 2011 64
University library
The girl
The war
The house
The diary
The book
The movie
The playAbout
Library catalogue
FRBR
Subject: Anne Frank
NVB 2011, 17 november 2011 65
University library
New aggregations
http://www.annefrank.org/en/Subsites/Timeline/#
NVB 2011, 17 november 2011 66
University library
LOCAH – Linking LivesLinked Open Copac Archives Hub
http://blogs.ukoln.ac.uk/locah/
http://data.archiveshub.ac.uk/
Publish linked dataArchives+libraries
Using Linked Data to create biographical resources
http://archiveshub.ac.uk/linkinglives
NVB 2011, 17 november 2011 67
University library
New Aggregates - What’s needed Content curation Cooperation
Technology Expertise New systems
NVB 2011, 17 november 2011 68
University library
Linked data options for libraries
Publishing
NVB 2011, 17 november 2011 69
University library
Publishing linked data
RDF: Ontology
Ontologies (re)used (namespaces)
Object types, attributes, relations Triples
On the fly
Triple store
NVB 2011, 17 november 2011 70
University library
Publishing library data as linked data
Bibliographic information:
FRBR Work/Expression/Manifestation
FRAD Authors/Creators
FRSAD SubjectsIdeally only once, no redundancy
Publishers
LoC New Bibliographic Framework
Not unique
NVB 2011, 17 november 2011 71
University library
Publishing library data as linked data
Holdings information:
Holdings per library
FRBR Items Usage data
Unique
Approved
NVB 2011, 17 november 2011 72
University library
Publishing library data as linked data
Special collections
=
Cultural heritage
Archives
Museums
Unique
Approved
NVB 2011, 17 november 2011 73
University library
Publishing - What’s needed System development skills/staff Linked Data features added to existing library
systems
New generic linked data information systems, tools,
online services
NVB 2011, 17 november 2011 74
University library
Recommendations
Cooperate! Libraries, Archives, Museums Consortia
Ask library systems vendors to adapt (next gen) systems: FRBR/RDA/Linking architecture/infrastructure LOD/RDF/URI Publishing options LOD/RDF/URI Consuming options
NVB 2011, 17 november 2011 75
University library
Existing library system vendors
adding publishing options
authority files - VIAF
working with user grouphttp://igelu.org/special-interests/lod
NVB 2011, 17 november 2011 76
University library
Linked Open Data: Systems and tools
Develop your own systems/open source Use existing commercial systems Consortia infrastructures National platforms Use free tools
NVB 2011, 17 november 2011 77
University library
http://kasabi.com/
NVB 2011, 17 november 2011 78
University library
http://dydra.com/
NVB 2011, 17 november 2011 79
University library
http://revyu.com/
NVB 2011, 17 november 2011 80
University library
http://virtuoso.openlinksw.com/
NVB 2011, 17 november 2011 81
University library
http://metadataregistry.org/
NVB 2011, 17 november 2011 82
University library
http://thedatahub.org/
NVB 2011, 17 november 2011 83
University library
Library Linked Data documentation
W3C Library Linked Data Incubator Group, Report:
http://www.w3.org/2005/Incubator/lld/XGR-lld-20111025/
IGeLU 2011 session Linked Data and Ex Libris products, Summary slides:
http://igelu.org/wp-content/uploads/2011/09/Linked-data-and-Ex-Libris-products-Summary.pdf
Tutorial publishing linked open data by DEN: http://www.den.nl/pagina/334/den-lab/