keynote @final nwo catch program event

Lora Aroyo @laroyo http://lora-aroyo.org

CATCHing up with People

from individual access to crowd engagement

Lora Aroyo


… and more


2004 - 2014

CHOICE STITCH

SCRATCH MITCH

CHIP

RICH


2004 - 2014

HiTiME

MuNCH

CHOICE STITCH

SCRATCH MITCH

CHIP

RICH

BRIDGE

MuSEUM Agora

LINKS

CHORAL WITCHCRAFT


… life after CATCH

COMMIT/SealincMedia

NLeSC DIVE

DIVE+ CLARIN

Polimedia CLARIAH

….


before CATCH


Museums, Libraries & Archives as Inventories of the World

André Malraux, The Imaginary Museum of World Sculpture, 1953


Museums, Libraries & Archives as a Place to Engage with the World


Digital Content at Web Scale


Bridging the Gap between Digital & Physical


Bridging the Gap between Past & Present


Transforming Cultural Heritage …


… into engaging experience


… into personal experience


Empowering End-Users


Enabling (Digital) Humanities


Expanding Computer Science


Project: CHIP


Enriching Collection Metadata


Creator: Rembrandt van Rijn


Style: Baroque


Subject: Portraiture


Creation Site: Amsterdam


1642

Rembrandt

The Night Watch

Militia

Oil paint

Baroque

creationDate

Creator

subject

material

AmsterdamcreationSite

Ferdinand BolPieter Lastman

studentOf

North Holland

Portraituresubject

Male portraits

specific termpart of

teacherOf

style

Wang, Y., Stash, N., Aroyo, L., Gorgels, P., Rutledge, L. and Schreiber, G., Recommenda>ons Based on Seman>cally-‐enriched Museum Collec>ons, Journal of Web Seman>cs: Science, Services and Agents on the World Wide Web, Volume 6, Issue 4, Pages 43 -‐ 50, November, 2008


style: Baroque

teacher of: Gerrit Dou

teacher of: Nicolaes Maes teacher of: Ferdinand Bol

self-portrait

militia

place: Amsterdam period:

1625 to 1650


CHIP Semantics-driven Recommendations


Semantics-driven Museum Tours


Personalized Mobile Guide


Project: AGORA


Metadata Enrichment with Events


Erp, M. van; Oomen, J.; Segers, R.; Akker, C. van de; Aroyo, L.; Jacobs, G.; Legêne, S; Meij, L. van der;O ssenbruggen, J.R. van; Schreiber, G. Automa>c Heritage Metadata Enrichment with Historic Events Museums and the Web 2011


engaging users

through event

narratives


DIGITAL HERMENEUTICS

theory of interpretation: relation parts of wholes events as context for interpretation of online collections

intersection of hermeneutics & Web technology

“Digital Hermeneutics: Agora and the online understanding of cultural heritage” In proceedings of Web Science Conference, (ACM: New York, 2011)


Project: DIVE


support a multitude of perspectives


Simple Event Model (SEM)OpenAnnotation (OA) & SKOS

DIVE:MEDIA OBJECT SEM:EVENT

SEM:PLACE

SEM:TIME

SEM:ACTOR

SKOS:CONCEPT

OA:ANNOTATION •  LINKS TO EUROPEANA (MULTILINGUAL) •  LINKS TO DBPEDIA


OPENIMAGES.EU •  3000 videos •  NL Institute for Sound & Vision •  mostly news broadcasts

DELPHER.NL •  1.5 Million Scans •  Radio bulletins •  (hand annotated) •  1937 – 1984


En0ty & Event Extra0on with CrowdTruth.org

ENTITY EXTRACTION

EVENTS CROWDSOURCING AND LINKING TO CONCEPTS THROUGH CROWDTRUTH.ORG

SEGMENTATION & KEYFRAMES

LINKING EVENTS AND CONCEPTS TO KEYFRAMES


Crowdsourcing Video Analysis CrowdTruth.org


Crowdsourcing Text Analysis CrowdTruth.org


Crowdsourcing Diversity of Perspectives


http://crowdtruth.org


dive.beeldengeluid.nl

3rd Price at the Seman>c Web Challenge 2014


Project: SealincMedia


expertise of museum professionals is in annotating their collection

with art-historical information, e.g. when they were created, by whom, etc.


detailed domain-specific information about depicted objects, e.g. which species the

animal or plant belongs to, is in most cases not available

Lora Aroyo @laroyo http://lora-aroyo.org Lora Aroyo @laroyo http://lora-aroyo.org


Related Recommenda0ons


Serendipity


Structured Semantics for CLUSTERING, RANKING, TRUST & INTEREST


Engage the Niche in Cultural Heritage

http://annotate.accurator.nl


use nichesourcing, i.e. niches of people with the right expertise, to add more specific information


Engage with Games in Cultural Heritage

training the general crowd to be a niche: game in which players can carry out an expert

annotation tasks with some assistance


data enrichment interpretation support

capturing multiple perspectives crowd & nichesourcing

Power to the People from the People


… and more


http://chip.win.tue.nl/ http://agora.cs.vu.nl

http://dive.beeldengeluid.nl http://crowdtruth.org

http://annotate.accurator.nl http://wm.cs.vu.nl

keynote @final nwo catch program event

Technology