yourhistory - entity linking for a personalized timeline of historic events
DESCRIPTION
slides for yH talk @ ICT.OPEN2013 (Intelligent Systems track)TRANSCRIPT
Gaza War
Berlin Wall
9/11Gulf WarWorld War II
1900 20102000199019801970196019501940193019201910
201020001990198019701950
Britches
BET Hiphop AwardsWoodstock
David Graus, Maria-Hendrike Peetz, Daan Odijk, Maarten de Rijke, Ork de Rooij
Entity Linking for a personalized timeline of historic events
• Motivation
• Method
• Part I: Fetch Candidate Historic Events
• Part II: Generate User Profile
• Part III: Matching Events to User Profile
• Part IV: Scoring & Ranking Events
• Future Work
• […] To design and build innovative and robust prototypes and demos for tools that analyse and/or integrate open web data for educational purposes.
History education
Gaza War
Berlin Wall
9/11Gulf WarWorld War II
1900 20102000199019801970196019501940193019201910
201020001990198019701950
Britches
BET Hiphop AwardsWoodstock
Personalized historic timeline
Part I: Candidate Historic Events
select ?concept where { ?concept rdf:type dbpedia-‐owl:Event }
Part I: Candidate Historic Events
select ?concept where { ?concept rdf:type dbpedia-‐owl:Event }
select ?concept where { ?concept rdf:type dbpedia-‐owl:Event }
BIOPOST
POST
POST
MY FACEBOOK
PROFILE
LIKES
Part II: User Profile
Extract Information from Facebook profile
BIOPOST
POST
POST
MY FACEBOOK
PROFILE
LIKES
Access Facebook profile
BIOPOST
POST
POST
MY FACEBOOK
PROFILE
LIKES
{ "id": "1183880085", "likes": { "data": [ { "category": "Musician/band", "created_time": "2013-‐10-‐27T11:37:51+0000", "name": "NAS", "id": "113591595350795" }, { "category": "Company", "created_time": "2013-‐10-‐17T07:45:36+0000", "name": "Infinibase", "id": "573216229380347" }, { "category": "Magazine", "created_time": "2013-‐10-‐04T13:55:10+0000", "name": "New Scientist NL", "id": "369158433181445" }, {
Extract text attributes
{ "id": "1183880085", "likes": { "data": [ { "category": "Musician/band", "created_time": "2013-‐10-‐27T11:37:51+0000", "name": "NAS", "id": "113591595350795" }, { "category": "Company", "created_time": "2013-‐10-‐17T07:45:36+0000", "name": "Infinibase", "id": "573216229380347" }, { "category": "Magazine", "created_time": "2013-‐10-‐04T13:55:10+0000", "name": "New Scientist NL", "id": "369158433181445" }, { "category": "Tv show", "created_time": "2010-‐05-‐09T01:06:27+0000", "name": "The Wire", "id": "5991693871" } ] }
• American Horror Story
• Omroep Maxim • Gamer01 • Breaking Bad • AT5 • Mad Men • The Wire • Monty Python's Flying Circus
• Flight of the Conchords
• Donnie Darko • Flevopark Film Festival
• Do The Right Thing
• A Clockwork Orange
• Wild Style • Princess Mononoke
• The Fountain • Pi • Northfork • La Haine • Zen and the Art of Motorcycle Maintenance
• Moon Palace
• The Fountainhead
• The Wind-‐Up Bird Chronicle
• Wu-‐Tang • J.Cole • NAS • Pusha T • ASAP Rocky • Ab-‐Soul • Chance The Rapper
• Cannibal Ox • Bonobo • Aesop Rock • Boards Of Canada
• Jurassic 5 • GREMS • Quasimoto • Strange Journey Volume Three
• Drop Velvet • MODESELEKTOR • IAM • Derek • The Onion • Imgur • De Speld • Wu-‐Tang
• Pusha T • ASAP Rocky • Ab-‐Soul • Chance The Rapper • Cannibal Ox • Bonobo • Aesop Rock • Boards Of Canada • Jurassic 5 • GREMS • Quasimoto • Strange Journey Volume Three • Drop Velvet • MODESELEKTOR • IAM • Derek • The Onion • Imgur • De Speld • Wu-‐Tang • J.Cole • I Am Fucking Ambivalent About Science
• NAS • Pusha T • ASAP Rocky • Chrietitie • Infinibase • Marktplaatspo\xc3\xabzie • Jeannette Span : Spelen • New Scientist NL
Entity Linking
• Given a Knowledge Base
• Link mentions of entities (or concepts) to their referent entities
Entity Linking
• From Wikipedia:
• Extract anchor texts (words used to link to Wikipedia pages)
!
!
!
!
!
!
• For each n-gram n ↔ Wikipedia page W estimate:
• Probability of using n-gram n to refer to Wikipedia page W
Entity Linking Example Link Probability
“Nas” occurs 2475x in Wikipedia
is anchor
is no anchor
!
1.723x
752x
Entity Linking Example Link Probability
“Nas” occurs 2475x in Wikipedia
is anchor
is no anchor
!
1723/2475 = 69,6%
752/2475 = 30.4%
Entity Linking Example Commonness
• Nas is used to refer to:
• http://en.wikipedia.org/wiki/Nas
• http://en.wikipedia.org/wiki/Naas
• http://en.wikipedia.org/wiki/Nås
• http://en.wikipedia.org/wiki/Nas (Ikaria)
• http://en.wikipedia.org/wiki/Untitled Nas album
Entity Linking Example Commonness
• Nas is used to refer to:
• http://en.wikipedia.org/wiki/Nas
• http://en.wikipedia.org/wiki/Naas
• http://en.wikipedia.org/wiki/Nås
• http://en.wikipedia.org/wiki/Nas (Ikaria)
• http://en.wikipedia.org/wiki/Untitled Nas album
14x
4x
3x
2x
2x
Entity Linking Example Commonness
• Nas is used to refer to:
• http://en.wikipedia.org/wiki/Nas
• http://en.wikipedia.org/wiki/Naas
• http://en.wikipedia.org/wiki/Nås
• http://en.wikipedia.org/wiki/Nas (Ikaria)
• http://en.wikipedia.org/wiki/Untitled Nas album
14/25 = 56%
4/25 = 1.6%
3/25 = 1.2%
2/25 = 0.8%
2/25 = 0.8%
{ "text": "Nas", "links": [ { "senseProbability": 0.726027397260274, "title": "Nas", "url": "http://en.wikipedia.org/wiki/Nas" }, { "senseProbability": 0.125, "title": "Naas", "url": "http://en.wikipedia.org/wiki/Naas" }, { "senseProbability": 0.1111111111111111, "title": "Nås", "url": "http://en.wikipedia.org/wiki/N%C3%A5s" }, { "senseProbability": 0.0006523157208088715, "title": "Nas (Ikaria)", "url": "http://en.wikipedia.org/wiki/Nas%20%28Ikaria%29" }, { "senseProbability": 0.0006523157208088715, "title": "Untitled Nas album", "url": "http://en.wikipedia.org/wiki/Untitled%20Nas%20album" } }
• Breaking Bad • AT5 • Mad Men • The Wire • Monty Python's Flying Circus
• Flight of the Conchords • Donnie Darko • Flevopark Film Festival • Do The Right Thing • A Clockwork Orange • Wild Style • Princess Mononoke • The Fountain • Pi • Northfork • La Haine • Zen and the Art of Motorcycle Maintenance
• Moon Palace • The Fountainhead • The Wind-‐Up Bird Chronicle
• Wu-‐Tang • J.Cole • NAS
Match Events to Profile Entities
Match Events to Profile Entities
Map Events to Wikipedia Entities
Match Events to Profile Entities
Matching metric #1: link overlap
Matching metric #1: link overlap
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley
World!War II
Global!War
U.S.
Allies
Axis
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley
World!War II
Global!War
U.S.
Allies
Axis
1
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley
World!War II
51st!Grammy!Awards
Jay-Z
Kanye!West
Hiphop
Link #4
Global!War
U.S.
Allies
Axis
1
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley 51st!
Grammy!Awards
Jay-Z
Kanye!West
Hiphop
Link #4
3
World!War II
Global!War
U.S.
Allies
Axis
1
Matching metric #2: direct link
NAS
U.S.
Hiphop
Kanye!West
Jay-Z
Damian!Marley 51st!
Grammy!Awards
Jay-Z
Kanye!West
Hiphop
Matching metric #3: textual similarity
NAS51st!
Grammy!Awards
Matching metric #3: textual similarity
NAS51st!
Grammy!Awards
Matching metric #3: textual similarity
NAS51st!
Grammy!Awards
51st!Grammy!Awards
World!War II
Score: 0.74 Score: 0.35
Combine scores & rank events "5043324": { "event_title": "Iraq War", "related_entity_title": "The Wire", "score": 1.0, "event_date": "2003-‐03-‐20" }, "1376628": { "event_title": "Blankets (comics)", "related_entity_title": "Princess Mononoke", "score": 0.11465851113504691, "event_date": "2003-‐07-‐23" }, "15694206": { "event_title": "2006 LG Hockey Games", "related_entity_title": "Reimersholme", "score": 0.3467068139664613, "event_date": "2006-‐04-‐29" }, "4861876": { "event_title": "2005 UEFA Champions League Final", "related_entity_title": "Istanbul", "score": 1.0, "event_date": "2005-‐05-‐25" }, "31966809": { "event_title": "63rd Primetime Emmy Awards", "related_entity_title": "Mad Men", "score": 0.04039278737569369, "event_date": "2011-‐09-‐18" },
Future Work
• Log interactions
• Interpret clicks as (implicit) feedback:
• Click on Event: user is interested
• No click on Event: user is not
• Learn scoring & ranking functions
Thank you! Questions?
Try yourHistory: http://apps.facebook.com/yourHistory See our poster: #98
!
!!!David Graus
@dvdgrs