freebase 101

Freebase 101Kirrily Robert, August 2010

Thursday, August 19, 2010

All of Freebasein 30 minutesand 73 slides.

A structured entity database.

A structured databaseof people, places, and things.

Freebase has many types of things

12 Million Topics

Connections between things

education

nationality

contained-by

education

member-of

eventalbums

contained-by

contains

member-of

education

nationality

contained-by

education

member-of

eventalbums

contained-by

contains

member-of

~400 Million

Where does the data come from?

What’s an entity?

An entity is a singleperson, thing, or concept.

Types and Properties

Types = “is-a”

• Person

• Location

• Business

• Movie

• TV show

• Fictional character

• Winery

• Automobile model

• Airport

• Travel destination

• Ingredient

• Mountain

• Cause of death

• Political party

Guy Ritchie is a...

• Person

• Film director

• Award winner

• Celebrity

Properties = “has-a”

Properties of “person”

• gender

• date of birth

• place of birth

• profession

• nationality

• ethnicity

• parents

• children

• religion

• education

• employment history

• ... and more

Freebase Schema

10,448 Properties

describing

4,936 Types*

organized into

641 Domains

(~70 Commons)

*types with 10 or more instancesThursday, August 19, 2010

Domains

Freebase Commons = 72 domains

American FootballArchitectureAstronomyAutomotiveAviationAwardsBaseballBasketballBicyclesBiologyBoatsBooksBroadcastBusinessCelebritiesChemistryComputersConferences

CricketData worldDigicamsEducationEngineeringEventsFashionFictional universesFilmFoodFreebaseGamesGeologyGovernmentHobbies and interestsIce hockeyInfluenceInternet

LanguageLawLibraryLocationMartial artsMeasurement unitMedia commonsMedicineMeteorologyMiltaryMusicOlympicsOperaOrganizationPeoplePeriodicalsPhysical geographyPhysics

Projects Protected placesRadioRailReligionRoyaltySoccerSpaceflightSportsSymbolsTennisTheaterTimeTransportationTravelTVVideo gamesVisual arts

One entity, many types.

Politician/government/politician

Person/people/person

Film Actor/film/actor

Commons: 72 domainsBases: 4000 domains

Commons: 72 domainsBases: ~700 useful domains

Bases = user-built domainsThursday, August 19, 2010

Summary viewThursday, August 19, 2010

Table viewThursday, August 19, 2010

Map viewThursday, August 19, 2010

Timeline viewThursday, August 19, 2010

Coming soon: Domains as projectsThursday, August 19, 2010

But, back to entities...

Every entity has one or more IDs

Topic IDs

• /en/guy_ritchie

• /m/0mm1q

• /wikipedia/en_id/91084

• /authority/imdb/name/nm0005363

• ... and more

http://ids.freebaseapps.comThursday, August 19, 2010

Developing applicationswith Freebase data

• Metaweb Query Language

• Rhymes with “pickle”

• JSON format

• Query by example

Querying Freebase

[{ "type": "/film/film", "id": null, "name": null}]

Query results[{ "id": "/en/3_10_to_yuma_1957", "name": "3:10 to Yuma", "type": "/film/film"},{ "id": "/en/20_000_leagues_under_the_sea", "name": "20,000 Leagues Under the Sea", "type": "/film/film"},{ "id": "/en/2010_the_year_we_make_contact", "name": "2010: The Year We Make Contact", "type": "/film/film"},... and so on}]

Querying Freebase

[{ "type": "/film/film", "id": null, "name": null}]

Querying Freebase

[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" },}]

Querying Freebase[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" }, "starring":[{ "actor": { "id":"/en/harrison_ford" } }]}]

Querying Freebase[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" }, "starring":[{ "actor": { "name": null, "film": [{ "film": { "id": "/en/the_great_escape" } }] } }]}]

Drumroll, please![{ "directed_by": { "id": "/en/george_lucas" }, "id": "/en/thx_1138", "name": "THX 1138", "starring": [{ "actor": { "film": [{ "film": { "id": "/en/the_great_escape" } }], "name": "Donald Pleasence" } }]}]

http://freebase.com/tools/queryeditorThursday, August 19, 2010

REST API

mqlread read structured data

mqlwrite write structured data

search free text search

topic simplified topic data

... and more

http://freebase.com/docs/Thursday, August 19, 2010

Libraries

• freebase-python (best supported):http://code.google.com/p/freebase-python

• other languages: http://wiki.freebase.com/wiki/Libraries

App Editor (acre.freebase.com)Thursday, August 19, 2010

Templating language

http://freebase.com/appsThursday, August 19, 2010

Freebase Suggest

• JQuery plugin

• Search Freebase entities

• Limit by Freebase type

Freebase Suggesthttp://code.google.com/p/freebase-suggest/

Data dumps

• TSV format (simplified for import into Excel)

• Triple format (full graph representation)

• Simple topic dump (basic information about every topic)

• http://download.freebase.com/

Loading data

Wikipedia pipeline(one of many)

• Runs every 2 weeks

• Imports new topics

• Looks for structure in Wikipedia

Quality Assurance

Data quality

QAProcess

99%accuracy

Reconciliation

“The Little Prince” ?

... the book?

... the movie?

... the opera?

... the episode of Lost?

Human Judgements

RABJ(Redundant Array of Brains in a Jar)

How YOU can load data

• mqlwrite

• Spreadsheet Loader

• Gridworks

http://code.google.com/p/freebase-gridworks/Thursday, August 19, 2010

http://matchmaker2.freebaseapps.com Thursday, August 19, 2010

genderizer.freebaseapps.comThursday, August 19, 2010

Freebase Community

• Schema development

• Data curation

• Data loads

• QA and human judgement

• Building apps

Freebase Community

• Freebase-discuss mailing listhttp://lists.freebase.com/

• Bug trackerhttp://bugs.freebase.com/

• Wiki (community documentation)http://wiki.freebase.com/

• IRCirc.freenode.net #freebase

skud@google.com

http://blog.freebase.com/

@fbase

freebase 101

Technology

deconstructing freebase

partii:schema-agnostic knowledge base...

wrangler: interactive visual speciﬁcation of data ... ·...

bistrica potok put lopate ribnjak jarak obuhvat upu-a...

toby segaran, freebase the ecosystem of business and social...

freebasing for fun and enhancement · freebase •...

exploring our world with freebase

bolnica z planovi... · 2019-11-06 · 401 401 101 101 101...

freebase-triples: a methodology for processing the...

toby segaran, freebase

pumps • motors · 2020. 6. 4. · 101 101 101 101 101 101...

freebase - semantic technologies 2010 code camp

rabj freebase all

center for e-business technology seoul national university...

content egg wordpress pluginfreebase модуль...

ht seating chart color update - the music hallstage 111 111...

put lopate 2.c. energetski sustav 110kv obuhvat...

information extraction over structured data:...

question answering over freebase via attentive rnn with...

ny freebase workshop 10 dec 2009