freebase 101

Freebase 101Kirrily Robert, August 2010

Thursday, August 19, 2010

All of Freebasein 30 minutesand 73 slides.


A structured entity database.


A structured databaseof people, places, and things.


Freebase has many types of things


12 Million Topics


Connections between things


education

nationality

contained-by

education

member-of

eventalbums

label

contained-by

contains

member-of



education

nationality

contained-by

education

member-of

eventalbums

label

contained-by

contains

member-of

~400 Million



Where does the data come from?

+


What’s an entity?


An entity is a singleperson, thing, or concept.


Types and Properties


Types = “is-a”

• Person

• Location

• Business

• Movie

• TV show

• Fictional character

• Winery

• Automobile model

• Airport

• Travel destination

• Ingredient

• Mountain

• Cause of death

• Political party


Guy Ritchie is a...

• Person

• Film director

• Award winner

• Celebrity


Properties = “has-a”


Properties of “person”

• gender

• date of birth

• place of birth

• profession

• nationality

• ethnicity

• parents

• children

• religion

• education

• employment history

• ... and more


Freebase Schema

10,448 Properties

describing

4,936 Types*

organized into

641 Domains

(~70 Commons)

*types with 10 or more instancesThursday, August 19, 2010

Domains


Freebase Commons = 72 domains

American FootballArchitectureAstronomyAutomotiveAviationAwardsBaseballBasketballBicyclesBiologyBoatsBooksBroadcastBusinessCelebritiesChemistryComputersConferences

CricketData worldDigicamsEducationEngineeringEventsFashionFictional universesFilmFoodFreebaseGamesGeologyGovernmentHobbies and interestsIce hockeyInfluenceInternet

LanguageLawLibraryLocationMartial artsMeasurement unitMedia commonsMedicineMeteorologyMiltaryMusicOlympicsOperaOrganizationPeoplePeriodicalsPhysical geographyPhysics

Projects Protected placesRadioRailReligionRoyaltySoccerSpaceflightSportsSymbolsTennisTheaterTimeTransportationTravelTVVideo gamesVisual arts


One entity, many types.

Politician/government/politician

Person/people/person

Film Actor/film/actor

is-a

is-a

is-a


Commons: 72 domainsBases: 4000 domains


Commons: 72 domainsBases: ~700 useful domains


Bases = user-built domainsThursday, August 19, 2010

Summary viewThursday, August 19, 2010

Table viewThursday, August 19, 2010

Map viewThursday, August 19, 2010

Timeline viewThursday, August 19, 2010

Coming soon: Domains as projectsThursday, August 19, 2010

But, back to entities...


Every entity has one or more IDs


Topic IDs

• /en/guy_ritchie

• /m/0mm1q

• /wikipedia/en_id/91084

• /authority/imdb/name/nm0005363

• ... and more


http://ids.freebaseapps.comThursday, August 19, 2010

http://ids.freebaseapps.com

http://ids.freebaseapps.com

Developing applicationswith Freebase data


MQL

• Metaweb Query Language

• Rhymes with “pickle”

• JSON format

• Query by example


Querying Freebase

[{ "type": "/film/film", "id": null, "name": null}]


Query results[{ "id": "/en/3_10_to_yuma_1957", "name": "3:10 to Yuma", "type": "/film/film"},{ "id": "/en/20_000_leagues_under_the_sea", "name": "20,000 Leagues Under the Sea", "type": "/film/film"},{ "id": "/en/2010_the_year_we_make_contact", "name": "2010: The Year We Make Contact", "type": "/film/film"},... and so on}]


Querying Freebase

[{ "type": "/film/film", "id": null, "name": null}]


Querying Freebase

[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" },}]


Querying Freebase[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" }, "starring":[{ "actor": { "id":"/en/harrison_ford" } }]}]


Querying Freebase[{ "type": "/film/film", "id": null, "name": null, "directed_by" : { "id": "/en/george_lucas" }, "starring":[{ "actor": { "name": null, "film": [{ "film": { "id": "/en/the_great_escape" } }] } }]}]


Drumroll, please![{ "directed_by": { "id": "/en/george_lucas" }, "id": "/en/thx_1138", "name": "THX 1138", "starring": [{ "actor": { "film": [{ "film": { "id": "/en/the_great_escape" } }], "name": "Donald Pleasence" } }]}]


http://freebase.com/tools/queryeditorThursday, August 19, 2010

http://freebase.com/tools/queryeditor

http://freebase.com/tools/queryeditor

REST API

mqlread read structured data

mqlwrite write structured data

search free text search

topic simplified topic data

... and more

http://freebase.com/docs/Thursday, August 19, 2010

http://freebase.com/docs/

http://freebase.com/docs/

Libraries

• freebase-python (best supported):http://code.google.com/p/freebase-python

• other languages: http://wiki.freebase.com/wiki/Libraries


http://code.google.com/p/freebase-python

http://code.google.com/p/freebase-python

http://wiki.freebase.com/wiki/Libraries

http://wiki.freebase.com/wiki/Libraries

Acre


App Editor (acre.freebase.com)Thursday, August 19, 2010

Templating language


http://freebase.com/appsThursday, August 19, 2010

http://freebase.com/apps

http://freebase.com/apps

Freebase Suggest

• JQuery plugin

• Search Freebase entities

• Limit by Freebase type


Freebase Suggesthttp://code.google.com/p/freebase-suggest/


http://code.google.com/p/freebase-suggest/

http://code.google.com/p/freebase-suggest/

Data dumps

• TSV format (simplified for import into Excel)

• Triple format (full graph representation)

• Simple topic dump (basic information about every topic)

• http://download.freebase.com/


Loading data


Wikipedia pipeline(one of many)

• Runs every 2 weeks

• Imports new topics

• Looks for structure in Wikipedia


Quality Assurance


Data quality

QAProcess

99%accuracy


Reconciliation

“The Little Prince” ?

... the book?

... the movie?

... the opera?

... the episode of Lost?


Human Judgements

RABJ(Redundant Array of Brains in a Jar)


How YOU can load data


How YOU can load data

• mqlwrite

• Spreadsheet Loader

• Gridworks


http://code.google.com/p/freebase-gridworks/Thursday, August 19, 2010

http://code.google.com/p/freebase-gridworks/

http://code.google.com/p/freebase-gridworks/

http://matchmaker2.freebaseapps.com Thursday, August 19, 2010

http://matchmaker2.freebaseapps.com

http://matchmaker2.freebaseapps.com

genderizer.freebaseapps.comThursday, August 19, 2010

Freebase Community

• Schema development

• Data curation

• Data loads

• QA and human judgement

• Building apps


Freebase Community

• Freebase-discuss mailing listhttp://lists.freebase.com/

• Bug trackerhttp://bugs.freebase.com/

• Wiki (community documentation)http://wiki.freebase.com/

• IRCirc.freenode.net #freebase


http://lists.freebase.com

http://lists.freebase.com

http://bugs.freebase.com

http://bugs.freebase.com

http://wiki.freebase.com

http://wiki.freebase.com

[email protected]

http://blog.freebase.com/

@fbase


mailto:[email protected]

mailto:[email protected]

http://blog.freebase.com

http://blog.freebase.com

freebase 101

Technology