organizing the people’s voices on political controversies
DESCRIPTION
Organizing the People’s Voices on Political Controversies . Politicians have opinions (but none of us can remember them). Lots of issues, stake - holders, opinions Great to have an “opinion-base” which tells us who stands where. An opinion-base. Opinion Network. Illegal_Immigration. - PowerPoint PPT PresentationTRANSCRIPT
Organizing the People’s Voices on Political Controversies
Rawia AwadallahGerhard Weikum
Max-Planck Institute for Informatics, Germany
Maya Ramanath
IIT-Delhi, India
Politicians have opinions(but none of us can remember them)
• Lots of issues, stake-holders, opinions• Great to have an
“opinion-base” which tells us who stands where
An opinion-baseEntity Polarit
y Topic Context
Barack Obama supports Military Action in Libya
“…President Obama Authorizes Limited Military Action in Libya...”
Nicolas Sarkozy supports Military Action in Libya
“…Sarkozy supports military action in Libya…”
UN Security Council
supports No-Fly Zone on Libya
“…U.N. Security Council approves no-fly zone in Libya…”
Germany opposes No-Fly Zone on Libya
“…Germany blocks plans for Libya no fly zone…”
Opinion Network
Barack_Obama Angela_Merkel UN_Security_Council
Military_Action_in_Libya No-fly_Zone Gaddafi’s_Response_to_Civil_War
Libyan_Civil_War_2011
War_Crimes_in_Libya
Illegal_Immigration
SS
O OS
Entities
Facets
Topic Hierarchy
OpinioNetItCandidate Opinion- Snippets
Entity and facet
extraction
Canonical forms for entities
and facets
Organization of topic hierarchy
War on TerrorAfghanistan_WarTaliban_
NegotiationsDrone_Strikes
Iraq_WarSuicide_Bombin
gs
EntityAfghan President
FacetTalks with Taliban
Hamid_KarzaiAfghan PresidentKarzai
Taliban_NegotiationsTaliban TalksTalks with Taliban
Prime Minister David Cameron met Mr Gates in Downing Street on Monday and restated his support for American strategy in Afghanistan.
Acquiring Snippets• “Web”– Newspapers: AlJazeera, CNN,
BBC– Wikipedia
• Seed phrases as queries– “he supports”, “she supports”– “he voted for”, “he voted
against”
Candidate Opinion- Snippets
Republican Senator Jon Kyl is a supporter of the Arizona immigration law
Robert Gates, the US defence secretary, has acknowledged that projections that are based on proposed military timelines may not be accurate, but stressed that the Pentagon is not exempt from belt-tightening because of its charge of defending the country.
Prime Minister David Cameron met Mr Gates in Downing Street on Monday and restated his support for American strategy in Afghanistan.
Republican Senator Jon Kyl is a supporter of the Arizona immigration law
Entity and facet• Parse sentence to extract
entity and facet– Dependency parsing used:
look for subject and object– Lots of heuristics
• Expected parsing to be easy– It was easier, not easy
Entity and facet
extraction
Candidate Opinion- Snippets
Robert Gates, the US defence secretary, has acknowledged that projections that are based on proposed military timelines may not be accurate, but stressed that the Pentagon is not exempt from belt-tightening because of its charge of defending the country.
Raw facets and entities• Lots of entities
“Gaddaffi”, “Qaddaffi”“Obama”, “U.S. President”
• Lots of raw facets“UN mandate against Libya”“use of force against Libyan civilians”“military air strikes on Libyan cities”“coalition air strikes on Libya”
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Canonical names• Canonical names derived
from YAGOEntity and
facet extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facetsBarack_Oba
ma
Obama President Obama
Barack Hussein Obama
Michelle_Obama
means
preferred meaning
means
Canonical facets (1/3)• Wikipedia– Good source for labels– Topics not always controversial
• Debatepedia– Lots of debates– Debates mean controversial
topics• Map to Debatepedia, then to
Wikipedia
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Canonical facets (2/3)
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
D1k
Category 1, 2,…
ARTICLETEXT
TOPIC T1
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Dnj
Category 1, 2,…
ARTICLETEXT
TOPIC Tn
…
Debatepedia Articles
Canonical facets (3/3)
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Article title
Category 1, 2,…
ARTICLETEXT
Topic T, Document Di
• Used for ranking debates• Scores of top-10 results used to
discard “useless” facets• Title of top debate used for
canonical name
Raw facet, f
Topic Hierarchy• Debatepedia to Wikipedia
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Organization of topic hierarchy
Canonical facet name + documentArticle title
Category 1, 2,…
ARTICLETEXT
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Article title
Category 1, 2,…
ARTICLETEXT
Top 3 Wikipedia articles
Top 3 Wikipedia categories Candidate categories
Constructing the hierarchy
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Organization of topic hierarchy
Iran-Iraq War
Iraq War
Iran’s nuclear energy
Bilateral relations of Israel
Israel’s weapons of mass destruction
Israeli-Palestinian conflict Israeli
Nuclear Energy
Iran’s nuclear program
Iran’s weapons
Iran’s politics
410
Depends on no. of raw facets mapped to it
Depends on no. of common subcategories
Constructing the hierarchy
Entity and facet
extraction
Candidate Opinion- Snippets
Canonical forms for entities
and facets
Organization of topic hierarchy
Iran-Iraq War
Iraq War
Bilateral relations of Israel
Israel’s weapons of
mass destructionIsraeli-
Palestinian conflict
Israeli Nuclear Energy
Iran’s nuclear program
Iran’s weapons
Iran’s politics
Iran’s nuclear energy
Graph coarsening algorithm to cluster leads to a hypergraph
Building a lexicon• Unsupervised– Query Google with
<entity, facet> pairs• Supervised (details in the
paper)– n-grams–mutual information– synonyms and
antonyms
Candidate Opinion- Snippets
Entity and facet
extraction
Lexicon of Support/O
ppose phrases
Canonical forms for entities
and facets
Organization of topic hierarchy
Lexicon of support/oppose phrases
Obama strongly defends US Military Action in Libya Barack Obama has aligned himself with Nicolas Sarkozy by committing to support military action in Libya US President Barack Obama defended his decision to launch military action in Libya President Obama said Saturday that he had authorized limited military action in Libya President Obama tells Americans that he ordered military action in Libya
SUPPORT OPPOSE
approve criticized
acknowledge speak againstcampaigned for
campaigned against
strongly defends attacks
Unsupervised
Evaluation• End-to-end experiments (Metric:
Precision)– Random sample– Focused sample– Ground truth set
• Quality of topic hierarchy • Quality of support/oppose lexicon
End-to-end experiments
AlJazeera
BBC CNN Googl
eNYTime
sWikipedi
aOvera
ll
# 970 3349
2650 6861 9877 5941 29648
Prec. 0.72 0.6
6 0.78 0.79 0.74 0.69 0.72
2000 randomly selected opinions were evaluated
Errors in extraction• Attributing the opinion to the incorrect entity (45%)• Facet extraction (45%)• Seeds were incorrect (9%)
Thank you
Time to express your opinions!
Candidate Opinion- Snippets
Entity and facet
extraction
Lexicon of Support/O
ppose phrases
Canonical forms for entities
and facets
Organization of topic hierarchy