lecture 19: question answering - computer sciencekc2wc/teaching/nlp16/slides/19-qa.pdf ·...

17
Lecture 19: Question Answering Kai-Wei Chang CS @ University of Virginia [email protected] Couse webpage: http://kwchang.net/teaching/NLP16 1 CS6501-NLP

Upload: others

Post on 22-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Lecture 19: Question Answering

Kai-Wei ChangCS @ University of Virginia

[email protected]

Couse webpage: http://kwchang.net/teaching/NLP16

1CS6501-NLP

Page 2: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Question answering

CS6501– Natural Language Processing 2credit:ifunny.com

'Watson' computer wins at 'Jeopardy'

Page 3: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Question answering

vGo beyond search

CS6501– Natural Language Processing 3

Page 4: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Go beyond traditional web search

Answer queries using structured knowledge

vGoogle Knowledge GraphvFacebook Graph SearchvBing’s Satori

Need to understand the query!

CS6501-NLP 4

Thefollowing slidesaremodified fromChristopherManning&Pandu Nayak’s intro.toIR.

Page 5: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

ExamplefromFernandoPereira(GOOG)

Page 6: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 7: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 8: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 9: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 10: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 11: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com
Page 12: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Paradigms for question answering

vText-based approachesvTREC QA, IBM Watson

vStructured knowledge-based approachesvApple Siri, Wolfram Alpha, Facebook Graph

Search

CS6501-NLP 12

Page 13: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Task – Answer Sentence Selection

v Given a factoid question, find the sentence that v Contains the answerv Can sufficiently support the answer

Q: Who won the best actor Oscar in 1973?S1: Jack Lemmon was awarded the Best Actor Oscar for Save

the Tiger (1973).S2: Academy award winner Kevin Spacey said that Jack

Lemmon is remembered as always making time for others.

Scott Wen-tau Yih (ACL 2013) paper

Page 14: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Lemmon was awarded the Best Supporting Actor Oscar in 1956 for Mister Roberts (1955) and the Best Actor Oscar for Save the Tiger (1973), becoming the first actor to achieve this rare double…Source: Jack Lemmon -- Wikipedia

Who won the best actor Oscar in 1973?

Page 15: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

AssumethatthereisanunderlyingalignmentDescribeswhichwordsinandcanbeassociated

What is the fastest car in the world?

The Jaguar XJ220 is the dearest, fastest and most sought after car on the planet.

Word Alignment for Question AnsweringTREC QA (1999-2005)

See if the (syntactic/semantic) relations support the answer

[Harabagiu & Moldovan, 2001]

Page 16: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Knowledge-based QA

vBuild a semantic representation of the queryvTimes, dates, locations, entities, numeric quantities

vMap from this semantics to query structured data or resourcesvDatabase vOntologies (Wikipedia infoboxes, dbPedia,

WordNet, Yago)vScientific databases

16

Page 17: Lecture 19: Question Answering - Computer Sciencekc2wc/teaching/NLP16/slides/19-QA.pdf · 2019-04-14 · Question answering CS6501– Natural Language Processing 2 credit: ifunny.com

Linking Open Data cloud Diagram

CS6501-NLP 17

http://lod-cloud.net/