sp10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/sp10 cs288 lecture 22...hdp model...
TRANSCRIPT
![Page 1: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/1.jpg)
1
Statistical NLPSpring 2010
Lecture 21: Coreference Resolution
Dan Klein – UC Berkeley
![Page 2: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/2.jpg)
2
![Page 3: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/3.jpg)
3
![Page 4: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/4.jpg)
4
![Page 5: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/5.jpg)
5
![Page 6: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/6.jpg)
6
![Page 7: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/7.jpg)
7
![Page 8: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/8.jpg)
8
Infinite Mixture Model
MUC F1
The Weir Group , whose headquarters is in
the U.S is a large specialized corporation.
This power plant , which , will be situated in
Jiangsu, has a large generation capacity.
Enriching the Mention Model
W
Z
Mention Model
P(W | Weir Group):
“Weir Group”=0.4,
“whose”=0.2,
.......
![Page 9: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/9.jpg)
9
Enriching the Mention Model
Pronoun
W
Z
TGNNumber
Sing, Plural
W
Z
Non-Pronoun
Gender
M,F,N
Type
PERS, LOC,
ORG, MISC
Enriching the Mention Model
W | SING, MALE, PERS
“he”:0.5, “him”: 0.3,...
W | PL, NEUT, ORG
“they”:0.3, “it”: 0.2,...
Entity Parameters
Pronoun Parameters
W
Z
TGN
Pronoun
![Page 10: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/10.jpg)
10
Enriching the Mention Model
Pronoun
W
Z
TGN
W
Z
Non-Pronoun
Enriching Mention Model
M
Pronoun
Non-pronoun
Mention Type
Proper,
Pronoun,
Nominal
W
Z
TGN
![Page 11: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/11.jpg)
11
Enriching Mention Model
.....
W
Z
W
Z
..... .....
Enriching Mention Model
.....
M
W
Z
TGN
M
W
Z
TGN
..... .....
![Page 12: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/12.jpg)
12
Pronoun Model
MUC F1
The Weir Group , whose headquarters is in
the U.S is a large specialized corporation.
This power plant , which , will be situated in
Jiangsu, has a large generation capacity.
![Page 13: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/13.jpg)
13
![Page 14: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/14.jpg)
14
![Page 15: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/15.jpg)
15
![Page 16: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/16.jpg)
16
Salience Model
MUC F1
The Weir Group , whose headquarters is in
the U.S is a large specialized corporation.
This power plant , which , will be situated in
Jiangsu, has a large generation capacity.
![Page 17: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/17.jpg)
17
HDP Model
MUC F1
The Weir Group , whose headquarters is in
the U.S is a large specialized corporation.
This power plant , which , will be situated in
Jiangsu, has a large generation capacity.
![Page 18: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/18.jpg)
18
Global Entity Resolution
Bush he Rice
Rice Bush she
Experiments
� MUC6 English NWIRE (all mentions)
� 53.6 F1* [Cardie and Wagstaff 99] Unsupervised
� 70.3 F1 [Haghighi & Klein 07] Unsupervised
� 73.4 F1 [McCallum & Wellner 04] Supervised
� 81.3 F1 [Luo et al 04] Supervised+Oracle
• MUC score, not all systems are completely comparable
• Why not: some assume oracle gives boundaries, NER
types, etc.
![Page 19: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/19.jpg)
19
* Now system mentions!
These are “real numbers”
![Page 20: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/20.jpg)
20
![Page 21: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/21.jpg)
21
![Page 22: SP10 cs288 lecture 22 -- coreference.pptklein/cs288/sp10/slides/SP10 cs288 lecture 22...HDP Model MUC F 1 The Weir Group , whose headquarters is in ... Bush he Rice Rice Bush she Experiments](https://reader030.vdocuments.net/reader030/viewer/2022040918/5e9429ac8a251914941105e6/html5/thumbnails/22.jpg)
22