computational semantics - shane · computational semantics ling 571 — deep processing for nlp...

54
Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1

Upload: others

Post on 22-May-2020

14 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Computational SemanticsLING 571 — Deep Processing for NLP

October 28, 2019

1

Page 2: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Announcements● HW5: your grammar should use rules and features that are linguistically

motivated (e.g. number, gender, aspect, animacy, ….)

● Consider grammars for the following suite of examples:● This sentence is grammatical.● *This grammatical sentence is.

● The following is not an acceptable grammar (you would lose some points):● S[+grammatical] -> ‘This sentence is grammatical.’● S[-grammatical] -> ‘This grammatical sentence is.’

2

Page 3: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Roadmap● First-order Logic: Syntax and Semantics

● Inference + Events

● Rule-to-rule Model● More lambda calculus

3

Page 4: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

FOL Syntax + Semantics

4

Page 5: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Example Meaning Representation● A non-stop flight that serves Pittsburgh:

∃x Flight(x) ∧ Serves(x, Pittsburgh) ∧ Non-stop(x)

5

Page 6: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

FOL Syntax Summary

6

Formula → AtomicFormula Connective → ∧ | ∨ | ⇒| Formula Connective Formula Quantifier → ∀ | ∃| Quantifier Variable, … Formula Constant → VegetarianFood | Maharani | …| ¬ Formula Variable → x | y | …| (Formula) Predicate → Serves | Near | …

AtomicFormula → Predicate(Term,…) Function → LocationOf | CuisineOf | …Term → Function(Term,…)

| Constant| Variable

J&M p. 556 (3rd ed. 16.3)

Page 7: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Model-Theoretic Semantics● A “model” represents a particular state of the world

● Our language has logical and non-logical elements.

● Logical: Symbols, operators, quantifiers, etc

● Non-Logical: Names, properties, relations, etc

7

Page 8: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Denotation● Every non-logical element points to a fixed part of the model

● Objects — elements in the domain, denoted by terms● John, Farah, fire engine, dog, stop sign

● Properties — sets of elements● red: {fire hydrant, apple,…}

● Relations — sets of tuples of elements● CapitalCity: {(Washington, Olympia), (Yamoussokro, Cote d’Ivoire),

(Ulaanbaatar, Mongolia),…}

8

Page 9: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Sample Domain 𝒟

9

ObjectsMatthew, Franco, Katie, Caroline a,b,c,dFrasca, Med, Rio e,f,gItalian, Mexican, Eclectic h,i,j

PropertiesNoisy Frasca, Med, and Rio are noisy Noisy={e,f,g}

RelationsLikes Matthew likes the Med Likes={〈a,f〉,〈c,f〉, 〈c,g〉, 〈b,e〉, 〈d,f〉,

〈d,g〉}Katie likes the Med and RioFranco likes FrascaCaroline likes the Med and Rio

Serves Med serves eclectic Serves={〈c,f〉, 〈f,i〉, 〈e,h〉}Rio serves MexicanFrasca serves Italian

via J&M, p. 554

Page 10: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Inference + Events(last Wednesday’s slides)

10

Page 11: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Rule-to-Rule Model

11

Page 12: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Recap● Meaning Representation ● Can represent meaning in natural language in many ways● We are focusing on First-Order Logic (FOL)

● Principle of compositionality ● The meaning of a complex expression is a function of the meaning of its parts

● Lambda Calculus● λ-expressions denote functions● Can be nested● Reduction = function application

12

Page 13: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Semantics Reflects Syntax

13

Page 14: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Chiasmus:Syntax affects Semantics!

14

Tesla playing BowieBowie playing TeslaThe Prestige (2006) SpaceX Falcon Heavy Test Launch (2/6/2018)

Page 15: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Chiasmus:Syntax affects Semantics!

● “Never let a fool kiss you or a kiss fool you” (Grothe, 2002)

● “Then you should say what you mean,” the March Hare went on.

“I do,” Alice hastily replied; “at least—at least I mean what I say—that’s the same thing, you know.”

“Not the same thing a bit!” said the Hatter. “Why, you might just as well say that ‘I see what I eat’ is the same thing as ‘I eat what I see’!”

“You might just as well say,” added the March Hare, “that ‘I like what I get’ is the same thing as ‘I get what I like’!”

“You might just as well say,” added the Dormouse, which seemed to be talking in his sleep, “that ‘I breathe when I sleep’ is the same thing as ‘I sleep when I breathe’!”

—Alice in Wonderland, Lewis Carrol

15

Page 16: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Ambiguity & Models● “Every Tesla is powered by a battery.” — Ambiguous!● ∀x.Tesla(x) ⇒ (∃(y).Battery(y) ∧ Powers(y, x))

● ∃(y).Battery(y) ∧ (∀x.Tesla(x) ⇒ Powers(y, x))

● Every Tesla is not hurtling toward Mars.● ∀x.Tesla(x) ⇒ ¬(HurtlingTowardMars(x))

● ¬∀x.(Tesla(x) ⇒(HurtlingTowardMars(x)))

● [∃(x).(Tesla(x) ∧ ¬HurtlingTowardsMars(x))]

16

Things in SpaceTeslasTeslas Things in

Space

∃(x).(Tesla(x) ∧ HurtlingTowardsMars(x))

State of known Universe: 02/05/2018State of known Universe: 02/06/2018

Page 17: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Scope Ambiguity● Potentially O(n!) scope interpretations (“scopings”)● Where n=number of scope-taking operators.● (every, a, all, no, modals, negations, conditionals, …)

● Different interpretations correspond to different syntactic parses!

17

Page 18: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Integrating Semantics into Syntax1. Pipeline System● Feed parse tree and sentence to semantic analyzer● How do we know which pieces of the semantics link to which part of the

analysis?● Need detailed information about sentence, parse tree● Infinitely many sentences & parse trees● Semantic mapping function per parse tree → intractable

18

Page 19: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Integrating Semantics into Syntax2. Integrate Directly into Grammar● This is the “rule-to-rule” approach we’ve been implicitly examining and will now

make more explicit● Tie semantics to finite components of grammar (rules & lexicon)● Augment grammar rules with semantic info● a.k.a. “attachments” — specify how RHS elements compose to LHS

19

Page 20: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Simple Example● United serves Houston

20

7

24

4VST�2

9RMXIH

:4

:

WIVZIW

24

4VST�2

,SYWXSR

∃e(Serving(e) ∧ Server(e, United) ∧ Served(e, Houston))

Page 21: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Rule-to-rule Model● Lambda Calculus and the Rule-to-Rule Hypothesis● λ-expressions can be attached to grammar rules● used to compute meaning representations from syntactic trees based on the

principle of compositionality● Go up the tree, using reduction (function application) to compute meanings at

non-terminal nodes

21

Page 22: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Semantic Attachments● Basic Structure: A→a1, …, an {f(aj.sem, … ak.sem)}

● In NLTK syntax (more later): A → a1 … an[SEM=<f(?aj.sem …)>]

22

Semantic Function

Page 23: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Attachments as SQL!>>> nltk.data.show_cfg('grammars/book_grammars/sql0.fcfg')% start SS[SEM=(?np + WHERE + ?vp)] -> NP[SEM=?np] VP[SEM=?vp]VP[SEM=(?v + ?pp)] -> IV[SEM=?v] PP[SEM=?pp]VP[SEM=(?v + ?ap)] -> IV[SEM=?v] AP[SEM=?ap]NP[SEM=(?det + ?n)] -> Det[SEM=?det] N[SEM=?n]PP[SEM=(?p + ?np)] -> P[SEM=?p] NP[SEM=?np]AP[SEM=?pp] -> A[SEM=?a] PP[SEM=?pp]NP[SEM='Country="greece"'] -> 'Greece'NP[SEM='Country="china"'] -> 'China'Det[SEM='SELECT'] -> 'Which' | 'What'N[SEM='City FROM city_table'] -> 'cities'IV[SEM=''] -> 'are'A[SEM=''] -> 'located'P[SEM=''] -> 'in'

23

'What cities are located in China’

parses[0]: SELECT City FROM city_table WHERE Country="china"

NLTK book, ch. 10

Page 24: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Semantic Attachments: Options● Why not use SQL? Python?● Arbitrary power but hard to map to logical form● No obvious relation between syntactic, semantic elements

● Why Lambda Calculus?

● First Order Predicate Calculus (FOPC) + function application is highly expressive, integrates well with syntax

● Can extend our existing feature-based model, using unification● Can ‘translate’ FOL to target / task / downstream language (e.g. SQL)

24

Page 25: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Semantic Analysis Approach● Semantic attachments:● Each CFG production gets semantic attachment

● Semantics of a phrase is function of combining the children

● Complex functions need to have parameters

● Verb → ‘arrived’ ● Intransitive verb, so has one argument: subject

● …but we don’t have this available at the preterminal level of the tree!

25

Page 26: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Defining Representations● Proper Nouns

● Intransitive Verbs

● Transitive Verbs

● Quantifiers

26

Page 27: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

7ॱ7)1 /LEPMP�ᅶ\�VYRW�\ ॲ24

224ॱ7)1 /LEPMP"ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ "ॲVYRW

<latexit sha1_base64="XUFuKw0LeeQsTgQ2g9X36U+4HOM=">AAAH/XicpVVfT9RAEC8IntZ/oI/6sBEhYADvIHqSeEYBT4wcYuBOk+uFbLd7ZXPbbd3dImfT+BH8FL4ZX/0sfhGfnf4B7CFoYNu0k/n9dnZmdnbWDjhTulz+OTR8YWT0YunSZfPK1WvXb4yN32wpP5SENonPffnexopyJmhTM83p+0BS7NmcvrN7Kwn+bo9KxXyxrfsB7XjYFazLCNag2hkf+WIpqj3MRNcXOnrJOEdbWKjYnETPWw20td2s100L73nKlzrlWEzHpuXQLiyZOhARHkdr2431OFpYqa4s1Qdg+xB+VF1cfPxwECYH8MOl5IlNM/NJ7w741JZYuLQWBg8iV1Lam32ZfjnEImbX068Ivbhzwny07HPnwIjd/beZydP9YPpEA4kPf8ZIHTeTDkJdqq8srQ5mQoW2IpIFukB9VF+urlYHqKLIgbyvHst7kXKQXMumLhNR15dU6RjBH2lwvxZhzlxRI1RoKmOzjSK0ZR3uUD4L6iBGVhuhyDrc+q0XjRhNHWpgt6FC0OtdsMen71kcitHB9/bnZSjU9P7MDBiwkNVBFhVOajCeRUl+akdZmtW7jPRAn4eZOLOx+Z+8jc1zuP0k8/vpGZ08ivwUfkZHIDAqax996aAOyt7ERus/A33VOk+cxzfmPDEnJs4WMbxmumBekDtjE+X5cjrQcaGSCxNGPjZ3xoebluOT0IPCJRwr1a6UA92JsNSMcAoFHyoaYNLDLo0CLOFIQ7kX1G0QBfao6kTZkUGToHHSs5EcfZRqC4awp1Tfs4GZ9Ac1iCXKv2HtUHcfdyImglBTQbKFuiFH2kdJe0YOk5Ro3gcBQyuAEBDZxRITOJRgaZVCiJI2wO6bgEqsfXk/srB0Peg5kWV3US6fRsX7R1SQC75r1vs09yHJ0BzxvQDrv8AODWDDwP1+EUxKpqDYz7JZ0OXbbML9Uof0DmBCq4CS4oxQMOI7dC7NabG1p70WNQCV8MvwJKHpGpzZEst+BFejG8JNygjcalaG4SDg/ZwALROHXKsi0YRCrAyW3XGhtTBfKc9X3i5MPFvOS/KScdu4a0wbFaNqPDPWjE2jaZCRX6N3RidHp0qfS19L30rfM+rwUD7nllEYpR+/AQPP0Is=</latexit><latexit sha1_base64="XUFuKw0LeeQsTgQ2g9X36U+4HOM=">AAAH/XicpVVfT9RAEC8IntZ/oI/6sBEhYADvIHqSeEYBT4wcYuBOk+uFbLd7ZXPbbd3dImfT+BH8FL4ZX/0sfhGfnf4B7CFoYNu0k/n9dnZmdnbWDjhTulz+OTR8YWT0YunSZfPK1WvXb4yN32wpP5SENonPffnexopyJmhTM83p+0BS7NmcvrN7Kwn+bo9KxXyxrfsB7XjYFazLCNag2hkf+WIpqj3MRNcXOnrJOEdbWKjYnETPWw20td2s100L73nKlzrlWEzHpuXQLiyZOhARHkdr2431OFpYqa4s1Qdg+xB+VF1cfPxwECYH8MOl5IlNM/NJ7w741JZYuLQWBg8iV1Lam32ZfjnEImbX068Ivbhzwny07HPnwIjd/beZydP9YPpEA4kPf8ZIHTeTDkJdqq8srQ5mQoW2IpIFukB9VF+urlYHqKLIgbyvHst7kXKQXMumLhNR15dU6RjBH2lwvxZhzlxRI1RoKmOzjSK0ZR3uUD4L6iBGVhuhyDrc+q0XjRhNHWpgt6FC0OtdsMen71kcitHB9/bnZSjU9P7MDBiwkNVBFhVOajCeRUl+akdZmtW7jPRAn4eZOLOx+Z+8jc1zuP0k8/vpGZ08ivwUfkZHIDAqax996aAOyt7ERus/A33VOk+cxzfmPDEnJs4WMbxmumBekDtjE+X5cjrQcaGSCxNGPjZ3xoebluOT0IPCJRwr1a6UA92JsNSMcAoFHyoaYNLDLo0CLOFIQ7kX1G0QBfao6kTZkUGToHHSs5EcfZRqC4awp1Tfs4GZ9Ac1iCXKv2HtUHcfdyImglBTQbKFuiFH2kdJe0YOk5Ro3gcBQyuAEBDZxRITOJRgaZVCiJI2wO6bgEqsfXk/srB0Peg5kWV3US6fRsX7R1SQC75r1vs09yHJ0BzxvQDrv8AODWDDwP1+EUxKpqDYz7JZ0OXbbML9Uof0DmBCq4CS4oxQMOI7dC7NabG1p70WNQCV8MvwJKHpGpzZEst+BFejG8JNygjcalaG4SDg/ZwALROHXKsi0YRCrAyW3XGhtTBfKc9X3i5MPFvOS/KScdu4a0wbFaNqPDPWjE2jaZCRX6N3RidHp0qfS19L30rfM+rwUD7nllEYpR+/AQPP0Is=</latexit><latexit sha1_base64="XUFuKw0LeeQsTgQ2g9X36U+4HOM=">AAAH/XicpVVfT9RAEC8IntZ/oI/6sBEhYADvIHqSeEYBT4wcYuBOk+uFbLd7ZXPbbd3dImfT+BH8FL4ZX/0sfhGfnf4B7CFoYNu0k/n9dnZmdnbWDjhTulz+OTR8YWT0YunSZfPK1WvXb4yN32wpP5SENonPffnexopyJmhTM83p+0BS7NmcvrN7Kwn+bo9KxXyxrfsB7XjYFazLCNag2hkf+WIpqj3MRNcXOnrJOEdbWKjYnETPWw20td2s100L73nKlzrlWEzHpuXQLiyZOhARHkdr2431OFpYqa4s1Qdg+xB+VF1cfPxwECYH8MOl5IlNM/NJ7w741JZYuLQWBg8iV1Lam32ZfjnEImbX068Ivbhzwny07HPnwIjd/beZydP9YPpEA4kPf8ZIHTeTDkJdqq8srQ5mQoW2IpIFukB9VF+urlYHqKLIgbyvHst7kXKQXMumLhNR15dU6RjBH2lwvxZhzlxRI1RoKmOzjSK0ZR3uUD4L6iBGVhuhyDrc+q0XjRhNHWpgt6FC0OtdsMen71kcitHB9/bnZSjU9P7MDBiwkNVBFhVOajCeRUl+akdZmtW7jPRAn4eZOLOx+Z+8jc1zuP0k8/vpGZ08ivwUfkZHIDAqax996aAOyt7ERus/A33VOk+cxzfmPDEnJs4WMbxmumBekDtjE+X5cjrQcaGSCxNGPjZ3xoebluOT0IPCJRwr1a6UA92JsNSMcAoFHyoaYNLDLo0CLOFIQ7kX1G0QBfao6kTZkUGToHHSs5EcfZRqC4awp1Tfs4GZ9Ac1iCXKv2HtUHcfdyImglBTQbKFuiFH2kdJe0YOk5Ro3gcBQyuAEBDZxRITOJRgaZVCiJI2wO6bgEqsfXk/srB0Peg5kWV3US6fRsX7R1SQC75r1vs09yHJ0BzxvQDrv8AODWDDwP1+EUxKpqDYz7JZ0OXbbML9Uof0DmBCq4CS4oxQMOI7dC7NabG1p70WNQCV8MvwJKHpGpzZEst+BFejG8JNygjcalaG4SDg/ZwALROHXKsi0YRCrAyW3XGhtTBfKc9X3i5MPFvOS/KScdu4a0wbFaNqPDPWjE2jaZCRX6N3RidHp0qfS19L30rfM+rwUD7nllEYpR+/AQPP0Is=</latexit><latexit sha1_base64="XUFuKw0LeeQsTgQ2g9X36U+4HOM=">AAAH/XicpVVfT9RAEC8IntZ/oI/6sBEhYADvIHqSeEYBT4wcYuBOk+uFbLd7ZXPbbd3dImfT+BH8FL4ZX/0sfhGfnf4B7CFoYNu0k/n9dnZmdnbWDjhTulz+OTR8YWT0YunSZfPK1WvXb4yN32wpP5SENonPffnexopyJmhTM83p+0BS7NmcvrN7Kwn+bo9KxXyxrfsB7XjYFazLCNag2hkf+WIpqj3MRNcXOnrJOEdbWKjYnETPWw20td2s100L73nKlzrlWEzHpuXQLiyZOhARHkdr2431OFpYqa4s1Qdg+xB+VF1cfPxwECYH8MOl5IlNM/NJ7w741JZYuLQWBg8iV1Lam32ZfjnEImbX068Ivbhzwny07HPnwIjd/beZydP9YPpEA4kPf8ZIHTeTDkJdqq8srQ5mQoW2IpIFukB9VF+urlYHqKLIgbyvHst7kXKQXMumLhNR15dU6RjBH2lwvxZhzlxRI1RoKmOzjSK0ZR3uUD4L6iBGVhuhyDrc+q0XjRhNHWpgt6FC0OtdsMen71kcitHB9/bnZSjU9P7MDBiwkNVBFhVOajCeRUl+akdZmtW7jPRAn4eZOLOx+Z+8jc1zuP0k8/vpGZ08ivwUfkZHIDAqax996aAOyt7ERus/A33VOk+cxzfmPDEnJs4WMbxmumBekDtjE+X5cjrQcaGSCxNGPjZ3xoebluOT0IPCJRwr1a6UA92JsNSMcAoFHyoaYNLDLo0CLOFIQ7kX1G0QBfao6kTZkUGToHHSs5EcfZRqC4awp1Tfs4GZ9Ac1iCXKv2HtUHcfdyImglBTQbKFuiFH2kdJe0YOk5Ro3gcBQyuAEBDZxRITOJRgaZVCiJI2wO6bgEqsfXk/srB0Peg5kWV3US6fRsX7R1SQC75r1vs09yHJ0BzxvQDrv8AODWDDwP1+EUxKpqDYz7JZ0OXbbML9Uof0DmBCq4CS4oxQMOI7dC7NabG1p70WNQCV8MvwJKHpGpzZEst+BFejG8JNygjcalaG4SDg/ZwALROHXKsi0YRCrAyW3XGhtTBfKc9X3i5MPFvOS/KScdu4a0wbFaNqPDPWjE2jaZCRX6N3RidHp0qfS19L30rfM+rwUD7nllEYpR+/AQPP0Is=</latexit>

● Our instinct for names is to just use the constant:● NNP[SEM=<Khalil>] → ‘Khalil’

● However, we want to apply our λ-closures left-to-right consistently.

7

24

224ॱ7)1 /LEPMP"ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ "ॲVYRW

<latexit sha1_base64="X/Xh6/Sa6QhpEqbh+9AYWt8jo70=">AAAHl3icpVXtTtRAFC24uli/QH8Z/0xEjBjAXQiuJK4i4IrRRQjsQrLdkOl0tkx2Oq0zU2Rt+g4+jX/1NXwbbz9AuyASbZv25p4zd+69c2ZqB5wpXan8GBm9VLp8pTx21bx2/cbNW+MTt9vKDyWhLeJzX+7ZWFHOBG1ppjndCyTFns3prt1fTfDdQyoV88WOHgS062FXsB4jWINrf6I0bSmqPcxEzxc6esM4R9tYqNicQq/aTbS902o0TAsfesqXOuVYTMem5dAeTJkmEBEeR+s7zfdxNL9aW11qDMH2Cfy0trDwbHEYJsfw4lJyx6aZ5aQPhnLqSCxcWg+DJ5ErKe3PvEnfHGoRM+/Ttwi9uPuH8WjF585xELv39zBT5+fB9B8DJDn8XiN13Mw6LnWpsbq0NtwJFdqKSBboAvVpY6W2VhuiiiIH+r52qu9FynFzLZu6TEQ9X1KlYwRfpCH9eoQ5c0WdUKGpjM0OitB2PIOSzOu/8p/RB4z0wZ8nkNA2Ni/I29i0TpY8TwOEFSOrg1BknWhp+3UzRg9PPCAfkBx6/u4AMuQvgG4hq4ssKpx0+MUmT0JkEc7hZ3QEBqOy/smXDuqi7ElitC9Y6Nv2/9T5wOKwfx384GhOhkI9Opr+n5qTEP9WMTxmOmEulf3xycpcJb3QaaOaG5NGfm3uT4y2LMcnoQeSIhwr1alWAt2NsNSMcApSDBUNMOljl0YBlrDZQIgFdwdMgT2qulEmZjQFHidVbbIpUeotBMKeUgPPBmayc9UwljjPwjqh7j3rRkwEoaaCZBP1Qo60j5KDEzlMUqL5AAwMmxRKQOQAS0xgu0CkNQolStqEuB8CKrH25ePIwtL14DSILLuHcvs8Kj76RQW7kLtm/c+zH5MOzRLfC7A+A3ZoAAsG6Q+KYCKZguMo62bBly+zCSd/A9o7hAmtAkqKI0LBiO/Q2bSnxUM3PQVRE1AJnwxPGprOwZktsRxE8NNyQ/jHMQL/GyvDcBDwQU6AwwyHXKsi0QQhVodld9poz89VK3PVrfnJ5ZVckmPGPeO+8cioGjVj2Vg3No2WQUpfSl9L30rfy3fLL8uN8npGHR3Jx9wxCld56yfpkaoH</latexit><latexit sha1_base64="X/Xh6/Sa6QhpEqbh+9AYWt8jo70=">AAAHl3icpVXtTtRAFC24uli/QH8Z/0xEjBjAXQiuJK4i4IrRRQjsQrLdkOl0tkx2Oq0zU2Rt+g4+jX/1NXwbbz9AuyASbZv25p4zd+69c2ZqB5wpXan8GBm9VLp8pTx21bx2/cbNW+MTt9vKDyWhLeJzX+7ZWFHOBG1ppjndCyTFns3prt1fTfDdQyoV88WOHgS062FXsB4jWINrf6I0bSmqPcxEzxc6esM4R9tYqNicQq/aTbS902o0TAsfesqXOuVYTMem5dAeTJkmEBEeR+s7zfdxNL9aW11qDMH2Cfy0trDwbHEYJsfw4lJyx6aZ5aQPhnLqSCxcWg+DJ5ErKe3PvEnfHGoRM+/Ttwi9uPuH8WjF585xELv39zBT5+fB9B8DJDn8XiN13Mw6LnWpsbq0NtwJFdqKSBboAvVpY6W2VhuiiiIH+r52qu9FynFzLZu6TEQ9X1KlYwRfpCH9eoQ5c0WdUKGpjM0OitB2PIOSzOu/8p/RB4z0wZ8nkNA2Ni/I29i0TpY8TwOEFSOrg1BknWhp+3UzRg9PPCAfkBx6/u4AMuQvgG4hq4ssKpx0+MUmT0JkEc7hZ3QEBqOy/smXDuqi7ElitC9Y6Nv2/9T5wOKwfx384GhOhkI9Opr+n5qTEP9WMTxmOmEulf3xycpcJb3QaaOaG5NGfm3uT4y2LMcnoQeSIhwr1alWAt2NsNSMcApSDBUNMOljl0YBlrDZQIgFdwdMgT2qulEmZjQFHidVbbIpUeotBMKeUgPPBmayc9UwljjPwjqh7j3rRkwEoaaCZBP1Qo60j5KDEzlMUqL5AAwMmxRKQOQAS0xgu0CkNQolStqEuB8CKrH25ePIwtL14DSILLuHcvs8Kj76RQW7kLtm/c+zH5MOzRLfC7A+A3ZoAAsG6Q+KYCKZguMo62bBly+zCSd/A9o7hAmtAkqKI0LBiO/Q2bSnxUM3PQVRE1AJnwxPGprOwZktsRxE8NNyQ/jHMQL/GyvDcBDwQU6AwwyHXKsi0QQhVodld9poz89VK3PVrfnJ5ZVckmPGPeO+8cioGjVj2Vg3No2WQUpfSl9L30rfy3fLL8uN8npGHR3Jx9wxCld56yfpkaoH</latexit><latexit sha1_base64="X/Xh6/Sa6QhpEqbh+9AYWt8jo70=">AAAHl3icpVXtTtRAFC24uli/QH8Z/0xEjBjAXQiuJK4i4IrRRQjsQrLdkOl0tkx2Oq0zU2Rt+g4+jX/1NXwbbz9AuyASbZv25p4zd+69c2ZqB5wpXan8GBm9VLp8pTx21bx2/cbNW+MTt9vKDyWhLeJzX+7ZWFHOBG1ppjndCyTFns3prt1fTfDdQyoV88WOHgS062FXsB4jWINrf6I0bSmqPcxEzxc6esM4R9tYqNicQq/aTbS902o0TAsfesqXOuVYTMem5dAeTJkmEBEeR+s7zfdxNL9aW11qDMH2Cfy0trDwbHEYJsfw4lJyx6aZ5aQPhnLqSCxcWg+DJ5ErKe3PvEnfHGoRM+/Ttwi9uPuH8WjF585xELv39zBT5+fB9B8DJDn8XiN13Mw6LnWpsbq0NtwJFdqKSBboAvVpY6W2VhuiiiIH+r52qu9FynFzLZu6TEQ9X1KlYwRfpCH9eoQ5c0WdUKGpjM0OitB2PIOSzOu/8p/RB4z0wZ8nkNA2Ni/I29i0TpY8TwOEFSOrg1BknWhp+3UzRg9PPCAfkBx6/u4AMuQvgG4hq4ssKpx0+MUmT0JkEc7hZ3QEBqOy/smXDuqi7ElitC9Y6Nv2/9T5wOKwfx384GhOhkI9Opr+n5qTEP9WMTxmOmEulf3xycpcJb3QaaOaG5NGfm3uT4y2LMcnoQeSIhwr1alWAt2NsNSMcApSDBUNMOljl0YBlrDZQIgFdwdMgT2qulEmZjQFHidVbbIpUeotBMKeUgPPBmayc9UwljjPwjqh7j3rRkwEoaaCZBP1Qo60j5KDEzlMUqL5AAwMmxRKQOQAS0xgu0CkNQolStqEuB8CKrH25ePIwtL14DSILLuHcvs8Kj76RQW7kLtm/c+zH5MOzRLfC7A+A3ZoAAsG6Q+KYCKZguMo62bBly+zCSd/A9o7hAmtAkqKI0LBiO/Q2bSnxUM3PQVRE1AJnwxPGprOwZktsRxE8NNyQ/jHMQL/GyvDcBDwQU6AwwyHXKsi0QQhVodld9poz89VK3PVrfnJ5ZVckmPGPeO+8cioGjVj2Vg3No2WQUpfSl9L30rfy3fLL8uN8npGHR3Jx9wxCld56yfpkaoH</latexit><latexit sha1_base64="X/Xh6/Sa6QhpEqbh+9AYWt8jo70=">AAAHl3icpVXtTtRAFC24uli/QH8Z/0xEjBjAXQiuJK4i4IrRRQjsQrLdkOl0tkx2Oq0zU2Rt+g4+jX/1NXwbbz9AuyASbZv25p4zd+69c2ZqB5wpXan8GBm9VLp8pTx21bx2/cbNW+MTt9vKDyWhLeJzX+7ZWFHOBG1ppjndCyTFns3prt1fTfDdQyoV88WOHgS062FXsB4jWINrf6I0bSmqPcxEzxc6esM4R9tYqNicQq/aTbS902o0TAsfesqXOuVYTMem5dAeTJkmEBEeR+s7zfdxNL9aW11qDMH2Cfy0trDwbHEYJsfw4lJyx6aZ5aQPhnLqSCxcWg+DJ5ErKe3PvEnfHGoRM+/Ttwi9uPuH8WjF585xELv39zBT5+fB9B8DJDn8XiN13Mw6LnWpsbq0NtwJFdqKSBboAvVpY6W2VhuiiiIH+r52qu9FynFzLZu6TEQ9X1KlYwRfpCH9eoQ5c0WdUKGpjM0OitB2PIOSzOu/8p/RB4z0wZ8nkNA2Ni/I29i0TpY8TwOEFSOrg1BknWhp+3UzRg9PPCAfkBx6/u4AMuQvgG4hq4ssKpx0+MUmT0JkEc7hZ3QEBqOy/smXDuqi7ElitC9Y6Nv2/9T5wOKwfx384GhOhkI9Opr+n5qTEP9WMTxmOmEulf3xycpcJb3QaaOaG5NGfm3uT4y2LMcnoQeSIhwr1alWAt2NsNSMcApSDBUNMOljl0YBlrDZQIgFdwdMgT2qulEmZjQFHidVbbIpUeotBMKeUgPPBmayc9UwljjPwjqh7j3rRkwEoaaCZBP1Qo60j5KDEzlMUqL5AAwMmxRKQOQAS0xgu0CkNQolStqEuB8CKrH25ePIwtL14DSILLuHcvs8Kj76RQW7kLtm/c+zH5MOzRLfC7A+A3ZoAAsG6Q+KYCKZguMo62bBly+zCSd/A9o7hAmtAkqKI0LBiO/Q2bSnxUM3PQVRE1AJnwxPGprOwZktsRxE8NNyQ/jHMQL/GyvDcBDwQU6AwwyHXKsi0QQhVodld9poz89VK3PVrfnJ5ZVckmPGPeO+8cioGjVj2Vg3No2WQUpfSl9L30rfy3fLL8uN8npGHR3Jx9wxCld56yfpkaoH</latexit>

Proper Nouns & Intransitive Verbs

27

ERROR: Constant “Khalil” is not a function!

S[SEM=np?(vp?)] → NP[SEM=np?] VP[SEM=vp?]

Page 28: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Proper Nouns & Intransitive Verbs● Instead, we use a dummy predicate:● λQ.Q(Khalil)

● “Generalizing to the worst case” (cf. Montague; Partee on type-shifting)

28

Page 29: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Proper Nouns & Intransitive Verbs● With the dummy predicate:● NNP[SEM=<\P.P(Khalil)>] → ‘Khalil’

29

S[SEM=np?(vp?)] → NP[SEM=np?] VP[SEM=vp?]

7

24

224ॱ7)1 ᅶ4�4�/LEPMP ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ ॲVYRW

<latexit sha1_base64="FZftB9jjXHamNHsgX3G4UX9G42g=">AAAHoXicrVXdUtNAFI5YLcZf9NKbHREHHagtjFQuOqOAFUaKVWhhpukwm8027HSzibsbpWbyIj6Nt/oGvo0nP4ApiIyaZJIz53x79jsn3+7aAWdKV6s/Lk1cLl25Wp68Zl6/cfPW7TtTd7vKDyWhHeJzX+7ZWFHOBO1opjndCyTFns3prj1cTeK7H6lUzBc7ehTQvoddwQaMYA2u/anSoqWo9jATA1/o6DXjHG1joWJzBr3sttD2TqfZNC380VO+1CnGYjo2LYcOYMqUQER4HK3vtDbjaGG1vrrcHAvbx+Gl+uLi82fjYXIUfrac3LFpZpz0wRinnsTCpY0weBq5ktLh3Ov0zaEWMbeZvkXoxf3fjEcrPneOktiDP6eZOZ8H079NkHD4tUbquJl1VOpyc3V5bbwTKrQVkSzQBehSc6W+Vh+DiiIG+r52qu9FyFFzLZu6TEQDX1KlYwRfpIF+I8KcuaJBqNBUxmYPRWg7nkMJ88YJ/zl9wMgQ/DmBBLbVviBuq20d//KcBggrRlYPocg61tL2q1aMHh17QD4gOfTQ4iBrBz9sV9qzbw6ALX8MQy1k9ZFFhZOmuhiRJF2W4Rx8BkdgMCobn3zpoD7KniRH94JFb3T/R82HFRkKNXv4LxUnGf6uXnjMdMJcNPt3pquVanqh00YtN6aN/GrvT010LMcnoQfiIhwr1atVA92PsNSMcAqiDBUNMBlil0YBlrDsQJIFdw9MgT2q+lEmazQDHifVb7I8UeotJMKeUiPPBmSyhtV4LHGeFeuFevC8HzERhJoKkk00CDnSPkq2UOQwSYnmIzAwLFcoAZEDLDGBhQOZ1iiUKGkL8r4NqMTal08iC0vXg30hsuwByu3zoPjwBAp2gbtmw8/zH5IOzRPfC7A+I+zQAH4Y0B8Vg4lkCo7DrJsFX/6bTTgDmtDesZjQKqCkOCIUjPgOnU97Wtx+0/0QtSAq4ZPFk4amc3BmSyxHERxfbginHSNw8lhZDAcBH+UA2NZwyLUqAk0QYm1cdqeN7kKlVq3U3i1Mv1jJJTlp3DceGLNGzagbL4x1o210DFL6Uvpa+lb6Xp4ub5Tb5fcZdOJSPuaeUbjKvZ/Btq2b</latexit><latexit sha1_base64="FZftB9jjXHamNHsgX3G4UX9G42g=">AAAHoXicrVXdUtNAFI5YLcZf9NKbHREHHagtjFQuOqOAFUaKVWhhpukwm8027HSzibsbpWbyIj6Nt/oGvo0nP4ApiIyaZJIz53x79jsn3+7aAWdKV6s/Lk1cLl25Wp68Zl6/cfPW7TtTd7vKDyWhHeJzX+7ZWFHOBO1opjndCyTFns3prj1cTeK7H6lUzBc7ehTQvoddwQaMYA2u/anSoqWo9jATA1/o6DXjHG1joWJzBr3sttD2TqfZNC380VO+1CnGYjo2LYcOYMqUQER4HK3vtDbjaGG1vrrcHAvbx+Gl+uLi82fjYXIUfrac3LFpZpz0wRinnsTCpY0weBq5ktLh3Ov0zaEWMbeZvkXoxf3fjEcrPneOktiDP6eZOZ8H079NkHD4tUbquJl1VOpyc3V5bbwTKrQVkSzQBehSc6W+Vh+DiiIG+r52qu9FyFFzLZu6TEQDX1KlYwRfpIF+I8KcuaJBqNBUxmYPRWg7nkMJ88YJ/zl9wMgQ/DmBBLbVviBuq20d//KcBggrRlYPocg61tL2q1aMHh17QD4gOfTQ4iBrBz9sV9qzbw6ALX8MQy1k9ZFFhZOmuhiRJF2W4Rx8BkdgMCobn3zpoD7KniRH94JFb3T/R82HFRkKNXv4LxUnGf6uXnjMdMJcNPt3pquVanqh00YtN6aN/GrvT010LMcnoQfiIhwr1atVA92PsNSMcAqiDBUNMBlil0YBlrDsQJIFdw9MgT2q+lEmazQDHifVb7I8UeotJMKeUiPPBmSyhtV4LHGeFeuFevC8HzERhJoKkk00CDnSPkq2UOQwSYnmIzAwLFcoAZEDLDGBhQOZ1iiUKGkL8r4NqMTal08iC0vXg30hsuwByu3zoPjwBAp2gbtmw8/zH5IOzRPfC7A+I+zQAH4Y0B8Vg4lkCo7DrJsFX/6bTTgDmtDesZjQKqCkOCIUjPgOnU97Wtx+0/0QtSAq4ZPFk4amc3BmSyxHERxfbginHSNw8lhZDAcBH+UA2NZwyLUqAk0QYm1cdqeN7kKlVq3U3i1Mv1jJJTlp3DceGLNGzagbL4x1o210DFL6Uvpa+lb6Xp4ub5Tb5fcZdOJSPuaeUbjKvZ/Btq2b</latexit><latexit sha1_base64="FZftB9jjXHamNHsgX3G4UX9G42g=">AAAHoXicrVXdUtNAFI5YLcZf9NKbHREHHagtjFQuOqOAFUaKVWhhpukwm8027HSzibsbpWbyIj6Nt/oGvo0nP4ApiIyaZJIz53x79jsn3+7aAWdKV6s/Lk1cLl25Wp68Zl6/cfPW7TtTd7vKDyWhHeJzX+7ZWFHOBO1opjndCyTFns3prj1cTeK7H6lUzBc7ehTQvoddwQaMYA2u/anSoqWo9jATA1/o6DXjHG1joWJzBr3sttD2TqfZNC380VO+1CnGYjo2LYcOYMqUQER4HK3vtDbjaGG1vrrcHAvbx+Gl+uLi82fjYXIUfrac3LFpZpz0wRinnsTCpY0weBq5ktLh3Ov0zaEWMbeZvkXoxf3fjEcrPneOktiDP6eZOZ8H079NkHD4tUbquJl1VOpyc3V5bbwTKrQVkSzQBehSc6W+Vh+DiiIG+r52qu9FyFFzLZu6TEQDX1KlYwRfpIF+I8KcuaJBqNBUxmYPRWg7nkMJ88YJ/zl9wMgQ/DmBBLbVviBuq20d//KcBggrRlYPocg61tL2q1aMHh17QD4gOfTQ4iBrBz9sV9qzbw6ALX8MQy1k9ZFFhZOmuhiRJF2W4Rx8BkdgMCobn3zpoD7KniRH94JFb3T/R82HFRkKNXv4LxUnGf6uXnjMdMJcNPt3pquVanqh00YtN6aN/GrvT010LMcnoQfiIhwr1atVA92PsNSMcAqiDBUNMBlil0YBlrDsQJIFdw9MgT2q+lEmazQDHifVb7I8UeotJMKeUiPPBmSyhtV4LHGeFeuFevC8HzERhJoKkk00CDnSPkq2UOQwSYnmIzAwLFcoAZEDLDGBhQOZ1iiUKGkL8r4NqMTal08iC0vXg30hsuwByu3zoPjwBAp2gbtmw8/zH5IOzRPfC7A+I+zQAH4Y0B8Vg4lkCo7DrJsFX/6bTTgDmtDesZjQKqCkOCIUjPgOnU97Wtx+0/0QtSAq4ZPFk4amc3BmSyxHERxfbginHSNw8lhZDAcBH+UA2NZwyLUqAk0QYm1cdqeN7kKlVq3U3i1Mv1jJJTlp3DceGLNGzagbL4x1o210DFL6Uvpa+lb6Xp4ub5Tb5fcZdOJSPuaeUbjKvZ/Btq2b</latexit><latexit sha1_base64="FZftB9jjXHamNHsgX3G4UX9G42g=">AAAHoXicrVXdUtNAFI5YLcZf9NKbHREHHagtjFQuOqOAFUaKVWhhpukwm8027HSzibsbpWbyIj6Nt/oGvo0nP4ApiIyaZJIz53x79jsn3+7aAWdKV6s/Lk1cLl25Wp68Zl6/cfPW7TtTd7vKDyWhHeJzX+7ZWFHOBO1opjndCyTFns3prj1cTeK7H6lUzBc7ehTQvoddwQaMYA2u/anSoqWo9jATA1/o6DXjHG1joWJzBr3sttD2TqfZNC380VO+1CnGYjo2LYcOYMqUQER4HK3vtDbjaGG1vrrcHAvbx+Gl+uLi82fjYXIUfrac3LFpZpz0wRinnsTCpY0weBq5ktLh3Ov0zaEWMbeZvkXoxf3fjEcrPneOktiDP6eZOZ8H079NkHD4tUbquJl1VOpyc3V5bbwTKrQVkSzQBehSc6W+Vh+DiiIG+r52qu9FyFFzLZu6TEQDX1KlYwRfpIF+I8KcuaJBqNBUxmYPRWg7nkMJ88YJ/zl9wMgQ/DmBBLbVviBuq20d//KcBggrRlYPocg61tL2q1aMHh17QD4gOfTQ4iBrBz9sV9qzbw6ALX8MQy1k9ZFFhZOmuhiRJF2W4Rx8BkdgMCobn3zpoD7KniRH94JFb3T/R82HFRkKNXv4LxUnGf6uXnjMdMJcNPt3pquVanqh00YtN6aN/GrvT010LMcnoQfiIhwr1atVA92PsNSMcAqiDBUNMBlil0YBlrDsQJIFdw9MgT2q+lEmazQDHifVb7I8UeotJMKeUiPPBmSyhtV4LHGeFeuFevC8HzERhJoKkk00CDnSPkq2UOQwSYnmIzAwLFcoAZEDLDGBhQOZ1iiUKGkL8r4NqMTal08iC0vXg30hsuwByu3zoPjwBAp2gbtmw8/zH5IOzRPfC7A+I+zQAH4Y0B8Vg4lkCo7DrJsFX/6bTTgDmtDesZjQKqCkOCIUjPgOnU97Wtx+0/0QtSAq4ZPFk4amc3BmSyxHERxfbginHSNw8lhZDAcBH+UA2NZwyLUqAk0QYm1cdqeN7kKlVq3U3i1Mv1jJJTlp3DceGLNGzagbL4x1o210DFL6Uvpa+lb6Xp4ub5Tb5fcZdOJSPuaeUbjKvZ/Btq2b</latexit>

7ॱ7)1 ᅶ4�4�/LEPMP �ᅶ\�VYRW�\ ॲ24

224ॱ7)1 ᅶ4�4�/LEPMP ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ ॲVYRW

<latexit sha1_base64="wPhtZgIfLaro1e/jjotzgePC064=">AAAIFXicrVVfb9MwEA+D0hH+Dh55sRhDG9pKuwFlD0VjGwUEhaKtBampJsdxM6uOE2xnrET5HHwEPgVviFee+TZc/qwj3RgIcKLkdL+fz3fn89kOOFO6Wv1+aur0mdLZ8vQ58/yFi5cuX5m52lV+KAntEJ/78q2NFeVM0I5mmtO3gaTYszl9Yw83EvzNHpWK+WJbjwLa97Ar2IARrEG1M3Pmk6Wo9jATA1/o6AnjHG1hoWJzDj3qttDWdqfZNC285ylf6pRjMR2blkMHsGTqQER4HD3dbr2Io+WN+sZqcwK2x/D9+srKg3uTMDmA760mT2yamU96d8KnnsTCpY0wuBO5ktLh4pP0yyEWsfgi/YrQi/u/mI/Wfe4cGLEHvzczd7IfTP/SQOLDzzFSx82kg1BXmxurm5OZUKGtiGSBLlDvN9frm/UJqihyIO+bR/JepBwk17Kpy0Q08CVVOkbwRxrcb0SYM1c0CBWaytjsoQhtWeMdymdBHcTI6iEUWeOt33rcitGtsQZ2GyoE3bQ4VKGDb7Yr7fnnu2CcL8yPlfsVGQo1v7+wAOYsZPWRRYWTmo8XUZKtxmHOFvUuI0PQ50Enrr1s/yHvZfs/B/GXDifmMgsn8DM6AoFR2XjvSwf1UfYmNrp/GPSz7v+IebxH/xBxYuHv4oXXTBfMC3Xnymy1Uk0HOirUcmHWyEd7Z2aqYzk+CT0oaMKxUr1aNdD9CEvNCKdwEEJFA0yG2KVRgCUcdTgGBXUPRIE9qvpRdpTQHGic9MwkLQGl2oIh7Ck18mxgJn1DTWKJ8jisF+rBg37ERBBqKki20CDkSPsoadvIYZISzUcgYGgREAIiu1hiAocVLG1SCFHSFth9FVCJtS9vRxaWrge9KLLsAcrlk6h4/5AKcsF3zYYflt4lGVoivhdgfQzs0AA2DNwfFcGkZAqK/SybBV2+zSbcO01I7wQmtAooKc4IBSO+Q5fSnBZbftqDUQtQCb8MTxKarsGZLbEcRXBluiHcsIzAbWdlGA4CPsoJ0EpxyLUqEk0oxNpk2R0VusuVWrVSe708u7ael+S0cd24YcwbNaNurBlPjbbRMUjpUuluqVF6WP5Y/lz+Uv6aUadO5XOuGYVR/vYD0HXX0A==</latexit><latexit sha1_base64="wPhtZgIfLaro1e/jjotzgePC064=">AAAIFXicrVVfb9MwEA+D0hH+Dh55sRhDG9pKuwFlD0VjGwUEhaKtBampJsdxM6uOE2xnrET5HHwEPgVviFee+TZc/qwj3RgIcKLkdL+fz3fn89kOOFO6Wv1+aur0mdLZ8vQ58/yFi5cuX5m52lV+KAntEJ/78q2NFeVM0I5mmtO3gaTYszl9Yw83EvzNHpWK+WJbjwLa97Ar2IARrEG1M3Pmk6Wo9jATA1/o6AnjHG1hoWJzDj3qttDWdqfZNC285ylf6pRjMR2blkMHsGTqQER4HD3dbr2Io+WN+sZqcwK2x/D9+srKg3uTMDmA760mT2yamU96d8KnnsTCpY0wuBO5ktLh4pP0yyEWsfgi/YrQi/u/mI/Wfe4cGLEHvzczd7IfTP/SQOLDzzFSx82kg1BXmxurm5OZUKGtiGSBLlDvN9frm/UJqihyIO+bR/JepBwk17Kpy0Q08CVVOkbwRxrcb0SYM1c0CBWaytjsoQhtWeMdymdBHcTI6iEUWeOt33rcitGtsQZ2GyoE3bQ4VKGDb7Yr7fnnu2CcL8yPlfsVGQo1v7+wAOYsZPWRRYWTmo8XUZKtxmHOFvUuI0PQ50Enrr1s/yHvZfs/B/GXDifmMgsn8DM6AoFR2XjvSwf1UfYmNrp/GPSz7v+IebxH/xBxYuHv4oXXTBfMC3Xnymy1Uk0HOirUcmHWyEd7Z2aqYzk+CT0oaMKxUr1aNdD9CEvNCKdwEEJFA0yG2KVRgCUcdTgGBXUPRIE9qvpRdpTQHGic9MwkLQGl2oIh7Ck18mxgJn1DTWKJ8jisF+rBg37ERBBqKki20CDkSPsoadvIYZISzUcgYGgREAIiu1hiAocVLG1SCFHSFth9FVCJtS9vRxaWrge9KLLsAcrlk6h4/5AKcsF3zYYflt4lGVoivhdgfQzs0AA2DNwfFcGkZAqK/SybBV2+zSbcO01I7wQmtAooKc4IBSO+Q5fSnBZbftqDUQtQCb8MTxKarsGZLbEcRXBluiHcsIzAbWdlGA4CPsoJ0EpxyLUqEk0oxNpk2R0VusuVWrVSe708u7ael+S0cd24YcwbNaNurBlPjbbRMUjpUuluqVF6WP5Y/lz+Uv6aUadO5XOuGYVR/vYD0HXX0A==</latexit><latexit sha1_base64="wPhtZgIfLaro1e/jjotzgePC064=">AAAIFXicrVVfb9MwEA+D0hH+Dh55sRhDG9pKuwFlD0VjGwUEhaKtBampJsdxM6uOE2xnrET5HHwEPgVviFee+TZc/qwj3RgIcKLkdL+fz3fn89kOOFO6Wv1+aur0mdLZ8vQ58/yFi5cuX5m52lV+KAntEJ/78q2NFeVM0I5mmtO3gaTYszl9Yw83EvzNHpWK+WJbjwLa97Ar2IARrEG1M3Pmk6Wo9jATA1/o6AnjHG1hoWJzDj3qttDWdqfZNC285ylf6pRjMR2blkMHsGTqQER4HD3dbr2Io+WN+sZqcwK2x/D9+srKg3uTMDmA760mT2yamU96d8KnnsTCpY0wuBO5ktLh4pP0yyEWsfgi/YrQi/u/mI/Wfe4cGLEHvzczd7IfTP/SQOLDzzFSx82kg1BXmxurm5OZUKGtiGSBLlDvN9frm/UJqihyIO+bR/JepBwk17Kpy0Q08CVVOkbwRxrcb0SYM1c0CBWaytjsoQhtWeMdymdBHcTI6iEUWeOt33rcitGtsQZ2GyoE3bQ4VKGDb7Yr7fnnu2CcL8yPlfsVGQo1v7+wAOYsZPWRRYWTmo8XUZKtxmHOFvUuI0PQ50Enrr1s/yHvZfs/B/GXDifmMgsn8DM6AoFR2XjvSwf1UfYmNrp/GPSz7v+IebxH/xBxYuHv4oXXTBfMC3Xnymy1Uk0HOirUcmHWyEd7Z2aqYzk+CT0oaMKxUr1aNdD9CEvNCKdwEEJFA0yG2KVRgCUcdTgGBXUPRIE9qvpRdpTQHGic9MwkLQGl2oIh7Ck18mxgJn1DTWKJ8jisF+rBg37ERBBqKki20CDkSPsoadvIYZISzUcgYGgREAIiu1hiAocVLG1SCFHSFth9FVCJtS9vRxaWrge9KLLsAcrlk6h4/5AKcsF3zYYflt4lGVoivhdgfQzs0AA2DNwfFcGkZAqK/SybBV2+zSbcO01I7wQmtAooKc4IBSO+Q5fSnBZbftqDUQtQCb8MTxKarsGZLbEcRXBluiHcsIzAbWdlGA4CPsoJ0EpxyLUqEk0oxNpk2R0VusuVWrVSe708u7ael+S0cd24YcwbNaNurBlPjbbRMUjpUuluqVF6WP5Y/lz+Uv6aUadO5XOuGYVR/vYD0HXX0A==</latexit><latexit sha1_base64="wPhtZgIfLaro1e/jjotzgePC064=">AAAIFXicrVVfb9MwEA+D0hH+Dh55sRhDG9pKuwFlD0VjGwUEhaKtBampJsdxM6uOE2xnrET5HHwEPgVviFee+TZc/qwj3RgIcKLkdL+fz3fn89kOOFO6Wv1+aur0mdLZ8vQ58/yFi5cuX5m52lV+KAntEJ/78q2NFeVM0I5mmtO3gaTYszl9Yw83EvzNHpWK+WJbjwLa97Ar2IARrEG1M3Pmk6Wo9jATA1/o6AnjHG1hoWJzDj3qttDWdqfZNC285ylf6pRjMR2blkMHsGTqQER4HD3dbr2Io+WN+sZqcwK2x/D9+srKg3uTMDmA760mT2yamU96d8KnnsTCpY0wuBO5ktLh4pP0yyEWsfgi/YrQi/u/mI/Wfe4cGLEHvzczd7IfTP/SQOLDzzFSx82kg1BXmxurm5OZUKGtiGSBLlDvN9frm/UJqihyIO+bR/JepBwk17Kpy0Q08CVVOkbwRxrcb0SYM1c0CBWaytjsoQhtWeMdymdBHcTI6iEUWeOt33rcitGtsQZ2GyoE3bQ4VKGDb7Yr7fnnu2CcL8yPlfsVGQo1v7+wAOYsZPWRRYWTmo8XUZKtxmHOFvUuI0PQ50Enrr1s/yHvZfs/B/GXDifmMgsn8DM6AoFR2XjvSwf1UfYmNrp/GPSz7v+IebxH/xBxYuHv4oXXTBfMC3Xnymy1Uk0HOirUcmHWyEd7Z2aqYzk+CT0oaMKxUr1aNdD9CEvNCKdwEEJFA0yG2KVRgCUcdTgGBXUPRIE9qvpRdpTQHGic9MwkLQGl2oIh7Ck18mxgJn1DTWKJ8jisF+rBg37ERBBqKki20CDkSPsoadvIYZISzUcgYGgREAIiu1hiAocVLG1SCFHSFth9FVCJtS9vRxaWrge9KLLsAcrlk6h4/5AKcsF3zYYflt4lGVoivhdgfQzs0AA2DNwfFcGkZAqK/SybBV2+zSbcO01I7wQmtAooKc4IBSO+Q5fSnBZbftqDUQtQCb8MTxKarsGZLbEcRXBluiHcsIzAbWdlGA4CPsoJ0EpxyLUqEk0oxNpk2R0VusuVWrVSe708u7ael+S0cd24YcwbNaNurBlPjbbRMUjpUuluqVF6WP5Y/lz+Uv6aUadO5XOuGYVR/vYD0HXX0A==</latexit>

7ॱ7)1 ᅶ\�VYRW�\ �/LEPMP ॲ24

224ॱ7)1 ᅶ4�4�/LEPMP ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ ॲVYRW

<latexit sha1_base64="BM9Jei0RWayhBvxA/eW2Mu4jkRI=">AAAIB3icrVXdbtMwFM7GSkf4HVxyY7EfDbSVdmiUXVSCbXRDrFC0tUNqqslx3Myq4wTbgZUoD8Aj8BTcIW55DN6Gk59tpIOBACdKjs73+fic4+NjO+BM6Wr128TkhanSxfL0JfPylavXrt+YudlVfigJ7RCf+/K1jRXlTNCOZprT14Gk2LM53beHGwm+/5ZKxXyxp0cB7XvYFWzACNagOpiZ+mgpqj3MxMAXOtpinKNdLFRszqMn3Rba3es0m6aF33rKlzrlWEzHpuXQASyZOhARHkfbe62dOFrZqG+sNcdg+wR+WH/w4NHqOEyO4dW15IlNM/NJH4751JNYuLQRBvcjV1I6XNpKvxxiEUs76VeEXtz/xXy07nPn2Ig9+L2Z+fP9YPqXBhIffoyROm4mHYe61txY2xzPhAptRSQLdIH6sLle36yPUUWRA3nfPJP3IuU4uZZNXSaigS+p0jGCP9LgfiPCnLmiQajQVMZmD0Vo1zrZoXwW1EGMrB5CkXWy9btPWzFaONHAbkOFoDmLQxU6eO6oIkOhFo/uLj4/hCX4XTBgIauPLCqc1GC8hJL8NE6ztKQPGRmCPg8zceZF+w95L9r/w+12pf2PDifmMgvn8DM6AoFR2XjnSwf1UfYmNrp/GPSz7n/dqn+IOLHwd/HCa6YL5qV5cGO2WqmmA50Varkwa+SjfTAz2bEcn4QelDDhWKlerRrofoSlZoRTKP1Q0QCTIXZpFGAJhxsKv6DugSiwR1U/yg4PmgeNk56SpAmgVFswhD2lRp4NzKRTqHEsUf4M64V68KgfMRGEmgqSLTQIOdI+Sho1cpikRPMRCBiaAoSAyCGWmMDxBEubFEKUtAV2XwZUYu3Le5GFpetB94kse4By+TwqPjqlglzwXbPh++U3SYaWie8FWP8EdmgAGwbuj4pgUjIFxVGWzYIu32YTbpompHcME1oFlBRnhIIR36HLaU6LTT7tuqgFqIRfhicJTdfgzJZYjiK4JN0Q7lRG4H6zMgwHAR/lBGieOORaFYkmFGJtvOzOCt2VSq1aqb1amX28npfktHHbuGMsGjWjbjw2to220TFIySgtlO6XquUP5U/lz+UvGXVyIp9zyyiM8tfvKdLTIA==</latexit><latexit sha1_base64="BM9Jei0RWayhBvxA/eW2Mu4jkRI=">AAAIB3icrVXdbtMwFM7GSkf4HVxyY7EfDbSVdmiUXVSCbXRDrFC0tUNqqslx3Myq4wTbgZUoD8Aj8BTcIW55DN6Gk59tpIOBACdKjs73+fic4+NjO+BM6Wr128TkhanSxfL0JfPylavXrt+YudlVfigJ7RCf+/K1jRXlTNCOZprT14Gk2LM53beHGwm+/5ZKxXyxp0cB7XvYFWzACNagOpiZ+mgpqj3MxMAXOtpinKNdLFRszqMn3Rba3es0m6aF33rKlzrlWEzHpuXQASyZOhARHkfbe62dOFrZqG+sNcdg+wR+WH/w4NHqOEyO4dW15IlNM/NJH4751JNYuLQRBvcjV1I6XNpKvxxiEUs76VeEXtz/xXy07nPn2Ig9+L2Z+fP9YPqXBhIffoyROm4mHYe61txY2xzPhAptRSQLdIH6sLle36yPUUWRA3nfPJP3IuU4uZZNXSaigS+p0jGCP9LgfiPCnLmiQajQVMZmD0Vo1zrZoXwW1EGMrB5CkXWy9btPWzFaONHAbkOFoDmLQxU6eO6oIkOhFo/uLj4/hCX4XTBgIauPLCqc1GC8hJL8NE6ztKQPGRmCPg8zceZF+w95L9r/w+12pf2PDifmMgvn8DM6AoFR2XjnSwf1UfYmNrp/GPSz7n/dqn+IOLHwd/HCa6YL5qV5cGO2WqmmA50Varkwa+SjfTAz2bEcn4QelDDhWKlerRrofoSlZoRTKP1Q0QCTIXZpFGAJhxsKv6DugSiwR1U/yg4PmgeNk56SpAmgVFswhD2lRp4NzKRTqHEsUf4M64V68KgfMRGEmgqSLTQIOdI+Sho1cpikRPMRCBiaAoSAyCGWmMDxBEubFEKUtAV2XwZUYu3Le5GFpetB94kse4By+TwqPjqlglzwXbPh++U3SYaWie8FWP8EdmgAGwbuj4pgUjIFxVGWzYIu32YTbpompHcME1oFlBRnhIIR36HLaU6LTT7tuqgFqIRfhicJTdfgzJZYjiK4JN0Q7lRG4H6zMgwHAR/lBGieOORaFYkmFGJtvOzOCt2VSq1aqb1amX28npfktHHbuGMsGjWjbjw2to220TFIySgtlO6XquUP5U/lz+UvGXVyIp9zyyiM8tfvKdLTIA==</latexit><latexit sha1_base64="BM9Jei0RWayhBvxA/eW2Mu4jkRI=">AAAIB3icrVXdbtMwFM7GSkf4HVxyY7EfDbSVdmiUXVSCbXRDrFC0tUNqqslx3Myq4wTbgZUoD8Aj8BTcIW55DN6Gk59tpIOBACdKjs73+fic4+NjO+BM6Wr128TkhanSxfL0JfPylavXrt+YudlVfigJ7RCf+/K1jRXlTNCOZprT14Gk2LM53beHGwm+/5ZKxXyxp0cB7XvYFWzACNagOpiZ+mgpqj3MxMAXOtpinKNdLFRszqMn3Rba3es0m6aF33rKlzrlWEzHpuXQASyZOhARHkfbe62dOFrZqG+sNcdg+wR+WH/w4NHqOEyO4dW15IlNM/NJH4751JNYuLQRBvcjV1I6XNpKvxxiEUs76VeEXtz/xXy07nPn2Ig9+L2Z+fP9YPqXBhIffoyROm4mHYe61txY2xzPhAptRSQLdIH6sLle36yPUUWRA3nfPJP3IuU4uZZNXSaigS+p0jGCP9LgfiPCnLmiQajQVMZmD0Vo1zrZoXwW1EGMrB5CkXWy9btPWzFaONHAbkOFoDmLQxU6eO6oIkOhFo/uLj4/hCX4XTBgIauPLCqc1GC8hJL8NE6ztKQPGRmCPg8zceZF+w95L9r/w+12pf2PDifmMgvn8DM6AoFR2XjnSwf1UfYmNrp/GPSz7n/dqn+IOLHwd/HCa6YL5qV5cGO2WqmmA50Varkwa+SjfTAz2bEcn4QelDDhWKlerRrofoSlZoRTKP1Q0QCTIXZpFGAJhxsKv6DugSiwR1U/yg4PmgeNk56SpAmgVFswhD2lRp4NzKRTqHEsUf4M64V68KgfMRGEmgqSLTQIOdI+Sho1cpikRPMRCBiaAoSAyCGWmMDxBEubFEKUtAV2XwZUYu3Le5GFpetB94kse4By+TwqPjqlglzwXbPh++U3SYaWie8FWP8EdmgAGwbuj4pgUjIFxVGWzYIu32YTbpompHcME1oFlBRnhIIR36HLaU6LTT7tuqgFqIRfhicJTdfgzJZYjiK4JN0Q7lRG4H6zMgwHAR/lBGieOORaFYkmFGJtvOzOCt2VSq1aqb1amX28npfktHHbuGMsGjWjbjw2to220TFIySgtlO6XquUP5U/lz+UvGXVyIp9zyyiM8tfvKdLTIA==</latexit><latexit sha1_base64="BM9Jei0RWayhBvxA/eW2Mu4jkRI=">AAAIB3icrVXdbtMwFM7GSkf4HVxyY7EfDbSVdmiUXVSCbXRDrFC0tUNqqslx3Myq4wTbgZUoD8Aj8BTcIW55DN6Gk59tpIOBACdKjs73+fic4+NjO+BM6Wr128TkhanSxfL0JfPylavXrt+YudlVfigJ7RCf+/K1jRXlTNCOZprT14Gk2LM53beHGwm+/5ZKxXyxp0cB7XvYFWzACNagOpiZ+mgpqj3MxMAXOtpinKNdLFRszqMn3Rba3es0m6aF33rKlzrlWEzHpuXQASyZOhARHkfbe62dOFrZqG+sNcdg+wR+WH/w4NHqOEyO4dW15IlNM/NJH4751JNYuLQRBvcjV1I6XNpKvxxiEUs76VeEXtz/xXy07nPn2Ig9+L2Z+fP9YPqXBhIffoyROm4mHYe61txY2xzPhAptRSQLdIH6sLle36yPUUWRA3nfPJP3IuU4uZZNXSaigS+p0jGCP9LgfiPCnLmiQajQVMZmD0Vo1zrZoXwW1EGMrB5CkXWy9btPWzFaONHAbkOFoDmLQxU6eO6oIkOhFo/uLj4/hCX4XTBgIauPLCqc1GC8hJL8NE6ztKQPGRmCPg8zceZF+w95L9r/w+12pf2PDifmMgvn8DM6AoFR2XjnSwf1UfYmNrp/GPSz7n/dqn+IOLHwd/HCa6YL5qV5cGO2WqmmA50Varkwa+SjfTAz2bEcn4QelDDhWKlerRrofoSlZoRTKP1Q0QCTIXZpFGAJhxsKv6DugSiwR1U/yg4PmgeNk56SpAmgVFswhD2lRp4NzKRTqHEsUf4M64V68KgfMRGEmgqSLTQIOdI+Sho1cpikRPMRCBiaAoSAyCGWmMDxBEubFEKUtAV2XwZUYu3Le5GFpetB94kse4By+TwqPjqlglzwXbPh++U3SYaWie8FWP8EdmgAGwbuj4pgUjIFxVGWzYIu32YTbpompHcME1oFlBRnhIIR36HLaU6LTT7tuqgFqIRfhicJTdfgzJZYjiK4JN0Q7lRG4H6zMgwHAR/lBGieOORaFYkmFGJtvOzOCt2VSq1aqb1amX28npfktHHbuGMsGjWjbjw2to220TFIySgtlO6XquUP5U/lz+UvGXVyIp9zyyiM8tfvKdLTIA==</latexit>

7ॱ7)1 VYRW�/LEPMP ॲ24

224ॱ7)1 ᅶ4�4�/LEPMP ॲ/LEPMP

:4

-:ॱ7)1 ᅶ\�VYRW�\ ॲVYRW

<latexit sha1_base64="lm5dXOa+kIfD5eyWKolq5J11X10=">AAAH+XicrVXdbtMwFA5joxB+BzdI3BjGEKCttJtG2UUl2EYBQaFoa0Fqqslx3Myq4wTbgRUrT8BTcIe45Wl4DZ6Ak58N0sFADCdKjs73+fic4+NjN+JM6Vrt67Gp49MzJyonT9mnz5w9d/7C7MWeCmNJaJeEPJSvXawoZ4J2NdOcvo4kxYHL6St3tJ7ir95SqVgotvQ4ooMA+4INGcEaVNuz0x8cRXWAmRiGQptHjHO0iYVK7Hn0oNdGm1vdVst28NtAhVJnHIfpxHY8OoQlMwcM4Yl5vNV+lpil9cb6amsCdvfhu43l5XsrkzDZg1dW0yex7dwnvTPhU19i4dNmHN0xvqR0tPAo+3KIRSw8y74iDpLBb+ajtZB7e0bc4Z/NzB/uB9O/NZD68HOM1PNzaS/U1db66sZkJlTsKiJZpEvUu621xkZjgirKHMj7xoG8lyl7yXVc6jNhhqGkSicI/kiD+02DOfNFk1ChqUzsPjJo09nfoWIW1EGCnD5Cxtnf+s2H7QTd2NfAbkOFIBkLdfPpDhjlt2CKg5wBcqjwMhPJAkoz0vyRlwW9w8gI9EVg6fLPO3/Je945gqPXHQ7HxcPXO9XOER1OzeUWDuHndAQCo7L5LpQeGqD8TW30/jLoJ73/EfNuNdun3aNEnFr4t3jhtbMFi2LcvjBXq9aygQ4K9UKYs4rR2Z6d6jpeSOIAipZwrFS/Xov0wGCpGeEUij1WNMJkhH1qIizhOEOpl9R9EAUOqBqY/LigedB42blIjz3KtCVDOFBqHLjATHuDmsRS5a+wfqyH9waGiSjWVJB8oWHMkQ5R2pqRxyQlmo9BwNAGIAREdrDEBA4kWNqgEKKkbbD7IqIS61DeNg6WfgD9xjjuEBXyYVS8+4MKcsl3zUbvF9+kGVokYRBh/QvYoxFsGLg/LoNpyZQUu3k2S7pim224W1qQ3glMaBVRUp4RC0ZCjy5mOS239azPojagEn45niY0W4MzV2I5NnAt+jHcoozAjebkGI4iPi4I0C5xzLUqE20oxPpk2R0UekvVeq1af7k0d3+tKMmT1hXrmnXTqlsN67712OpYXYtMf5u5PHN15lrFVD5WPlU+59SpY8WcS1ZpVL58B0u3zx8=</latexit><latexit sha1_base64="lm5dXOa+kIfD5eyWKolq5J11X10=">AAAH+XicrVXdbtMwFA5joxB+BzdI3BjGEKCttJtG2UUl2EYBQaFoa0Fqqslx3Myq4wTbgRUrT8BTcIe45Wl4DZ6Ak58N0sFADCdKjs73+fic4+NjN+JM6Vrt67Gp49MzJyonT9mnz5w9d/7C7MWeCmNJaJeEPJSvXawoZ4J2NdOcvo4kxYHL6St3tJ7ir95SqVgotvQ4ooMA+4INGcEaVNuz0x8cRXWAmRiGQptHjHO0iYVK7Hn0oNdGm1vdVst28NtAhVJnHIfpxHY8OoQlMwcM4Yl5vNV+lpil9cb6amsCdvfhu43l5XsrkzDZg1dW0yex7dwnvTPhU19i4dNmHN0xvqR0tPAo+3KIRSw8y74iDpLBb+ajtZB7e0bc4Z/NzB/uB9O/NZD68HOM1PNzaS/U1db66sZkJlTsKiJZpEvUu621xkZjgirKHMj7xoG8lyl7yXVc6jNhhqGkSicI/kiD+02DOfNFk1ChqUzsPjJo09nfoWIW1EGCnD5Cxtnf+s2H7QTd2NfAbkOFIBkLdfPpDhjlt2CKg5wBcqjwMhPJAkoz0vyRlwW9w8gI9EVg6fLPO3/Je945gqPXHQ7HxcPXO9XOER1OzeUWDuHndAQCo7L5LpQeGqD8TW30/jLoJ73/EfNuNdun3aNEnFr4t3jhtbMFi2LcvjBXq9aygQ4K9UKYs4rR2Z6d6jpeSOIAipZwrFS/Xov0wGCpGeEUij1WNMJkhH1qIizhOEOpl9R9EAUOqBqY/LigedB42blIjz3KtCVDOFBqHLjATHuDmsRS5a+wfqyH9waGiSjWVJB8oWHMkQ5R2pqRxyQlmo9BwNAGIAREdrDEBA4kWNqgEKKkbbD7IqIS61DeNg6WfgD9xjjuEBXyYVS8+4MKcsl3zUbvF9+kGVokYRBh/QvYoxFsGLg/LoNpyZQUu3k2S7pim224W1qQ3glMaBVRUp4RC0ZCjy5mOS239azPojagEn45niY0W4MzV2I5NnAt+jHcoozAjebkGI4iPi4I0C5xzLUqE20oxPpk2R0UekvVeq1af7k0d3+tKMmT1hXrmnXTqlsN67712OpYXYtMf5u5PHN15lrFVD5WPlU+59SpY8WcS1ZpVL58B0u3zx8=</latexit><latexit sha1_base64="lm5dXOa+kIfD5eyWKolq5J11X10=">AAAH+XicrVXdbtMwFA5joxB+BzdI3BjGEKCttJtG2UUl2EYBQaFoa0Fqqslx3Myq4wTbgRUrT8BTcIe45Wl4DZ6Ak58N0sFADCdKjs73+fic4+NjN+JM6Vrt67Gp49MzJyonT9mnz5w9d/7C7MWeCmNJaJeEPJSvXawoZ4J2NdOcvo4kxYHL6St3tJ7ir95SqVgotvQ4ooMA+4INGcEaVNuz0x8cRXWAmRiGQptHjHO0iYVK7Hn0oNdGm1vdVst28NtAhVJnHIfpxHY8OoQlMwcM4Yl5vNV+lpil9cb6amsCdvfhu43l5XsrkzDZg1dW0yex7dwnvTPhU19i4dNmHN0xvqR0tPAo+3KIRSw8y74iDpLBb+ajtZB7e0bc4Z/NzB/uB9O/NZD68HOM1PNzaS/U1db66sZkJlTsKiJZpEvUu621xkZjgirKHMj7xoG8lyl7yXVc6jNhhqGkSicI/kiD+02DOfNFk1ChqUzsPjJo09nfoWIW1EGCnD5Cxtnf+s2H7QTd2NfAbkOFIBkLdfPpDhjlt2CKg5wBcqjwMhPJAkoz0vyRlwW9w8gI9EVg6fLPO3/Je945gqPXHQ7HxcPXO9XOER1OzeUWDuHndAQCo7L5LpQeGqD8TW30/jLoJ73/EfNuNdun3aNEnFr4t3jhtbMFi2LcvjBXq9aygQ4K9UKYs4rR2Z6d6jpeSOIAipZwrFS/Xov0wGCpGeEUij1WNMJkhH1qIizhOEOpl9R9EAUOqBqY/LigedB42blIjz3KtCVDOFBqHLjATHuDmsRS5a+wfqyH9waGiSjWVJB8oWHMkQ5R2pqRxyQlmo9BwNAGIAREdrDEBA4kWNqgEKKkbbD7IqIS61DeNg6WfgD9xjjuEBXyYVS8+4MKcsl3zUbvF9+kGVokYRBh/QvYoxFsGLg/LoNpyZQUu3k2S7pim224W1qQ3glMaBVRUp4RC0ZCjy5mOS239azPojagEn45niY0W4MzV2I5NnAt+jHcoozAjebkGI4iPi4I0C5xzLUqE20oxPpk2R0UekvVeq1af7k0d3+tKMmT1hXrmnXTqlsN67712OpYXYtMf5u5PHN15lrFVD5WPlU+59SpY8WcS1ZpVL58B0u3zx8=</latexit><latexit sha1_base64="lm5dXOa+kIfD5eyWKolq5J11X10=">AAAH+XicrVXdbtMwFA5joxB+BzdI3BjGEKCttJtG2UUl2EYBQaFoa0Fqqslx3Myq4wTbgRUrT8BTcIe45Wl4DZ6Ak58N0sFADCdKjs73+fic4+NjN+JM6Vrt67Gp49MzJyonT9mnz5w9d/7C7MWeCmNJaJeEPJSvXawoZ4J2NdOcvo4kxYHL6St3tJ7ir95SqVgotvQ4ooMA+4INGcEaVNuz0x8cRXWAmRiGQptHjHO0iYVK7Hn0oNdGm1vdVst28NtAhVJnHIfpxHY8OoQlMwcM4Yl5vNV+lpil9cb6amsCdvfhu43l5XsrkzDZg1dW0yex7dwnvTPhU19i4dNmHN0xvqR0tPAo+3KIRSw8y74iDpLBb+ajtZB7e0bc4Z/NzB/uB9O/NZD68HOM1PNzaS/U1db66sZkJlTsKiJZpEvUu621xkZjgirKHMj7xoG8lyl7yXVc6jNhhqGkSicI/kiD+02DOfNFk1ChqUzsPjJo09nfoWIW1EGCnD5Cxtnf+s2H7QTd2NfAbkOFIBkLdfPpDhjlt2CKg5wBcqjwMhPJAkoz0vyRlwW9w8gI9EVg6fLPO3/Je945gqPXHQ7HxcPXO9XOER1OzeUWDuHndAQCo7L5LpQeGqD8TW30/jLoJ73/EfNuNdun3aNEnFr4t3jhtbMFi2LcvjBXq9aygQ4K9UKYs4rR2Z6d6jpeSOIAipZwrFS/Xov0wGCpGeEUij1WNMJkhH1qIizhOEOpl9R9EAUOqBqY/LigedB42blIjz3KtCVDOFBqHLjATHuDmsRS5a+wfqyH9waGiSjWVJB8oWHMkQ5R2pqRxyQlmo9BwNAGIAREdrDEBA4kWNqgEKKkbbD7IqIS61DeNg6WfgD9xjjuEBXyYVS8+4MKcsl3zUbvF9+kGVokYRBh/QvYoxFsGLg/LoNpyZQUu3k2S7pim224W1qQ3glMaBVRUp4RC0ZCjy5mOS239azPojagEn45niY0W4MzV2I5NnAt+jHcoozAjebkGI4iPi4I0C5xzLUqE20oxPpk2R0UekvVeq1af7k0d3+tKMmT1hXrmnXTqlsN67712OpYXYtMf5u5PHN15lrFVD5WPlU+59SpY8WcS1ZpVL58B0u3zx8=</latexit>

Page 30: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs

30

Page 31: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs● So, if we want to say “Alex loves Jim” we would want λy.λx.loves(x,y)

● …but going in linear order, we have one arg to the left and one to the right.

● So, instead:● λX y.X(λx.loves(x,y))

31

Page 32: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs● So, if we want to say “Alex loves Jim” we would want λy.λx.loves(x,y)

● …but going in linear order, we have one arg to the left and one to the right.

32

7

24

224ॱ7)1 ᅶ4�4�%PI\ ॲ%PI\

:4

8:ॱ7)1 ᅶ]�ᅶ\�PSZIW�\�] ॲPSZIW

24

224ॱ7)1 ᅶ5�5�.MQ ॲ.MQ

Page 33: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs● TV(NP):● λy.λx.loves(x,y) (λQ.Q(Alex))

● λx.loves(x,λQ.Q(Alex))● ➜ Error! We can’t reduce Alex.

33

Page 34: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs● Instead: λX y.X(λx.loves(x,y))

34

7

24

224ॱ7)1 ᅶ4�4�%PI\ ॲ%PI\

:4

8:ॱ7)1 ᅶ< ]�<�ᅶ\�PSZIW�\�] ॲPSZIW

24

224ॱ7)1 ᅶ5�5�.MQ ॲ.MQ

Page 35: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Transitive Verbs● TV(NP):● λX y.X(λx.loves(x,y)) (λQ.Q(Jim))

● λy.(λQ.Q(Jim)(λx.loves(x,y))

● λy.(λx.loves(x,y)(Jim))

● λy.(loves(Jim,y))

● NP(VP):● λP.P(Alex)(λy.(loves(Jim,y))

● λy.(loves(Jim,y)(Alex)

● loves(Jim,Alex)

35

λX takes (λQ.Q(Jim))λQ takes (λx.loves(x,y))λx takes (Jim)

λP takes (λy.(loves(Jim,y))λy takes (Alex)

Page 36: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Converting to an Event● “y loves x,” Originally:● λX y.X(λx.loves(x,y))

● as a Neo-Davidsonian event:● λX y.X(λx.∃e love(e) ∧ lover(e,y) ∧ loved(e,x))

36

Page 37: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Quantifiers & Scope

37

Page 38: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

● Basic model● Neo-Davidsonian event-style model● Complex quantification

● Example: Every flight arrived

∀x Flight(x) ⇒ ∃e Arrived(e) ∧ ArrivedThing(e,x )

Semantic Analysis Example

38

7

24

(IX

IZIV]

2SQ

2SYR

JPMKLX

:4

:

EVVMZIH

Page 39: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

“Every flight arrived”● First intuitive approach:● Every flight = ∀x Flight(x)● “Everything is a flight”

● Instead, we want:● ∀x Flight(x) ⇒ Q(x) ● “if a thing is a flight, then Q”● Since Q isn’t available yet… Dummy predicate!● λQ.∀x Flight(x) ⇒ Q(x)

39

Page 40: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

“Every flight arrived”● “Every flight” is:● λQ.∀x Flight(x) ⇒ Q(x)

● …so what is the representation for “every”?● λP.λQ.∀x P(x) ⇒ Q(x)

40

Page 41: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

“A flight arrived”● We just need one item for truth value● So, start with ∃x…

● λP.λQ.∃x P(x)∧Q(x)

41

Page 42: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

“The flight arrived”● …yeah, this turns out to be tricky.

● We’ll save it for Wednesday.

● It’s not on the homework.

42

Page 43: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Creating Attachments

43

Det → ‘Every’ { λP.λQ.∀x P(x) ⇒ Q(x) }Noun → ‘flight’ { λx.Flight(x) }Verb → ‘arrived’ {λy.∃eArrived(e) ∧ ArrivedThing(e, y)}VP → Verb { Verb.sem }Nom → Noun { Noun.sem }

S → NP VP { NP.sem(VP.sem) }NP → Det Nom { Det.sem(Nom.sem) }

“Every flight arrived”

Page 44: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

44

7|ষ /্)ঽ ষ /্*~24|ফ/্)ৎ/্*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4

:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~EVVMZIH

Page 45: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

7|ষ /্)ঽ ষ /্*~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4

:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~EVVMZIH

45

NP → Det.sem(NP.sem)λP.λQ.∀xP(x) ⇒Q(x)(λy.Flight(y))

λQ.∀xλy.Flight(y)(x) ⇒Q(x)λQ.∀xFlight(x) ⇒Q(x)

7|ষ /্)ঽ ষ /্*~24|ফ/্)ষ /্*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4

:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~EVVMZIH

Page 46: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

46

7|ষ /্)ঽ ষ /্*~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~

EVVMZIH

Page 47: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

47

7|ষ /্)ঽ ষ /্*~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~

EVVMZIH

Page 48: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

7|ѭভ ৌৈυ)* ш Ѱন)* Ҕ ন υৎৈ)- *~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~

EVVMZIH

48

λQ.∀xFlight(x) ⇒Q(x)(λz.∃eArrived(e) ∧ ArrivedThing(e, z))

∀xFlight(x) ⇒λz.∃eArrived(e) ∧ ArrivedThing(e, z)(x)

∀xFlight(x) ⇒∃eArrived(e) ∧ ArrivedThing(e, x)

7|ষ /্)ঽ ষ /্*~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~

EVVMZIH

Page 49: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

49

7|ѭভ ৌৈυ)* ш Ѱন)* Ҕ ন υৎৈ)- *~24|ౠস/ѭভ ৌৈυ)* ш স)*~

(IX|ౠষ /ౠস/ѭষ )* ш স)*~)ZIV]

2SYR|ౠ/ভ ৌৈυ)*~JPMKLX

:4|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~:|ౠ/Ѱন)* Ҕ ন υৎৈ)- *~

EVVMZIH

Page 50: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

‘John Booked A Flight’

50

Det → ‘a’ { λP.λQ.∃x P(x) ∧ Q(x) }Det → ‘every’ { λP.λQ.∀x P(x) ⇒ Q(x) }NN → ‘flight’ {λx.Flight(x)}

NNP → ‘John’ {λX.X(John)}NP → NNP {NNP.sem}S → NP VP {NP.sem(VP.sem)}VP → Verb NP {Verb.sem(NP.sem)}Verb → ‘booked’ {λW.λz.W(∃eBooked(e) ∧ Booker(e,z) ∧ BookedThing(e,y))}

…we’ll step through this on Wednesday.

Page 51: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Strategy for Semantic Attachments● General approach:● Create complex lambda expressions with lexical items● Introduce quantifiers, predicates, terms● Percolate up semantics from child if non-branching● Apply semantics of one child to other through lambda● Combine elements, don’t introduce new ones

51

Page 52: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Semantics Learning● Zettlemoyer & Collins (2005, 2007, etc); Kate & Mooney (2007)

● Given semantic representation and corpus of parsed sentences● Learn mapping from sentences to logical form

● Similar approaches to:● Learning instructions from computer manuals● Game play via walkthrough descriptions● Robocup/Soccer play from commentary

52

Page 53: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Parsing with Semantics● Implement semantic analysis in parallel with syntactic parsing● Enabled by this rule-to-rule compositional approach

● Required modifications● Augment grammar rules with semantics field● Augment chart states with meaning expression● Incrementally compute semantics

53

Page 54: Computational Semantics - Shane · Computational Semantics LING 571 — Deep Processing for NLP October 28, 2019 1. Announcements HW5: your grammar should use rules and features that

Sidenote: Idioms● Not purely compositional● kick the bucket → die● tip of the iceberg → small part of the entirety

● Handling● Mix lexical items with constituents● Create idiom-specific construct for productivity● Allow non-compositional semantic attachments

● Extremely complex, e.g. metaphor

54