progress on nl-soar, and introducing xnl-soar

39
Soar 2005 1 Progress on NL- Soar, and Introducing XNL- Soar Deryle Lonsdale, Jamison Cooper- Leavitt, and Warren Casbeer (and the rest of the BYU NL-Soar Research Group) BYU Linguistics [email protected]

Upload: redford

Post on 17-Jan-2016

91 views

Category:

Documents


0 download

DESCRIPTION

Progress on NL-Soar, and Introducing XNL-Soar. Deryle Lonsdale, Jamison Cooper-Leavitt, and Warren Casbeer ( and the rest of the BYU NL-Soar Research Group) BYU Linguistics [email protected]. NL-Soar?. What appears to be happening with NL-Soar support. NL-Soar?. > /dev/null. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 1

Progress on NL-Soar, and Introducing XNL-

Soar

Deryle Lonsdale, Jamison Cooper-Leavitt, and Warren Casbeer

(and the rest of the BYU NL-Soar Research Group)BYU [email protected]

Page 2: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 2

What appears to be happening with NL-Soar support

NL-Soar?

Page 3: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 3

What appears to be happening with NL-Soar support

> /dev/null

NL-Soar?

Page 4: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 4

What’s actually happening with NL-Soar support

Page 5: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 5

What’s actually happening with NL-Soar support

Page 6: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 6

What’s actually happening with NL-Soar support

Page 7: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 7

What’s actually happening with NL-Soar support

Page 8: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 8

NL-Soar developments (1) Discourse/robotic dialogue

Sphinx-4 speech input (working on lattice-based interface)

Festival text-to-speech output Two agents holding a (short) conversation Video produced showing round-trip speech-

based human/robot interaction NSF proposal submitted

Page 9: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 9

NL-Soar developments (2) NL generation

Decoupled from comprehension Can be driven from arbitrary LCS

Front-end GUI for creating LCS’s

Port to Soar 8.5.2 Some NLG chunking issues remain

Modeling of cognition in simultaneous interpretation (English-French)

Page 10: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 10

SI from a cognitive modeling perspective

Page 11: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 11

Parsing and the models

Page 12: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 12

Mapping operators

Page 13: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 13

NL-Soar generation operators

Page 14: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 14

Combining the capabilities

Page 15: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 15

Pipelining the processes

Page 16: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 16

Interleaving operator implemen-tations

Page 17: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 17

Interleaving the processes

Page 18: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 18

Predicted times by operator type

Page 19: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 19

Event timeline (one possibility)

Page 20: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 20

Sample alignment analysis

Page 21: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 21

Observed profile and timing assumptions

Page 22: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 22

First 1/3 of an interleaved scenario timeline

Acrobat Document

Page 23: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 23

LG-Soar developments

Predicate extraction in biomedical texts domain (www.clinicaltrials.gov)

Scaling up of Persian syntactic parser

Page 24: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 24

Unveiling XNL-Soar: Minimalism and

Incremental Parsing

Page 25: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 25

What are we trying to do?

As with NL-Soar, study how humans process language Lexical access Syntax/semantics

Apply the Soar architecture Operator-based cognitive modeling system Symbolic, rule-based, goal-directed agent Learning

Implement syntax in the Minimalist Program

Page 26: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 26

Why XNLS? (1) GB has been (largely) superseded by MP It’s a debatable development (e.g. recent

LinguistList discussion/flamefest) No large-scale MP parser implemented

yet No MP generator implemented yet Flavor seems right (even operators!)

I just re-read Rick's thesis, and I wondered if you've thought at all about applying "newer" grammars (e.g., Chomsky's "minimalist programme") in NL-Soar? (Chris Waterson, June 17, 2002)

Page 27: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 27

Why XNLS? (2) Incrementality of MP not explored Unknown whether MP viable for human

sentence processing (but claimed to be) Experience with another formalism

Syntax so far: GB, Link Grammar Semantics so far: Annotated models, LCS,

DRT Pedagogical aims

Page 28: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 28

After hearing “The scientist...”

Page 29: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 29

After hearing “The scientist gave...”

Page 30: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 30

After hearing “The scientist gave the linguist...”

Page 31: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 31

After hearing “The scientist gave the linguist a computer.”

Page 32: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 32

Projecting the structure

Page 33: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 33

Completed tree for “The scientist gave the linguist a computer.”

Page 34: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 34

Operator types (still to be done) (Attention) Lexical access (from NL-Soar, including

WordNet) Merge: link 2 pieces of syntactic structure

Constraints: subcategorization, (hierarchy of projections), (theta roles: PropBank?)

Move: moves a constituent (e.g. questions) Constraints: locality, features

(Snip)

Page 35: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 35

Operator types

Inherit from NL-Soar: Semantics: build pieces of conceptual

representation Discourse: select and instantiate discourse

plans for comprehension and generation Generation: generate text from semantic

representation

Page 36: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 36

Other system components

Assigners/receivers set? Parameterized decay-prone I/O buffer New grapher for MP parse trees

Page 37: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 37

Current status

Current XNLS system: about 40 rules(c.f. NL-Soar system: 3500 rules)

Intransitive sentences Basic sentences work (e.g. ‘zebras

sneezed’) WordNet gives us uninflected forms;

this is a problem for generation

Page 38: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 38

Expected payoffs

Crosslinguistic development Easier to parameterize due to features

Wider coverage of complex constructions Ditransitives, resultatives, causatives,

unaccusatives, etc. More workable platform for

implementing partial analyses from the literature

Page 39: Progress on NL-Soar, and Introducing XNL-Soar

Soar 2005 39

Conclusion

Coals Performance? MP not fully explored More highly

lexicalized, so more lexical resources required

XNLS entails the Guilt-Redemption cycle

Nuggets Better coverage (Engl.

& crosslinguistically) New start in Soar8 State-of-the-art syntax Puts us in the thick of

the battle Relevance to current

linguistic pedagogy