chapter 8. situated dialogue processing for human-robot interaction greert-jan m. kruijff, pierre...
TRANSCRIPT
![Page 1: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/1.jpg)
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction
Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender, Ivana Kruijff-Korbayova, and Nick Hawes
Kim, Jong In
Oct,2, 2015
College of
Interdisciplinary Program in Cognitive Science
Seoul National University
![Page 2: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/2.jpg)
2
Contents8.4. Talking about What You Can See(Small Scale)
What you see and what you mean What you All know, and What you are Saying Using What you see to Rank Alternative Interpretations Referring to What you see
8.5. Talking about places You can Visit(Large Scale) Talking about places Representing Places to Talk about Referring to Elsewhere Determining the Appropriate contrast set Understanding References to Elsewhere
8.6 Talking about things you can do
8.7. Conclusions
![Page 3: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/3.jpg)
3
Overview
![Page 4: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/4.jpg)
4
Talking about What you Can see Talking about What You Can See
1) A small-scale space or closed context
2) Perception – Symbol
3) Grounding – determines the meaning of the linguistic symbol 4) Old information(common ground) vs New information
(Guide Learning)
“The red mug is Big”
![Page 5: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/5.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 5
Guide Learning
![Page 6: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/6.jpg)
6
Translation of Spatial expressions.
Talking about What you Can see
![Page 7: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/7.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 7
Ontology
![Page 8: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/8.jpg)
Talking about What you Can see What you see and What you mean
1) Semantic – Ontologically Sorted
2) Delimitation , Quantification (Grounding)
3) Dealing with instances, update
4) Evaluation whether the new information is added
Motivation Working memory Binding Working memory
• Prompt to take action
• Intentional contents
• Operating modality
• Visuo-Spatial information
• Indexical content
![Page 9: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/9.jpg)
Talking about What you Can see Using What you see to Rank Alternative Interpretations
<The discriminative model>:assign a score to each possible semantic interpretation of a given spoken input
1) Linguistic feature
-The acoustic feature (ASR score<auto speech recognition>)
-The syntactic Level (Parsing)
-The semantic Level (Logical form)1) Contextual Feature
-Situated context(the objects in the visual scene)
-Dialogue context(previously referred entities in the dialogue history)
2) Current data set -195 individual utterance -Check exact match, partial match, error match
-Depending on Grammar relaxation, Activated feature
![Page 10: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/10.jpg)
Talking about What you Can see Using What you see to Rank Alternative Interpretations
![Page 11: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/11.jpg)
Talking about What you Can see
1) Indexical Ambiguity
2) “Put the ball near the mug to the left of the box”
<Disambiguation effects – Visuo-Spatial Scene provides support>
Using What you see to figure out what is meant
![Page 12: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/12.jpg)
Talking about What you Can see
1) Robot could refer to objects and the spatial rela-tions
2) Q1. If the number of Object is too much?
3) Problem) Inter-object Spatial Relation
4) Define the set of objects –function as landmark –
Referring to What you see(small scale)
![Page 13: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/13.jpg)
Talking about Places you can visit Talking about Places(Large Scale)
1) How people tend to employ many different strategies to introduce new location to Robot?
(“Space which cannot be perceived at once”)
2) How human presents a familiar indoor environment to a robot(Guided tour scenario)
-Human guided the robot around and names and objects
![Page 14: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/14.jpg)
Talking about Places you can visit Talking about Places(Large Scale)
Strategies to introduce new locations.1) Naming whole rooms (“this it the kitchen” –referring to the room itself)2) Naming specific locations (“this is the kitchen” –referring to cooking area)3) Naming specific locations by the objects (“this is the coffee machine”)
->Personalizing the representation of the environment that robotConstructs)
![Page 15: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/15.jpg)
15
Multi-Layer Spatial Map <Metric Map>1)The first layer of SLAMSLAM: Simultaneous localization and mapping
<Topological map>1) Abstract form.2) Topological segmentation is repre-sented by the coloring of the nodes3) In order to determine category of an area, we take a majority vote approach of the classification
<Conceptual map>1) On the highest level of Abstraction2) Spatial unit(e.g. room) ->human concept(e.g. kitchen)
![Page 16: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/16.jpg)
16
Overview
Conceptual Map is represented as a Description logic ontology
-conceptual taxonomy(hand-written commonsense ontololgy
representing various aspects of indoor envi-ronment)
-a storage of instances(T-Box and A-Box of a Description Logics rea-soning framework)
![Page 17: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/17.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 17
SLAM – Metric map
Videohttps://www.youtube.com/watch?v=mQQL8pmztb4
![Page 18: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/18.jpg)
Talking about Places you can visit Referring to Elsewhere
1. “the location at position(X=35.56, Y=-3.92,
2. “the mug left of the plate right of the mug left of the plate”
3. “Peter’s office no.200 at the end of the corridor on the third floor of the Acme Corp. building 3 in the Acme Corp. Building complex, 47 Ever-green Terrace, Calisota, Planet Earth”
1. “the kitchen around the corner”2. “the red mug left of the china
plate”3. “Peter’s office”4. “the large hall on the first
floor”
Communicate goal issue.1) Robot are good at measuring exact distances, but humans are not2) Infinite recursion3) The robot might have a vast knowledge but have to separate uniquely the referent from all enti-ties.
![Page 19: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/19.jpg)
Talking about Places you can visit
Issue1) Determining proper contrast Set
1) If contrast set is too much?
2) if contrast set is too little?
Issue2) Robot viewpoints?
1) Exact measure or Topological Ab-straction
-The context for a dialogue situated in large-scale space can be determined on the basis of a topological represen-tation like human
Determining the Appropriate Contrast set
![Page 20: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/20.jpg)
8.6 Talking about things you can do
1) Action Planning: the goal of action planning is to choose actions and ordering rela-tions among these actions to achieve a suitable location and plans for executing the action
-Action planning and Dialogue processing should interact.
2) Event nucleus
-it models the action as an event with temporal and casual dimension
3) Indexicality, intentionality, and information structure
“First take the mug, and put it in near the plate”
Things you can do
![Page 21: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/21.jpg)
Small Scale Guide Tour -Ambiguity, Semantic Grounding -Motivation working memory -Binding working memory
Large Scale Guide Tour -Multi-Layered Spatial mapping -topological map, conceptual map
Action -Action planning,
Summary
![Page 22: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/22.jpg)
Debate issue
1. How to solve ambiguity problem in Situated Dia-logue
.
2. Drone and Robot cooperation
![Page 23: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/23.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 23
Q & A
![Page 24: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/24.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 24
Appendix 질문 대비
![Page 25: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/25.jpg)
APPENDIX( 질문 대비 )
![Page 26: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/26.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 26
Ambiguity
![Page 27: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/27.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 27
Human Augmented Mapping
![Page 28: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/28.jpg)
28
Ambiguity
![Page 29: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/29.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 29
Topological Partitioning
Solution> Topological Partitioning
-Large red stars indicate doorways and the different coloring of the nodes depicts the topological parti-tioning of the environment
![Page 30: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/30.jpg)
30
Ambiguity
![Page 31: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/31.jpg)
31
CCG grammar
![Page 32: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/32.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 32
Clarification
![Page 33: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/33.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 33
Clarification
![Page 34: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/34.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 34
Clarification
![Page 35: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/35.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 35
Event nucleus
![Page 36: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/36.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 36
Generation of Referring Expressions
![Page 37: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/37.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 37
Basic Incremental Algorithm for GRE
![Page 38: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/38.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 38
SLAM
![Page 39: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/39.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 39
Conceptual map
![Page 40: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/40.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 40
Multi-Layered Conceptual Spatial MAP
![Page 41: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/41.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 41
![Page 42: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/42.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 42
![Page 43: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/43.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 43
Ontolgoy
![Page 44: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/44.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 44
Semantic Ontology
![Page 45: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/45.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 45
Parsing
![Page 46: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/46.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 46
Parsing
![Page 47: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/47.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 47
Simple Parse
![Page 48: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/48.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 48
Parsing
![Page 49: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/49.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 49
Parse
![Page 50: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/50.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 50
Referential Anchoring
![Page 51: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/51.jpg)
51
![Page 52: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/52.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 52
Temporal-Causal Sequence
![Page 53: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/53.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 53
Temporal
![Page 54: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/54.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 54
Robotic Platform
![Page 55: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/55.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 55
Guide Learning
![Page 56: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/56.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 56
![Page 57: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/57.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 57
Guided Learning
![Page 58: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/58.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 58
![Page 59: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/59.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 59
Topology
![Page 60: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/60.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 60
Multi-Layered Conceptual Spatial Map
![Page 61: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/61.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 61
Perceptual Control System
![Page 62: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/62.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 62
Robotic Architecture
![Page 63: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/63.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 63
Spatial Interpretation
![Page 64: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/64.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 64
![Page 65: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/65.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 65
T-box
![Page 66: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/66.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 66
Delimitation
![Page 67: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/67.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 67
Human Augmented Mapping
![Page 68: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/68.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 68
Proxy- Reasoner
![Page 69: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/69.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 69
Wizard of Oz experiment, /nominal constructs
![Page 70: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/70.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 70
Indexicality
![Page 71: Chapter 8. Situated Dialogue Processing for Human-Robot Interaction Greert-Jan M. Kruijff, Pierre Lison, Trevor Benjamin, Henril Jacobsson, Hendrik Zender,](https://reader035.vdocuments.net/reader035/viewer/2022062309/5697bfda1a28abf838cb04c4/html5/thumbnails/71.jpg)
© 2015, SNU CSE Biointelligence Lab., http://bi.snu.ac.kr 71
Intentionality