angelo cafaro 1 and lorenzo scagnetti 2 1 [email protected] center for analysis and design of...
TRANSCRIPT
A Simple Embodied Dialog System NLP Final Project
Angelo Cafaro1 and Lorenzo Scagnetti2
1 [email protected] for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University Iceland
2 [email protected] of Camerino ItalyA Simple Embodied Dialog SystemNLP Final Project
Scenario and GoalsScenario:People playing a Card Game in a bar:Briscola: Italian card game;Conversation during the game: chat;
Goals Selection of Non-Verbal Behavior chatting:Set of Gestures;Gazes;
Approach (cont.)
Approach (2 cont.)Situational Context:Discourse Model with Simple coreference resolution:New and Evoked Discourse Entities;Knowledge Base (objects and characters in the scene);
Steps:Tokenization;Pos Tagging (Penn TreeBank PoS tagset);Syntax Analysis (Noun Phrases, Verb Phrases and Pr eposition Phrases);Coreference Resolution (Markers NEW and EVOKED Discourse Entities);Information Structure: Rhematic and Thematic Part;Heuristics BML Output.
Approach (3)Game Events:People in a particular context (card game):Turn Begin, Card Played, Match Rounds, etcVideo, Observations and Annotation:
DemoJoint Project with Virtual Environments course.We apologizebut we still have Work in Progress!!!
Future DirectionsImproved Discourse Model:Gender and Numnber: Advanced Pos Tag set;
New Heuristics;
Selection of additional non-verbal behaviors:Facial Expressions;Eyebrowns;Postures;Questions???Thanks for listening!!!
Angelo Cafaro1 and Lorenzo Scagnetti2
1 [email protected] for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University Iceland
2 [email protected] of Camerino Italy