intermediary 2

8/6/2019 Intermediary 2

1/24

Final presentation:

Online communication

A theoreticalapproach onnonverbal communication of

virtualhumans in CAVEAutomatic VirtualEnvironments.

Emotions and interactionIntermediary 2

1


2/24

Final presentation:


Agenda

Actualstate of work

RQ1

Examples

2


3/24

Final presentation:


Where to?

3

(Final Fantasy, themovie)

Happiness?

Fear?

Surprise?


4/24

Final presentation:


State of work

RQ1: Howcanthesevenemotionsberepresentedfrom an anatomical

perspective at thelevel of thewholebody (proportions, intensity)?

4

Visual representationz

Face

Body

(Owndepiction)


5/24

Final presentation:


Definitions

Different perspectives on emotions

- e.g.Darwin, James, cognitivetheory

Componentialtheory of emotions (Scherer, 1982/2005)

>

5

Definitions. Components

Emotions vs. otherphenomena

Components Examples

Intentionality (-) Feelingcold(Leventhal&Scherer, 1987)

Cognitive/Evaluation (-) Reflexes

Somatic/motorcorelates (-) Attitudes(Lang, 1985; Scherer, 2005)

Neutral state Neutral state

Duration, intensity, target Moods

>100 definitions

(Kleinginna&Klienginna, 1981)

(adaptedfrom Moors, 2010)


6/24

Final presentation:


Definitions

Componentialtheory of emotions

Emotion isdefined as an episode of interrelated,

synchronizedchanges in thestates of all ormost of

thefiveorganismicsubsystems in response to theevaluation of an

externalorinternalstimulusevent as relevant to majorconcerns oftheorganism (Scherer, 1987/2001, in Scherer, 2005).

6

response

external



7/24

Final presentation:


Components

7


Scherer, 2005)


8/24

Final presentation:


Components

Internalvsexternaldimension

- focus on theexternalmanifestation

4 different generaltheoreticalperspectives

1. Darwinian

2. Jamesian

3. Cognitive4. Socialconstructivist (Cornelius, 2000)

8

Darwinian


Jamesian


9/24

Final presentation:


Basic emotions

Emotions as buildingblocks of emotional life (Moors, 2010)

Uniquephysiologicalresponsepattern(Ekman, Levenson&Friesen, 1983)

Uniquefacialresponsepattern(Ekman, 1984)

Emotion description

Common subjectivelanguage

Words such as happy, disgusted

Behaviouralterms as in psychology and ethology Hitting, biting, runningaway, growling, crying, vomiting(Plutchik, 1982)

9


10/24

Final presentation:


Characteristics

All facialemotionsareinvoluntary

Themuscularactioncanbevolutnarilydamnpened

7 classes of information:

Antecedents

Thoughts

Internalstate

Ametaphor

Theverynextintention of theexpresser

Whattheexpresserwantstheperceiver to do Emotion word(Ekman, 1993)

10

Basic emotions


11/24

Final presentation:


Plutchikspostulates

Emotionshave an evolutionaryhistory and haveevolvedvariousforms of

expression in different species

Despite different forms of expression of emotions in different species,

therearecertaincommonelements, orprototypepatterns, thatcanbeidentified.

Thereis a smallnumber of basic, primary, orprototypeemotions(Plutchik, n.a.)

11

Basic emotions


12/24

Final presentation:


Examples

Facialmuscularbasis

Action Units introduction

Examples of emotions

Body level

12


13/24

Final presentation:


Facialmuscularbasis

16 mimicalmuscles

Do not to contribute to themotion of thejoints

Positionedundertheskin and movingtheskin(Lippert, Herbold&Lippert-Burmester, 2010)

13

Examples

Expression muscles

Nucleus, Medical media


14/24

Final presentation:


Facialmuscularbasis

14

Names and locations of facialareas and parts

FACS, Ekman, Friesen & Hager, 2002, p. 3)

Examples


15/24

Final presentation:


Facialmuscularbasis

Theaction of themusclesdeterminescertainfacialmovements.

15

Examples

Example of terms to describetheapperancechanges in thelip and otherfeatures

FACS, Ekman, Friesen & Hager, 2002)


16/24

Final presentation:


Action Units - introduction

IntroducedbyEkman, Friesen & Hager in theFacialAction Coding System

Action Units (AUs) [...]

representthemuscularactivitythatproducesmomentarychanges in

facialappearance (Ekman, Friesen & Hager, 2002).

16

Examples

Upper face AUs Lower face AUs

Specificelements Specificunits

Eyebrows Up/Downs

Forehead Horizontals

Eyelids Obliques

Orbitals

Miscelanneous

FACS, Ekman, Friesen & Hager, 2002)


17/24

Final presentation:


Upper faceAUs

17

Examples

FA S, Ek an, Friesen ager, 2002)


18/24

Final presentation:


Upper faceAUs

18

Examples

FACS, Ekman, Friesen & Hager, 2002, p.21)


19/24

Final presentation:


Lower faceAUs

19

Examples

FACS, Ekman, Friesen & Hager, 2002, p. 103)


20/24

Final presentation:


Lower faceAUs

20

Examples

FACS, Ekman, Friesen & Hager, 2002, p.95)

Disgust


21/24

Final presentation:


Body level

Rule of thumb

World of warcraft 210 comandsfor emotions: 44 animated, 114 nonanimated(online source)

E.g.

Anger occurswhenachievement of goals arefrustrated.

Neck and/or face is red orflushed.

Baring of teeth and snarling.

Clenchedfists. Leaningforward and invasion of bodyspace.

Other aggressive bodylanguage.

Use of power bodylanguage. (online source)

21


22/24

Final presentation:


Design dimensions

22

SocialenvironmentReal time performance

Establishment of

appropriatesocialexpectations

Selfmotivatedinteraction

Regulation of interactions

Readablesocialcues

Interpretation of humans cues

Competentbehavior in a

complexworld

Believablebehavior


23/24

Final presentation:

Online communication 23

What

Perspectives

Definitions

Components

Models

Where

Face

Body

How

Valence

Intensity


24/24

Final presentation:


Design

Reconstructionfrom 2-D photoorvideo

sequence

(Magnenat-Thalmann&Thalmann, 2004, p. 20)

Reconstructionispossibleforthesimulation of

basicemotionsbutisnotenough.

24

intermediary 2

Documents