applications of emotions recognition

Applications ofEmotions Recognition

Francesco Bonadimanfranzbona@hotmail.it

30 January 2015Computer-Supported Interaction

Emotion Recognition

EEG + Brain Computer Interfaces

upload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg

2

Emotion Recognition

EEG + Brain Computer Interfaces

ECG + Cardiovascular signals

atrialfibrillation.org.ukupload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg

2

Emotion Recognition

EEG + Brain Computer Interfaces

ECG + Cardiovascular signals

Electrodermal activity

ycanaustralia.comatrialfibrillation.org.ukupload.wikimedia.org/wikipedia/commons/b/bf/EEG_cap.jpg

2

Emotion Recognition

Speech + Voice intonation

www-03.ibm.com

3

Emotion Recognition

Speech + Voice intonation

Facial expressions

chilloutpoint.comwww-03.ibm.com

3

Emotion Recognition

Speech + Voice intonation

Facial expressions

Body language

chilloutpoint.comwww-03.ibm.comwinwithvictory.com

3

Human vs. Human

arabianindustry.com

4

Human vs. Machine

orbitmedia.com

5

Human vs. Machine

orbitmedia.com

EMOTIONS?

5

davenussbaum.com

6

Applications of Emotion Recognition

Medicine E-learning Monitoring

Entertainment Law Marketing

7

1. Medicine

baysidecarecenter.com

Rehabilitation →help monitoring

8

1. Medicine

baysidecarecenter.com iavrpt.org

Companion →enhance realism

8

1. Medicine

baysidecarecenter.com iavrpt.org degreequery.com

Counseling → client’s emotional state

8

1. Medicine

baysidecarecenter.com iavrpt.org degreequery.com masainternational.com

Health care → patients’ feelings about treatment

8

Autism

- struggling to interpret expressions

mychildwithoutlimits.org

9

Autism

- struggling to interpret expressions

- game with this same purpose

mychildwithoutlimits.org

9

Autism

- struggling to interpret expressions

- game with this same purpose

- develop a system → therapy

mychildwithoutlimits.org

9

http://youtu.be/Suc5B79qjfE?t=40s

10

Music Therapy

- help patients deal with stress, anxiety and depression

musictherapy.orggaryradler.com

11

Music Therapy

- help patients deal with stress, anxiety and depression

- positive effects on Alzheimer

musictherapy.orggaryradler.com

11

Music Therapy

- help patients deal with stress, anxiety and depression

- positive effects on Alzheimer

- EEG = real-timemusictherapy.orggaryradler.com

11

2. E-learning

- adjust the presentation style of an online tutor

educed.org

12

2. E-learning

- adjust the presentation style of an online tutor

- detect the state of the learner

educed.org

12

Tutoring system

- positive attitude to maximize learning

skypeteachingjobs.com

13

Tutoring system

- positive attitude to maximize learning

- more interactive and effective

skypeteachingjobs.com

13

Tutoring system

- positive attitude to maximize learning

- more interactive and effective

- provide feedback and guide towards a solution

skypeteachingjobs.com

13

3. Monitoring

sbtjapan.com

Car driver →detect state and alert other cars

14

3. Monitoring

sbtjapan.com manage.grabweb.net

Agent →warning before angry email + invite to calm down

14

3. Monitoring

sbtjapan.com manage.grabweb.net s3.amazonaws.com

ATM not dispensing money when scared

14

Call-center system

- recognize voices

lovemoneylaw.com

15

Call-center system

- recognize voices

- detect anger in speech

lovemoneylaw.com

15

Call-center system

- recognize voices

- detect anger in speech

- prioritize angry calls

lovemoneylaw.com

15

Remote Love

- globalization →mobility

weknowmemes.com

16

Remote Love

- globalization →mobility

- long distance relations

weknowmemes.com

16

Remote Love

- globalization →mobility

- long distance relations

- recognize partner’s trueemotional state

weknowmemes.com

16

Remote Love

- globalization →mobility

- long distance relations

- recognize partner’s trueemotional state

- heartbeat pulsing rings

weknowmemes.com

16

Remote Love

- globalization →mobility

- long distance relations

- recognize partner’s trueemotional state

- heartbeat pulsing rings

- phone detecting affectionweknowmemes.com

16

4. Entertainment

i.ytimg.com

17

jonlieffmd.com

- Recognize mood and emotions of the users

Music Player18

jonlieffmd.com

- Recognize mood and emotions of the users

- satisfy needs

Music Player18

5. Lawdeeper discovery of depositions

cdn2.hubspot.net

19

6. Marketing

- impact of ads

redorbit.com

20

6. Marketing

- impact of ads

- attention and engagement

redorbit.com

20

6. Marketing

- impact of ads

- attention and engagement

- emotion vital in purchasing decisions

redorbit.com

20

6. Marketing

- impact of ads

- attention and engagement

- emotion vital in purchasing decisions→ improve sales

redorbit.com

20

References1. Yoon W.-J. , Park K.-S., A Study of Emotion Recognition and Its Applications, 4th International Conference,

MDAI, Springer, 2007

2. Yoon W.-J. , Park K.-S., A study of speech emotion recognition and its application to mobile services, 4th

International Conference, UIC, Springer, 2007

3. Rached T.S., Perkusich A., Emotion Recognition Based on Brain-Computer Interface Systems, Brain-Computer

Interface Systems, 2013

4. Ntombikayise B., Robinson P., Multimodal Affect Recognition in Intelligent Tutoring Systems, Proceedings of

the 4th international conference on Affective computing and intelligent interaction, 2011

5. Petrushin V., Emotion recognition in speech signal: experimental study, development, and application, ICSLP,

2000

6. Liu Y., Sourina O., Nguyen M.K., Real-time EEG-based Emotion Recognition and its Applications, Special Issue

on Cyberworlds, 2011

7. ExtremeTech:extremetech.com/extreme/189259-real-time-emotion-detection-with-google-glass-an-

awesome-creepy-taste-of-the-future-of-wearable-computers

8. Speech emotion recognition: emospeech.net

9. Emotient, leading authority on emotion detection and sentiment analysis technologies: emotient.com

10. Wikipedia: en.wikipedia.org/wiki/Affective_computing

21

22