hci 2015 (9/10) affective factors
TRANSCRIPT
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
affective factors
Human-Computer Interaction
http
://lts5ww
w.ep
fl.ch/
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
“Designers think, so people can feel.”
Juan-Carlos Fernandez
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Affective aspects of interaction (Rogers, 2007)
expressivity
how the interface look & feel could affect the user?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Affective aspects of interaction (Rogers, 2007)
frustration
how we can detect and reduce it?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Affective aspects of interaction (Rogers, 2007)
persuasive technologies
how we can change the user attitude & behaviorby using the actual technologies?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotion is a reaction to events deemed relevantto the needs, goals, or concerns of an individual
Scott Brave & Clifford Nass, 2008
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotion represents the experience in UX
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotion encompasses physiological, affective, behavioral, and cognitive components
Scott Brave & Clifford Nass, 2008
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion in the cognitive context – Moore (2005)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as discrete categories
basic emotions (Paul Ekman et al., 1972):anger
disgustfear
happinesssadnesssurprise
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as discrete categories
additional emotions (Paul Ekman, 1990):amusement contempt contentment
embarrassment excitement guiltpride in achievement relief satisfaction
sensory pleasure shame
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
circumplex model (James Russell, 1980)
2 axes: arousal (calm↔excitement) + valence (pleasantness)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
circumplex model (James Russell, 1980)
used to test stimuli of emotion words, emotional facial expressions, and affective states
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
Plutchik’s wheel of emotions (Robert Plutchik, 1980)
8 primary bipolar emotions: joy vs. sadness; anger vs. fear;
trust vs. disgust; surprise vs. anticipation+
more advanced emotions
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Negative & forcefulAnger, Annoyance, Contempt,Disgust, Irritation
Negative & not in controlAnxiety, Embarrassment,Fear, Helplessness,Powerlessness, Worry
Negative thoughtsDoubt, Envy, Frustration,Guilt, Shame
Negative & passiveBoredom, Despair,Disappointment, Hurt, Sadness
AgitationShock, Stress, Tension
Positive & livelyAmusement, Delight, Elation,Excitement, Happiness,Joy, Pleasure
CaringAffection, Empathy,Friendliness, Love
Positive thoughtsCourage, Hope, Pride,Satisfaction, Trust
Quiet positiveCalm, Content, Relaxed,Relieved, Serene
ReactiveInterest, Politeness, Surprise
Douglas-Cowie et al. (2015)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
positive activation—negative activation (PANA)Watson and Tellegan, 1985
PAD (Pleasure, Arousal & Dominance) emotional state model – Mehrabian, 1997used to study nonverbal communication
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Lövheim cube of emotion (Hugo Lövheim, 2012)a theoretical model considering the relationships
between monoamine neurotransmitters (serotonin, dopamine, noradrenaline) and emotions
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
Parrotts’ classification (Gerrod Parrott, 2001)primary emotions: love, joy, surprise, anger, sadness, fear
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
Parrotts’ classification (Gerrod Parrott, 2001)primary emotions: love, joy, surprise, anger, sadness, fear
secondary emotions – e.g., love: affection, lust, longing
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
Emotions as multi-dimensional models
Parrotts’ classification (Gerrod Parrott, 2001)primary emotions: love, joy, surprise, anger, sadness, fear
secondary emotions – e.g., love: affection, lust, longing
tertiary emotions – e.g., affection: adoration, fondness, liking, attraction, caring, tenderness, compassion,…
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: classification
discussion
http://uniquelang.peiyinglin.net/visualization/Parrott_Model_b.png
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Modeling languages & vocabularies
Emotion Annotation and Representation LanguageHUMAINE Project, 2006
http://emotion-research.net/projects/humaine/earl/
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotion Markup Language (EmotionML) 1.0 W3C Recommendation, 2014
http://www.w3.org/TR/emotionml/
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Vocabularies for EmotionMLW3C Working Group Note, 2014
http://www.w3.org/TR/emotion-voc/
representing emotions in terms of scientifically valid descriptors:
categories, dimensions, appraisals, action tendencies
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
<emotionml xmlns="http://www.w3.org/2009/10/emotionml" xmlns:meta="..."><info><meta:name>Emotional state of the robot</meta:name></info>
<!-- Robot's current global state configuration: negative, active, powerless (using PAD model) --><emotion dimension-set="http://www.w3.org/TR/emotion-voc/xml#pad-dimensions">
<dimension name="pleasure" value="0.2"/><dimension name="arousal" value="0.8"/><dimension name="dominance" value="0.3"/>
</emotion>
<!-- Robot's action tendencies: want to recharge --><emotion action-tendency-set="http://human-robot-interfaction.info/custom/action/robot.xml">
<action-tendency name="charge-battery" value="0.9"/><action-tendency name="seek-shelter" value="0.7"/><action-tendency name="pickup-boxes" value="0.1"/>
</emotion>
<!-- Appraised value of incoming event: obstacle detected, appraised as novel and unpleasant --><emotion appraisal-set="http://www.w3.org/TR/emotion-voc/xml#scherer-appraisals">
<appraisal name="suddenness" value="0.8" confidence="0.4"/><appraisal name="intrinsic-pleasantness" value="0.2" confidence="0.8"/><reference role="triggeredBy" uri="file:scannerdata.xml#obstacle27"/>
</emotion>
<!-- Robot's planned facial gestures: will frown --><emotion category-set="http://human-robot-interfaction.info/custom/robot-emotions.xml"
expressed-through="face"><category name="frustration"/><reference role="expressedBy" uri="file:behavior-repository.xml#frown"/>
</emotion></emotionml>
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
neurological structure of emotion (LeDoux, 1996)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
limbic system – the “seat of emotion” – evaluatesthe need/goal relevance of its inputs
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
thalamus + limbic system mainly deal withprimitive (basic) emotions
e.g., startle-based fear, anger, sadness, joy, disgust
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotions that require more extensive cognitive(i.e., knowledge-based) processing are called secondary
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotions that require more extensive cognitive(i.e., knowledge-based) processing are called secondary
examples:frustration
pridesatisfaction
in the cortex
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
An emotion can result from a combination of boththalamic-limbic and cortex-limbic mechanisms
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
An emotion can result from a combination of boththalamic-limbic and cortex-limbic mechanisms
an event causing an initial fear reactioncan be later recognized as harmless
by more extensive, rational evaluation
examples: screensaver initialization, a warning message
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotions could be learned from the social environment
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
emotions are intentional
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
emotions are intentional
“they imply and involve relationshipswith a particular object”
Frijda, 1994
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
moods are not directed at any object in particular andare experienced as more diffuse, global, and general
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
moods are not directed at any object in particular andare experienced as more diffuse, global, and general
a person can be sad about something (an emotion)or generally depressed (a mood)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
from a functional point of view,emotions could determine the execution of task(s)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus mood
emotions cause or contribute to moods
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus sentiment
sentiments are not states of an individual,but assigned properties of an entity (person, object)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus sentiment
sentiments can persist indefinitely, by contrast withemotions (seconds) or moods (hours/days)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus sentiment
sentiments are often generalizations about a class ofobjects with a given recognizable property
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
emotion versus sentiment
sentiments are often generalizations about a class ofobjects with a given recognizable property
these generalizations must not necessarily be logical“I hate spreadsheet applications!”
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
How about the role of emotion in HCI?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Emotion has influences on
attentionmemory
performanceopinion (assessment)
Scott Brave & Clifford Nass, 2008
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Attention
an interface capable of detecting – or at least predicting –a user’s emotional or mood state could similarly assumean affect-regulation role, helping to guide attention away
from negative and toward more positive stimuli
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Memory
negative events, which tend to be highly arousing,are typically remembered better than positive events
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Memory
negative events, which tend to be highly arousing,are typically remembered better than positive events
avoid error messages
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Memory
emotionality “improves memory for central details,while undermining memory for background details”
Heuer & Reisberg, 1992; Parrott & Spackman, 2000
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
User performance
keeping a user happy may, therefore,not only affect satisfaction,
but may also lead to efficiency and creativity
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
the circumplex model in the context of user experience
P. Desmet & P. Hekkert, “Framework of Product Experience”, International Journal of Design, Vol. 1, No. 1 (2007)
http://www.ijdesign.org/ojs/index.php/IJDesign/article/view/66/15
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
User performance
negative example: objects that appear or move unexpectedly
– e.g., pop-ups, animations – and loud or sharp noises are likely to trigger startle-based fear
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Assessment
mood influences judgment and decision making
users in a good mood will likely judgeboth the interface and their work more positively,
regardless of any direct emotional effects
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:needs & goals
Maslow’s hierarchy of basic needs (1968)
physiological, safety/security, social, esteem,cognitive, aesthetic, self-actualization, transcendence
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:needs & goals
interfaces can also directly address a user’s basic needs
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:needs & goals
interfaces can also directly address a user’s basic needs
example (Fogg, 1998):establishing a trusting and safe relationship with users
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:needs & goals
interfaces can also directly address a user’s basic needs
example (Brave & Nass, 2006):educational software should address users’ emotional
needs, not only teaching the relevant content,but also ensuring users believe that they are learning
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:obstacles & control
Ellsworth (1994)
if user has the control over the software,the negative affective consequences are least important
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:social context – “agency”
(Ellsworth, 1994) & (Friedman & Kahn, 1997)
“This system failed to understand your command.” – blaming itself“The command was not understood.” – blaming no one“You did not speak clearly enough for your command
to be understood.” – blaming the user
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
blaming itself
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Causes:previous emotional state
repeated pleasurable affective states, therefore,become expected and thus gradually lose intensity
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
How emotion could be detected?
neurological response – via electroencephalogram (EEG) or magneto-resonance imaging (MRI)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
How emotion could be detected?
autonomous activity of the human organism
breathfacial expression
voice
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
categorization of facial responses to determine which emotions they express
Facial Action Coding System – FACS(Paul Ekman et al., 1978, 2002)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
interpreting micro-expressions (e.g., pushed up cheeks, dropping upper eyelids, eyebrows raised, nose wrinkling,…) – via FACS –
and body language to detect emotions
see also http://tinyurl.com/k47dhen
http://temasys.com.sg/vidyoedm22102013/
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
How emotion could be detected?
behavioral changes
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
6 + 1 emotions with universal facial gestures(N. Lazzaro, Why We Play: Affect and the Fun of Games, 2008)
Emotion Example
Frustration Figuring out how to get character off a roof in Tom Clancy’s Splinter Cell (usability issues that detract from the player experience)
Fear Falling into boiling lava, fast-moving projectiles aimed at the player in Doom
Surprise Using Myst’s linking books for the first time to transport toa new world
Sadness When the young magician Aerith, in Final Fantasy VII is murdered
Amusement When two Sims get married in The Sims, or rollingover and picking up sumo wrestlers in Katamari Damacy
Disgust Becoming a social outcast (social disgust)after losing the dancing challenge in Sid Meier’s Pirates
Curiosity Wanting to know what happens by driving the race trackthe wrong way in Project Gotham Racing 3
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Expressivity
induces an emotional state via UI elements:color, icons, sound, graphics,…
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Expressivity
lack of expressivity in communication at a textual levelemoticons + Emoji
:) :| >:-( 👀 👍 💆
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Expressivity
abbreviations could have emotional connotations
see leet speak
I 12 CU 2NITE
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
To stimulate emotions, products must haveattributed a personality based on appearance
and interaction means
Reeves & Nass, 1989
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
How to create emotions in a person?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
Ekman, 2004
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
a dialog window appears
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
thinking about previous message
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
rememberinglast game played
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
thinking about what happensnow on Web
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
discussing UI features with others
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
another person’s facial expression
(video-chat)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
another person’s review of a task
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
deleting others’ files
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
1. Auto appraisal2. Reflective appraisal3. Memory of an emotion4. Imagination5. Talking about6. Empathy or witnessing another’s emotion7. Instruction by others on how to feel8. Violation of social norm9. Making facial expression of an emotion
laughing after defeatin front of friends makes
it feel more positive
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
metaphors+
idioms
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
metaphors + idioms
“Metaphors create insight. But they also distort.They have strengths. But they also have limitations.”
Gareth Morgan
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
metaphors + idioms
use metaphors to convey and/or createmental associations
Dan Saffer, 2005
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
metaphors + idioms
proper metaphors used to denote UI objects/devices contribute to the personification of the software,
increasing the usability
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
icons
denote a relation between a visual representationand a certain concept
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
icons
denote a relation between a visual representationand a certain concept
based on similarity – e.g., an empty page = new fileanalogue – example: scissors = cut operation
arbitrary (based on an idiom) – e.g., X = close window
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
icons
most effective are the icons designed with respect to similarity between visual representation and the concept
Rogers, 2007
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
arbitrary applications
system programs
remark: the orientation is differentsee also GNOME Human Interface Guidelines
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
icons
beware of the cultural context
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
earcons
earcon = the aural equivalent of an icon
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
earcons
earcon = the aural equivalent of an icon
using sounds to denote a specific concept, event, or object
M. Blattner et al, “Earcons and Icons”, Human-Computer Interaction, Vol. 4 (1989)
http://www.daimi.au.dk/~dsound/DigitalAudio.dir/Papers/Earcons_and_Icons.pdf
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
earcons
design guidelines (Karen Kaushansky, 2012):choose the right type of audio
embed meaning in audio earconsdesign in context
consider the “non-use cases”decide between recorded prompts and text-to-speech
www.smashingmagazine.com/2012/09/14/guidelines-for-designing-with-audio/
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
earcons
examples:mobile phones, operating system sound schemes,
instant messaging, e-games, watches, 3D environments,…
commonly, not used in the Web context
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
tactons
communicate non-visual informationby using the tactile sense
“structured tactile messages” (Brewster & Brown, 2004)http://eprints.gla.ac.uk/3443/1/tactons_aussi.pdf
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
tactons
communicate non-visual informationby using the tactile sense
a common example: coded tactile representations (Braille code)
text informationnon-visual form
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
tactons
context:wearable computing
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
tactons
examples:haptic I/O devices – e.g., sensors
case study:L. Brown, Tactons: Structured Vibrotactile Messages for Non-Visual
Information Display, Microsoft Research (2006)http://research.microsoft.com/apps/video/default.aspx?id=135935
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutionsabstract
representationcognitive
dimensionusage
icon visual conveying information
earcon audio attention
tacton haptic appeal to a known touch
emoticon emotion conveying an emotional state
gesticon dynamic indicating a state change
kineticon dynamic state change, progress
some are more suitable to (visually) impaired users
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
persuasive computing
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Positive psychology
hedonomics
focusing on the pleasant or enjoyable aspects of HCI
Hancock, Pepe & Murphy, 2005
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
interactive computational systems deliberately designed to change human attitudes and behaviors
B. J. Fogg (2003)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
interactive computational systems deliberately designed to change human attitudes and behaviors
captology(computers as persuasive technologies)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
persuasion in the context (Maria Miceli et al., 2011):accidental vs. intentional
communicative vs. non-communicativecoercive vs. non-coercive
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
typical examples:advertisement techniques,
warning boxes, reminders, prompts,personalized messages, recommendations,…
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
case studies:games with social impact – for people with special needs
applications helping the cure of certain phobiasinfant simulators
virtual pets – to diminish “bad habits” of children…
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion
Herman the bug (Lester et al., 1997)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
interesting uses in the HCI context:get understanding of user behaviour
get understanding of cognitive factors
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
multimodal factors (Guerini, 2011):embodied conversational agents – ECAs
kinetic typographymusic
use of images
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Persuasive (seductive) technologies
multimodal factors (Guerini, 2011):embodied conversational agents – ECAs
kinetic typographymusic
use of images
virtual characters
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Virtual characters
avatars – artificial (visual) representations of people
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Virtual characters
user-facing agents
showing simulated human behavior(knowledge, inferring, choices,…artificial intelligence)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Virtual characters
autonomy no human interventionreactivity takes stimuli from environmentproactivity takes initiative to actcollaboration able to collaborate with other agents
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Virtual characters
autonomy no human interventionreactivity takes stimuli from environmentproactivity takes initiative to actcollaboration able to collaborate with other agents
multi-agent systems
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutionsintelligent virtual agents having human appearance and the capability to teach
foreign language vocabulary
M. Macedonia et al., “Intelligent virtual agents as language trainers facilitate multilingualism”, Frontiers in Psychology (2014)
http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00295/full
case study
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
The use of anthropomorphism
adding human qualities to virtual things
reducing the user’s anxiety regarding computers(computer and/or Internet phobia)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
The use of anthropomorphism
example:“Hi, Florentina, welcome back! What we learnt last time?
Oh, yes, that experiment on Web navigation…Let’s repeat it!”
versus“User 33, start the experiment 7!”
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
The use of anthropomorphism
warnings:user might feel inferior, anxious, or stupid
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Affective interaction
goal:
a program/device able to register emotions and other stimuli and to generate a correct response
to these stimuli
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Affective interaction
input:
sensors measuring (or learning) the user affective state
facial expression, gestures,heartbeat rate, blood pressure, transpiration, speech
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Affective interaction
output:
expressing empathy using computational approaches
“intelligently” / “emotionally” reacting on a situation
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
iCAT – a robot hardware platform using a setof logical rules to convey emotional states (Philips, 2005)
context: human-robot interaction (HRI)
www.research.philips.com/technologies/projects/robotics/
case study
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Aspect of interest: computational humour
humour is a powerful generator of emotions
theories of humour applied in computer science
details in P. Petta et al. (Eds.), Emotion-Oriented Systems, Springer, 2011
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Aspect of interest: computational humour
humour generation
building computational models to generate humourous content (text)
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: design solutions
Aspect of interest: computational humour
humour recognition
identifying humourin natural language and/or human behaviour
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: abuse on software
Humans could have an offensive behaviorregarding the digital entities
www.agentabuse.org
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: abuse on software
Humans could have an offensive behaviorregarding the digital entities
example (Tatsuya Nomura, 2005):
impolite behavior of the patients,when they discovered that the therapist is a virtual agent
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: abuse on software
Humans could have an offensive behaviorregarding the digital entities
example (Antonella De Angeli & Rollo Carpenter, 2005):
“injuries” on conversational – e.g., IRC – robots:“liar”, “stupid”, “dumb” software
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: abuse on software
Humans could have an offensive behaviorregarding the digital entities
experiment (Christoph Bartneck et al., 2005):
humans tend to hurt more easily robots/devicesthan people
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: abuse on software
User: What is your address?
Jabberwacky: I don't think I'll tell you.
You'd kill me if I told you. Wouldn't you!
User: Yes I would.
Jabberwacky: What is your favourite food?
User: I WILL KILL YOU! I WILL HUNT YOU DOWN!!!
Jabberwacky: Please don't... I really have to leave.
User: I WILL KILL YOU!
Jabberwacky: Good.
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: open question
With which emotionshould HCI designers be most concerned?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: open question
When and how should interfaces attemptto directly address users’ emotions and
basic needs (versus application-specific goals)?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: open question
When and how should users be informedthat their affective states are being monitored
and adapted to?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
Emotion: open question
How does emotion play outin computer-mediated communication?
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
affective factorsemotions, moods, sentiments
persuasive technologies
“Conclusion”
Master on Software Engineering :: Human-Computer Interaction
Dr. Sabin-Corneliu Buraga – www.purl.org/net/busaco
next lecture: ubiquitous computing