EmoPoker Tetsuo Yamabe

Distributed and Ubiquitous Computing Laboratory, Waseda University, Japan

Helsinki Institute for Information Technology, Finland

Why you lose in gambling?

Listen to your heart •  Control your emotional arousal

‒  Feedback to calm the heated brain ‒  Real-time sonification from measured biosignals

•  Heart beating sound for improving self-awareness

Biofeedback user study

User Study: Heartbeat Sonification fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

User Study: Heartbeat Sonification fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

User Study: Heartbeat Sonification fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions

EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

fEMG (facial electromyography) •  6 nodes to face

•  Currugator supercilii •  Zygomaticus major •  Masseter

•  Positive/negative emotions EDA (electrodermal activity) •  2 nodes to fingers •  Arousal level

RESP (respiration) •  1 node around chest

HR (Heart rate) •  1 node around chest •  Emotional arousal

EmoPoker system

Biosignal

Multimodal feedback (Shared/Individual)

RFID tags

Projector Emotional state (arousal) identification

Possible use cases 1.  Beginner support

‒  Self training with biofeedback ‒  Gaming guide with rule projection

2.  New gaming style with shared feedback ‒  Visualize players’ physiological information ‒  Handicap for playing with skillful players

3.  Research infrastructure for game analysis ‒  Game event logging for further analysis

Future work •  Analyze user study results •  EmoPoker AR development

EmoPoker in WIP presentation •  “Biofeedback Training with EmoPoker: Controlling Emotional Arousal for Better Poker Play”