using kinetic typography to convey emotion in text-based interpersonal communication joonhwan lee,...

17
Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi For lizzi, and Scott E. Hudson Carnegie Mellon University ACM DIS 2006 (Designing Interactive Systems)

Upload: audrey-ruddick

Post on 16-Dec-2015

226 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Using Kinetic Typography to Convey Emotion

in Text-Based Interpersonal Communication

Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson

Carnegie Mellon University

ACM DIS 2006 (Designing Interactive Systems)

Page 2: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Introduction

Expressing one’s emotional state has become an important issue, particularly in interpersonal text-based communication.

Page 3: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Emoticons( 情緒圖示 ) 由 emotion ( 情緒 ) 和 icon ( 圖像 , 圖

標 ) 拼綴而成 , 笑面譜 , 情緒臉譜 ( 由標點符號組成用以表達情感的符號 , 通常出現在電子郵件或網路聊天中 )

Page 4: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Emoticons

Emoticons can depict one’s emotional state through their shape, and can therefore help readers to understand the emotional intention of the message

EX: 沒圖示 有圖示 某學長 : 畜牲 某學長 : 畜牲 某學弟 : ??? 某學弟 : 禽獸

Page 5: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Emoticons

The first generation of emoticons was generated using ASCII text.

Several combinations of characters were used to create a variety of emoticons.

ASCII ART->Emoticons

Page 6: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Emoticons

Emoticons cannot depict the tone of voice or intensity of emotion of the speaker.

EX:某學長 : 別浪費我時間某學弟 : 怎 .. 麼了 ( 戰戰兢兢 )某學長 : 快點上台我要聽你報告

Page 7: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Kinetic Typography text that changes in color, size, or position over tim

e consistent and repeatable manner to convey em

otion Examples

loud, urgent voice of a speaker the tone of a calmer utterance

Page 8: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Examples

STOP

Page 9: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Questions

viewers interpret kinetic effects in the ways that designers intended?

Page 10: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Design emotion We asked three expert kinetic typogra

phy designers to generate kinetic typography expressions

Each designer made two examples for each emotion, using a neutral sentence, “I am fine”

Happy, Joyous, Angry and Sad. 3*4*2 = 24 examples

Page 11: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

examples

Page 12: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

Participants and Procedure 66 subjects participated, 20

female and 46 male, ranging in age from 17 to 67

They were asked to rate each movie using an emotional scale with the dimensions of Mood and Energy

Page 13: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

RESULTS AND DISCUSSION(1)

participants gave Angry and Sad lower mood ratings and Happy and Joyous higher mood ratings

Page 14: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

RESULTS AND DISCUSSION(2)

Participants ranked Angry as the highest energy rating,followed by Happy, Joyous, and finally Sad.

Page 15: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie

RESULTS AND DISCUSSION(3) ANOVA analyses evaluating the within-

subjects effects of emotion type on Mood and Energy.

These results indicate that text used in the movies was neutral, and did not express any form of emotion, we can assume that participants were responding similarly to the emotion expressed in each kinetic effect.

Page 16: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie
Page 17: Using Kinetic Typography to Convey Emotion in Text-Based Interpersonal Communication Joonhwan Lee, Soojin Jun, Jodi Forlizzi, and Scott E. Hudson Carnegie