emotion analysis in natural language · 2019. 10. 8. · pros cons • more universal • can...
TRANSCRIPT
![Page 1: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/1.jpg)
Emotion Analysis in Natural Language
Pearl Pu 1
![Page 2: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/2.jpg)
1What and why Emotion?
![Page 3: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/3.jpg)
The Distinguished Speakers Program is made possible by
For additional information, please visit http://dsp.acm.org/3
![Page 4: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/4.jpg)
About ACM
▪ ACM, the Association for Computing Machinery (www.acm.org), is the premier global community of computing professionals and students with nearly 100,000 members in more than 170 countries interacting with more than 2 million computing professionals worldwide.
▪ OUR MISSION: We help computing professionals to be their best and most creative. We connect them to their peers, to what the latest developments, and inspire them to advance the profession and make a positive impact on society.
▪ OUR VISION: We see a world where computing helps solve tomorrow’s problems – where we use our knowledge and skills to advance the computing profession and make a positive social impact throughout the world.
4
![Page 5: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/5.jpg)
What is Emotion?
• emotion is a reaction to events
• emotion leads to changes in multiple organismic subsystems
5
Emotion is the conduit that connects our mind to our body
![Page 6: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/6.jpg)
6
https://www.youtube.com/watch?v=9J1lXEXFHog
![Page 7: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/7.jpg)
Why Emotion Matters?
7
![Page 8: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/8.jpg)
8
My son in law booked us in here and we were very pleased with his choice. Check in was smooth and easy. The hotel is smart, trendy and very well situated for exploring the city. We went into town virtually every day and most of the town is walkable even to the castle on the far side of town.. Our rooms were very large with a spacious bathroom complete with hair dryer. Basic soap and shampoo are provided. The wardrobe space is a bit limited but we managed. The room was serviced daily and was kept very clean. There is a fridge stocked with the hotels items, all chargeable. There is no facility in the room to make tea or coffee but we always pack a mini kettle and put some milk in the fridge. We had breakfast only which was OK but at the peak time on the weekends, 8.30 ish it was a bit chaotic and they could do with a second coffee maker. All in all I would recommend this hotel and would stay there again.
![Page 9: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/9.jpg)
9
My son in law booked us in here and we were very pleased with his choice. Check in was smooth and easy. The hotel is smart, trendy and very well situated for exploring the city. We went into town virtually every day and most of the town is walkable even to the castle on the far side of town.. Our rooms were very large with a spacious bathroom complete with hair dryer. The bed is comfortable and so are the pillows. The wardrobe space is a bit limited but we managed. The room was serviced daily and was kept very clean. There is a fridge stocked with the hotels items, all chargeable. There is no facility in the room to make tea or coffee but we always pack a mini kettle and put some milk in the fridge. We had breakfast only which was OK but at the peak time on the weekends, 8.30 ish it was a bit chaotic and they could do with a second coffee maker. All in all I would recommend this hotel and would stay there again.
![Page 10: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/10.jpg)
How to model emotions?
Dimensional Categorical
valence
arousal
dominance
Happiness
SadnessIrritation
Interest
FearAnxiety
Pros
Cons
• More universal • Can describe any experience
• Difficult to express states linguistically
Pros
Cons• No agreement on the unique set
• Provides linguistic labels • Allows variety of applications
10
![Page 11: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/11.jpg)
Categorical - Ekman
Ekman, An argument for basic emotions, 1992
Happy
Sad
Fear
Anger
Surprise
Disgust
11
![Page 12: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/12.jpg)
12
![Page 13: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/13.jpg)
Geneva Emotion Wheel
GEW, adapted version 2.0PositiveNegative
High Control
Low Control
13
![Page 14: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/14.jpg)
How to model emotions?
Dimensional Categorical
valence
arousal
dominance
Happiness
SadnessIrritation
Interest
FearAnxiety
Pros
Cons
• More universal • Can describe any experience
• Difficult to express states linguistically
Pros
Cons• No agreement on the unique set
• Provides linguistic labels • Allows variety of applications
14
![Page 15: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/15.jpg)
How to Detect Emotions?
facial expressionvoice
galvanic skin response (GSR)skin temperature
electrocardiogram (ECG)electroencephalogram (EEG)
gesturetext
15
![Page 16: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/16.jpg)
Emotion Recognition in Natural Language
16
PrideAs a mother I know the pride in one’s child, as an American I know the pride in one’s country. I feel a little both for you.
Which emotions are expressed?
![Page 17: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/17.jpg)
Reference
17
Ekman, An argument for basic emotions, 1992. Cognition & Emotion. 6 (3): 169–200.
Klaus R Scherer. What are emotions? and how can they be measured? Social science information, 44(4):695–729, 2005.
Plutchik, The Nature of Emotions, 2002. American Scientist. 89 (4): 349.
Brave & Nass, Agents that care: Investigating the effects of orientation of emotion exhibited by an embodied computer agent, 2003.
The emotional life of your brain: how its unique patterns affect the way you think, feel, and live - and how you can change them. By Richard Davidson and Sharon Begley, 2002.
Thinking, fast and slow. By Daniel Kahneman, 2011.
![Page 18: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/18.jpg)
2Emotion Lexicons
![Page 19: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/19.jpg)
Gabby should only feel immense pride in her accomplishments at Rio. Ignore the jealous haters. (Pride/Elation, strong)
Have you seen Chinese swimmer #Fu Yuanhui? Her reactions are infectious, hysterical and really authentic. #Rio2016. (Happiness/Joy, strong)
#realDonaldTrump first president in a long time that has the American people and their interests at heart. Thank you Mr. President. (Love/tenderness, worry/fear, sadness/despair, embarrassment/shame)
Speaker and audience emotions are not the same
19
![Page 20: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/20.jpg)
Emotion Lexicons
• General Inquirer
• ANEW
• Bing Liu’s Lexicon
• OpinionFinder
• WordNet Affect
• NRC
• GALC (geneva affect label coder)
• LIWC (linguistic inquiry and word count)
20
![Page 21: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/21.jpg)
412 characters with heart in it, the most complex one has 28 strokes 21
爱恨怕悲念恋
![Page 22: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/22.jpg)
OlympLex 2013 (EPFL)
• Create an emotion lexicon dedicated to sport events
• Distinguish up to 20 categories of emotions
• Develop a novel method for crowd worker
22
![Page 23: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/23.jpg)
Crowdsourcing by Darwin
Watch Video
23
![Page 24: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/24.jpg)
24
![Page 25: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/25.jpg)
Our Human Computation Task
9 25
![Page 26: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/26.jpg)
Human Computation Task
10
Emotion Label Happiness, Anger, Fear, No emotion…
Emotion Strength Low, Medium, High
Emotion Polarity Positive, Negative, Neutral
26
![Page 27: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/27.jpg)
Human Computation Task
11
Tweet Emotion Indicators n-grams expressing or revealingthe chosen emotion in the text
27
![Page 28: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/28.jpg)
Human Computation Task
12
Additional Emotion Indicators other n-grams expressing or indicating the chosen emotion 28
![Page 29: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/29.jpg)
SREC (Sport-related Emotion Corpus)
![Page 30: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/30.jpg)
Quality of Labels
30
Observed agreement: A
Kappa: where Ac – chance agreement
A = 2/6 = 0.33
Agreement Kappa
Emotion category 29.3% 0.24Polarity 75.7% 0.52
Strength 43.8% 0.13
![Page 31: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/31.jpg)
How did we aggregate results?
31
Emotion distributions forthe tweets with the term
Additional indicators using the same term
Averaging distributions
Term emotion distribution
Example term: hopefullyHopefully she can smash it and bring home medal
They are now watching the #TeamGB boys hopefully get medal
Hopefully #TeamGB will get an #Olympic Gold Soon!
Twee
tsAd
diti
-on
al hopefully
![Page 32: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/32.jpg)
OlympLex 2013 (EPFL)
• Number of annotation ~2000 tweets
• Contains 3,193 terms
• Examples (per quadrant)
Anger, Disgust, Scorn, … unfair, mad, ugh, annoyed, ticked
off, idiots, slap, offended, epicfail, …
Pride, Happiness, Interest, … bravo, champions, my girl, hero, woohoo, sohappy, good job, yessss, …
ouch, noooo, eek, tough to watch, heartbroken, feel so bad, fearful, … Sadness, Fear, Pity, …
astounded, luv u, incredible talent, omg, marry me, desiring, amaze, …
Love, Surprise, Awe, … 32
![Page 33: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/33.jpg)
Lessons Learned
• Crowdsourcing is a viable approach to collect annotated data
• Distinguish speaker’s emotions from the audience’ emotion
• Online inexpert workers require training
• Provide context for emotion labelling
• Consider diversity as an advantage rather than noise
33
![Page 34: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/34.jpg)
Reference
34
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods. Volume: 29 issue: 1, page(s): 24-54. Article first published online: December 8, 2009;Issue published: March 1, 2010
Klaus R Scherer. What are emotions? and how can they be measured? Social science information, 44(4):695–729, 2005.
The general inquirer: A computer approach to content analysis. Stone, Philip J.; Dunphy, Dexter C.; Smith, Marshall S. Oxford, England: M.I.T. Press The general inquirer: A computer approach to content analysis.(1966). 651 pp.
ANEW: Margaret M Bradley and Peter J Lang. Affective norms for english words (anew): Instruction manual and affective ratings. Technical report, Technical Report C-1, The Center for Research in Psychophysiology, University of Florida, 1999.
Bing Liu’s lexicon: Minqing Hu and Bing Liu. Mining and summarizing customer reviews. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining, pages 168–177. ACM, 2004.
Yla R Tausczik and JamesWPennebaker. The psychological meaning of words: Liwc and computerized text analysis methods. Journal of language and social psychology, 29(1):24–54, 2010.
EmoLex: Saif M Mohammad and Peter D Turney. Crowdsourcing a word–emotion association lexicon. Computational Intelligence, 29(3):436—-465, 2013.
OlympLex” Valentina Sintsova, Claudiu Musat, and Pearl Pu. Fine-Grained Emotion Recognition in Olympic Tweets Based on Human Computation. In Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA), 12–20. Association for Computational Linguistics, 2013.
![Page 35: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/35.jpg)
3Lexicons -> Classifiers
![Page 36: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/36.jpg)
Why classifiers?
• Scalability
• Domain dependent words
• Fine-grained detection
36
Classifiers are more suitable for machines, more adapted to big data, capable of integrating the nuances of how humans collectively express emotions.
![Page 37: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/37.jpg)
37
Anger
Pride Joy
Supervised learning Semi-supervised learning
Distant Learning
![Page 38: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/38.jpg)
Happiness Joy
Interest/Involvement Surprise Anger Sadness Disgust Fear
Disappo-intment
cheer* ecstat* absor* amaze* anger chagrin* abhor* afraid* comedownbliss* elat* alert astonish* angr* deject* avers* aghast* disappoint*delect* euphor* animat* dumbfound* cross* dole* detest* alarm* discontent*delight* exalt* ardor* startl* enrag* gloom* disgust* dread* disenchant*enchant* exhilar* attenti* stunn* furious glum* dislik* fear* disgruntl*enjoy* exult* curi* surpris* fury grie* disrelish fright* disillusion*felicit* flush* eager* aback incens* hopeles* distast* horr* frustrat*happ* glee* enrapt* thunderstruck infuriat* melancho* loath* panic* jilt*merr* joy* engross* wonder* irate mourn* nause* scare* letdown
jubil* enthusias* ire* sad* queas* terror* resign*overjoyed ferv* mad* sorrow* repugn* sour*ravish* interes* rag* tear* repuls* thwart*rejoic* zeal* resent* weep* revolt*
temper sicken*wrath*wrought*
How does our method work?GALC Scherer, 2005
38
GALC as the initial classifier
![Page 39: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/39.jpg)
Valentina Sintsova and Pearl Pu. Dystemo: Distant Supervision Method for Multi-Category Emotion Recognition in Tweets. ACM Transactions on Intelligent Systems and Technology (TIST). (forthcoming) 2016
39
How does our method work?
![Page 40: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/40.jpg)
Pseudo-Labeled Tweets
Balanced Weighted Voting: 1.Rebalancing2.Weighted Voting
Feature Extraction & Selection
Supervised Learner
Text Preprocessing
Resultant Emotion Classifier
so proud <int> be british massive well done <int> all of team gb ! <emot59>
So proud 2 be British massive well done 2 all of Team GB! :D
Pride
proud, so proud, proud <int>, massive, well, massive well, done, well done, done <int>, <emot59>
Pride
well done
Learn from all tweets with “well done”
Pride
PridePride
LoveNost.
× CPride
× CLove
× CNostalgia× CPride
× CPride
40
Balanced Weighted Voting
![Page 41: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/41.jpg)
![Page 42: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/42.jpg)
Lessons Learned for Emotion Recognition in Tweets
• Distant learning is a viable approach to build emotion classifiers across domains
• Including pseudo-neutral documents avoids over-classifying emotional content
• Can be applied to dialogs, food & mood data, etc.
42
![Page 43: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/43.jpg)
![Page 44: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/44.jpg)
Reference
44
Supervised:
Saima Aman and Stan Szpakowicz. Identifying expressions of emotion in text. In Text, Speech and Dialogue, pages 196–205. Springer, 2007.
Semi-supervised using emoticons and hashtages:
Changhua Yang, Kevin Hsin-Yih Lin, and Hsin-Hsi Chen. Building emotion lexicon from weblog corpora. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pages 133–136. ACL, 2007.
Munmun De Choudhury,Michael Gamon, and Scott Counts. Happy, nervous or surprised? Classificationof human affective states in social media. In Proceedings of Sixth International AAAI Conference onWeblogs and SocialMedia (ICWSM), 2012.
Saif M Mohammad. #Emotional tweets. In Proc. 1st Joint Conf. on Lexical and Comput. Semantics(*SEM), pages 246–255. ACL, 2012.
Distant learning without labels and structural data:
Valentina Sintsova and Pearl Pu. Dystemo: Distant Supervision Method for Multi-Category Emotion Recognition in Tweets. ACM Transactions on Intelligent Systems and Technology (TIST), 8(1):Article No 13, 2016
![Page 45: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/45.jpg)
4Modifiers: emotion shifts
![Page 46: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/46.jpg)
Examples
46
I am not ashamed: the emotion has shifted from shame to pride
I feel so relieved now: intensifier to increase the degree of relief I feel a little sad: it diminishes the degree of sad
I know i should be happy: shift from happy to sad/regret
I’ll be sad if you leave: fear for event that may happen
Do you love her? interest/involvement, anger
I was happy then: disappointment/regret
![Page 47: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/47.jpg)
Novelty
• treat 6 modifiers simultaneously
• data-driven method
• re-mapping
47
![Page 48: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/48.jpg)
GEW, adapted version 2.0
PositiveNegative
High Control
Low Control
48
![Page 49: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/49.jpg)
…
49
![Page 50: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/50.jpg)
Kullback-Leibler divergence
= 1.96
Pride, non-modified Pride, negated
Smallest KL divergence to (0.24)
Pride, negated Shame, non-modified
50
![Page 51: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/51.jpg)
Shifts of Emotions under Negation
0.53
1.00
0.35
0.23
0.94
0.55
0.42
0.87
0.56
0.45
0.68
0.55
0.31
0.65
0.40
0.53Pleasure
Happiness Involvement
AmusementRegret
PrideAwe
Nostalgia
SadnessLove
Worry
SurpriseAnger
Guilt
Envy
Shame
51
![Page 52: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/52.jpg)
All 6 Modifiers
52
Modifier
Modified to non-modified
average distance
Average Certainty
Coefficient
% of Emotion
Shift
Intensifiers 0.14 1.32 17%
Past Tense 0.17 0.75 6%
Modality 0.19 0.74 19%
Conditionality 0.27 0.82 36%
Diminishers 0.30 1.17 38%
Interrogation 0.41 1.51 53%
Negation 0.80 0.56 75%
![Page 53: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/53.jpg)
• OlympLexSintsova, Valentina, Claudiu-Cristian Musat, and Pearl Pu. "Fine-Grained Emotion Recognition in Olympic Tweets based on Human Computation." In 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA), 2013.
• DystemoSintsova, Valentina, and Pearl Pu. “Dystemo: Distant Supervision Method for Multi-Category Emotion Recognition in Tweets.” ACM Transactions on Intelligent Systems and Technology (TIST), 2016.
• Modifiers AnalysisSintsova, Valentina, Margarita Bolivar Jimenez, and Pearl Pu. “The Impact of Modifiers on Emotional Statements,” in Proceedings of the International Conference on Computational Linguistics (COLING), 2008.
• Incentive Schemes for Inexpert WorkersSephora Madjiheurem, Sintsova, Valentina, and Pearl Pu. “Qualitative Framing of Financial Incentives – A Case of Emotion Annotation ,” arxiv.org/abs/1609.00439.
References of our work
53
![Page 54: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/54.jpg)
5Conclusion
![Page 55: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/55.jpg)
55
EmotionWatch Video
http://ijcai13.org/video/05
![Page 56: Emotion Analysis in Natural Language · 2019. 10. 8. · Pros Cons • More universal • Can describe any experience • Difficult to express states linguistically Pros Cons](https://reader035.vdocuments.net/reader035/viewer/2022071021/5fd57153ce539b0f4a39ff00/html5/thumbnails/56.jpg)
Thank You!