IntersectingwordvectorstotakefigurativelanguageintonewheightsApaperbyAndreaGagliano&EmilyPaul&KyleBooten&MartiA.Hearst

Sowhat'stheplan?●Motivationandpurpose

● Previouswork

● Somebackground

● Thenewapproach

● Conclusionsandfuturework

Whatarewetryingtodo?

Previouswork● Ametaphorisa“mapping”betweentwodistinctsemanticspaces(LakoffandTurner,1989)

● Usingadjectivesasanindicatorformetaphoricalrelationshipbetweentwoterms(VealeandHao2007,2008)

Word2vec“Youshallknowawordbythecompanyitkeeps”–JohnR.Firth

● Howdoesitworkwithwords?

● Howdoesitworkwithphrases?

● Syntacticandsemanticrelationships

Word2vec

● Syntacticandsemanticrelationships

Word2vec

● Howdowemeasurethesimilarityoftwowords?Weareusingthecosinesimilarityformula (ontheboard)

Howwillwemeasureourresults?● Quantitative

● Qualitative

Let’sgetstarted

Inthebeginning…

Selectinganchorwords

Selectinganchorwords

Selectinganchorwords● Settingathreshold:similarity<0.4

Additionmodel

Additionmodel●Wecreateanewvector,a:vec(a)=vec(c)+vec(t)

Additionmodel●Wecreateanewvector,a:vec(a)=vec(c)+vec(t)

● FindasetAcontainingnwordsclosesttovec(a)

Additionmodel

Additionmodel

Notgoodenough…

Intersectionmodel● Findtwosets:-Ccontainingnwordsclosesttovec(c)-Tcontainingnwordsclosesttovec(t)

● LookattheintersectionsetI=C∩T

Intersectionmodel● Findtwosets:-Ccontainingnwordsclosesttovec(c)-Tcontainingnwordsclosesttovec(t)

● LookattheintersectionsetI=C∩T

*choosingn=1000

Let’sseparatethewheatfromthechaff● Observation:A\I≠∅≠I\A

● Createtwonewsetsasfollows:-Uniquetointersection:UI=I\A -Uniquetoaddition:UA=A\I

Quantitativeobservations

Quantitativeobservations

Quantitativeobservations

Quantitativeobservations

Qualitativeobservations● Constructingadatasetofsentencesusingcrowd-sourcedworkers(MechanicalTurk)

● Thetask:completeatemplatesentenceoftheform:“[connectorword]connects[concretenoun]and[poetictheme]because...”

● “Barrageconnectsstormandsurrenderingbecause...”

Anexample

Anexample● “Cookconnectscaringandflamebecauseitisrelatedtoflameasflamesareusedincookingandcookingcanbeasymbolofcaringforsomeonewithgoodfood.”

● “Torchconnectscaringandflamebecausewhensomeonecaresaboutsomeoneelseit’softensaidtheyarecarryingatorchforthem,whilethevisualofatorchitselftendstohaveaflameatopit.”

Qualitativeobservations● Ourgoal:blendthedistinctsemanticspacesofthetwoanchorwordstocreatefigurativerelationships.

● Synonym-basedrelationships

● Relationshipsblendingdistinctsemanticspaces

Qualitativeobservations● Synonym-basedrelationships

● “Torchconnectscaringandflamebecausewhensomeonecaresaboutsomeoneelseit’softensaidtheyarecarryingatorchforthem,whilethevisualofatorchitselftendstohaveaflameatopit.”

● Similarityscoretorch-caring:0.06Similarityscoretorch-flame:0.67

Qualitativeobservations● Relationshipsblendingdistinctsemanticspaces

● “Cookconnectscaringandflamebecauseitisrelatedtoflameasflamesareusedincookingandcookingcanbeasymbolofcaringforsomeonewithgoodfood.”

● Similarityscorecook-caring:0.26Similarityscorecook-flame:0.22

Discussingtheresults● Unbalancedcosinesimilarity-leadstoasynonymousrelationships.

● Balancedcosinesimilarity-blendsthetwodistinctsemanticspacesoftheanchorwordandcreatesanewsharedsemanticspace.

Discussingtheresults● Unbalancedcosinesimilarity-leadstoasynonymousrelationships.*mostlythewordsfromthesetUA

● Balancedcosinesimilarity-blendsthetwodistinctsemanticspacesoftheanchorwordandcreatesanewsharedsemanticspace.*mostlythewordsfromthesetUI

Futurework● Testthishypothesisdirectly

● Checkingotherbandsofsimilarityoutside0.25-0.30

● Poetrygeneration

● Toolstoassistcreativewriting

Thankyou!