conclusions our behavioural test proved that naive speakers are able to operate subtle epistemic...

1
Conclusions Our behavioural test proved that naive speakers are able to operate subtle epistemic operations We hypothesize that a complex cognitive system underlies this ability (a folk epistemology system?): language, theory of mind, attention... We hypothesize that a widely distributed neural network supports such a system Our hypothesis is supported by results on metaphor Epistemic judgments in language Behavioural data and perspectives for neurological validation Alexandra Kratschmer - Valentina Bambini Institut for Sprog, Litteratur og Kultur, Aarhus Universitet - Laboratorio di Linguistica, Scuola Normale Superiore, Pisa Linguistic and Cognitive Modelling of Epistemicity (based on Kratschmer 2006) A possible modulation to study epistemic processing is offered by the Italian verb sembrare (engl. “to seem”) Sembrare contains the semantic aspect of epistemic quantification, i.e., the speaker’s judgment of the truth value (of the predication subordinate to sembrare) Consider the different values on a cognitive scale of truth assessment: a) Il computer sembrava rotto (“The computer seemed broken”); formalized by an epistemic factor ” ≤ trueb) Il computer sembrava senziente (reagiva come un essere umano) (“The computer seemed conscious” (it reacted like a human being)); formalized by an epistemic factor “< trueThe two readings can be classified as: a) literal reading – categorization (with a reserve) b) non-literal reading - comparison Can we validate this cognitive postulate? References Bambini,V., C. Gentili, E. Ricciardi, P. Pietrini. 2006. Neural Correlates of Metaphor Comprehension Assessed by fMRI. Human Brain Mapping. Kratschmer, A. 2006. Catégorisation vs comparaison : une question de quantification épistémique. Propos de modèle interprétatif semantico-pragmatique modulaire des constructions italiennes avec sembrare/parere. To appear in : Cahiers Chronos. Kronning, H. 2005. Polyfoni, modalitet och evidentialitet. Om epistemiska uttryck i franskan, särskilt epistemisk konditionalis. Arbejdspapirer 3, Sprogligt Polyfoninetværk. RUC. 71-99. Sensory-based reorganization Theoryofm ind com prehension Mem ory Sensory-based processes Em otion Imagery Language Syntactic reorganization Language Semantic integration Theoryofm ind A ttention M etaphor com prehension Results The four categories lie on an epistemic continuum V and F lie each on their own end of the scale: higher correct decoding% VR and VP are adjacent: lower correct decoding % Strengthening of theoretical assumptions 10 of the proposed example groups sanctioned as “well functioning”; other example groups adjustable Aims of the study Verifying the actual distinctability of the four readings in contextualized examples Detecting stimuli designing problems Isolating “well functioning” examples qualifying as stimuli in neurolinguistic tests Strengthening of theoretical assumptions Converging Perspectives Studying the Neural Basis of Epistemicity Acknowledgments This project is funded by the research priority area Cognition, Communication & Culture (CCC), Faculty of the Humanities, Aarhus University Contact Alexandra Kratschmer: [email protected] Valentina Bambini: [email protected] 90,00 92,00 94,00 96,00 98,00 100,00 T TR TC F Introduction What is epistemicity in language? Any aspect regarding truthfulness/probability of a linguistic content unit according to linguistic signals provided by the speaker Epistemic judgments can be placed on scales, e.g. going from “true” to false” (see Kronning, 2005) Coding by the speaker: Concerning the content: epistemic modality the force a speaker attributes to a content expressed in an utterance ("true", "probable", "necessarily true") Decoding by the hearer/reader: Concerning the interpretation of the speaker’s linguistic signals conveying his/her epistemic judgments – what did the speaker mean? What is going on in our brains, when we decode the speaker’s signals concerning epistemic modality? What is going on in our brains, when we try to decode utterances with literal and non-literal meanings? How do we avoid this? true (TC ) epistem icfactor: non-literal reading false (F) true (TC :i.e.true as a com parison) true (TR :i.e.true w ith a reserve) true (T) epistem icfactor: literalreading That lawyer is a shark m etaphor That lawyer seems an actor com parison based on sembrare That lawyer seems a civil lawyer categorization m odalized by sembrare That lawyer is an intern assertive categorization (non m odalized) true (TC ) epistem icfactor: non-literal reading false (F) true (TC :i.e.true as a com parison) true (TR :i.e.true w ith a reserve) true (T) epistem icfactor: literalreading That lawyer is a shark m etaphor That lawyer seems an actor com parison based on sembrare That lawyer seems a civil lawyer categorization m odalized by sembrare That lawyer is an intern assertive categorization (non m odalized) We think that a good way to modulate the epistemic ability is to include the literal/non literal distinction into the true/false dichotomy On the basis of theoretical work on epistemic modality, we elaborated an epistemic continuum The epistemic continuum Behavioural study Experimental Design Task: Determining the epistemic degree of the literal reading of the target sentence in its context: true (T), true with a reserve (TR), true as a comparison (TC), false (F) Did you hear the speech of that lawyer? He is an intern. Did you hear the speech of that lawyer? He seems a civil lawyer. Did you hear the speech of that lawyer? He seems an actor. Did you hear the speech of that lawyer? He is a shark. Subjects: 11 students Stimuli: 43 groups of four sentences; in each group the target word appears once with one of the four meanings; words balanced for frequency and constant sentence structure to prevent confound effect; random order inside each group to prevent mechanical choices Cognitive components in the neural network for metaphor comprehension Cognitive components expected in the neural network for epistemic judgment The study of mental processes underlying epistemological skills may support the hypothesis of a dedicated “folk epistemology” system. Over the last decades many cases of domain-specific cognitive systems with dedicated inferential resources have been identified in infants and higher primates. These include folk physics, folk biology, folk arithmetics, folk psychology, among others. Can the ability to judge truth and epistemic reliability be accounted for in terms of a folk epistemology system? (European Review of Philosophy 8 (2008), Heintz et al., 2008) Subjects: 10 graduate students (5 F) Stimuli: 40 sentence pairs; in each pair the target word appears once with a literal, once with a metaphorical meaning; 40 fillers Task: Semantic association: choosing between two adjectives presented AFTER the target sentences; metaphor comprehension is an implicit task (i.e., not metalinguistic) random betw een 0-1000 m s 3000 m s m ax 2500 m s until completion 7500 m s random betw een 0-1000 m s 3000 m s m ax 2500 m s until completion 7500 m s 7500 m s + D o you know w hatthatlaw yeris? A shark. ferocious geographical p<0.01 2 W ays AN O VA M etaphor Literal p<0.01 2 W ays AN O VA M etaphor Literal L-STS /B A 21,22 R -STS /B A 22 L-IN SU LA /B A 47 R -IN SU LA /B A 13 L-M FG /BA 6 R-M FG /BA 9 L-PRECUNEUS /BA 7 R-PRECUNEUS /BA 7 L-PUTAM ENT R-CAUDATE R -TH A LA M U S y= -51 x= -51 x= -31 x= -1 z = 10 x = 46 x = 26 x = 11 L-IFG /B A 47 R -IFG /B A 45 A C -SFG /B A 6.32 L-STS /B A 21,22 R -STS /B A 22 L-IN SU LA /B A 47 R -IN SU LA /B A 13 L-M FG /BA 6 R-M FG /BA 9 L-PRECUNEUS /BA 7 R-PRECUNEUS /BA 7 L-PUTAM ENT R-CAUDATE R -TH A LA M U S y= -51 x= -51 x= -31 x= -1 z = 10 x = 46 x = 26 x = 11 L-IFG /B A 47 R -IFG /B A 45 A C -SFG /B A 6.32 Do you know what that fish is? A shark. Do you know what that lawyer is? A shark. Do you know what that politician is? A senator. Brain Mapping of Metaphor Processing (based on Bambini et al. 2006) Results: Metaphors compared to literal sentences activated a distributed network of cerebral regions (disconfirming the clinical hypothesis on the selective involvement of the right hemisphere), including traditional language areas plus regions responsible for extra-linguistic higher order cognitive functions (memory, theory of mind, etc.) High statistical correlation between intended and decoded readings (range: 94,71 - 98,23 %) There is a context- related distinctability of the four readings The literal/non literal readings of sembrare resemble the literal/figurative readings of metaphorical expressions We hypothesize that epistemic judgment is a complex cognitive operation, both linguistic and extra-linguistic, supported by a widely distributed neural network Our aim is to identify such a neural network and the cognitive processes involved. Steps: Behavioural studies What are the epistemic modulations subjects are sensitive to? What are the correct stimuli to modulate the epistemic ability in the brain? fMRI study

Upload: hugo-mcgee

Post on 25-Dec-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Conclusions  Our behavioural test proved that naive speakers are able to operate subtle epistemic operations  We hypothesize that a complex cognitive

Conclusions

Our behavioural test proved that naive speakers are able to operate subtle epistemic operationsWe hypothesize that a complex cognitive system underlies this ability (a folk epistemology system?): language, theory of mind, attention... We hypothesize that a widely distributed neural network supports such a systemOur hypothesis is supported by results on metaphor

Epistemic judgments in language Behavioural data and perspectives for neurological validation

Alexandra Kratschmer - Valentina BambiniInstitut for Sprog, Litteratur og Kultur, Aarhus Universitet - Laboratorio di Linguistica, Scuola Normale Superiore, Pisa

Linguistic and Cognitive Modelling of Epistemicity(based on Kratschmer 2006)

A possible modulation to study epistemic processing is offered by the Italian verb sembrare (engl. “to seem”)Sembrare contains the semantic aspect of epistemic quantification, i.e., the speaker’s judgment of the truth value (of the predication subordinate to sembrare)

Consider the different values on a cognitive scale of truth assessment:a) Il computer sembrava rotto (“The computer seemed broken”); formalized by an epistemic factor ” ≤ true”b) Il computer sembrava senziente (reagiva come un essere umano) (“The computer seemed conscious” (it reacted like a human being)); formalized by an epistemic factor “< true”

The two readings can be classified as:a) literal reading – categorization (with a reserve)b) non-literal reading - comparison

Can we validate this cognitive postulate? ReferencesBambini,V., C. Gentili, E. Ricciardi, P. Pietrini. 2006. Neural Correlates of Metaphor Comprehension Assessed by fMRI. Human Brain Mapping.Kratschmer, A. 2006. Catégorisation vs comparaison : une question de quantification épistémique. Propos de modèle interprétatif semantico-pragmatique modulaire des constructions italiennes avec sembrare/parere. To appear in : Cahiers Chronos.Kronning, H. 2005. Polyfoni, modalitet och evidentialitet. Om epistemiska uttryck i franskan, särskilt epistemisk konditionalis. Arbejdspapirer 3, Sprogligt Polyfoninetværk. RUC. 71-99.

MemoryMemory

Sensory-basedprocesses

Sensory-basedprocesses

EmotionEmotion

ImageryImagery

LanguageSyntactic

reorganization

LanguageSyntactic

reorganization

LanguageSemantic

integration

LanguageSemantic

integration

Theory of mindTheory of mind

AttentionAttention

Metaphorcomprehension

Metaphorcomprehension

MemoryMemory

Sensory-basedprocesses

Sensory-basedprocesses

EmotionEmotion

ImageryImagery

LanguageSyntactic

reorganization

LanguageSyntactic

reorganization

LanguageSemantic

integration

LanguageSemantic

integration

Theory of mindTheory of mind

AttentionAttention

Metaphorcomprehension

Metaphorcomprehension

Results

The four categories lie on an epistemic continuum V and F lie each on their own end of the scale: higher correct decoding% VR and VP are adjacent: lower correct decoding %

Strengthening of theoretical assumptions

10 of the proposed example groups sanctioned as “well functioning”; other example groups adjustable

Aims of the study

Verifying the actual distinctability of the four readings in contextualized examplesDetecting stimuli designing problemsIsolating “well functioning” examples qualifying as stimuli in neurolinguistic testsStrengthening of theoretical assumptions

Converging PerspectivesStudying the Neural Basis of Epistemicity

AcknowledgmentsThis project is funded by the research priority area Cognition, Communication & Culture (CCC), Faculty of the Humanities, Aarhus University

ContactAlexandra Kratschmer: [email protected] Bambini: [email protected]

90,00

92,00

94,00

96,00

98,00

100,00

T

TR

TC

F

IntroductionWhat is epistemicity in language?

Any aspect regarding truthfulness/probability of a linguistic content unit according to linguistic signals provided by the speakerEpistemic judgments can be placed on scales, e.g. going from “true” to false” (see Kronning, 2005)

Coding by the speaker: Concerning the content: epistemic modalitythe force a speaker attributes to a content expressed in an utterance ("true", "probable", "necessarily true")Decoding by the hearer/reader: Concerning the interpretation of the speaker’s linguistic signals conveying his/her epistemic judgments – what did the speaker mean?

What is going on in our brains, when we decode the speaker’s signals concerning epistemic modality? What is going on in our brains, when we try to decode utterances with literal and non-literal meanings?

How do we avoid this?

true (TC)

epistemic factor:non-literalreading

false(F)

true (TC: i.e. true as a comparison)

true (TR: i.e. true

with a reserve)

true

(T)

epistemic factor:literal reading

That lawyer is a shark

metaphor

That lawyerseems an actor

comparisonbased on sembrare

That lawyer seemsa civil lawyer

categorizationmodalized by sembrare

That lawyer is an intern

assertive categorization(non modalized)

true (TC)

epistemic factor:non-literalreading

false(F)

true (TC: i.e. true as a comparison)

true (TR: i.e. true

with a reserve)

true

(T)

epistemic factor:literal reading

That lawyer is a shark

metaphor

That lawyerseems an actor

comparisonbased on sembrare

That lawyer seemsa civil lawyer

categorizationmodalized by sembrare

That lawyer is an intern

assertive categorization(non modalized)

We think that a good way to modulate the epistemic ability is to include the literal/non literal distinction into the true/false dichotomy

On the basis of theoretical work on epistemic modality, we elaborated an epistemic continuum

The epistemic continuum

Behavioural study

Experimental Design

Task: Determining the epistemic degree of the literal reading of the target sentence in its context: true (T), true with a reserve (TR), true as a comparison (TC), false (F)

Did you hear the speech of that lawyer? He is an intern. Did you hear the speech of that lawyer? He seems a civil lawyer. Did you hear the speech of that lawyer? He seems an actor. Did you hear the speech of that lawyer? He is a shark.

Subjects: 11 students

Stimuli: 43 groups of four sentences; in each group the target word appears once with one of the four meanings; words balanced for frequency and constant sentence structure to prevent confound effect; random order inside each group to prevent mechanical choices

Cognitive components in the neural network for metaphor comprehension

Cognitive components expected in the neural network for epistemic judgment

The study of mental processes underlying epistemological skills may support the hypothesis of a dedicated “folk epistemology” system. Over the last decades many cases of domain-specific cognitive systems with dedicated inferential resources have been identified in infants and higher primates. These include folk physics, folk biology, folk arithmetics, folk psychology, among others. Can the ability to judge truth and epistemic reliability be accounted for in terms of a folk epistemology system? (European Review of Philosophy 8 (2008), Heintz et al., 2008)

Subjects: 10 graduate students (5 F)

Stimuli: 40 sentence pairs; in each pair the target word appears once with a literal, once with a metaphorical meaning; 40 fillers

Task: Semantic association: choosing between two adjectives presented AFTER the target sentences; metaphor comprehension is an implicit task (i.e., not metalinguistic)

random between0-1000 ms

3000 ms

max2500 ms

untilcompletion

7500 ms

+

Do you know what that lawyer is?

A shark.

ferocious geographical

random between0-1000 ms

3000 ms

max2500 ms

untilcompletion

7500 ms

+

Do you know what that lawyer is?

A shark.

ferocious geographical

7500 ms

+

Do you know what that lawyer is?

A shark.

ferocious geographical

+

Do you know what that lawyer is?

A shark.

ferocious geographical

p<0.012 Ways ANOVA

Metaphor

Literal

L-STS / BA 21, 22R-STS / BA 22

L-INSULA / BA 47R-INSULA / BA 13

L-MFG / BA 6R-MFG / BA 9

L-PRECUNEUS / BA 7R-PRECUNEUS / BA 7

L-PUTAMENT R-CAUDATER-THALAMUS

y= -51 x= -51 x= -31 x= -1

z = 10 x = 46 x = 26 x = 11

L-IFG / BA 47R-IFG / BA 45

AC-SFG / BA 6.32

p<0.012 Ways ANOVA

Metaphor

Literal

p<0.012 Ways ANOVA

Metaphor

Literal

L-STS / BA 21, 22R-STS / BA 22

L-INSULA / BA 47R-INSULA / BA 13

L-MFG / BA 6R-MFG / BA 9

L-PRECUNEUS / BA 7R-PRECUNEUS / BA 7

L-PUTAMENT R-CAUDATER-THALAMUS

y= -51 x= -51 x= -31 x= -1

z = 10 x = 46 x = 26 x = 11

L-IFG / BA 47R-IFG / BA 45

AC-SFG / BA 6.32

L-STS / BA 21, 22R-STS / BA 22

L-INSULA / BA 47R-INSULA / BA 13

L-MFG / BA 6R-MFG / BA 9

L-PRECUNEUS / BA 7R-PRECUNEUS / BA 7

L-PUTAMENT R-CAUDATER-THALAMUS

y= -51 x= -51 x= -31 x= -1

z = 10 x = 46 x = 26 x = 11

L-IFG / BA 47R-IFG / BA 45

AC-SFG / BA 6.32

Do you know what that fish is? A shark.Do you know what that lawyer is? A shark.Do you know what that politician is? A senator.

Brain Mapping of Metaphor Processing(based on Bambini et al. 2006)

Results:Metaphors compared toliteral sentences activateda distributed network of cerebral regions (disconfirming the clinical hypothesis on the selective involvement of the right hemisphere), including traditional language areas plus regions responsible for extra-linguistic higher order cognitive functions (memory, theory of mind, etc.)

High statistical correlation between intended and decoded readings (range: 94,71 - 98,23 %)There is a context-related distinctability of the four readings

The literal/non literal readings of sembrare resemble the literal/figurative readings of metaphorical expressionsWe hypothesize that epistemic judgment is a complex cognitive operation, both linguistic and extra-linguistic, supported by a widely distributed neural networkOur aim is to identify such a neural network and the cognitive processes involved. Steps:

Behavioural studiesWhat are the epistemic modulations subjects are sensitive to?What are the correct stimuli to modulate the epistemic ability in the brain?

fMRI study