unified cognitive science
DESCRIPTION
Unified Cognitive Science. Neurobiology Psychology Computer Science Linguistics Philosophy Social Sciences Experience Take all the Findings and Constraints Seriously. What are schemas?. Regularities in our perceptual, motor and cognitive systems - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/1.jpg)
Unified Cognitive Science
•Neurobiology•Psychology•Computer Science•Linguistics•Philosophy•Social Sciences•ExperienceTake all the Findings and Constraints Seriously
![Page 2: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/2.jpg)
What are schemas?
• Regularities in our perceptual, motor and cognitive systems
• Structure our experiences and interactions with the world.
• May be grounded in a specific cognitive system, but are not situation-specific in their application (can apply to many domains of experience)
![Page 3: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/3.jpg)
Basis of Image schemas
•Perceptual systems
•Motor routines
•Social Cognition
•Image Schema properties depend on
•Neural circuits
•Interactions with the world
![Page 4: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/4.jpg)
Image schemas•Trajector / Landmark (asymmetric)
•The bike is near the house •? The house is near the bike
•Boundary / Bounded Region
•a bounded region has a closed boundary•Topological Relations
•Separation, Contact, Overlap, Inclusion, Surround•Orientation
•Vertical (up/down), Horizontal (left/right, front/back)•Absolute (E, S, W, N)
LMTR
bounded region
boundary
![Page 5: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/5.jpg)
Similarity:
•Perceptual and motor systems
•Basic functional interactions with the world
•Environment
Variation:Cross-linguistic variation in how schemas are used.
![Page 6: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/6.jpg)
Cross-linguistic Variations
![Page 7: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/7.jpg)
English
![Page 8: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/8.jpg)
Japanese
![Page 9: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/9.jpg)
English
ON
AROUND
OVER IN
Bowerman & Pederson
![Page 10: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/10.jpg)
Dutch
Bowerman & Pederson
AAN
OM
BOVEN IN
OP
![Page 11: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/11.jpg)
Chinese
Bowerman & Pederson
SHANG
ZHOU
LI
![Page 12: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/12.jpg)
Spatial schemas•TR/LM relation
•Boundaries, bounded region
•Topological relations
•Orientational Axes
•Proximal/Distal
![Page 13: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/13.jpg)
Trajector/Landmark Schema•Roles:Trajector (TR) – object being located
Landmark (LM) – reference object
TR and LM may share a location (at)
![Page 14: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/14.jpg)
TR/LM -- asymmetry
•The cup is on the table
•?The table is under the cup.
•The skateboard is next to the post.
•?The post is next to the skateboard.
![Page 15: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/15.jpg)
Boundary Schema
Region ARegion B
Boundary
Roles:BoundaryRegion ARegion B
![Page 16: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/16.jpg)
Topological Relations
•Separation
![Page 17: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/17.jpg)
Topological Relations
•Separation
•Contact
![Page 18: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/18.jpg)
Topological Relations
•Separation
•Contact
•Coincidence:
![Page 19: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/19.jpg)
Topological Relations
•Separation
•Contact
•Coincidence:
- Overlap
![Page 20: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/20.jpg)
Topological Relations
•Separation
•Contact
•Coincidence:
-Overlap
-Inclusion
![Page 21: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/21.jpg)
Topological Relations
•Separation
•Contact
•Coincidence:
-Overlap
-Inclusion
-Encircle/surround
![Page 22: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/22.jpg)
Orientation•Vertical axis -- up/down
up
down
above
belowupright
![Page 23: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/23.jpg)
OrientationHorizontal plane – Two axes:
![Page 24: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/24.jpg)
Language and Frames of Reference•There seem to be three
prototypical frames of reference in language (Levinson)
•Intrinsic
•Relative
•Absolute
![Page 25: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/25.jpg)
Intrinsic frame of reference
frontback
right
left
![Page 26: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/26.jpg)
Relative frame of reference
frontback
left??
right??
![Page 27: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/27.jpg)
Absolute frame of reference
north
west
south
east
![Page 28: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/28.jpg)
TR/LM and Verticality Schemas
•The book is under the table.
up
down
under
![Page 29: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/29.jpg)
Proximal/Distal Schema
.
![Page 30: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/30.jpg)
Simple vs. Complex Schemas
![Page 31: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/31.jpg)
Container Schema•Roles:
•Interior: bounded region
•Exterior
•Boundary
C
![Page 32: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/32.jpg)
C C
TR
TR
out in
TR/LM + Container
![Page 33: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/33.jpg)
Container Schema Elaborated•Complexities –more
roles/specifications:•Boundary properties•Strength•Porosity•Portals
![Page 34: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/34.jpg)
Source-Path-GoalConstraints:
initial = TR at Source
central = TR on Path
final = TR at Goal
Source Path Goal
![Page 35: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/35.jpg)
SPG -- simple example
She drove from the store to the gas station.
TR = sheSource = the storeGoal = the gas station
Source Path Goal
![Page 36: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/36.jpg)
SPG and ContainerShe ran into the room.
SPG. Source ↔ Container.Exterior
SPG.Path ↔ Container.Portal
SPG. Goal ↔ Container.Interior
![Page 37: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/37.jpg)
PATH landmarks past across along
LM
LM
LM
![Page 38: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/38.jpg)
Part-Whole Schema
Part
Whole
![Page 39: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/39.jpg)
semantic schema Containerroles:
interiorexteriorportalboundary
Representing image schemas
Interior
Exterior
Boundary
PortalSource
Path
GoalTrajector
These are abstractions over sensorimotor experiences.
semantic schema Source-Path-Goalroles:
sourcepathgoaltrajector
![Page 40: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/40.jpg)
Language and Spatial Schemas• People say that they look up to some people, but
look down on others because those we deem worthy of respect are somehow “above” us, and those we deem unworthy are somehow “beneath” us.
• But why does respect run along a vertical axis (or any spatial axis, for that matter)? Much of our language is rich with such spatial talk.
• Concrete actions such as a push or a lift clearly imply a vertical or horizontal motion, but so too can more abstract concepts.
• Metaphors: Arguments can go “back and forth,” and hopes can get “too high.”
![Page 41: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/41.jpg)
Regier Model Lecture
Jerome A. FeldmanFebruary 27, 2007
With help from Matt Gedigian
![Page 42: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/42.jpg)
Neural Theory of Language
![Page 43: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/43.jpg)
Language Development in Children
•0-3 mo: prefers sounds in native language
•3-6 mo: imitation of vowel sounds only
•6-8 mo: babbling in consonant-vowel segments
•8-10 mo: word comprehension, starts to lose sensitivity to consonants outside native language
•12-13 mo: word production (naming)
•16-20 mo: word combinations, relational words (verbs, adj.)
•24-36 mo: grammaticization, inflectional morphology
•3 years – adulthood: vocab. growth, sentence-level grammar for discourse purposes
![Page 44: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/44.jpg)
![Page 45: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/45.jpg)
![Page 46: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/46.jpg)
Trajector/Landmark Schema
•Roles:Trajector (TR) – object being located
Landmark (LM) – reference object
TR and LM may share a location (at)
![Page 47: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/47.jpg)
TR/LM -- asymmetry
•The cup is on the table
•?The table is under the cup.
•The skateboard is next to the post.
•?The post is next to the skateboard.
![Page 48: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/48.jpg)
![Page 49: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/49.jpg)
Language and Frames of Reference
•There seem to be three prototypical frames of reference in language (Levinson)
•Intrinsic
•Relative
•Absolute
![Page 50: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/50.jpg)
![Page 51: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/51.jpg)
Basis of Image Schemas
•Perceptual systems
•Motor routines
•Social Cognition
•Image Schema properties depend on
•Neural circuits
•Interactions with the world
![Page 52: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/52.jpg)
Image schemas
•Trajector / Landmark (asymmetric)
•The bike is near the house •? The house is near the bike
•Boundary / Bounded Region
• bounded region has a closed boundary•Topological Relations
•Separation, Contact, Overlap, Inclusion, Surround•Orientation
•Vertical (up/down), Horizontal •Absolute (E, S, W, N)
LMTR
bounded region
boundary
![Page 53: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/53.jpg)
Spatial schemas•TR/LM relation
•Boundaries, bounded region
•Topological relations
•Orientational Axes
•Proximal/Distal
![Page 54: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/54.jpg)
Regier’s Model
•Training input: configuration of TR/LM and the correct spatial relation term
•Learned behavior: input TR/LM, output spatial relation
Learning System
above below left right in out on off
Input:TR
LMabove
![Page 55: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/55.jpg)
![Page 56: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/56.jpg)
Issue #1: Implicit Negatives
• Children usually do not get explicit negatives
• But we won’t know when to stop generalizing if we don’t have negative evidence
• Yet spatial relation terms aren’t entirely mutually exclusive
• The same scene can often be described with two or more spatial relation terms (e.g. above and outside)
• How can we make the learning problem realistic yet learnable?
![Page 57: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/57.jpg)
![Page 58: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/58.jpg)
![Page 59: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/59.jpg)
![Page 60: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/60.jpg)
Dealing with Implicit Negatives
• Explicit positive for above
• Implicit negatives for below, left, right, etc
• in Regier:
E = ½ ∑i,p (( ti,p – oi,p) * βi,p )2,
where i is the node, p is the pattern,
βi,p = 1 if explicit positive,
βi,p < 1 if implicit negative
![Page 61: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/61.jpg)
![Page 62: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/62.jpg)
![Page 63: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/63.jpg)
![Page 64: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/64.jpg)
![Page 65: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/65.jpg)
Learning
Systemdynamic relations(e.g. into)
structured connectionistnetwork (based on visual system)
![Page 66: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/66.jpg)
![Page 67: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/67.jpg)
![Page 68: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/68.jpg)
![Page 69: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/69.jpg)
![Page 70: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/70.jpg)
![Page 71: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/71.jpg)
![Page 72: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/72.jpg)
![Page 73: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/73.jpg)
![Page 74: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/74.jpg)
![Page 75: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/75.jpg)
Topological Relations
•Separation
•Contact
•Coincidence:
-Overlap
-Inclusion
-Encircle/surround
![Page 76: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/76.jpg)
Issue #2: Shift Invariance
• Backprop cannot handle shift invariance (it cannot generalize from 0011, 0110 to 1100)
• But the cup is on the table whether you see it right in the center or from the corner of your eyes (i.e. in different areas of the retina map)
• What structure can we utilize to make the input shift-invariant?
![Page 77: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/77.jpg)
![Page 78: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/78.jpg)
![Page 79: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/79.jpg)
![Page 80: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/80.jpg)
![Page 81: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/81.jpg)
Limitations•Scale•Uniqueness/Plausibility•Grammar•Abstract Concepts•Inference•Representation
![Page 82: Unified Cognitive Science](https://reader035.vdocuments.net/reader035/viewer/2022070419/56815d2d550346895dcb261a/html5/thumbnails/82.jpg)
Language and Thought
• We know thought (our cognitive processes) constrains the way we learn and use language
• Does language also influence thought?
• Benjamin Whorf argues yes
• Psycholinguistics experiments have shown that linguistics categories influence thinking even in non-linguistics task
Language
Thought
cognitive processes