sensation and perception (ii) 3270 speech
DESCRIPTION
Sensation and Perception (II) 3270 Speech. Keywords on hearing (introduction ). auditory canal, ear drum, ossicles, oval window, cochlea, helicotrema, basilar membrane, tectorial membrane, hair cells, kinocilium, stereocilia, - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/1.jpg)
Sensation and Perception (II)3270
Speech
![Page 2: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/2.jpg)
Keywords on hearing (introduction)
auditory canal, ear drum, ossicles, oval window, cochlea, helicotrema, basilar membrane, tectorial membrane, hair cells, kinocilium, stereocilia,
amplification (by ossicles & area difference between ear drum and oval window), travelling wave, resonance, tonotopic coding, cochleotopic coding, transduction
auditory thresholds, effect of age, different animals, fundamental, harmonics, timbre, pitch/frequency, loudness/amplitude, pure tone, equal loudness, masking
place theory, periodicity theory, duplicity theory, missing fundamental, goldfish has no basilar membrane - can distinguish freqs, phase-locking, diplacusis,
![Page 3: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/3.jpg)
PHONEMES
“sounds that create meaning”
47 in English
VOICING PLACE OF MANNER OFARTICULATION ARTICULATION
voiced alveloar ridge stop unvoiced labiodental fricative
etc… nasaletc…
http://nationalstrategies.standards.dcsf.gov.uk/node/85357
![Page 4: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/4.jpg)
![Page 5: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/5.jpg)
time
Formant 3
Formant 2
Formant 1
![Page 6: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/6.jpg)
Formant transitions
Formants
SEGMENTATION PROBLEM
![Page 7: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/7.jpg)
Segmentation problem
Where one sound is influenced by what sound came before or after because of CO-ARTICULATION
![Page 8: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/8.jpg)
Same sounds, different spectrographs...
VARIABILITY PROBLEM
![Page 9: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/9.jpg)
IS SPEECH SPECIAL?
1. MOTOR THEORY OF SPEECH
-- mirror neurones?
http://www.teachersdomain.org/asset/hew06_vid_mirrorneurons/
![Page 10: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/10.jpg)
IS SPEECH SPECIAL?
2. CATEGORICAL PERCEPTION
![Page 11: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/11.jpg)
Voice Onset Time (VOT)
ShortVOT
LongVOT
![Page 12: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/12.jpg)
“SAME”“DIFFERENT”
![Page 13: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/13.jpg)
IS SPEECH SPECIAL?
3. SPEECH PERCEPTION IS MULTIMODAL
![Page 14: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/14.jpg)
McGurk Effect
SOUND
VISION
![Page 15: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/15.jpg)
Video demos
1. McGurk effect
video=gasound = bacombo= da
2. Vision helps degraded sound
![Page 16: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/16.jpg)
IS SPEECH SPECIAL?
4. Are there INVARIANTS for phonemes?
-- practical importance-- some hints-- varied by neighbouring sound-- different conditions eg. speed of speech-- different speakers-- but TOP DOWN INFLUENCES
![Page 17: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/17.jpg)
TOP-DOWN INFLUENCES
1. Segmentation influenced by meaning
Anna Mary Candy Lights Since Imp PulpLay Things.
I scream, you scream, we all scream for ice cream!!
![Page 18: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/18.jpg)
TOP DOWN INFLUENCES
1. Segmentation influenced by meaning2. Semantics (meaning) and syntax (grammar)
both influence your ability to shadow (repeat what you have heard) a text.p
erce
nt
corr
ect 89%
79%
56%
normal s
entences
anomalous sentences
ungrammatic
al sentences
![Page 19: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/19.jpg)
TOP DOWN INFLUENCES
1. Segmentation influenced by meaning2. Semantics (meaning) and syntax (grammar) both
influence your ability to shadow (repeat what you have heard) a text.
3. Phonemic restoration.
Time to meet with their respective legi laturess *
cough
time to aves the countryw the flag
Pink noise demo: http://www.youtube.com/watch?v=k74KCfSDCn8
Legislatures: http://www.youtube.com/watch?v=UlJs24j3i8E&feature=related
![Page 20: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/20.jpg)
![Page 21: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/21.jpg)
SUMMARY “Is speech special?”
1. Motor theory of speech2. Categorical perception3. Multimodal aspects4. Invariants
Top down influences(i) Segmentation influenced by meaning(ii) Shadowing influenced by meaning(iii) Phonemic restoration
![Page 22: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/22.jpg)
PHYSIOLOGY OF SPEECH PERCEPTION
![Page 23: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/23.jpg)
Might there be phoneme detectors in the brain?
Voice onset time (ms)0 20 40 60 80
Per
cen
tag
e h
eard
as
“da”
100%
50%
0%
Per
cen
tag
e h
eard
as
“ba”0%
50%
100%
/da/
/ba/
![Page 24: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/24.jpg)
ADAPT TO /ba/
/ba/ /ba/
/ba/
/ba/
/ba/
/ba/
/ba/
/ba/
/ba/
/ba/
/ba/
/ba/
![Page 25: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/25.jpg)
After adapting to /ba/……
Voice onset time (ms)0 20 40 60 80
Per
cen
tag
e h
eard
as
“da”
100%
50%
0%
Per
cen
tag
e h
eard
as
“ba”0%
50%
100%
/da/
/ba/
![Page 26: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/26.jpg)
As if that wasn’t cool enough…..
What happens after adapting to a McGurk effect?
![Page 27: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/27.jpg)
Sound = /ba/
Vision = /ga/
Perception = /da/
acoustic
perception
![Page 28: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/28.jpg)
After adapting to McGurk
Voice onset time (ms)0 20 40 60 80
Per
cen
tag
e h
eard
as
“da”
100%
50%
0%
Per
cen
tag
e h
eard
as
“ba”0%
50%
100%
/da/
/ba/
If /ba/ (acoustic) adapts
If /da/ (perception) adapts
??
![Page 29: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/29.jpg)
It is the ACOUSTIC signal that adapts
Voice onset time (ms)0 20 40 60 80
Per
cen
tag
e h
eard
as
“da”
100%
50%
0%
Per
cen
tag
e h
eard
as
“ba”0%
50%
100%
/da/
/ba/
Acoustic adapts!!!
![Page 30: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/30.jpg)
![Page 31: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/31.jpg)
Broca’s aphasia http://www.youtube.com/watch?v=f2IiMEbMnPM
Wernicke’s aphasia http://www.youtube.com/watch?v=B-LD5jzXpLE
![Page 32: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/32.jpg)
Cells in cortex show:
• Phoneme information carried in a population code
• Special features in auditory cortex (eg, frequency sweeps) compatible with phonemic features
![Page 33: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/33.jpg)
Background resting activity -- note more activity in frontal regions
Green = averageblue = lessred = more
![Page 34: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/34.jpg)
Looking around
Frontal eye fields
Visual cortex
![Page 35: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/35.jpg)
Listening to words
WERNICKE’S AREA
Auditory cortex
![Page 36: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/36.jpg)
Counting out loud
Supplementarymotor area
BROCA’S AREA(speech production)
WERNICKE’S AREA(speech understanding)
![Page 37: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/37.jpg)
Internal speech -- counting in your head
?????
![Page 38: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/38.jpg)
Internal speech -- counting in your head
Frontal regions
NOTBroca or Wernicke’sareas !!!!
![Page 39: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/39.jpg)
![Page 40: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/40.jpg)
![Page 41: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/41.jpg)
olfactory binding protein, olfactory receptors cells continuously regenerate (about every 60 days), cilia (on olfactory receptor cells), glomerulus (contact zones between receptor cells and mitral cells:plural glomeruli), convergence (1,000:1), mitral cell, olfactory tubercle of cortex (part of paleocortex), medial dorsal nucleus of thalamus , orbitofrontal cortex, olfactory neocortex
paleocortex associated with limbic system, limbic system associated with emotions (electrical stimulation causes sham rage), limbic system associated with memories (H.M. had lesions here and lost the ability to memorize things), some hot spots in olfactory tubercle and on olfactory mucosa
KEYWORDS -- SMELL I
![Page 42: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/42.jpg)
odour quality, no primaries identified in olfactory system, poor tuning of receptors (to chemicals or chemical types) (sharpened by lateral inhibition, inhibitory interneurones, granule cells), Henning smell prism, stereochemical theories based on lock and key partially successful, BUT no receptor sites identified, similar shaped molecules can be associated with different smell perceptions
cells broadly tuned (responding to many different chemicals associated with many different smells)
codingintensity= firing rate/recruitment, quality = distributed pattern code, problems in identifying many smells at once, binding problem
KEYWORDS -- SMELL II
![Page 43: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/43.jpg)
odour thresholds, olfactorium; unique technical problems!, humans very sensitive (eg. mercaton can be detected at 1 part per 50,000,000,000), affected by gender; can be affected by menstrual cycle, affected by age
adaptation, thresholds raised (by exposure), masking (by other chemicals), some cross effects: eg. adapting to orange affects smell of lemons
identification, can identify gender from shirt, prefer own odours, odour memories long lasting; associated with emotions (via limbic system) "designed not to forget”, pheromones, releasers (immediate effect), eg. bitch on heat, territorial markers, humans?, McClintock effect (synchronized menstrual cycles), primers (longer term) eg. mice need males around for proper oestrus cycles
KEYWORDS -- SMELL III
![Page 44: Sensation and Perception (II) 3270 Speech](https://reader035.vdocuments.net/reader035/viewer/2022062314/56813bb1550346895da4e491/html5/thumbnails/44.jpg)
PATHWAYS olfactory receptor cells to mitral cells in olfactory bulb to olfactory tubercle in paleocortex THEN
1 to medial dorsal thalamus to olfactory cortex
(ORBITOFRONTAL CORTEX) 2 to limbic system 3 brain stem pathways associated with pheromones
ALSO
inhibitory pathway (via inhibitory interneurone: granule cells) from one olfactory bulb to the other to do with detecting the DIRECTION from which a smell originates
KEYWORDS -- SMELL IV