how does the hearing system perform auditory scene analysis? · 2015-11-24 · auditory scene...
TRANSCRIPT
![Page 1: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/1.jpg)
How Does the Hearing System Perform Auditory Scene Analysis?
Georg M. Klump
서울대학교
인지과학 협동과정
박예슬
![Page 2: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/2.jpg)
Contents
Key question Basic auditory system 2 ways of processing Segregation of sequential tone pulses Object formation by common modulation Object formation by spatial processing Good continuation: top-down processing Conclusion Future study
![Page 3: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/3.jpg)
Key questions
How does the brain perform the auditory scene analysis?
Auditory Scene Analysis - Termed by Albert Bregman - The process by which the human auditory system organizes sound into perceptually meaningful elements.
Auditory Stream - A perceived melodic line
![Page 4: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/4.jpg)
Basic auditory system
Cochlea as a Fourier transformer
![Page 5: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/5.jpg)
2 ways of processing
Bottom-up processing - Segregation of sequential tone pulses - Object formation by common modulation CMR, MDI - Object formation by spatial processing Top-down processing - Perceptual restoration of interrupted speech
![Page 6: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/6.jpg)
Segregation of sequential tone pulses
The segregation of tone sequences depending on the proximity of the tones in time and frequency
-Percepts as one stream like galloping rhythm or separated stream
Open circle: Human perceptual data Filled circle: European starling perceptual data
Filled square: L2 in the starling forebrain
![Page 7: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/7.jpg)
Segregation of sequential tone pulses
Responses in the primary auditory cortex of the macaque monkey
Fishman, Y. I., Reser, D. H., Arezzo, J. C., & Steinschneider, M. (2001)
![Page 8: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/8.jpg)
Segregation of sequential tone pulses
Fishman thought about local inhibitory circuit in the primary auditory cortex about the suppression. But this can be the result of across-frequency processing at lower levels (cochlear nuleus) Build-up effect (Micheyl et al.) : might be affected by attention Other cues : envelope, interaural time, intensity..
![Page 9: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/9.jpg)
Object formation by common modulation
Temporally coherent changes (correlated variation) of each frequency: potent cues of grouping of the components CMR(Correlated Modulation Release) CMR shows us that if the difference frequency band signals has (temporally) correlated amplitude fluctuations, auditory system can know that (its’ threshold value is decreased) 1. Analysis of the excitation within a single frequency channel centered on the signal (Human) 2. A comparison of excitation across different frequency channels (other animals) MDI(Modulation detection interference In MDI also means the interaction of multiple frequency channel
![Page 10: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/10.jpg)
Object formation by common modulation
For detect to target signal, Best efficient S/N filter(s) is used If target signal and coherent modulated noises are presented simultaneously, the threshold of target signal is decreased. Release value is bigger when fluctuation is slow, and noise bandwidth is broad
Th
resh
old
of
sign
al (
dB
SP
L)
Bandwidth of noise (Hz)
Randon noise comodulated noise
<Auditory filter> <CMR effect>
![Page 11: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/11.jpg)
Object formation by spatial processing
a model allowing representation of two sound sources in the ICx of barn owl when presented with temporally
uncorrelated noise bursts (Takahashi, Keller (1994))
To identify different locations of sound source, about duration of 100ms is needed
![Page 12: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/12.jpg)
Good Continuation : top-down processing
The perceptual restoration of interrupted speech could be a evidence for top-down processing Human , birds could percept one continue stream Sound perception (speech restoration) could be supported by memory process and perceptual learning, if the appropriate excitation is present
#ite kite, bite…
_ite _ite
Warren, R. M. (1970)
![Page 13: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/13.jpg)
Conclusion
Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude… And distributed population coding is able to combine these information (Each neural excitation encodes relevant stimulus characteristics) Analysis is performed through top-down process and bottom-up process both
![Page 14: How Does the Hearing System Perform Auditory Scene Analysis? · 2015-11-24 · Auditory scene analysis through combination of multiple stimulus dimensions like location, timbre, amplitude…](https://reader034.vdocuments.net/reader034/viewer/2022050719/5f36d751cd95f064dd54d0ab/html5/thumbnails/14.jpg)
Future study
Distributed populations of cortical neuron in Visual scene analysis Temporal correlations of distributed neural activity Temporal patterns of the neural response using stimulus paradigms