perception of language -...
TRANSCRIPT
![Page 1: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/1.jpg)
Psycholinguistics 04
Perception of Language
![Page 2: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/2.jpg)
Perception of Language
• Structure of Speech• Perception of Isolated Speech Segments• Perception of Continuous Speech• Perception of Written Language
![Page 3: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/3.jpg)
Structure of Speech
• Speech recognition is a complex process.Normal environmental conditions are full ofdistractions that interfere with the fidelity ofthe speech signal. The variability of thespeech signal also influence or distort theacoustic stimulus.
![Page 4: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/4.jpg)
Prosodic Factors
• Stress: emphasis given to syllables in asentence.
• Intonation: use of pitch to signify differentmeanings;
• Rate: speed at which speech is articulated.
![Page 5: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/5.jpg)
Articulatory Phonetics
• Place of articulation• Manner of articulation• Voiced and voiceless
![Page 6: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/6.jpg)
Acoustic Phonetics
• Spectrograms: descriptionof the acoustical energy ofspeech sounds
• Formant: concentrationof acoustical energy (darkbands in spectrograms)
• Formant transitions: largerises or drops in formantfrequency
![Page 7: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/7.jpg)
Acoustic Phonetics• Parallel transmission:
different phonemes of thesame syllable are encodedinto the speech signalsimultaneously—no sharpphysical break betweenadjacent sounds
• Context-conditioned variation: the exact spectrographic appearance of a given phone is related to the speech context.
![Page 8: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/8.jpg)
Perception of Isolated Speech Segments
• Speech as a Modular System• Criteria for modularity• 1. domain specific• 2. operate on a mandatory basis• 3. fast• 4. unaffected by feedback
![Page 9: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/9.jpg)
Problem of Invariance• There is no one-to-one correspondence
between acoustic cues and perceptual events.• Speech is a special mode of perception• Context plays an important role too.
![Page 10: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/10.jpg)
Categorical Perception
• categorical identification of the incoming speech signal. the presence of sharp identification functions ([ba]:[pa]) and failure to discriminate between sounds within a given sound class
![Page 11: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/11.jpg)
Categorical Perception
• Mattingly (1971): there was categoricalperception for the synthesized syllables butnot for the chirps, bleats, or backwardsounds.
• Formant transitions provide important information for producing special mode of speech perception.
![Page 12: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/12.jpg)
The Motor Theory of Speech Perception
• Liberman (1967): Listeners use implicitarticulatory knowledge—knowledge abouthow sounds are produced—as an aid inperception. This mechanism dealseffectively with the problem of invariance.
• Criticism: the theory is too abstract to be testable.
![Page 13: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/13.jpg)
Perception of Continuous Speech
• Pollack’s test (1964): only one half of theisolated words in conversations can becorrectly identified.
• Conclusion: context plays a significant rolein our identification of speech.
• Prosodic factors and semantic and syntactic factors
![Page 14: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/14.jpg)
Prosodic Factors in Speech Recognition• Stress: pitch, duration, intensity, loudness, rate of
syllables• Martin (1972): the stress pattern of speech provides
cues for listeners to anticipate what is coming nextand listeners tend to organize their perceptionaround stressed syllables.
• Detection rates are faster with stressed syllables thanwith unstressed syllables, and this occurs only forspeech.
• We tend to interpret continuous speech in terms ofstress patterns.
![Page 15: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/15.jpg)
Prosodic Factors in Speech Recognition
• Rate : As we speed up, vowel duration is reduced, and the duration of the cues that signal various consonantal distinctions is also modified.
![Page 16: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/16.jpg)
Semantic and Syntactic Factors • Miller’s test (recognition of grammatical,
anomalous and ungrammatical strings, 1963)shows that the more predictable a passage, thebetter it is recognized. A top-down processing ofcontinuous speech seems most likely when thespeech context is semantically reasonable andfamiliar to the listener.
• Phonemic restoration• Listeners will restore the missing phonemes.
Context helps determine how phonemicrestoration take place.
![Page 17: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/17.jpg)
Trace Model
• Several levels of processing, distinctive features,phonemes, and words are simultaneously activeduring speech perception and interact with eachother. Cognitive units at the feature, phoneme andword levels are activated to a greater or lesserextent. When units are activated above a certainthreshold, they may influence other units at thesame or different levels.
![Page 18: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/18.jpg)
Perception of Written Language
• Writing System– Logography: Chinese—stroke, radical,
character– Syllabary: Japanese– Alphabet: English
![Page 19: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/19.jpg)
Level of Processing
• Feature level: the stimulus is represented interms of the physical features.
• Letter level: the visual stimulus isrepresented more abstractly as an identityseparate from its physical manifestation.
• Word level: an array of features and letters is recognized as a familiar word.
![Page 20: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/20.jpg)
Perception of Letters in Isolation
• Letter recognition tests shows that we identify letters from a variable number of features, depending on the other letters that are present. The detection of the letter Z is faster in the left array than in the right where the features of the letters are closer to each other.
![Page 21: Perception of Language - IAUNresearch.iaun.ac.ir/pd/shafiee-nahrkhalaji/pdfs/UploadFile_8210.pdfPsycholinguistics 04 Perception of Language . Perception of Language • Structure of](https://reader035.vdocuments.net/reader035/viewer/2022070216/611d274f1f2b1b083a234e04/html5/thumbnails/21.jpg)
Perception of Letters in Isolation
• Biological proof: cells in the visual cortexof cats are selectively responsive to visualstimulation such as vertical lines, edges oflines, etc.