Slide 1

Slide 2

Getting the Biggest Bang for Your Buck Maddie Kiley, Douglas Margolis, & Amara Treuenfels University of WisconsinRiver Falls 1

Slide 3

Pronunciation Research Step One Task Design Speech Samples Step Two Rating Scale Ratings of Speech Samples Step Three Transcription Coding & Analysis 2 RQ1: What are the most frequent pronunciation issues of Korean and Taiwanese ELLs? RQ2: What factors most contribute to nave listeners ratings? RQ3: Does task type affect performance and ratings?

Slide 4

Step One: Tasks Description Narration Script 3

Slide 5

Collection of Speech Samples 4 GenderAge Study Abroad English Practice Years English Study MaleFemale< 23>24YesNo Private Tutor Language Institute Mean (SD) Taiwanese66102752 13.3 (2.54) Korean28649164 16.2 (2.66)

Slide 6

Step Two: Rating Raters N = 17 3 Males 14 Females Ages 20 28 (Mean = 24, SD = 2.34) All studied a 2nd language 14 had international travel experience 5

Slide 7

Step Two: Overall & Complexity Ratings Inter-Rater Reliability 6

Slide 8

Fluency & Comprehensibility Inter-Rater Reliability 7

Slide 9

Step Three: Transcription 8 Reliability Analysis Task 2 Agreement = 92.4% Task 3 Agreement = 97.3%

Slide 10

Findings 9 TaiwaneseKorean Pauses2.081.9 Filled Pauses39.3 Grammar169.5 Total Words189172 Words per Second1.771.46

Slide 11

Most Frequent Pronunciation Errors 10

Slide 12

Years of Study on Fluency & Comprehensibility 11

Slide 13

Pronunciation Errors on Fluency 12

Slide 14

Grammar Errors on Fluency 13

Slide 15

Implications & Limitations For assessing oral tasks, the length and total word count should be taken into consideration. Specific attention to interdental phonemes would be beneficial for both populations. Koreans tend to articulate each phoneme, whether accurate or inaccurate. Taiwanese diversity of pronunciation errors was over 50% larger than that of the Koreans. This suggests that whole-group pronunciation discussion would be more beneficial to Korean students. Years of Study had the greatest effect on Fluency and Comprehensibility Ratings Grammar errors appear to NOT impact fluency ratings Task does make a difference 14

Slide 16

For more information Doug Margolis Dept of English: TESOL Program University of Wisconsin-River Falls River Falls, WI 54022 Office: 715-425-3754 douglas.margolis@uwrf.edu Amara Treuenfels amara.treuenfels@my.uwrf.edu 15 madeline.kiley@my.uwrf.edu Maddie Kiley