A study on evaluating English speech rate: Focusing on professional vs. non-professional raters
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
This study is designed to find out what speeds professional evaluators give the best scores to on speaking assessments and how their speed-related assessment differs from non-expert evaluators. The test tokens are designed to avoid the experimental complications that have normally appeared in previous studies of relevance. The test materials recorded by a trained native speaker with 8 different speed ranges are free of distortion caused by computer manipulation, and they exclude other factors affecting rating results as much as possible. Three different groups of eight each participated (8 native English raters and 8 Korean raters who had official evaluation experience on an English-speaking test as professional raters, and 8 general Korean student-raters with high English proficiency as non-professional raters), with 24 raters in total, and the results show that the range of the speaking rate that draws the highest score is between 4.43 and 4.50 syl/sec on average. The assessment of extremely fast speed ranges varied slightly among the three rater groups but all three groups showed a similar tendency.
Abstract
This study is designed to find out what speeds professional evaluators give the best scores to on speaking assessments and how their speed-related assessment differs from non-expert evaluators. The test tokens are designed to avoid the experimental complications that have normally appeared in previous studies of relevance. The test materials recorded by a trained native speaker with 8 different speed ranges are free of distortion caused by computer manipulation, and they exclude other factors affecting rating results as much as possible. Three different groups of eight each participated (8 native English raters and 8 Korean raters who had official evaluation experience on an English-speaking test as professional raters, and 8 general Korean student-raters with high English proficiency as non-professional raters), with 24 raters in total, and the results show that the range of the speaking rate that draws the highest score is between 4.43 and 4.50 syl/sec on average. The assessment of extremely fast speed ranges varied slightly among the three rater groups but all three groups showed a similar tendency.
참고문헌 (38)
- Anderson-Hsieh, Janet, "Syllable duration and pausing in the speech of Chinese ESL speakers", TESOL Quarterly, 28(4), pp.807~812 (1994)
- Apple, William, "Effects of pitch and speech rate on personal attributions", Journal of Personality and Social Psychology, 37(5), pp.715~727 (1979)
- Brindley, Geoff, "Exploring task difficulty in ESL listening assessment", Language Testing, 19(4), pp.369~394 (2002)
- Campbell, W. Nick, "Durational shortening and anaphoric reference", Proceedings of International Congress of Phonetic Sciences (ICPhS), 2, pp.286~289 (1991)
- Crystal, H. Thomas, "Segmental durations in connected‐speech signals: Current results", The Journal of the Acoustical Society of America, 83(4), pp.1553~1573 (1988)
- Cucchiarini, Catia, "Fluency in non-native read and spontaneous speech", Proceedings of Disfluency in Spontaneous Speech (DiSS) and Linguistic Patterns in Spontaneous Speech (LPSS) Joint Workshop (2010)
- Dankovičová, Jana, "The linguistic basis of articulation rate variation in Czech" (2001), Hector
- De Rooij, Johan, "Speech punctuation: An acoustic and perceptual study of some aspects of speech prosody in Dutch", PhD, pp.1979
- Derwing, Tracey M., "The relationship between L1 fluency and L2 fluency development", Studies in Second Language Acquisition, 31(4), pp.533~557 (2009)
- Derwing, Tracey M., "Second language fluency: Judgments on different tasks", Language Learning, 54(4), pp.655~679 (2004)
- Foulke, Emerson, "Listening rate preferences of college students for literary material of moderate difficulty", Journal of Auditory Research, 6, pp.65~89 (1966)
- Franco, Horacio, "Combination of machine scores for automatic grading of pronunciation quality", Speech Communication, 30(2), pp.121~130 (2000)
- Goldman-Eisler, Frieda, "Psycholinguistics: Experiments in spontaneous speech" (1968), Academic Press
- Götz, Sandra, "Fluency in native and nonnative English speech (vol. 53)" (2013), John Benjamins Publishing
- Griffiths, Roger, "Speech rate and NNS comprehension: A preliminary study in time-benefit analysis", Language Learning, 40(3), pp.311~336 (1990)
- Isaacs, Talia, "Towards defining a valid assessment criterion of pronunciation proficiency in non-native English-speaking graduate students", Canadian Modern Language Review, 2008, pp.64(4), 555~580
- Jacewicz, Ewa, "Between-speaker and within-speaker variation in speech tempo of American English", The Journal of the Acoustical Society of America, 128(2), pp.839~850 (2010)
- Kang, Okim, "Relative salience of suprasegmental features on judgments of L2 comprehensibility and accentedness", System, 38(2), pp.301~315 (2010)
- 강석한, "한국인 영어 발음의 좋음과 나쁨 인지 평가에 영향을 미치는 초분절 매개변수 연구", 말소리와 음성과학, 3(2), pp.3~10 (2011), 한국음성학회
- Kendall, Tyler, "Speech rate, pause and sociolinguistic variation: studies in corpus sociophonetics" (2013), Palgrave Macmillan
- Kim, Mi-Sun, "The speaking rate of English that evaluators prefer", Proceedings of Korean Society of Speech Sciences (KSSS) 2016 Fall Conference, pp.163~164 (2016)
- Klatt, Dennis H, "Linguistic uses of segmental duration in English: Acoustic and perceptual evidence", The Journal of the Acoustical Society of America, 59(5), pp.1208~1221 (1976)
- Lass, Norman J, "Listening rate preference: Comparison of two time alteration techniques", Perceptual and Motor Skills, 44(3), pp.1163~1168 (1977)
- 이주경, "Prosodic remedies of Korean talkers' English L2 speech: Optimal pitch and speech rate", 언어연구, 35(1), pp.203~232 (2018), 언어정보연구소[DOI]
- Lehtonen, Jaakko, "Perception and Production of English: Papers on Interlanguage", pp.35~51 (1979), Åbo Akademi
- Lindblom, Björn E, "Auditory Analysis and Speech Perception", pp.387~396 (1973), Academic Press
- Munro, Murray J, "The Effects of Speaking Rate on Listener Evaluations of Native and Foreign‐Accented Speech", Language Learning, 48(2), pp.159~182 (1998)
- Munro, Murray J, "Modeling perceptions of the accentedness and comprehensibility of L2 speech the role of speaking rate", Studies in Second Language Acquisition, 23(4), pp.451~468 (2001)
- Nakatani, Lloyd H, "Prosodic aspects of American English speech rhythm", Phonetica, 38, pp.84~105 (1981)
- Neumeyer, Leonardo, "Automatic text-independent pronunciation scoring of foreign language student speech", Proceedings of International Conference on Spoken Language Processing (ICSLP), pp.1457~1460 (1996)
- Nooteboom, Sibout G, "Production and perception of vowel duration: A study of durational properties of vowels in Dutch", PhD, pp.1972
- Quené, Hugo, "Multilevel modeling of between-speaker and within-speaker variation in spontaneous speech tempo", The Journal of the Acoustical Society of America, 123, pp.1104~1113 (2008)
- Riggenbach, Heidi, "Toward an understanding of fluency: A microanalysis of nonnative speaker conversations", Discourse Processes, 14(4), pp.423~441 (1991)
- Shattuck-Hufnagel, Stefanie, "The domain of phrase-final lengthening in English", The Sound of the Future: A Global View of Acoustics in the 21st Century, Proceedings of the 16th International Congress on Acoustics and 135th Meeting Acoustical Society of America, pp.1235~1236 (1998)
- Shrout, Patrick E, "Intraclass correlations: Uses in assessing rater reliability", Psychological Bulletin, 86(2), pp.420~428 (1979)
- Trofimovich, Pavel, "Learning second language suprasegmentals:Effect of L2 experience on prosody and fluency characteristics of L2 speech", Studies in Second Language Acquisition, 28(1), pp.1~30 (2006)
- Zellner, Brigitte, "Fundamentals of speech synthesis and speech recognition", pp.41~62 (1994), John Wiley
- Zellner, Brigitte, "Temporal structures for fast and slow speech rate", The Third ESCA, 1998, 143~146