한국인 영어 학습자의 발음에 대한 영어 원어민과 한국인 채점자의 평가 행위에 관한 비교 연구
An investigation into native English-speaking and Korean raters’ judgments of Korean English learners’ pronunciations.
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
The present study examines the rating criteria, rating behaviors, and inter-rater reliabilities between native English-speaking (NES) raters and Korean raters in their judgments of Korean English learners’ pronunciations. Fifteen NES and 15 Korean English-teaching professionals rated the pronunciation in 15 Korean English learners’ utterances responding to a controlled and a spontaneous speech prompt. The two rater groups showed no significant differences in their rating scores. Many-facet Rasch model tests also revealed no different rating patterns between the groups. However, the raters’ think-aloud protocols suggested the possible differences in the raters’ sound recognitions and/or evaluation foci. Specifically, the NES raters commented on the errors on both consonant and vowel sounds while the Korean raters tended to mainly focus on the errors on consonant sounds. The NES raters evaluated the errors on word stress but few Korean raters ever considered stress errors. The study results suggest that despite the good estimates of inter-rater and intra-rater reliabilities of rating scores, NES and Korean raters could differ in their sound recognitions and evaluation foci. Suggestions for future research and implications for rater training are provided, along with the limitations of the study.
Abstract
The present study examines the rating criteria, rating behaviors, and inter-rater reliabilities between native English-speaking (NES) raters and Korean raters in their judgments of Korean English learners’ pronunciations. Fifteen NES and 15 Korean English-teaching professionals rated the pronunciation in 15 Korean English learners’ utterances responding to a controlled and a spontaneous speech prompt. The two rater groups showed no significant differences in their rating scores. Many-facet Rasch model tests also revealed no different rating patterns between the groups. However, the raters’ think-aloud protocols suggested the possible differences in the raters’ sound recognitions and/or evaluation foci. Specifically, the NES raters commented on the errors on both consonant and vowel sounds while the Korean raters tended to mainly focus on the errors on consonant sounds. The NES raters evaluated the errors on word stress but few Korean raters ever considered stress errors. The study results suggest that despite the good estimates of inter-rater and intra-rater reliabilities of rating scores, NES and Korean raters could differ in their sound recognitions and evaluation foci. Suggestions for future research and implications for rater training are provided, along with the limitations of the study.
참고문헌 (26)
- 배소연, "한국인의 영어 발음에 대한 한국인 평가자의 일관성 연구 : 평가자 내적", 외적 신뢰도 분석, 계명대학교 교육대학원, pp.영어교육, 2010
- 윤원희, "한국인 영어 학습자의 영어 발음평가 DB 구축을 위한 한국인 평가자 연구", 언어과학연구, 45(45), pp.239~256 (2008), 언어과학회
- 윤원희, "한국인 영어 학습자 발음평가에 대한 한국인과 원어민의 차이", 언어과학연구, 48(48), pp.201~217 (2009), 언어과학회
- 윤원희, "영어 발음 평가에서 한국인 평가자 사이의 평가 차이", 외국어교육연구, 23(2), pp.85~103 (2009), 외국어교육연구소
- 윤원희, "영어 발음평가에서 한국인 영어교사의 평가 일관성과 듣기 숙련도의 관계", 영미어문학, 99(99), pp.191~205 (2011), 한국영미어문학회
- 윤원희, "영어 발음평가에서 한국인 평가자의 영어 숙련도에 따른 타당성 및 신뢰도", 언어와언어학, 51(51), pp.71~94 (2011), 언어연구소
- 이석재, "한국인의 영어 문장 발음에 대한 한국인", 원어민, 대한음성학회 가을 학술대회 발표논문집, pp.2003[DOI]
- 정현성, "한국인 영어 학습자의 발음 정확성 자동 측정방법에 대한 연구", 언어와언어학, 42(42), pp.165~196 (2008), 언어연구소
- 최순재, "한국인 화자 영어 발음의 명료도, 이해도 및 억양도 : 모국어 배경이 다른 청자를 중심으로", 석사, 영어교육, pp.2010
- Avery, P., "Teaching American English pronunciation" (1992), Oxford University Press
- Bent, T., "The interlanguage speech intelligibility benefit", Journal of Acoustical Society of America, 114, pp.1600~1610 (2003)
- Brown, A., "The effect of rater variables in the development of an occupationspecific language performance test", Language Testing, 12(1), pp.1~15 (1995)
- Celce-Murcia, M., "Teaching pronunciation : A course book and reference guide" (2010), Cambridge University Press
- Dauer, R., "The lingua franca core: A new model for pronunciation instruction?", TESOL Quarterly, 39(3), pp.543~550 (2005)
- Fayer, J. M., "Native and non-native judgments of intelligibility and irritation", Language Learning, 37(3), pp.313~326 (1987)
- Jenkins, J., "The phonology of English as an International Language" (2000), Oxford University Press
- Jenkins, J., "A sociolinguistically based empirically researched pronunciation syllabus for English as an International Language", Applied Linguistics, 23(1), pp.83~103 (2002)
- Kim, Youn-Hee., "An investigation into native and non-native teachers' judgments of an English performance : A mixed methods approach", Language Testing, 26(2), pp.187~217 (2009)
- Major, R., "The effects of nonnative accents on listening comprehension : Implications for ESL assessment", TESOL Quarterly, 36(2), pp.173~190 (2002)
- McNamara, T. F., "Measuring second language performance" (1996), Longman
- Munro, M. J., "The mutual intelligibility of L2 speech", Studies in Second Language Acquisition, 28, pp.111~131 (2006)
- Pollitt, A., "Calibrating graded assessments : Rasch partial credit method analysis of performance in writing", Language Testing, 4, pp.73~92 (1987)
- Stansfield, C. W., "A long-term research agenda for the tests of written English", Language Testing, 5(2), pp.160~186 (1988)
- van Wijngaarden, S., "Intelligibility of native and non-native dutch", Speech Communication, 35, pp.103~113 (2001)
- "TOEFL equivalency table" (2014)[URL]
- 유경아, "The effect of raters’ language background on English-speaking test ratings across test-takers’ oral proficiency levels", 응용언어학, 26(4), pp.395~419 (2010), 한국응용언어학회