한국어 말하기 수행평가의 발음 범주 채점 방식에 따른 채점 신뢰도 분석 -다국면 라쉬 모형을 활용하여-
A Study on the scoring reliability in pronunciation scale for speaking performance assessment -using Many-facet Rasch Model-
0
조회
0
다운로드
17
인용
0
참고문헌
키워드
초록
In order to rightfully evaluate the Korean examinee's speech performance with reliability, a ‘Performance Assessment’ must be implemented. And such implementation can also provide a positive reflux effect to the field of foreign language education. The raters reliability, the tasks reliability, scales reliability have been considered as important issues in the speaking performance assessment. This research involves in conducting a computer based Korean language Speech Performance assessment, and method of the‘many-facet Rasch model analysis’was implied to evaluate the reliability of the pronunciation assessment in the speaking performance assessment. This study results seem to be meaningful enough to help any consideration for scoring reliability of speaking performance assessment.
Abstract
In order to rightfully evaluate the Korean examinee's speech performance with reliability, a ‘Performance Assessment’ must be implemented. And such implementation can also provide a positive reflux effect to the field of foreign language education. The raters reliability, the tasks reliability, scales reliability have been considered as important issues in the speaking performance assessment. This research involves in conducting a computer based Korean language Speech Performance assessment, and method of the‘many-facet Rasch model analysis’was implied to evaluate the reliability of the pronunciation assessment in the speaking performance assessment. This study results seem to be meaningful enough to help any consideration for scoring reliability of speaking performance assessment.
참고문헌 (41)
- 국립국어원, "말하기능력 측정도구 개발1" (2006), 국립국어원
- 김성숙, "채점의 변동요인 분석방법에 대한 고찰-일반화가능도 이론과 다국면 라쉬 모형의 적용과 재해석", 교육평가연구, 14(1), pp.303~325 (2001)
- 신동일, "채점 경향 분석을 위한 Rasch 측정모형 적용 연구", 외국어 교육, 8(1), pp.249~272 (2001)
- 신동일, "Rasch 모형을 이용한 고등학교 영어과 말하기 및 쓰기 능력 등급 기술표 개발", 영어교육, 57(4), pp.469~499 (2002), 한국영어교육학회
- 신동일, "한국의 영어평가학2: 말하기시험편" (2006), 한국문화사
- 이은하, "학문 목적 한국어 학습자의 쓰기 수행 평가를 위한 분석적 채점척도 개발", 석사, pp.2007
- 이향, "말하기 수행 평가에서 발음 범주 채점의 최적화 방안 연구 -일반화가능도 이론을 활용하여-", 한국어교육, 23(2), pp.301~329 (2012), 국제한국어교육학회[DOI]
- 이향, "한국어 말하기 수행평가의 발음 범주 채점 기준에 따른 채점 신뢰도 분석 -다국면 라쉬 모형을 활용하여", 제6회 세계한국학대회 (2012), 한국학중앙연구원
- 이화여자대학교 언어교육원, "말이 트이는 한국어1" (2009), 이화여자대학교출판부
- 장소영, "언어교육평가 연구를 위한 FACETS 프로그램." (2009), 글로벌콘텐츠
- Arteaga, D. L., "Articulatory Phonetics in the First-Year Spanish Classroom", The Modern Language Journal, 84(3), pp.339~354 (2000)
- Bachman, L. F., "Fundamental considerations in language testing" (1990), Oxford University Press
- Bachman, L. F., "Language testing in practice" (1996), Oxford University Press
- Bachman, L. F., "Modern language testing at the turn of the century: assuring that what we count counts", Language Testing, 17(1), pp.1~42 (2000)
- Bongaerts, T., "Ultimate attainment in L2 pronunciation: The case of very advanced late L2 learners" (1999), Lawrence Erlbaum
- Brian, K., "Using G-theory and Many-face Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants", Language Testing, 15(2), pp.158~180 (1998)
- Brown, H. D., "Language assessment: principles and classroom practices", pp.2010, Pearson
- Brown, G., "Discourse Analysis. Cambridge Textbooks in Linguistics Series" (1983), Cambridge University Press
- Canale, M., "Theoretical bases of communicative approaches to second language teaching and testing", Applied Linguistics, 1(1), pp.1~46 (1980)
- Chen, Y., "Principles and methods of the teaching of pronunciation", Language learning & communication, 2, pp.75~76 (1982)
- Cutler, A., "Prosody in the comprehension of spoken language: A literature review", Language and speech, 40(2), pp.141~201 (1997)
- Elliott, A. R., "On the teaching and acquisition of pronunciation within a communicative approach", Hispania, 80(1), pp.95~108 (1997)
- Europe, C. O., "Common European Framework of Reference for Languages: learning, teaching, assessment" (2001), Press Syndicate of the University of Cambridge
- Hughes, A., "Testing for language teachers" (2003), Cambridge University Press
- Fulcher, G., "Invalidating validity claims for the ACTFL oral rating scale", System, 24(2), pp.163~172 (1996)
- Fulcher, G., "Testing second language speaking" (2003), Longman
- Hughes, A., "Testing for language teachers" (2003), Cambridge University Press
- Jenkins, J., "The phonology of English as an international language: New models, new norms, new goals" (2000), Oxford University Press
- Kenyon, D. M., "Introductory remarks at symposium on Development and use of rating scales in language testing", Paper presented at the 14th Language Testing Research Colloquium (1992)
- Linacre, J. M., "Many-faceted Rasch measurement" (1989), MESA press
- Lumley, T., "Rater characteristics and rater bias: Implications for training", Language Testing, 12(1), pp.54~71 (1995)
- McNamara, T. F., "Measuring second language performance" (1996), Longman
- Morley, J., "The pronunciation component in teaching English to speakers of other languages", Tesol Quarterly, 25(3), pp.481~520 (1991)
- Morrison, DM, "Simulating an academic tutorial: A test validation study, In New directions in language testing", pp.85~92 (1985), Pergamon institude of English
- Norris, J. M., "Designing second language performance assessments" (1998), Second Language Teaching and Curriculum Center
- North, B., "The development of a common framework scale of language proficiency" (2000), Peter Lang Press
- Rasch, G., "Probabilistic models for some intelligence and attainment tests" (1980), University of Chicago Press
- Skehan, P., "A cognitive approach to language learning" (1998), Oxford University Press
- Shohamy, E., "Interrater and intrarater reliability of the oral interview and concurrent validity with cloze procedure in Hebrew, In Issues in Language Testing Research", pp.229~236 (1983), Newberry House
- Weigle, S. C., "Using FACETS to model rater training effects", Language Testing, 15(2), pp.263~ (1998)
- Wright, B. D., "A user’s guide to BIGSTEPS Rasch-model computer programs version 2.2" (1991), MESA Press
