중학교 영어교사의 말하기평가 채점경향 분석
A Study on Middle School English Teachers' Rating Patterns of Speaking Test
0
조회
0
다운로드
14
인용
0
참고문헌
키워드
초록
The purpose of this study is to investigate middle school English teachers' rater reliability in English speaking tests operated at schools. Eight raters who participated in this study all work at middle schools. Three of them are native speakers of English and have at least one year long educational experience at Korean middle schools, and five raters are middle school Korean English teachers with different educational experiences. The Korean English teachers are divided into two groups of ‘high’ English speaking competence and ‘medium’. All of them rated eighteen test takers' utterances, who are second year at a middle school, and their rating patterns were analyzed with FACETS, a computerized program of many-faceted Rasch model. This study also interviewed the raters to make it possible to identify the causes of rater variability and rater errors in the procedures of rating, and the actual conditions of English speaking tests at a middle school
Abstract
The purpose of this study is to investigate middle school English teachers' rater reliability in English speaking tests operated at schools. Eight raters who participated in this study all work at middle schools. Three of them are native speakers of English and have at least one year long educational experience at Korean middle schools, and five raters are middle school Korean English teachers with different educational experiences. The Korean English teachers are divided into two groups of ‘high’ English speaking competence and ‘medium’. All of them rated eighteen test takers' utterances, who are second year at a middle school, and their rating patterns were analyzed with FACETS, a computerized program of many-faceted Rasch model. This study also interviewed the raters to make it possible to identify the causes of rater variability and rater errors in the procedures of rating, and the actual conditions of English speaking tests at a middle school
참고문헌 (14)
- 신동일, "채점경향 분석을 위한 Rasch 측정모형 적용연구", 외국어 교육, 8(1), pp.249~272 (2001)
- 신동일, "NEW FACETS을 활용한 채점자료 분석방법", Foreign Languages Education, 12(2), pp.191~212 (2005), 한국외국어교육학회
- 장소영, "영어 말하기 능력의 이해: 채점자 변이로부터 평가 결과의 새로운 해석", 석사, pp.2001
- 장소영, "언어교육평가 연구를 위한 FACETS 프로그램:기초 과정편" (2009), 글로벌콘텐츠
- 한문섭, "SEPT 채점 신뢰도와 타당도 연구", 영어교육연구, 16(2), pp.285~299 (2004), 팬코리아영어교육학회
- Halleck,G, "The Oral Proficiency Interview: Discrete Point Test or a Measure of Communicative Language Ability", Foreign Language Annals, 25, pp.227~231 (1992)
- 정영경, "Preparing Bilingual Pre-Service Teachers for Bilingual Students in the US", 언어과학, 18(1), pp.153~175 (2011), 한국언어과학회
- Kim,Y.S, "Conversation Analysis in Second Language Classroom Talk", Journal of Language Sciences, 5(2), pp.295~311 (1998)
- Linacre,J.M, "Many-facet Rasch Measurement" (1989), MESA Press
- McNamara,T.F, "Measuring Second Language Performance" (1996), Pearson Education
- McNamara, T. F, "Exploring Rater Behavior with Rasch Techniques", ERIC Document Reproduction Service ED 345498, ~ (1991)
- North,B, "The Development of Descriptors on Scales of Language Proficiency, In NFLC Occational Papers" (1993), National Foreign Language Center at the Johns Hopkins University
- Savignon,S, "Evaluating of Communicative Competence: The ACTEL Provisional Proficiency Guidelines", Modern Language Journal, 69, pp.129~134 (1985)
- Stansfield, C. W, "A Long-term Research Agenda for the Tests of Written English", Language Testing, 5(2), pp.160~186 (1998)