현직 영어교사의 영어로 진행하는 영어수업능력 평가에 대한 타당도 검증 연구
Validating the assessment of Teaching English in English for contemporary English teachers
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The purpose of this paper is to validate the assessment of teaching English in English (TEE) for English teachers which was conducted by a regional Office of Education in Korea. For the research data 64 English teachers were assessed by three groups of invited raters (twenty-two raters in total): eight native university lecturers, nine Korean university professors and five Korean English teachers. In assessing the teachers’ TEE performances the raters used the TEE rating scale which comprised four domains of TEE: Organizational Skills, English Proficiency, Teaching Skills and Learner’s Activity. In order to investigate the reliability of TEE scoring, the computer program of Facets, which was developed based on the many-facet Rasch measurement (MFRM) model, was used. The analysis results showed that the ratings for the TEE performances of participating English teachers were generally reliable and appropriate, although a few cases of unreliable scoring by a couple of raters were found. A suggestion is made to develop the validation framework for the current TEE assessment in terms of MFRM analysis.
Abstract
The purpose of this paper is to validate the assessment of teaching English in English (TEE) for English teachers which was conducted by a regional Office of Education in Korea. For the research data 64 English teachers were assessed by three groups of invited raters (twenty-two raters in total): eight native university lecturers, nine Korean university professors and five Korean English teachers. In assessing the teachers’ TEE performances the raters used the TEE rating scale which comprised four domains of TEE: Organizational Skills, English Proficiency, Teaching Skills and Learner’s Activity. In order to investigate the reliability of TEE scoring, the computer program of Facets, which was developed based on the many-facet Rasch measurement (MFRM) model, was used. The analysis results showed that the ratings for the TEE performances of participating English teachers were generally reliable and appropriate, although a few cases of unreliable scoring by a couple of raters were found. A suggestion is made to develop the validation framework for the current TEE assessment in terms of MFRM analysis.
참고문헌 (24)
- 고정민, "교수법, 영어로 진행하는 영어수업, 원어민 교사 및 수준별 수업을 중심으로 살펴본 초등 영어교육 실태", 영어교과교육, 9(3), pp.101~118 (2010), 한국영어교과교육학회
- 제13회 교실수업개선실천사례 연구발표대회(영어과) 우수 보고서 모음집, "김성혜", 한국교육과정평가원, ~, pp.ORM 2012-5-1 (2012)
- 제15회 교실수업 개선 실천 사례연구 발표대회(영어과) 운영 결과보고, "박상복", 한국교육과정평가원, ~, pp.ORM 2014-3-2 (2014)
- 영어로 진행하는 영어수업(TEE): 진단매뉴얼 개발 및 활용방안 모색, "박준언", 교육인적자원부, ~, pp.인적자원개발 정책연구 2007-공동-15 (2008)
- 고정민, "의사소통중심 영어수업평가도구 개발: 해외사례를 중심으로", 영어영문학연구, 35(4), pp.125~155 (2009), 대한영어영문학회
- 이영식, "한국어 작문 평가 채점의 타당도 검증: 다국면 Rasch 측정 모형 활용", Foreign Languages Education, 21(3), pp.355~375 (2014), 한국외국어교육학회[DOI]
- 영어과 교육목표 및 내용체계 연구Ⅱ, "임찬빈", 한국교육과정평가원, ~, pp.연구보고 RRC 20 (2003)
- 2010년 영어수업개선 연구대회, "임찬빈", 한국교육과정평가원, ~, pp.CRO 2011-2 (2011)
- 2009년 영어수업개선 연구대회, "임찬빈", 한국교육과정평가원, ~, pp.CRO 2010-1 (2010)
- 영어수업개선 연구대회, "주형미", 한국교육과정평가원, ~, pp.CRI 2008-2 (2008)
- 의사소통 중심의 영어교육 활성화 방안, "최진황", 한국교육과정평가원, ~, pp.연구보고 CRC 2003-8 (2003)
- 안병규, "The Effect of an Intensive In-service English Teacher Development Program on Teaching Performance", 영어교육연구, 23(2), pp.1~23 (2011), 팬코리아영어교육학회
- Barkaoui, K., "The companion to language assessment", pp.1302~1322 (2014), John Wiley & Sons, Inc
- Bond, T. G., "Applying the Rasch model: Fundamental measurement in the human sciences" (2007), Routledge
- Eckes, T., "Introduction to many-facet Rasch measurement" (2011), Peter Lang GmbH
- 김성애, "A Critical Reflection on the ‘Teaching English Through English’ Classes in the Korean Context", 영어교육, 57(4), pp.315~346 (2002), 한국영어교육학회
- 김성연, "Five Years of Teaching English Through English: Responses from Teachers and Prospects for Learners", 영어교육, 63(1), pp.51~70 (2008), 한국영어교육학회
- 김영숙, "Teachers’ and Students’ Perception of English Use in the Secondary English Classroom", 영어교육, 57(4), pp.131~156 (2002), 한국영어교육학회
- 이진화, "Where to Start Teaching English Through English:Based on Perceived Effectiveness of Teachers’ English Use", 영어교육, 62(4), pp.335~354 (2007), 한국영어교육학회
- 이영식, "The status quo of secondary English education in the new millenium", 영어교과교육, 11(1), pp.49~69 (2012), 한국영어교과교육학회
- Linacre, J. M., "A user’s guide to FACETS: Rasch-model computer programs (Program Manual 3681)" (2011), Winstepscom
- McNamara, T. F., "Measuring second language performance" (1996), Addison Wesley
- Ockey, G., "The Routlege handbook of language testing", pp.336~349 (2012), Routledge
- Rasch, G., "Probabilistic models for some intelligence and attainment tests" (1980), University of Chicago Press