SEPT 채점 신뢰도와 타당도 연구
Exploring SEPT in rater reliability and test validity
0
조회
0
다운로드
5
인용
0
참고문헌
초록
Abstract
The purpose of this study is to explore the rater reliability and test validity of SEPT (Spoken English Proficiency Test) developed by YBM Sisa-Yong-A-Sa in Korea. For this purpose, the performance of 47 test-takers was rated and analyzed using Rasch modelled FACETS (Linacre & Wright, 1993). Speaking performance in SEPT was also compared with candidates’ TOEIC sub-scores. After exploring the psychometric extent to which the test criteria and tasks of the SEPT are valid, it was concluded that the testing scheme partially met the theoretical and empirical consideration behind the test specification and rater training. Implications for further revision of the SEPT are discussed.
참고문헌 (12)
- 신동일, "ACTFL-SOPI 체제의 영어 말하기평가 현장연구:한국에서의 문제점과 현실적 대안", 56(2), pp.309~331 (2001)
- 신동일, "채점경향 분석을 위한 Rasch 측정모형 적용연구", 8(1), pp.249~272 (2001)
- 신동일, "한국의 영어평가학 1: 시험개발편." (2003), 한국문화사
- Linacre,J.M, "Many-facet Rasch measurement" (1989), MESA Press
- & Wright, "A user’s guide to FACETS", pp.~2 (1993), MESA Press
- Lumley, T.,, "Rater characteristics and rater bias: Implications for training.", 12, pp.54~71 (1995)
- McNamara,T.F, "Measuring second language performance" (1996), Longman
- North, "The development of descriptors on scales of language proficiency National Foreign Language Center at the Johns Hopkins University" (1993)
- North, B., "Scaling descriptors for language proficiency scales", 15(2), pp.217~262 (1998)
- Pollitt,A, "Calibrating graded assessments:Rasch partial credit analysis of performance in writing", 4(1), pp.72~79 (1987)
- Weigle,S.W, "Using FACETS to model rater training effects", 15, pp.263~287 (1998)
- Woodford, "An introduction to TOEIC" (1982), Princeton