Rater's subjectivity in an Oral Test
Rater's Subjectivity in an Oral Test
0
조회
0
다운로드
0
인용
0
참고문헌
초록
Abstract
The Linguistic Association of Korea Journal, 12(3), 151-170. This experimental study investigated the seriousness of rater's subjectivity in an oral test. The researcher analyzed the verbal test results of English native speakers, who are assumed to be reliable and competent raters only because they are from English speaking countries. The researcher correlated the raters' and inter-raters' scores to those of the examinees' ranks, and investigated the English native speakers' scoring tendencies in the process of their evaluation. From comparing the statistics for the discrepancies between the examinees' scores and rankings, this study admonishes untrained evaluators to be aware of subjectivity, and also suggests that subjective tests should not be used for examinees' rank order even though the results are statistically very significant.
참고문헌 (32)
- "A development of rating scales for language(English)", 4(1), pp.189~221 (1998)
- "A study of marking behaviors in performance assessment of English writing", 12(2), pp.25~54 (1999)
- "A study on English oral performance tests methods and measurement reliability", 15(1), pp.171~198 (1999)
- "Exploring rating patterns with Rasch measurement techniques implications for training", 8(1), pp.249~272 (2001)
- "Validation process of an EFL speaking test on G-theory and other analytical techniques", 17(1), pp.199~221 (2001)
- "Understanding rating error sources on halo effect", 9(4), pp.215~232 (2002)
- "English Language Testing in Korea" (2003), Seoul: Hankookmunhwasa
- "An investigation into Korean markers' reliability for English writing assessment", 53(1), pp.179~200 (1998)
- "Assessing Korean university students' spoken English proficiency", 50(1), pp.37~63 (1995)
- "A Dictionary of English Language Teaching" (1991)
- "University of Lancaster" (1990), Unpublished doctoral dissertation
- "Language Comprehension and the Acquisition of Knowledge" (1972)
- "The validity of using holistic scoring to evaluate writing Research on the Teaching of English", pp.65~81 (1984)
- "The Development of Modern Language Skills from Theory to Practice The Center for Curriculum Development" (1971)
- "Resurrecting some answers and questions about the structure of job performance rating categories", pp.489~502 (1983)
- "Counseling-Learning in Second Language" (1976)
- "Examining rater errors in the assessment of written composition with a many-faceted Rasch model Journal of Educational Measurement", pp.93~112 (1994)
- "Testing English as a Second Language" (1969), McGraw-Hill Book
- "Testing for Language Teachers" (1989), Cambridge Universit Press
- "Perceiving Writing quality through gender lenses Paper presented at the 26th Annual TESOL Convention" (1992)
- "A study of the decision-making behavior of composition markers Paper presented at the 15the Language Testing Research Colloquium", milla(vic) (1993)
- "Techniques of evaluation for a notional syllabus" (1977), The Royal Society of Arts
- "Principles of communicative methodology Communication in the classroom" (1981)
- "Evidence of a general language proficiency factor", pp.165~174 (1976)
- "Prochievement testing of speaking" (1989)
- "Assessing the psychometric quality of rating data", pp.413~428 (1980)
- "the problem of validation", pp.88~94 (1968)
- "Comparing scales of speaking tasks by language teachers and by the ACTFL guidelines Validation in language testing", pp.124~153 (1992)
- "The cloze test as a measure of English proficiency", pp.239~248 (1974)
- "A Natural Approach to Second Language Acquisition and Learning", pp.325~337 (1977)
- "A handbook of oral testing techniques" (1987), Cambridge University Press
- "The Case for Authentic Assessment" (1990)
