Challenge of World Englishes to Language Testing: Investigation of Rater Variability in the Assessment Process
0
조회
0
다운로드
7
인용
0
참고문헌
초록
Abstract
This study examined whether or not there was an interaction between raters’ English language backgrounds and their attitudes toward World Englishes (WEs) in their rating of Korean students’ English language oral proficiency on the Test of Spoken English (TSE) picture-description task using holistic and six analytic rating scales (grammatical accuracy, vocabulary, pronunciation/accents, rate of speech, organization, and task fulfillment). This study also examined whether or not raters’ English language backgrounds and their attitudes toward WEs in language testing affected their rating of six Korean students’ speech samples using holistic and analytic rating scales. It was found that raters had substantial variability in the process of assessing the speech samples when they use analytic rating scales and these raters’ ratings were revealed to be influenced more by their attitudes toward WEs in language testing than by their English language backgrounds.
참고문헌 (32)
- Bachman, "Fundamental considerations in language testing" (1990), Oxford University Press
- Brown,A, "The effect of rater variables in the development of an occupation- specific language performance test", 12(1), pp.1~15 (1995)
- Brumfit, C. J, "Individual freedom in language teaching: Helping learners to develop a dialect of their own" (2001), Oxford University Press
- Brutt-Griffler, J, "Revisiting the colonial in the postcolonial critical praxis for nonnative English-speaking teachers in a TESOL program", 33, pp.413~431 (1999)
- Chalhoub-Deville,M, "Second language interaction:Current perspectives and future trends", 20, pp.369~383 (2003)
- Chalhoub-Deville, M, "A look back at and forward to what language testers measure. Researching pedagogic tasks: Second language learning, teaching and testing." (2005)
- Davies, "Principles of language testing" (1990), Basil Blackwell
- Jenkins, J, "World Englishes" (2003)
- The other tongue, "University of Illinois Press" (1982)
- In R, "The English language in outer circle English in the World", pp.11~30 (1985), Cambridge University Press
- Kachru, B. B, "Past imperfect: The other side of English in Asia. Resources for research and teaching", pp.209~251 (1997)
- Kachru, B. B, "World Englishes. Analyzing English in a global context", pp.9~25 (2001)
- Lumley, "Implications for training", 12(1), pp.54~71 (1995)
- Lunz, "Measuring the impact of judge severity on examination scores Applied Measurement in Education", pp.331~345 (1990)
- Lynch, B. K, "Using G-theory and many-facet rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants", 15(2), pp.158~180 (1998)
- McKay, S, "Teaching English as an international language: Rethinking goals and approaches" (2002), Oxford University Press
- McNamara, T. F, "Measuring second language performance" (1996)
- McNamara, T. F, "Interaction in second language performance assessment: Whose performance?", 18, pp.446~466 (1997)
- McNamara, T. F, "Looking back, looking forward: Rethinking Bachman", 20, pp.466~473 (2003)
- Modiano,M, "International English in the global village", 15(2), pp.22~34 (1999)
- Modiano, M, "Standard English (es) and educational practices for the worlds lingua franca", 15(4), pp.3~13 (1999)
- Pennycook, A, "Pedagogical implications of different frameworks for understanding the global spread of English, Teaching and learning English as a global language" (1999)
- Pennycook, A, "Critical applied linguistics: A critical introduction" (2001)
- Seidlhofer,B, "Double standards: Teacher education in the expanding circle", 18(2), pp.233~245 (1999)
- Shim, R. J, "Codified Korean English: Process, characteristics and consequence", 18(2), pp.247~258 (1999)
- Skehan,P, "A cognitive approach to language learning" (1998), Oxford University Press
- Thorndike, "A Constant error on psychological rating Journal of Applied Psychology", pp.25~29 (1920)
- Weigle, "Effects of training on raters of ESL compositions"
- Widdowson, "The ownership of English", pp.377~389 (1994)
- Wigglesworth,G, "Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction", 10, pp.305~335 (1993)
- Wigglesworth, G, "Influences on performance in task-based oral assessments. Researching pedagogic tasks second language learning, teaching and testing" (2001)
- Yano, Y, "World Englishes in 2000 and beyond", 20(2), pp.119~131 (2001)
