본문 바로가기
KERD
논문KCI 등재

영어 말하기 평가의 채점과정 연구

A Study on the assessment process of an English language oral proficiency test

김현주
대한영어영문학회 (The Association of English Language and Literature in Korea)|2007.12|영어영문학연구 (Studies in English Language & Literature)|제49권 제4호|pp. 169-186|DOI 10.18853/jjell.2007.49.4.009

1

조회

0

다운로드

9

인용

0

참고문헌

키워드

평가 기준validity타당도평가자평가 유형rater영어 말하기 평가rating criteriaEnglish language oral proficiency testtask-type
주제분류영어와문학

초록

Abstract

In order to provide an accurate measure of test-takers’ English language abilities, test developers should minimize the influence of intervening factors such as raters’ backgrounds on test results. The purpose of this study is to investigate the effects of raters’ language backgrounds and their attitudes toward WEs on the assessment process and to analyze the complex relationships among rater, task, and test scores in English language oral proficiency tests. Three groups of English teachers from the UK, Malaysia, and Japan took part in the study, providing scores for 12 Korean students’ speech samples. The main finding was that raters’ English language backgrounds and their attitudes toward WEs had a significant impact on their rating perceptions of rating criteria. In addition, raters’ language backgrounds, their attitudes toward WEs, and the task-type were also revealed as significant factors that influence the assessment process of English language oral proficiency tests. These results suggest that well-structured test-type and well- trained raters enhance the validity of English language oral proficiency tests.

참고문헌 (45)

  1. "채점척도에 따른 채점자의 일관성과 피험자 능력 추정의 정확성 비교", 14(1), pp.327~347 (2001)
  2. "한국의 영어평가학 II: 말하기 시험편" (2006), 서울: 한국문화사.
  3. "의사소통 능력 모델에 근거한 영어 평가의 필요성에 관한 연구", 9(2), pp.1~26 (2002)
  4. "Language test construction and evaluation" (1995), Cambridge: Cambridge University Press
  5. "Fundamental Considerations in Language Testing" (1990), Oxford University Press
  6. "Language testing practice" (1996), Cambridge: Cambridge University Press
  7. "Investigating variability in tasks and rater judgments in a performance test of foreign language speaking", 12, pp.238~252 (1995)
  8. "Torn between the norms Innovations in world Englishes", 17(1), pp.1~14 (1998)
  9. "A many-facet Rasch analysis of the second language group oral discussion task", 20, pp.89~110 (2003)
  10. "The effect of rater variables in the development of an occupation-specific language performance test", 12(1), pp.1~15 (1995)
  11. "Interviewer variation and the co-construction of speaking proficiency", 20, pp.1~25 (2003)
  12. "What do we mean by bias, Englishes, Englishes in testing, and English language proficiency?", 23(2), pp.317~319 (2004)
  13. "A FACETS analysis of rater bias in measuring Japanese second language writing performance", 19, pp.3~31 (2002)
  14. "Conceptual questions in English as a world language Taking up an issue", 17(3), pp.381~392 (1998)
  15. "Deriving oral assessment scales across different tests and rater groups", pp.16~33 (1995)
  16. "English as a Global Language" (1997), Cambridge: Cambridge University Press
  17. "The Cambridge Encyclopedia of the English Language" (2003), Cambridge: Cambridge University Press
  18. "Factors in judgements of writing ability", pp.61~15 (1961), Princeton
  19. "Quantity and quality in speaking test performance", pp.125~143 (1994)
  20. "Testing speaking ability in academic contexts: Theoretical considerations" (1997), Princeton: Educational Testing Service
  21. "The influence of planning on performance in task-based learning", 18(3), pp.299~324 (1996)
  22. "Classroom-based evaluation in second language education" (1996), New York: Cambridge University Press
  23. "Who should be the judge? The use of non-native speakers as raters on a test of English as an internationallanguage", 5(2), pp.29~50 (1996)
  24. "Can We Predict Task Difficulty in an Oral Proficiency Test? Exploring the Potential of an Information-Processing Approach to Task Design", 51(3), pp.401~436 (2001)
  25. "World Englishes" (2003), London and New York: Routledge
  26. "The Alchemy of English functions and models of non-native Englishes Pergamon Institute of English" (1986)
  27. "Analyzing English in a global context", pp.9~25 (2001), New York: Routledge
  28. "World Englishes and Language Testing: The influence of rater variability in the assessment process of English language oral proficiency" (2005)
  29. "A Pilot Study of Rater Effect on Assessing Speaking Ability", 6(1), pp.43~62 (2006)
  30. "Assessing English proficiency in the expending circle", 21(3), pp.431~435 (2002)
  31. "Assessment criteria in a large-scale writing test: what do they really mean to the raters?", 19, pp.246~276 (2002)
  32. "Rater characteristics and rater bias: Implications for training", 12(1), pp.54~71 (1995)
  33. "Measuring the impact of judge severity on examination scores Applied Measurement in Education", pp.331~345 (1990)
  34. "Using G-theory and many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants", 15(2), pp.158~180 (1998)
  35. "English as an Asian language", pp.19~22 (2003)
  36. "Validity and washback in language testing", 13(3), pp.241~256 (1996)
  37. "Examinee abilities and task difficulty in task-based second language performance assessment", 19, pp.395~418 (2002)
  38. "The impact of gender in oral proficiency testing", 19, pp.169~192 (2002)
  39. "Native and nonnative-speaking EFL teachers' evaluation of Chinese students' English writing", 18(3), pp.303~325 (2001)
  40. "The effect of raters' background and training on the reliability of direct writing tests", pp.26~33 (1992)
  41. "Sociolinguistic variation and change" (2002), Edinburgh: Edinburgh University Press
  42. "Constructing rating scales for second language tests", 49, pp.3~12 (1995)
  43. "Systematic effects in the rating of second language speaking ability: Test method and learner discourse", 16(1), pp.82~111 (1999)
  44. "Validity evidence in a university group oral test", 23(4), pp.411~440 (2006)
  45. "Using FACETS to model rater training effects", 15, pp.263~287 (1998)

관련 논문AI추천

영어 말하기 수행능력의 평가모텔에 관한 연구김영서, 김윤경인문과학연구소 · 인문과학연구2000 · 제5호영어 말하기 능력 절대 등급 설정에 관한 연구오준일팬코리아영어교육학회 · 영어교육연구2006 · 제18권 제1호영어 말하기 능력의 다집단 교실 평가 가능성에 대한 연구 - 자기, 동료, 교사평가를 중심으로 -김진희, 이희경팬코리아영어교육학회 · 영어교육연구2009 · 제21권 제4호학습자 측면에서 살펴본 영어 구술 면담평가의 타당도와 신뢰도에 관한 요인 분석정양수팬코리아영어교육학회 · 영어교육연구2005 · 제17권 제2호영작문 평가 상황에서 학생들의 평가 과정에 대한 연구이호팬코리아영어교육학회 · 영어교육연구2005 · 제17권 제3호말하기 평가 방법의 활용 방안박창균, 이정우한국화법학회 · 화법연구2019 · 제43호

이 간행물의 다른 논문 (16건)

A Study on Verbally Gifted Education강승만pp. 1-15필립 라킨: 여성혐오주의자인가, 예술의 사제인가?권영탁pp. 17-34The Roles of Prepositional Phrasesin Argument Structure Alternations김미숙pp. 35-51Collision of Genres: Three Perspectives on Pamela김봉률pp. 53-70쓰기 연습 유형이 동사패턴이 들어간 영어문장 산출 능력 습득에 미치는 영향김부자pp. 71-94
원문 보기