본문 바로가기
KERD
논문KCI 등재

EBB를 이용한 중등학교 말하기 평가척도 개발

Constructing rating scales for oral performance tests at secondary schools based on the EBB model.

황성삼
한국영어교육학회 (Korea Association Of Teachers Of English)|2008.06|영어교육 (English Teaching)|제63권 제2호|pp. 307-331|DOI 10.15858/engtea.63.2.200806.307

0

조회

0

다운로드

12

인용

0

참고문헌

키워드

말하기 평가평가척도EBB 교실평가
주제분류영어와문학

초록

Abstract

This article examines the validity of the empirically derived, binary-choice, boundary-definition (EBB) rating scale for oral performance tests at secondary schools. First, this article takes three problems into account of applying a priori rating scales such as ACTFL guidelines in the secondary school context. It then turns to a posteriori data-based EBB rating scale, and shows advantages of using the inductive scale which can cover the three problems mentioned in the deductive rating scales. Subjects are 20 high school students in an English conversation course and three Korean English teachers. Speech data are collected from the pupils who are asked to tell stories about their past volunteering experiences. Two of the three Korean teachers of this research collaborate to construct the EBB rating scale. Findings indicate that the EBB rating scale mirrors classroom learning in the assesment, divides the subjects in half, and its binary algorithms are clear. ICC inter-rater reliability coefficient is .78 for average measures which is a little lower, but still consistent with the previous result by Upshur and Turner (1995). This paper concludes that the EBB rating scale seems to have high degree of validity and is applicable to the secondary schools.

참고문헌 (61)

  1. "교육통계연보"[URL]
  2. 김덕기, "중등영어 수행능력 절대평가기준 제안: 표현기능을 중심으로", 영어교육, 54(2), pp.175~200 (1999)
  3. 김해선, "중학교 영어 말하기 평가 실태 분석과 제안.석사학위논문.부경대학교", 석사, pp.1999
  4. 박기화, "7차 영어과 교육과정 성취 기준의 적정성 연구: 말하기, 쓰기를 중심으로", 영어교육연구, 17(4), pp.229~250 (2005), 팬코리아영어교육학회
  5. 신동일, "ACTFL-SOPI체제의 영어 말하기 평가 현장연구:한국에서의 문제점과 현실적 대안", 영어교육, 56(2), pp.309~331 (2001)
  6. 신동일, "Rasch 모형을 이용한 고등학교 영어과 말하기 및 쓰기 능력 등급 기술표 개발", 영어교육, 57(4), pp.469~499 (2002), 한국영어교육학회
  7. 신동일, "SLA 선행 연구에 근거한 말하기 평가척도 제안: 문법 영역 중심으로", 영어교육, 57(2), pp.423~450 (2002), 한국영어교육학회
  8. 신상근, "예비교사의 평가 전문성 신장을 위한 동료평가의 유용성에 관한 연구", 영어교육연구, 19(1), pp.183~8 (2007), 팬코리아영어교육학회
  9. 오준일, "영어 말하기 능력 절대 등급 설정에 관한 연구", 영어교육연구, 18(1), pp.141~162 (2006), 팬코리아영어교육학회
  10. 이병민, "EFL 영어학습 환경에서 학습시간의 의미", Foreign Languages Education, 10(2), pp.107~129 (2003)
  11. 이영식, "영어 작문평가에 대한 채점자 훈련의 원리", 영어교육, 55(2), pp.201~217 (2000)
  12. 이완기, "영어 평가 방법론" (2003), 문진미디어
  13. 영어과 교사의 학생 평가 전문성 신장 모형과 기준, "이인제", 한국교육과정평가원, ~, pp.연구보고 RRE 2004-5-7 (2004)
  14. 이 호, "영작문 평가 상황에서 학생들의 평가 과정에 대한 연구", 영어교육연구, 17(3), pp.215~234 (2005)
  15. 이 호, "시험문항 지침서를 통한 예비교원 평가훈련", 한국외국어교육학회 학술대회 (2007)
  16. 임창근, "영어교육 평가에 있어서 질적인 평가와 양적인 평가의 조화", 초등영어교육, 4(1), pp.167~187 (1998)
  17. 전병만, "초.중등 영어교육 현황분석.(교육부 정책과제 2006-이슈-4)" (2006), 교육과학기술부
  18. 최인철, "중등영어교육 수행평가를 위한 음성인식기술기반 모의구술면접 모형", Foreign Languages Education, 12(4), pp.235~266 (2005), 한국외국어교육학회
  19. ACTFL, "ACTFL proficiency guidelines. Hastings-on-Hudson" (1986), American Council on the Teaching of Foreign Languages
  20. Adams, M. L., "Testing kit: French and Spanish" (1979), Department of State and the Foreign Services Institute
  21. "SST 등급해설"[URL]
  22. Atkinson, J. M., "Structures in social action: Studies in conversation analysis" (1984), Cambridge University Press
  23. Bachman, L., "Problems in examining the validity of the ACTFL oral proficiency interview", Studies in Second Language Acquisition, 10, pp.149~164 (1988)
  24. Bachman, L., "Language testing in practice" (1996), Oxford University Press
  25. Bachman, L., "The evaluation of communicative language proficiency: A critique of the ACTFL oral interview", The Modern Language Journal, 70, pp.380~390 (1986)
  26. Brewer, M. B., "Research design and issues of validity in Handbook of research methods in social and personality psychology" (2000), Cambridge University Press
  27. Canale, M., "From communicative competence to communicative language pedagogy in Language and Communication", pp.1~12 (1983), Longman
  28. Canale, M., "The theoretical bases of communicative approaches to second language teaching and testing", Applied linguistics, 1, pp.1~47 (1980)
  29. Carroll, B. J., "Language testing: Is there another way in Language Testing", pp.1~10 (1982), Modern English Publications
  30. Chalhoub-Deville, M., "Deriving oral assessment scales across different tests and rater groups", Language Testing, 12, pp.16~33 (1995)
  31. Council of Europe, "Common European framework of reference for languages: Learning, teaching, assessment" (2001), Cambridge University Press
  32. Davidson, F., "Testcraft: A teacher's guide to writing and using language test specifications" (2002), Yale University Press
  33. "TSE and SPEAK score user guide. Retrieved December 20, 2007, from the World Wide Web"[URL]
  34. Finch, A., "Integrating teaching and assessment in the EFL classroom" (2005), Sahoe Pyeogron Academy
  35. Fulcher, G., "Tests of oral performance: The need for data-based criteria", English Language Teaching Journal, 41(4), pp.287~291 (1987)
  36. Lexis and reality in oral testing, "Fulcher, G", ERIC Clearinghouse on Languages and Linguistic, ~, pp.ERIC Document Reproduction Service No. ED 298 759 (1988)
  37. Fulcher, G., "Does the thick description lead to smart tests?: A data-based approach to rating scale construction", Language Testing, 13(2), pp.208~238 (1996)
  38. Fulcher, G., "Testing second language speaking" (2003), Pearson Longman
  39. Fulcher, G., "Evaluating quality in second language performance tests", English Language Assessment, 1, pp.3~19 (2007)
  40. Hudson, T., "Trends in assessment scales and criterion-referenced language assessment", Annual Review of Applied Linguistics, 25, pp.205~227 (2005)
  41. Hwang, Sung-Sam., "Intrarater reliability of speaking tests in high school: A focus on rater's overfit rating patterns", TESOL Forum, 1, pp.93~105 (2007)
  42. Khattri, N., "Principles and practices of performance assessment" (1998), Erlbaum
  43. Lantolf, J. P., "Oral proficiency testing: A critical analysis", Modern Language Journal, 69, pp.337~345 (1985)
  44. Lazaraton, A., "Studies in language testing 14: A qualitative approach to the validation of oral language tests" (2002), Cambridge University Press
  45. Liskin-Gasparro, J. E., "Circumlocution, communication strategies, and the ACTFL proficiency guidelines: An analysis of student discourse", Foreign Language Annals, 29, pp.317~330 (1996)
  46. Lowe, P, "The ILR oral interview: Origins, applications, pitfalls, and implications", Unterrichtspraxis, 16, pp.230~244 (1985)
  47. Magnan, S. S., "Rater reliability of the ACTFL oral proficiency interview", The Canadian Modern Language Review, 43, pp.267~276 (1987)
  48. Matthews, M., "The measurement of productive skills: Doubts concerning the assessment criteria of certain public examinations", English Language Teaching Journal, 44(2), pp.117~121 (1990)
  49. Messick, S., "Validity in Educational measurement", pp.1989, Macmillan
  50. North, B., "Scales of language proficiency: A survey of some existing systems" (1994), Council of Europe
  51. North, B., "Scaling descriptors for language proficiency scales", Language Testing, 15(2), pp.217~263 (1998)
  52. Pienemann, M., "Constructing an acquisition-based procedure for second language assessment", Studies in Second Language Acquisition, 10, pp.217~234 (1988)
  53. Shohamy, E, "Language testing priorities: A different perspective", Foreign Language Annals, 23(5), pp.365~394 (1990)
  54. Shohamy, E., "Performance assessment in language testing", Annual Review of Applied Linguistics, 15, pp.188~211 (1995)
  55. Shohamy, E., "The power of tests: A critical perspective on the uses of language tests" (2001), Pearson Longman
  56. Shrout, P. E., "Intraclass correlations: Uses in assessing rater reliability", Psychological Bulletin, 86(2), pp.420~428 (1979)
  57. Skehan, P., "Issues in the testing of English for specific purposes", Language Testing, 1, pp.202~220 (1984)
  58. Stein, N. L., "An analysis of story comprehension in elementary school children in New directions in discourse processing", pp.53~120 (1979), Ablex
  59. Upshur, J., "Constructing rating scales for second language tests", English Language Teaching Journal, 49, pp.3~12 (1995)
  60. Upshur, J., "Systemic effects in the rating of second language speaking ability: Test method and learner discourse", Language Testing, 16(1), pp.82~111 (1999)
  61. Wilds, C., "The oral interview test in Testing Language Proficiency", pp.29~44 (1975), for Applied Linguistics

관련 논문AI추천

Applicability of an EBB Scale to English Speaking Performance Assessment in the Korean Secondary School송대연팬코리아영어교육학회 · 영어교육연구2009 · 제21권 제1호Rasch 모형을 이용한 고등학교 영어과 말하기 및 쓰기 능력 등급 기술표 개발신동일한국영어교육학회 · 영어교육2002 · 제57권 제4호영어 말하기 능력 절대 등급 설정에 관한 연구오준일팬코리아영어교육학회 · 영어교육연구2006 · 제18권 제1호말하기평가의 실태와 모형 및 기준에 대한 제언김영서, 이자원팬코리아영어교육학회 · 영어교육연구2008 · 제20권 제4호중학교 영어교사의 말하기평가 채점경향 분석백현영, 양병곤한국언어과학회 · 언어과학2011 · 제18권 제4호영어 말하기 수행능력의 평가모텔에 관한 연구김영서, 김윤경인문과학연구소 · 인문과학연구2000 · 제5호

이 간행물의 다른 논문 (15건)

Characteristics and Transferability of Text-Based CMC to Oral Performance황필아pp. 3-21Enhancement in Learners’ Perception of Recasts as Corrective Feedback through Explicit Moves장성수pp. 23-41Status Quo of CLT-based English Curricular Reform: A Teacher’s Voice from the Classroom김은주pp. 43-69Investigating Ideational Thematic Content in Korean University Student Essay Writing이성우pp. 71-94Time Talk by Korean Young Learners of English노경희pp. 95-120
원문 보기