본문 바로가기
KERD
논문KCI 등재

Testing in Social, Cultural, and Political Contexts

임관혁
한국영어교육학회 (Korea Association Of Teachers Of English)|2021.09|영어교육 (English Teaching)|제76권 제3호|pp. 3-33|DOI 10.15858/engtea.76.3.202109.3

2

조회

0

다운로드

0

인용

0

참고문헌

키워드

TOEICYBMan argument based approa chdocument anal ysistest validity and val i d a t ion
주제분류영어와문학

초록

Despite the popularity of the TOEIC in the Korean society for over 30 years, few studies have investigated the understanding and usage of TOEIC scores in the Korean context. This research gap needs to be filled to provide test users with useful informat ion in the Korean context. Using an argument based approach to validation, this study investigates the meanings and uses of the TOEIC scores in the Korean context, based on analyses of records publicly available at the YBM website (i.e., TOEIC administrato r i n Korea). One hundred ninety four documents published between 2012 and 2017 were collected from the website and the data were analyzed by combining the content and the context analyses. Findings reveal that contextual factors affect the understanding an d u sage of scores by different TOEIC stakeholders. The document data reveal unintended meanings and uses of the scores.

Abstract

Despite the popularity of the TOEIC in the Korean society for over 30 years, few studies have investigated the understanding and usage of TOEIC scores in the Korean context. This research gap needs to be filled to provide test users with useful informat ion in the Korean context. Using an argument based approach to validation, this study investigates the meanings and uses of the TOEIC scores in the Korean context, based on analyses of records publicly available at the YBM website (i.e., TOEIC administrato r i n Korea). One hundred ninety four documents published between 2012 and 2017 were collected from the website and the data were analyzed by combining the content and the context analyses. Findings reveal that contextual factors affect the understanding an d u sage of scores by different TOEIC stakeholders. The document data reveal unintended meanings and uses of the scores.

참고문헌 (62)

  1. Language testing in practice Designing and developing useful language tests, "Bachman, L. F.", Oxford University, ~ (1996)
  2. Bachman, L. F., "Language assessment in practice Developing language assessments and justifying their use in the real world" (2010), Oxford University Press
  3. Bowen, G., "Document analysis as a qualitative research method", Qualitative Research Journal, 9(2), pp.27~40 (2009)
  4. Chapelle, C. A., "Building a validity argument for the Test of English as a Foreign Language" (2008), Routledge
  5. Cheng, L., "Washba ck in language testing: Research contexts and methods", pp.3~18 (2004), Lawrence Erlbaum
  6. "User guide speaking & writing" (2010)[URL]
  7. "About the TOEIC ® Listening and Reading test" (2018)[URL]
  8. Im, G. H., "What do i nternational professionals say about the TOEIC?", Journal of the Korea English Education Society, 20(1), pp.1~37 (2021)
  9. Im, G. H., "The Test of English for International Communication", Language Testing, 36(2), pp.315~324 (2019)
  10. Im, G. H., "Sociopolitics of English language testing", pp.147~164 (2020), Bloomsbury Publishing
  11. 임관혁, "Legitimate or Illegitimate Uses of Test Scores in Contexts Unrelated to Test Purposes", 영어교육, 72(2), pp.71~99 (2017), 한국영어교육학회[DOI]
  12. Im, G. H., "Critical review of validation models and practices in language testing: Their limitations and future directions for validation research", Language Testing in Asia, 9(14) (2019)[DOI]
  13. Janssen, G., "Building a better rubric : Mixed methods rubric re vision", Assessing Writing, 26, pp.51~66 (2015)
  14. Kane, M. T., "An argument based approach to validity", Psychological Bulletin, 112(3), pp.527~535 (1992)
  15. Kane, M. T., "Educational measurement", pp.2006, American Council on Education
  16. Kane, M. T., "Validating the interpretations and uses of test scores", Journal of Educational Measurement, 50(1), pp.1~73 (2013)
  17. "Newsletter" (1997)[URL]
  18. "Newsletter" (2003)[URL]
  19. "Newsletter" (2004)[URL]
  20. "Newsletter" (2004)[URL]
  21. "Newsletter" (2005)[URL]
  22. "Newsletter" (2005)[URL]
  23. "Newsletter" (2006)[URL]
  24. "Newsletter" (2007)[URL]
  25. "Newsletter" (2008)[URL]
  26. "Newsletter" (2008)[URL]
  27. "Newsletter" (2008)[URL]
  28. "Newsletter" (2009)[URL]
  29. "Newsletter" (2009)[URL]
  30. "Newsletter" (2009)[URL]
  31. "Newsletter" (2010)[URL]
  32. "Newsletter" (2011)[URL]
  33. "Newsletter" (2011)[URL]
  34. "YBM Korea TOEIC ® committee newsletter" (2012)[URL]
  35. "YBM Korea TOEIC ® committee newsletter" (2012)[URL]
  36. "YBM Korea TOEIC ® committee newsletter" (2013)[URL]
  37. "YBM/Korea TOEIC ® committee newsletter" (2013)[URL]
  38. "YBM/Korea TOEIC ® committee newsletter" (2013)[URL]
  39. "YBM/Korea TOEIC ® committee newsletter" (2013)[URL]
  40. "YBM/Korea TOEIC ® committee newsletter" (2014)[URL]
  41. "YBM/Korea TOEIC ® committee newsletter" (2014)[URL]
  42. (2015)[URL]
  43. (2016)[URL]
  44. "Newsletter: YBM Korea TOEIC ® Committee" (2016)[URL]
  45. "Newsletter: YBM Korea TOEIC ® Committee" (2016)[URL]
  46. "Newsletter: Expand your possibilities" (2017)[URL]
  47. (2017)[URL]
  48. (2017)[URL]
  49. (2017)[URL]
  50. (2018)[URL]
  51. Li, Z., "An argument based validation study of the English placement test (EPT) Focusing on the inferences of extrapolation and ramification", doctoral, pp.2015
  52. Ma, J., "Preparing s tudents to take tests", TESOL Encyclopedia of English language teaching (2018)[DOI]
  53. McNamara, T., "Language testing : The social dimension" (2006), Blackwell Publishing
  54. Messick, S., "Educational measurement", pp.13~103 (1989), American Council on Education & Macmillan
  55. Miller, F., "Incorporating documents into qualitative nursing research", Journal of Nursing Scholarship, 37(4), pp.348~353 (2005)
  56. Mislevy, R. J., "On the structure of assessment argum ents", Measurement : Interdisciplinary Research and Perspectives, 1(1), pp.3~62 (2003)
  57. Moss, P. A., "Validity in educational assessment", Review of Research in Education, 30, pp.109~162 (2006)
  58. Jonathan E. Schmidgall, "Articulating and Evaluating Validity Arguments for the TOEIC ® Tests", ETS Research Report Series, 2017(1), pp.1~9 (2017), Wiley[DOI]
  59. Jonathan E. Schmidgall, "The Consistency of TOEIC ® Speaking Scores Across Ratings and Tasks", ETS Research Report Series, 2017(1), pp.1~8 (2017), Wiley[DOI]
  60. Shepard, L. A., "The role of assessment in a learning culture", Educational Researcher, 29(7), pp.4~14 (2000)
  61. Shohamy, E., "Test impact revisited : Washback effect over time", Language Testing, 13(3), pp.299~317 (1996)
  62. Zumbo, B. D., "Consequences, side effects and the ecology of testing: Keys to considering assessment in vivo ’", Keynote address, the annual meeting of the Association for Educational Assessment Europe (AEA-Europe) (2015)

관련 논문AI추천

What Do International Business Professionals Say about the TOEIC?임관혁한국영어교과교육학회 · 영어교과교육2021 · 제20권 제1호Legitimate or Illegitimate Uses of Test Scores in Contexts Unrelated to Test Purposes임관혁, TimMcNamara한국영어교육학회 · 영어교육2017 · 제72권 제2호토익 수험자의 인식 연구 - 비판적언어평가론 관점에서김주연, 신동일21세기영어영문학회 · 영어영문학212012 · 제25권 제2호Examining the criterion-referenced assessment program in the domain of English language subjects of Korean secondary schools using argument-based approaches to validity김연희교과교육연구소 · 교과교육학연구2015 · 제19권 제4호정책도구로 사용되는 언어시험: 국내 영어시험 중심으로신동일, 임관혁한국영어교육학회 · 영어교육2011 · 제66권 제4호Review of Language Testing for Specific Purposes이윤경사단법인 한국언어학회 · 언어학2015 · 제23권 제3호

이 간행물의 다른 논문 (7건)

Second Language Learning: Discovering an Unknown Path into a Brand New WorldLittlewood Williampp. 31-35Effects of E-Books and Printed Books on EFL Learners’ Reading Comprehension and Grammatical Knowledge이주희, 박지현pp. 35-61Claims of Entitlements in Elementary EFL Co-teaching이미진pp. 63-84A Gyopo English Teacher’s Professional Identity in an EFL ContextLEE JUNG WON, 김명희pp. 85-113‘Butter Balla Here!’: The Functions of Humor in Primary English Classrooms in Korea김솔pp. 115-137
원문 보기