본문 바로가기
KERD
논문KCI 등재

Validation of the Korean Bilingual Version of the Vocabulary Size Test

1

조회

0

다운로드

1

인용

0

참고문헌

키워드

주제분류영어와문학

초록

The present study aimed to validate a 70-item Korean bilingual version of the Vocabulary Size Test (VST) using Rasch modeling. The goal was to assess the applicability of this Korean version of the VST for Korean learners of English in an English as a foreign language (EFL) context by examining validity evidence based on Messick’s framework. Specifically, the study focused on the content, substantive, and external aspects of construct validity. However, the findings provided weak evidence supporting the utility of the VST as a measure of receptive vocabulary for Korean EFL learners. The test was deemed too easy and lacked the ability to effectively differentiate among varying levels of second language proficiency, with many test items exhibiting unexpected behavior. Additionally, the VST showed a weak correlation with another measure of second language proficiency. In light of these findings, the study offers specific recommendations for improving the test's validity and usefulness.

Abstract

The present study aimed to validate a 70-item Korean bilingual version of the Vocabulary Size Test (VST) using Rasch modeling. The goal was to assess the applicability of this Korean version of the VST for Korean learners of English in an English as a foreign language (EFL) context by examining validity evidence based on Messick’s framework. Specifically, the study focused on the content, substantive, and external aspects of construct validity. However, the findings provided weak evidence supporting the utility of the VST as a measure of receptive vocabulary for Korean EFL learners. The test was deemed too easy and lacked the ability to effectively differentiate among varying levels of second language proficiency, with many test items exhibiting unexpected behavior. Additionally, the VST showed a weak correlation with another measure of second language proficiency. In light of these findings, the study offers specific recommendations for improving the test's validity and usefulness.

참고문헌 (51)

  1. AERA, "Standards for educational and psychological testing", American Educational Research Association, ~ (2014)
  2. Alagumalai, S., "Applied Rasch measurement: A book of examplars", pp.1~14 (2005), Springer
  3. Alderson, J. C., "Diagnosing foreign language proficiency: The interface between learning and assessment" (2005), Continuum
  4. Aviad-Levitzky, T., "The new computer adaptive test of size and strength(CATSS) : Development and validation", Language Assessment Quarterly, 16(3), pp.345~368 (2019)
  5. Beglar, D., "A Rasch-based validation of the Vocabulary Size Test", Language Testing, 27(1), pp.101~118 (2010)
  6. Boone, W. J., "Rasch analysis in the human sciences" (2013), Springer
  7. Chapelle, C. A., "The Routledge handbook of SLA and language assessment", pp.11~20 (2021), Routledge
  8. Chon, Y. V., "Lexical profiles and socioeducational variables of Korean EFL university learners", Korean Journal of Applied Linguistics, 28(1), pp.115~146 (2012)
  9. Derrah, R., "Validating the Japanese bilingual version of the Vocabulary Size Test", International Journal of Languages, Literature and Linguistics, 1(2), pp.131~135 (2015)
  10. Elgort, I., "Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test", Language Testing, 30(2), pp.253~272 (2013)
  11. Flake, J. K., "Measurement schmeasurement : Questionable measurement practices and how to avoid them", Advances in Methods and Practices in Psychological Science, 3(4), pp.456~465 (2020)
  12. Green, R., "Statistical analyses for language testers" (2013), Palgrave Macmillan
  13. Greidanus, T., "Testing the quality of word knowledge in a second language by means of word associations : Types of distractors and types of associations", The Modern Language Journal, 85(4), pp.567~577 (2001)
  14. Hu, M., "Unknown vocabulary density and reading comprehension", Reading in a Foreign Language, 13(1), pp.403~430 (2000)
  15. Jeon, E. H., "L2 reading comprehension and its correlates : A metaanalysis", Language Learning, 64(1), pp.160~212 (2014)
  16. Karami, H., "The development and validation of a bilingual version of the Vocabulary Size Test", RELC Journal, 43(1), pp.53~67 (2012)
  17. Laufer, B., "Special language: From human thinking to thinking machines", pp.316~323 (1989), Multilingual Matters
  18. Laufer, B., "A vocabulary-size test of controlled productive ability", Language Testing, 16(1), pp.33~51 (1999)
  19. Laufer, B., "Lexical threshold revisited : Lexical coverage, learners’ vocabulary size and reading comprehension", Reading in a Foreign Language, 22(1), pp.15~30 (2010)
  20. Lee, Y., "Vocabulary size of Korean EFL university learners : Using an item response theory model", English Language & Literature Teaching, 18(1), pp.171~195 (2012)
  21. Li, C. -H., "Using a listening vocabulary levels test to explore the effect of vocabulary knowledge on GEPT listening comprehension performance", Language Assessment Quarterly, 16(3), pp.328~344 (2019)
  22. Linacre, J. M., "What do infit and outfit, mean-square and standardized mean", Rasch Measurement Transactions, 16(2), pp.878~ (2002)
  23. "A user’s guide to WINSTEPS MINISTEP Rasch-model computer programs"[URL]
  24. Meara, P., "An alternative to multiple choice vocabulary tests", Language Testing, 4(2), pp.142~154 (1987)
  25. Meara, P., "Eurocentres Vocabulary Size Test, Version E1.1", K10, 1990
  26. Messick, S., "Validity of psychological assessment : Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning", American Psychologist, 50(9), pp.741~749 (1995)
  27. Miller, G. A., "How children learn words", Scientific American, 257(3), pp.94~99 (1987)
  28. Milton, J., "L2 vocabulary acquisition, knowledge, and use: New perspectives on assessment and corpus analysis (vol. 2)", pp.57~78 (2013), Eurosla Monographs Series
  29. Miralpeix, I., "Receptive vocabulary size and its relationship to EFL language skills", International Review of Applied Linguistics in Language Teaching, 56(1), pp.1~24 (2018)
  30. Moon, Y., "Examining the appropriateness of the vocabulary size test in Korean EFL context", Foreign Language Education, 24(3), pp.23~45 (2017)
  31. Nation, I. S. P., "Testing and teaching vocabulary", Guidelines, 5, pp.12~25 (1983)
  32. Nation, I. S. P., "How large a vocabulary is needed for reading and listening", Canadian Modern Language Review, 63(1), pp.59~82 (2006)
  33. Nation, I. S. P., "Learning vocabulary in another language" (2013), Cambridge University Press
  34. Nation, I. S. P., "A vocabulary size test", The Language Teacher, 31(7), pp.9~13 (2007)
  35. Nation, I. S. P., "Researching and analyzing vocabulary" (2011), Heinle
  36. Nguyen, L. T. C., "A bilingual vocabulary size test of English for Vietnamese learners", RELC Journal, 42(1), pp.86~99 (2011)
  37. Noreillie, A. -S., "Vocabulary knowledge and listening comprehension at an intermediate level in English and French as foreign languages : An approximate replication study of Stæhr(2009)", International Journal of Applied Linguistics, 169(1), pp.212~231 (2018)
  38. Ortega, L., "An investigation of elicited imitation tasks in crosslinguistic SLA research", Second Language Research Forum (2002)
  39. Park, H. I., "How do Korean–English bilinguals speak and think about motion events? Evidence from verbal and non-verbal tasks", Bilingualism : Language and Cognition, 23(3), pp.483~499 (2020)
  40. Qian, D. D., "The Routledge handbook of vocabulary studies", pp.66~80 (2020), Routledge
  41. Rasch, G., "Probabilistic models for some intelligence and attainment tests" (1960), The Danish Institute for Educational Research
  42. Révész, A., "The Routledge handbook of second language acquisition and language testing", pp.21~32 (2021), Routledge
  43. Schmitt, N., "Moving the field of vocabulary assessment forward : The need for more rigorous test development and validation", Language Teaching, 53(1), pp.109~120 (2020)
  44. Shi, L., "How does vocabulary knowledge affect Chinese EFL learners’writing quality in web-based Settings?—Evaluating the relationships among three dimensions of vocabulary knowledge and writing quality", Chinese Journal of Applied Linguistics, 35(1), pp.117~127 (2012)
  45. Shin, D., "A corpus-based analysis of curriculum-based elementary and secondary English textbooks", Multimedia-Assisted Language Learning, 14(1), pp.149~175 (2011)
  46. Shin, D., "Receptive and productive vocabulary sizes of high school learners : What next for the basic word list", English Teaching, 66(3), pp.123~148 (2011)
  47. Stæhr, L. S., "Vocabulary size and the skills of listening, reading and writing", Language Learning Journal, 36(2), pp.139~152 (2008)
  48. Yan, X., "Elicited imitation as a measure of second language proficiency : A narrative review and meta-analysis", Language Testing, 33(4), pp.497~528 (2016)
  49. Zareva, A., "Relationship between lexical competence and language proficiency : Variable sensitivity", Studies in Second Language Acquisition, 27(4), pp.567~595 (2005)
  50. Zhang, S., "The relationship between vocabulary knowledge and L2reading", listening comprehension : A meta-analysis, 2022, pp.26(4), 696~725
  51. Zhao, P., "Validation of the Mandarin version of the Vocabulary Size Test", RELC Journal, 49(3), pp.308~321 (2018)

관련 논문AI추천

이 간행물의 다른 논문 (9건)