Examining the Validity of the LexTALE Test for Japanese College Students
1
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
The question of how vocabulary knowledge of second language (L2) learners can be measured in a valid and reliable way has attracted attention from researchers. One widely used format for assessing vocabulary knowledge is a Yes/No test, where learners are asked to indicate whether they know each vocabulary word on the test. The purpose of this study was to examine whether the LexTALE test, a recently developed Yes/No English vocabulary test, can be an approximate measure of vocabulary knowledge and general proficiency for Japanese learners of English. In this study, 111 Japanese university students majoring in English took the LexTALE, an English to Japanese translation test, and the Vocabulary Size Test (VST). They were further asked to provide self-ratings of their English proficiency. Analysis showed that the LexTALE score correlated more strongly with the translation score and VST score than self-ratings of their proficiency. The results also showed that the LexTALE score correlated significantly with the TOEFL ITP® score, although some self-ratings resulted in a higher correlation. The findings suggest that for Japanese learners of English, LexTALE may be used as an approximate measure of English vocabulary knowledge and, to a lesser extent, general proficiency.
Abstract
The question of how vocabulary knowledge of second language (L2) learners can be measured in a valid and reliable way has attracted attention from researchers. One widely used format for assessing vocabulary knowledge is a Yes/No test, where learners are asked to indicate whether they know each vocabulary word on the test. The purpose of this study was to examine whether the LexTALE test, a recently developed Yes/No English vocabulary test, can be an approximate measure of vocabulary knowledge and general proficiency for Japanese learners of English. In this study, 111 Japanese university students majoring in English took the LexTALE, an English to Japanese translation test, and the Vocabulary Size Test (VST). They were further asked to provide self-ratings of their English proficiency. Analysis showed that the LexTALE score correlated more strongly with the translation score and VST score than self-ratings of their proficiency. The results also showed that the LexTALE score correlated significantly with the TOEFL ITP® score, although some self-ratings resulted in a higher correlation. The findings suggest that for Japanese learners of English, LexTALE may be used as an approximate measure of English vocabulary knowledge and, to a lesser extent, general proficiency.
참고문헌 (54)
- J Barrow, "Assessing Japanese college students' vocabulary knowledge with a self-checking familiarity survey", System, 27(2), pp.223~247 (1999), Elsevier BV[DOI]
- Renaud Beeckmans, "Examining the Yes", No vocabulary test: some methodological issues in theory and practice, 2016, pp.18(3), 235~274[DOI]
- David Beglar, "A Rasch-based validation of the Vocabulary Size Test", Language Testing, 27(1), pp.101~118 (2010), SAGE Publications[DOI]
- Cameron, L., "Measuring vocabulary size in English as an additional language", Language Teaching Research, 6, pp.145~173 (2002)
- "The Compleat Lexical Tutor"[URL]
- Cohen, J., "Statistical power analysis for the behavioral sciences" (1988), Erlbaum
- Chujo, K., "How many words do you need to know to understand TOEIC, TOEFL & EIKAN? An examination of the text coverage and high frequency vocabulary", The Journal of Asian TEFL, 6(2), pp.121~148 (2009)
- Annabelle David, "Vocabulary breadth in French L2 learners", Language Learning Journal, 36(2), pp.167~180 (2008), Informa UK Limited[DOI]
- "Mapping the TOEIC tests on the CEFR" (2015)[URL]
- "TOEFL: For academic institutions: Compare scores" (2019)[URL]
- Irina Elgort, "Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test", Language Testing, 30(2), pp.253~272 (2012), SAGE Publications[DOI]
- Mostafa Janebi Enayat, "Reliable Measure of Written Receptive Vocabulary Size: Using the L2 Depth of Vocabulary Knowledge as a Yardstick", SAGE Open, 8(1), pp.215824401775222~ (2018), SAGE Publications[DOI]
- Eyckmans, J, "Measuring receptive vocabulary size: Reliability and validity of the yes", no vocabulary test for French-speaking learners of Dutch, Utrecht University, 2004
- Peter Yongqi Gu, "Fine Brush and Freehand: The Vocabulary-Learning Art of Two Successful Chinese EFL Learners", TESOL Quarterly, 37(1), pp.73~104 (2003), JSTOR[DOI]
- Gyllstad, H., "L2 vocabulary acquisition, knowledge and use: New perspectives on assessment and corpus analysis", pp.11~28 (2013), European Second Language Association
- Henrik Gyllstad, "Assessing vocabulary size through multiple-choice formats", ITL - International Journal of Applied Linguistics, 166(2), pp.278~306 (2015), John Benjamins Publishing Company[DOI]
- Michael Harrington, "The on-line Yes", No test as a placement tool, 2009, pp.37(4), 614~626[DOI]
- Steven J. Heine, "Cultural Differences in Self-Evaluation", Journal of Cross-Cultural Psychology, 32(4), pp.434~443 (2016), SAGE Publications[DOI]
- Ineke Huibregtse, "Scores on a yes-no vocabulary test: correction for guessing and response style", Language Testing, 19(3), pp.227~245 (2016), SAGE Publications[DOI]
- Hossein Karami, "The Development and Validation of a Bilingual Version of the Vocabulary Size Test", RELC Journal, 43(1), pp.53~67 (2012), SAGE Publications[DOI]
- Keiko Koda, "The Effects of Transferred Vocabulary Knowledge on the Development of L2 Reading Proficiency", Foreign Language Annals, 22(6), pp.529~540 (1989), Wiley[DOI]
- Laufer, B., "Vocabulary and applied linguistics", pp.126~132 (1992), Macmillan
- 이경랑, "Effects of Vocabulary Memorizing Tools on L2 Learners’ Vocabulary Size", Journal of Asia TEFL, 11(2), pp.125~148 (2014), 아시아테플
- Kristin Lemhöfer, "Introducing LexTALE: A quick and valid Lexical Test for Advanced Learners of English", Behavior Research Methods, 44(2), pp.325~343 (2012), Springer Science and Business Media LLC[DOI]
- Kristin Lemhöfer, "Recognizing cognates and interlingual homographs: Effects of code similarity in language-specific and generalized lexical decision", Memory & Cognition, 32(4), pp.533~550 (2004), Springer Science and Business Media LLC[DOI]
- Kristin Lemhöfer, "Native language influences on word recognition in a second language: A megastudy.", Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(1), pp.12~31 (2008), American Psychological Association (APA)[DOI]
- Stuart McLean, "Predicting L2 reading proficiency with modalities of vocabulary knowledge: A bootstrapping approach", Language Testing, 37(3), pp.389~411 (2020), SAGE Publications[DOI]
- Meara, P. M., "New approaches to testing vocabulary knowledge", pp.1992
- Meara, P. M., "English Vocabulary Tests: 10k", pp.1996
- Meara, P. M., "Applied linguistics in society", pp.80~87 (1988), CILT
- Milton, J., "Measuring second language vocabulary acquisition" (2009), Multilingual Matters
- kira Mochida, "The Yes", No test as a measure of receptive vocabulary knowledge, 2016, pp.23(1), 73~98[DOI]
- Nation, I. S. P., "Handbook of research in second language teaching and learning (Vol. 2)", pp.444~454 (2011), Routledge
- "The vocabulary size test: Information and specifications" (2012)[URL]
- Nation, I. S. P., "Learning vocabulary in another language" (2013), Cambridge University Press
- Nation, I. S. P., "A vocabulary size test", The Language Teacher, 31(7), pp.9~13 (2007)
- Le Thi Cam Nguyen, "A Bilingual Vocabulary Size Test of English for Vietnamese Learners", RELC Journal, 42(1), pp.86~99 (2011), SAGE Publications[DOI]
- Ruegg, R., "The English vocabulary level of Japanese junior high school students", JALT 2007 Conference Proceedings, pp.103~109 (2007)
- "Vocabulary Size Test (bilingual Japanese version)" (2010)[URL]
- Norbert Schmitt, "Size and Depth of Vocabulary Knowledge: What the Research Shows", Language Learning, 64(4), pp.913~951 (2014), Wiley[DOI]
- NORBERT SCHMITT, "The Percentage of Words Known in a Text and Reading Comprehension", The Modern Language Journal, 95(1), pp.26~43 (2011), Wiley[DOI]
- Schmitt, N., "Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test", Language Testing, 18, pp.55~89 (2001)
- "The application of Rasch modelling to yes/no vocabulary tests" (1996)[URL]
- Lars Stenius Stæhr, "Vocabulary size and the skills of listening, reading and writing", Language Learning Journal, 36(2), pp.139~152 (2008), Informa UK Limited[DOI]
- Jeffrey Stewart, "Do Multiple-Choice Options Inflate Estimates of Vocabulary Size on the VST?", Language Assessment Quarterly, 11(3), pp.271~282 (2014), Informa UK Limited[DOI]
- Tim Stoeckel, "Is “I Don't Know” a Viable Answer Choice on the Vocabulary Size Test?", TESOL Quarterly, 50(4), pp.965~975 (2016), Wiley[DOI]
- Tim Stoeckel, "The relationship of four variants of the Vocabulary Size Test to a criterion measure of meaning recall vocabulary knowledge", System, 87, pp.102161~ (2019), Elsevier BV[DOI]
- Raymond Stubbe, "Do pseudoword false alarm rates and overestimation rates in Yes", No vocabulary tests change with Japanese university students’ English ability levels?, 2012, pp.29(4), 471~488[DOI]
- Stubbe, R., "Optimizing scoring formulas for yes", no vocabulary tests with linear models, 2012, pp.16, 2~7
- Tang, E., "An exploration study of the English vocabulary size of Hong Kong primary and junior secondary school students", The Journal of Asia TEFL, 4(1), pp.125~144 (2007)
- Thornbury, S., "How to teach vocabulary" (2002), Pearson Longman
- University of Cambridge Local Examination Syndicate, "Quick Placement Test" (2001), Oxford University Press
- Yue, Y., "What is next in educational research?", pp.171~182 (2016), Sense Publishers
- Xian Zhang, "The I Don't Know Option in the Vocabulary Size Test", TESOL Quarterly, 47(4), pp.790~811 (2013), Wiley[DOI]