Developing a Vocabulary Level Test for Learners Who Prepare for a Civil-Service Examination
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
The current study is twofold; it demonstrates how to (1) develop a corpus-based vocabulary level test and (2) validate the test, especially for those who prepare for the English section of a civil-service examination in Korea. Out of the 294,911,732 tokens, garnered from the actual English tests of the civil-service examination administered between 2004 and 2017, we first made the 6,500-word list and selected 75 test words by using stratified random sampling. Seventy-four undergraduate students completed taking both the newly developed vocabulary level test and Beglar and Nation’s (2007) Vocabulary Level Test. With the malfunctioning items deleted, Cronbach’s alpha and KR-20 were estimated as .87. The test turned out to be valid as well because of the following reasons; (1) a medium but significant correlation between the vocabulary frequency and the item facility, (2) a medium but significant correlation between participants’ performance on the newly developed vocabulary test and that on Beglar and Nation’s vocabulary level test, and finally (3) the D-study variance component estimate originating from the person (test takers) facet. Further discussed are the practical implications and the limitations of the study.
Abstract
The current study is twofold; it demonstrates how to (1) develop a corpus-based vocabulary level test and (2) validate the test, especially for those who prepare for the English section of a civil-service examination in Korea. Out of the 294,911,732 tokens, garnered from the actual English tests of the civil-service examination administered between 2004 and 2017, we first made the 6,500-word list and selected 75 test words by using stratified random sampling. Seventy-four undergraduate students completed taking both the newly developed vocabulary level test and Beglar and Nation’s (2007) Vocabulary Level Test. With the malfunctioning items deleted, Cronbach’s alpha and KR-20 were estimated as .87. The test turned out to be valid as well because of the following reasons; (1) a medium but significant correlation between the vocabulary frequency and the item facility, (2) a medium but significant correlation between participants’ performance on the newly developed vocabulary test and that on Beglar and Nation’s vocabulary level test, and finally (3) the D-study variance component estimate originating from the person (test takers) facet. Further discussed are the practical implications and the limitations of the study.
참고문헌 (51)
- Bauer, L., "Word families", International journal of Lexicography, 6(4), pp.253~279 (1993)
- Beglar, D., "The vocabulary size test", The language teacher, 31(7), pp.9~13 (2007)
- Biber, D., "University language: A corpus-based study of spoken and written registers (Vol. 23)" (2006), John Benjamins Publishing
- Brennan, R. L., "Generalizability theory" (2001), Springer-Verlag
- Chung, T. M., "A corpus comparison approach for terminology extraction", Terminology. International Journal of Theoretical and Applied Issues in Specialized Communication, 9(2), pp.221~246 (2003)
- Coxhead, A., "A new academic word list", TESOL quarterly, 34(2), pp.213~238 (2000)
- Coxhead, A., "The Academic Word List 10 years on : Research and teaching implications", Tesol Quarterly, 45(2), pp.355~362 (2011)
- Dang, T. N. Y., "The lexical profile of academic spoken English", English for Specific Purposes, 33, pp.66~76 (2014)
- Dang, T. N. Y., "The academic spoken word list", Language Learning, 67(4), pp.959~997 (2017)
- Elgort, I., "Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test", Language Testing, 30(2), pp.253~272 (2013)
- Garnier, M., "The PHaVE List : A pedagogical list of phrasal verbs and their most frequent meaning senses", Language Teaching Research, 19(6), pp.645~666 (2015)
- Griffin, G. F., "Aspects of the psychology of second language vocabulary list learning", Doctoral, pp.1992
- Xuehong (Stella) He, "Choosing Words to Teach: A Novel Method for Vocabulary Selection and Its Practical Application", TESOL Quarterly, 53(2), pp.348~371 (2019), Wiley[DOI]
- Henning, G., "A guide to language testing: Development, evaluation, research" (1987), Newbury House
- Wenhua Hsu, "The Most Frequent Formulaic Sequences In College Engineering Textbooks", Corpus Linguistics Research, 1, pp.109~149 (2015), 한국코퍼스언어학회[DOI]
- Hyland, K., "Is there an “academic vocabulary?”", TESOL quarterly, 41(2), pp.235~253 (2007)
- Jeon, E. H., "L2 reading comprehension and its correlates: A meta‐analysis", Language Learning, 64(1), pp.160~212 (2014)
- 김향덕, "공무원시험준비생 규모 추정 및 실태에 관한 연구", 현대사회와 행정, 28(1), pp.49~70 (2018), 한국국정관리학회[DOI]
- "JibanG-gongmuwon 7geub gyeongjaenglyul 97.9dae1…jeonnyeon daebi daepog halag (The competitiveness of local public servants at the seventh rank 97.9 to 1…Significant decline from the previous year)" (2018)[URL]
- Krashen, S., "Viewpoints on English as a second language", pp.152~161 (1977)
- Kremmel, B., "Word families and frequency bands in vocabulary tests:Challenging conventions", TESOL Quarterly, 50(4), pp.976~987 (2016)
- Kremmel, B., "Interpreting vocabulary test scores : What do various item formats tell us about learners’ ability to employ words?", Language Assessment Quarterly, 13(4), pp.377~392 (2016)
- Kwon, H., "English for nuclear engineering", Proceedings from The Korea Association of Teachers of Engl, pp.40~42 (2017)
- Laufer, B., "A vocabulary-size test of controlled productive ability", Language testing, 16(1), pp.33~51 (1999)
- Laufer, B., "The Routledge handbook of second language acquisition", pp.163~176 (2012), Routledge
- Lee, H., "The differences among three-, four-, and five-option-item formats in the context of a high-stakes English-language listening test", Language Testing, 30(1), pp.99~123 (2013)
- "Ol guggajig 9 geub gongmuwon 2,931 myeong choejonghabgyeog…yeoseong 58.8% (2,931 candidates passed the national civil servant recruitment exam at the ninth rank …female candidates 58.8%)" (2017)[URL]
- Lei, L., "A new medical academic word list : A corpus-based study with enhanced methodology", Journal of English for Academic Purposes, 22, pp.42~53 (2016)
- Lervåg, A., "Vocabulary knowledge is a critical determinant of the difference in reading comprehension growth between first and second language learners", Journal of Child Psychology and Psychiatry, 51(5), pp.612~620 (2010)
- Martínez, I. A., "Academic vocabulary in agriculture research articles : A corpus-based study", English for specific purposes, 28(3), pp.183~198 (2009)
- Mishan, F., "Materials development for TESOL" (2015), Edinburgh University Press
- Morris, L., "Vocabulary profiles as predictors of the academic performance of Teaching English as a Second Language trainees", System, 32(1), pp.75~87 (2004)
- Nagy, W. E., "Breadth and depth of vocabulary knowledge : Implications for acquisition and instruction", The nature of vocabulary acquisition, 19, pp.35~ (1987)
- Nation, I. S., "Learning vocabulary in another language" (2001), Cambridge University Press
- Nation, P., "Principles Guiding Vocabulary Learning through Extensive Reading", Reading in a Foreign Language, 27(1), pp.136~145 (2015)
- Nation, I. S., "Making and using word lists for language learning and testing" (2016), John Benjamins
- Nation, P., "Where would general service vocabulary stop and special purposes vocabulary begin?", System, 23(1), pp.35~41 (1995)
- Nguyen, L., "A bilingual vocabulary size test of English for Vietnamese learners", RELC Journal, 42(1), pp.86~99 (2011)
- Noels, K. A., "Why are you learning a second language? Motivational orientations and selfdetermination theory", Language learning, 50(1), pp.57~85 (2000)
- Pinchbeck, G., "Developmental scales of L1 and L2 academic English vocabulary: Vocabulary test item difficulty indicates lexical sophistication and derivational morphology development", Paper presented at the American Association for Applied Linguistics conference (2016)
- Qian, D., "Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension", Canadian modern language review, 56(2), pp.282~308 (1999)
- Read, J., "Validation in language assessment", pp.41~60 (1998), Lawrence Erlbaum
- Schmitt, N., "Researching vocabulary : A vocabulary research manual" (2010), Palgrave Macmillan
- Schmitt, N., "Size and depth of vocabulary knowledge : What the research shows", Language Learning, 64(4), pp.913~951 (2014)
- Schmitt, N., "Researching vocabulary through a word knowledge framework : Word associations and verbal suffixes", Studies in second language acquisition, 19(1), pp.17~36 (1997)
- Schmitt, N., "A reassessment of frequency and vocabulary size in L2 vocabulary teaching", Language Teaching, 47(4), pp.484~503 (2014)
- Schmitt, N., "How much vocabulary is needed to use English? Replication of van Zeeland & Schmitt (2012), Nation (2006) and Cobb (2007)", Language Teaching, 50(2), pp.212~226 (2007)
- Schmitt, N., "Summary of personal email correspondence", ~ (2018)
- Simpson-Vlach, R., "An academic formulas list : New methods in phraseology research", Applied linguistics, 31(4), pp.487~512 (2010)
- Thornbury, S., "How to teach vocabulary" (2002), Longman
- Yang, M. N., "A nursing academic word list", English for specific purposes, 37, pp.27~38 (2015)
