The Prediction of Writing Scores Using Vocabulary Features in ESL University Students’ Essays
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The primary purpose of this study is to investigate how well vocabulary features, such as collocation, word family, etc., predict vocabulary scores in writing graded by human raters, and the degree to which they explain holistic scores. Forty-nine writings by first-year non-native English- speaking international students at a mid-western U.S. university were analyzed by using two multiple regression models. Data includes both holistic and analytic vocabulary scores given by four human raters and specific vocabulary features counted by concordance programs. Holistic and analytic vocabulary scores were estimated using many-facet Rasch measurement analysis. It was found that (a) collocation variety and essay length (or tokens) explained 32.0% of variance in the holistic writing scores, and (b) collocation variety and word family accounted for 29.5% of the variance in the vocabulary scores. The results of this study suggest that it is beneficial to teach and learn vocabulary knowledge to improve students’ writing proficiency.
Abstract
The primary purpose of this study is to investigate how well vocabulary features, such as collocation, word family, etc., predict vocabulary scores in writing graded by human raters, and the degree to which they explain holistic scores. Forty-nine writings by first-year non-native English- speaking international students at a mid-western U.S. university were analyzed by using two multiple regression models. Data includes both holistic and analytic vocabulary scores given by four human raters and specific vocabulary features counted by concordance programs. Holistic and analytic vocabulary scores were estimated using many-facet Rasch measurement analysis. It was found that (a) collocation variety and essay length (or tokens) explained 32.0% of variance in the holistic writing scores, and (b) collocation variety and word family accounted for 29.5% of the variance in the vocabulary scores. The results of this study suggest that it is beneficial to teach and learn vocabulary knowledge to improve students’ writing proficiency.
참고문헌 (56)
- Benson, M., "The BBI dictionary of English word combinations" (1997), John Benjamins
- Berry, W. D., "Understanding regression assumption" (1993), Sage
- Boers, F., "Cognitive linguistic approaches to teaching vocabulary and phraseology (Vol. 6)" (2008), Walter de Gruyter
- Bonk, W. J., "A focus on language test development: Expanding the language proficiency construct across a variety of tests", pp.113~142 (2001), University of Hawai’i, Second Language Teaching and Curriculum Center
- Breiner-Sanders, K. E., "ACTFL proficiency guidelines- Speaking (revised 1999)", Foreign Language Annals, 33(1), pp.13~18 (2000)
- "N-gram phrase extractor" (2012)[URL]
- correlation analysis for the behavioral sciences, "Applied multiple regression", pp.2003, Cohen, J.
- Crossley, S. A., "Assessing lexical proficiency using analytic ratings : A case for collocation accuracy", Applied Linguistics, 35(5), pp.1~22 (2014)
- Daller, H., "Modelling and assessing vocabulary knowledge", pp.150~164 (2007), Cambridge University Press
- Elliot, N., "Handbook of automated essay evaluation: Current applications and new directions", pp.16~35 (2013), Routledge
- "iBT/Next generation TOEFL test: Independent writing rubrics" (2004)[URL]
- Field, A., "Discovering statistics using SPSS" (2009), Sage Publications
- Folse, K. S., "Vocabulary myth: Applying second language research to classroom teaching" (2004), The University of Michigan Press
- Foltz, P. W., "Handbook of automated essay evaluation: Current applications and new directions", pp.68~88 (2013), Routledge
- Gilhooly, K. J., "Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words", Behavior Research Methods & Instrumentation, 12(4), pp.395~427 (1980)
- Gitsaki, C., "Second language lexical acquisition:A study of the development of collocational knowledge" (1999), International Scholars Publications
- Grabe, W., "Current developments in second language reading research", TESOL Quarterly, 25(3), pp.375~406 (1991)
- Granger, S., "Chunks in the description of language: A tribute to John Sinclair", pp.123~146 (2011), Walter de Gruyter
- Grant, L., "Criteria for re-defining idioms:Are we barking up the wrong tree?", Applied Linguistics, 25(1), pp.38~61 (2004)
- Graves, M. F., "The vocabulary book: Learning and instruction" (2006), Teachers College Press
- Hartmann, R. R. K., "Dictionary of lexicography" (1998), Routledge
- "RANGE and FREQUENCY programs" (2002)[URL]
- Hsu, J., "Lexical collocations and their relation to the online writing of Taiwanese college English majors and non-English majors", Electronic Journal of Foreign Language Teaching, 4(2), pp.192~209 (2007)
- Hsu, J., "Lexical collocations and their relation to speaking proficiency of college EFL Learners in Taiwan", The Asian EFL Journal, 10(1), pp.181~204 (2008)
- 현태덕, "연어학습이 영어능력 향상에 미치는 효과", 현대영어교육, 8(1), pp.191~219 (2007), 현대영어교육학회
- IBM Corp, "IBM SPSS statistics for Macintosh (Version 22)" (2013), IBM Corp
- Iwashita, N., "Assessed levels of second language speaking proficiency: How distinct?", Applied Linguistics, 29(1), pp.24~49 (2008)
- Jacobs, H., "Testing ESL composition: A practical approach" (1981), Newbury House
- Latour, B., "Pandora’s hope: Essays on the reality of science studies" (1999), Harvard University Press
- Laufer, B., "Vocabulary size and use : Lexical richness in L2 written production", Applied Linguistics, 16(3), pp.307~322 (1995)
- Laufer, B., "A vocabulary-size test of controlled productive ability", Language Testing, 16(1), pp.33~51 (1999)
- Lemmouh, Z., "The relationship between grades and the lexical richness of student essays", Nordic Journal of English Studies, 7(3), pp.163~180 (2008)
- Lewis, M., "Implementing the lexical approach: Putting theory into practice" (1997), Language Teaching Publications
- "A user’s guide to FACETS" (2014)[URL]
- McNamara, D. S., "Linguistic features of writing quality", Written Communication, 27(1), pp.57~86 (2010)
- McNamara, D. S., "A hierarchical classification approach to automated essay scoring", Assessing Writing, 23, pp.35~59 (2015)
- McNamara, D. S., "Automated evaluation of text and discourse with Coh-Metrix" (2014), Cambridge University Press
- Nation, P., "Learning vocabulary in another language" (2001), Cambridge University Press
- Nation, P., "Handbook of research in second language teaching and learning", pp.581~595 (2005), Lawrence Erlbaum
- Nation, P., "How large a vocabulary is needed for reading and listening?", The Canadian Modern Language Review, 63(1), pp.59~82 (2006)
- Nation, P., "A vocabulary size test", The Language Teacher, 31(7), pp.9~13 (2007)
- Nation, P., "An introduction to applied linguistics", pp.35~54 (2002), Hodder Arnold
- Read, J., "Validation in language assessment", pp.41~60 (1998), Lawrence Erlbaum
- Read, J., "Research in teaching vocabulary", Annual Review of Applied Linguistics, 24, pp.146~161 (2004)
- Richards, J. C., "The role of vocabulary teaching", TESOL Quarterly, 10(1), pp.77~89 (1976)
- Ruegg, R., "Rater sensitivity to qualities of lexis in writing", TESOL Quarterly, 45(1), pp.63~80 (2011)
- 유영숙, "Predictability of the Cloze Test as a Measure of Written Productive Vocabulary", 현대영어교육, 18(4), pp.24~45 (2017), 현대영어교육학회[DOI]
- Shermis, M. D., "Handbook of automated essay evaluation: Current applications and new directions", pp.1~15 (2013), Routledge
- Stæhr, L. S., "Vocabulary size and the skills of listening, reading and writing", Language Learning Journal, 36(2), pp.139~152 (2008)
- Stubbs, M., "Words and phrases: Corpus studies of lexical semantics" (2001), Blackwell Publishers
- Tabachnick, B. G., "Using multivariate statistics" (2013), Pearson Education Limited
- Thornbury, S., "How to teach vocabulary" (2002), Pearson Education
- Vermeer, A., "Breadth and depth of vocabulary in relation to L1", L2 acquisition and frequency of input, 2001, pp.22(2), 217~234
- Weigle, S. C., "Handbook of automated essay evaluation: Current applications and new directions", pp.36~54 (2013), Routledge
- Wray, A., "Formulaic sequences in second language teaching : Principle and practice", Applied Linguistics, 21(4), pp.463~489 (2000)
- Zipf, G. K., "Human behavior and the principle of least effort" (1949), Addison-Wesley Press
