The Long-Term Effect of Automated Writing Evaluation Feedback on Writing Development
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
This is a longitudinal case study using a mixed-methods research design to track how two Korean university students improved their English writing competence over one year with the aid of automated writing evaluation (AWE) program, Criterion. The participants wrote essays outside of class every month for one year, submitting first and later second drafts. The participants completed a TOEIC writing test at the beginning and end of the study; students’ reflections on their writing development, obtained through interviews and journal entries, were also examined. A comparison of scores, errors, and quantitative measures of fluency and grammatical complexity indicated writing improvement. Both participants used Criterion feedback effectively to render informed judgments and valid corrections. Essay revision based on Criterion feedback yielded more self-directed learning and greater comfort with writing in content courses. It is suggested that the effect of AWE feedback transfers to long-term improvement. The results point to the potential benefit of AWE use in individual out-of-class writing practices.
Abstract
This is a longitudinal case study using a mixed-methods research design to track how two Korean university students improved their English writing competence over one year with the aid of automated writing evaluation (AWE) program, Criterion. The participants wrote essays outside of class every month for one year, submitting first and later second drafts. The participants completed a TOEIC writing test at the beginning and end of the study; students’ reflections on their writing development, obtained through interviews and journal entries, were also examined. A comparison of scores, errors, and quantitative measures of fluency and grammatical complexity indicated writing improvement. Both participants used Criterion feedback effectively to render informed judgments and valid corrections. Essay revision based on Criterion feedback yielded more self-directed learning and greater comfort with writing in content courses. It is suggested that the effect of AWE feedback transfers to long-term improvement. The results point to the potential benefit of AWE use in individual out-of-class writing practices.
참고문헌 (19)
- Burstein, J., "CriterionSM Online essay evaluation: An application for automated evaluation of student essays", Proceedings of the Fifteenth Annual Conference on Innovative Applications of Artificial Intelligence, pp.3~10 (2003), Association for the Advancement of Artificial Intelligence
- Casanave, C. P., "Language development in students’ journals", Journal of Second Language Writing, 3(3), pp.179~201 (1994)
- Chodorow, M., "The utility of article and preposition error correction systems for English language learners : Feedback and assessment", Language Testing, 27(3), pp.419~436 (2010)
- Dikli, S., "Automated essay scoring feedback for second language writers: How does it compare to instructor feedback?", Assessing Writing, 22, pp.1~17 (2014)
- Ferris, D., "Response to student writing: Implications for second language students" (2003), Lawrence Erlbaum
- Knoch, U., "What happens to ESL students’ writing after three years of study at an English medium university?", Journal of Second Language Writing, 28, pp.39~52 (2015)
- Kobayashi, H., "L1", L2, Journal of Second Language Writing, pp.2013, 22(1)[DOI]
- 이은희, "Korean EFL College Writers' Perceptions of Criterion", 영어어문교육, 21(1), pp.199~216 (2015), 한국영어어문교육학회
- Li, J., "Rethinking the role of automated writing evaluation feedback in ESL writing instruction", Journal of Second Language Writing, 27, pp.1~18 (2015)
- Li, Z., "The role of automated writing evaluation holistic scores in the ESL classroom", System, 44(1), pp.66~78 (2014)
- Li, J., "The acquisition of lexical phrases in academic writing : A longitudinal case study", Journal of Second Language Writing, 18(2), pp.85~102 (2009)
- Lipnevich, A., "Effects of differential feedback on students’ examination performance", Journal of Experimental Psychology : Applied, 15(4), pp.319~333 (2009)
- 문영인, "Short-term Effects of Automated Writing Feedback and Users’ Evaluation of Criterion", 응용언어학, 27(4), pp.125~150 (2011), 한국응용언어학회
- Scharber, C., "Students’ experiences with an automated essay scorer", Journal of Technology, Learning, and Assessment, 7(1), pp.1~44 (2008)
- Storch, N., "The impact of studying in a second language medium university on the development of L2 writing", Journal of Second Language Writing, 18(2), pp.103~118 (2009)
- Storch, N., "What happens to international students’ English after one semester at university?", Australian Review of Applied Linguistics, 31(1), pp.1~17 (2008)
- Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability, "Weigle, S. C.", Educational Testing Service, ~, pp.Research Report No. RR-11-24 (2011)
- Weigle, S. C., "English language learners and automated scoring of essays : Critical considerations", Assessing Writing, 18(1), pp.85~99 (2013)
- Wolfe-Quintero, K., "Second language development in writing: Measures of fluency, accuracy, and complexity" (1998), University of Hawaii Press