From No Aid to Neural Aids: Exploring the Influence of Machine Translation on L2 Reading Problems
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Neural machine translators (NMTs), such as Google Translate, may assist second language (L2) readers with general comprehension. However, previous empirical studies show mixed results regarding their effectiveness. In this study, 145 Korean English learners from a girls’ high school were asked to solve three types of reading comprehension problems (grammar judgment, inferring meaning from context, inferring main idea) under three reading conditions (no aid, MT, glossary). Overall, when using MT, reading comprehension scores were higher than in either the no aid or glossary conditions individually. However, none of the reading aid conditions improved grammar judgment. Only mid-proficiency learners benefited from MT in both inferring meaning from context and inferring main idea tasks. The results suggest that the glossary may have interrupted the flow of the reading process. With the widespread availability of MT as an online reference tool, L2 teachers should consider incorporating MT as a legitimate reading aid for different proficiency levels and reading purposes.
Abstract
Neural machine translators (NMTs), such as Google Translate, may assist second language (L2) readers with general comprehension. However, previous empirical studies show mixed results regarding their effectiveness. In this study, 145 Korean English learners from a girls’ high school were asked to solve three types of reading comprehension problems (grammar judgment, inferring meaning from context, inferring main idea) under three reading conditions (no aid, MT, glossary). Overall, when using MT, reading comprehension scores were higher than in either the no aid or glossary conditions individually. However, none of the reading aid conditions improved grammar judgment. Only mid-proficiency learners benefited from MT in both inferring meaning from context and inferring main idea tasks. The results suggest that the glossary may have interrupted the flow of the reading process. With the widespread availability of MT as an online reference tool, L2 teachers should consider incorporating MT as a legitimate reading aid for different proficiency levels and reading purposes.
참고문헌 (55)
- Bruen, J., "Using a shared L1 to reduce cognitive overload and anxiety levels in the L2 classroom", The Language Learning Journal, 45(3), pp.368~381 (2017)
- Cancino, M., "The impact of Google Translate on L2 writing quality measures : Evidence from Chilean EFL high school learners", System, 98, pp.102464~ (2021)
- Carré, A., "Machine translation for everyone: Empowering users in the age of artificial intelligence", pp.187~207 (2022), Language Science Press
- Carreres, Á., "Translation as a means and as an end : Reassessing the divide", The Interpreter and Translator Trainer, 8(1), pp.123~135 (2014)
- Case, M., "Machine translation and the disruption of foreign language learning activities", eLearning Papers, 45, pp.4~16 (2015)
- Castilho, S., "Reading comprehension of machine translation output: What makes for a better read?", Proceedings of the 21st Annual Conference of the European Association for Machine Translation, pp.79~88 (2018), Universitat d’Alacant
- Chang, P., "Recursive editing with Google Translate : The impact on writing and error correction", Computer Assisted Language Learning, 37(7), pp.2116~2141 (2022)
- Chen, W., "Using Google Translate in an authentic translation task : The process, refinement efforts, and students’ perceptions", Current Trends in Translation Teaching and Learning E, 7, pp.213~238 (2020)
- Chen, I., "Hypertext annotation : Effects of presentation formats and learner proficiency on reading comprehension and vocabulary learning in foreign languages", Computers & Education, 63, pp.416~423 (2013)
- Chon, Y. V., "The electronic dictionary for writing : a solution or a problem", International Journal of Lexicography, 22(1), pp.23~54 (2009)
- Chon, Y. V., "Comparing L2 learners’ writing against parallel machine-translated texts : Raters’ assessment, linguistic complexity and errors", System, 96, pp.102408~ (2021)
- Chung, E. S., "The effect of using machine translation on linguistic features in L2 writing across proficiency levels and text genres", Computer Assisted Language Learning, 35(9), pp.2239~2264 (2022)
- Cook, G., "Translation in language teaching" (2010), Oxford University Press
- Ducar, C., "Machine translation and the L2 classroom : Pedagogical solutions for making peace with Google translate", Foreign Language Annals, 51(4), pp.779~795 (2018)
- Fuji, M., "Evaluation method for determining groups of users who find MT “useful.”", Proceedings of Machine Translation Summit VIII, pp.103~108 (2001), European Association for Machine Translation
- Graesser, A. C., "Constructing inferences during narrative text comprehension", Psychological Review, 101, pp.371~395 (1994)
- Hall, G., "Own-language use in language teaching and learning", Language Teaching, 45(3), pp.271~308 (2012)
- Hatim, B., "Translation: An advanced resource book for students" (2019), Routledge
- Hentschel, E., "Translation in second language learning and teaching", pp.15~30 (2009), Peter Lang
- Jolley, J. R., "Thirty years of machine translation in language teaching and learning : A review of the literature", L2 Journal, 14(1), pp.26~44 (2022)
- Jones, D., "Measuring human readability of machine generated text: Three case studies in speech recognition and machine translation", Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’05), 5, pp.1009~1012 (2005), IEEE Press
- Karnal, A. R., "Reading strategies in a L2 : A study on machine translation", The Reading Matrix, 15(2), pp.69~79 (2015)
- Kim, H. -S., "Exploring the use of a machine translator on EFL learners’reading comprehension", STEM Journal, 21(1), pp.119~143 (2020)
- Klimova, B., "Neural machine translation in foreign language teaching and learning : A systematic review", Education and Information Technologies, 28, pp.663~682 (2023)
- Kol, S., "Google Translate in academic writing courses", The EuroCALL Review, 26(2), pp.50~57 (2018)
- Lee, H., "Evaluation of electronic and paper textual glosses on second language vocabulary learning and reading comprehension", The Asia-Pacific Education Researcher, 25, pp.499~507 (2016)
- Lee, S. M., "The effectiveness of machine translation in foreign language education:A systematic review and meta-analysis", Computer Assisted Language Learning, 36(1–2), pp.103~125 (2023)
- Leffa, V. J., "Reading with an electronic glossary", Computers & Education, 19(3), pp.285~290 (1992)
- Liou, H. C., "The electronic bilingual dictionary as a reading aid to EFL learners:Research findings and implications", Computer Assisted Language Learning, 13(4–5), pp.467~476 (2000)
- Macken, L., "Measuring comprehension and perception of neural machine translated texts: A pilot study", Translating and the Computer 40 (TC40):Proceedings, pp.120~126 (2018), Editions Tradulex
- Maghsoudi, M., "Machine versus human translation outputs: Which one results in better reading comprehension among EFL learners?", Japan Association for Language Teaching Computer Assisted Language Learning Journal (JALT CALL Journal), 16(2), pp.69~84 (2020)
- Marzban, A., "The role of translation in promoting reading comprehension of Iranian high school students", Procedia Social and Behavioral Sciences, 18, pp.526~532 (2011)
- Mesgarshahr, A., "Understanding L2 reading cognitive processes : The case of the L2 reader’s goal", The Reading Matrix : An International Online Journal, 19(1), pp.206~225 (2019)
- Mokhtari, K., "Measuring ESL students’ awareness of reading strategies", Journal of Developmental Education, 25(3), pp.2~11 (2002)
- Moorkens, J., "What to expect from neural machine translation : A practical in-class translation evaluation exercise", The Interpreter and Translator Trainer, 12(4), pp.375~387 (2018)
- Odo, D. M., "Supporting pre-service English teachers’ academic reading and writing with online machine translation", STEM Journal, 21(2), pp.123~143 (2020)
- Nassaji, H., "Schema theory and knowledge-based processes in second language reading comprehension : A need for alternative perspectives", Language Learning, 57, pp.79~113 (2007)
- Nation, I. S. P., "Contemporary applied linguistics (Vol. 1)", pp.99~116 (2009), Continuum
- Niño, A., "Machine translation in foreign language learning : Language learners’ and tutors’ perceptions of its advantages and disadvantages", ReCALL, 21(2), pp.241~258 (2009)
- Nord, C., "Text type and translation method : An objective approach to translation criticism", The Translator, 2(1), pp.81~88 (1996)
- Pfafflin, S. M., "Evaluation of machine translations by reading comprehension tests and subjective judgments", Mechanical Translation, 8(2), pp.2~8 (1965)
- Pintado Gutiérrez, L., "Translation in language teaching, pedagogical translation, and code-switching : Restructuring the boundaries", The Language Learning Journal, 49(2), pp.219~239 (2021)
- Qian, D. D., "Evaluation of an in-depth vocabulary knowledge measure for assessing reading performance", Language Testing, 21(1), pp.28~52 (2004)
- Resende, N., "Can Google Translate rewire your L2 English processing", Digital, 1(1), pp.66~85 (2021)
- Scarton, C., "A reading comprehension corpus for machine translation evaluation", Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pp.3652~3658 (2016), European Language Resources Association (ELRA)
- Schmitt, N., "The percentage of words known in a text and reading comprehension", The Modern Language Journal, 95(1), pp.26~43 (2011)
- Shterionov, D., "Human versus automatic quality evaluation of NMT and PBSMT", Machine Translation, 32(3), pp.217~235 (2018)
- Sonbul, S., "Translation competence and collocation knowledge : Do congruency and word type have an effect on the accuracy of collocations in translation", The Interpreter and Translator Trainer, 16(4), pp.409~427 (2022)
- Stapleton, P., "Assessing the accuracy and teachers’ impressions of Google Translate : A study of primary L2 writers in Hong Kong", English for Specific Purposes, 56, pp.18~34 (2019)
- Tomita, M., "Evaluation of MT Systems by TOEFL", Proceedings of the Fifth Conference on Theoretical and Methodological Issues in Machine Translation of Natural Languages, pp.14~16 (1993)
- Van Brussel, L., "A fine-grained error analysis of NMT, PBMT and RBMT output for English-to-Dutch", Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC), pp.3799~3804 (2018), European Language Resources Association (ELRA)
- Weydt, H., "Translation in second language learning and teaching", pp.291~307 (2009), Peter Lang
- Yoon, C. W., "Machine translation errors and L2 learners’ correction strategies by error type and English proficiency", English Teaching, 77(3), pp.153~175 (2022)
- Zhang, D., "Vocabulary and grammar knowledge in second language reading comprehension : A structural equation modeling study", The Modern Language Journal, 96(4), pp.558~575 (2012)
- Zojer, H., "Translation in second language learning and teaching", pp.31~51 (2009), Peter Lang
