기계학습 알고리즘을 활용한 문학번역에서의 기계 번역과 인간 번역 결과물 분류 연구
Machine Learning Classification of Literary Translation Samples by Human and Machine Translators
0
조회
0
다운로드
15
인용
0
참고문헌
키워드
초록
The current paper reports the results of a text classification experiment on literary translation samples by human and machine translators. The original data consists of the English translations of 28 short and long Korean novels by a set of human translators and 3 Web-based neural machine translators – Google Translate (Google), Bing (Microsoft), and Papago (Naver). Machine translation samples were collected twice in February 2019 and February 2020. One hundred most frequent words were extracted from the data and subjected to supervised classification by two machine learning algorithms – random forest (RF) and linear discriminant analysis (LDA) - for cross-reference tests. The most important findings are as follows. First, Both RF and LDA classified human and machine translation samples from both 2019 and 2020 with high accuracy, with prediction accuracy rates topping 90 percent. This indicated a clear distinction in word use patterns between human and machine translators, which did not change much over the 1-year period. Second, in both RF and LDA tests, most of the 2019 machine translation samples were accurately classified according to their translators with prediction accuracy rates ranging between 78 and 100 percent. Classification accuracy, however, fell visibly for Bing and Papago in 2020, with Papago plunging from 100 and 80 percent to 41 percent. This meant that over the 1-year period the three machine translators moved in closer toward each other, suggesting a trend toward homogeneity in word use patterns over time.
Abstract
The current paper reports the results of a text classification experiment on literary translation samples by human and machine translators. The original data consists of the English translations of 28 short and long Korean novels by a set of human translators and 3 Web-based neural machine translators – Google Translate (Google), Bing (Microsoft), and Papago (Naver). Machine translation samples were collected twice in February 2019 and February 2020. One hundred most frequent words were extracted from the data and subjected to supervised classification by two machine learning algorithms – random forest (RF) and linear discriminant analysis (LDA) - for cross-reference tests. The most important findings are as follows. First, Both RF and LDA classified human and machine translation samples from both 2019 and 2020 with high accuracy, with prediction accuracy rates topping 90 percent. This indicated a clear distinction in word use patterns between human and machine translators, which did not change much over the 1-year period. Second, in both RF and LDA tests, most of the 2019 machine translation samples were accurately classified according to their translators with prediction accuracy rates ranging between 78 and 100 percent. Classification accuracy, however, fell visibly for Bing and Papago in 2020, with Papago plunging from 100 and 80 percent to 41 percent. This meant that over the 1-year period the three machine translators moved in closer toward each other, suggesting a trend toward homogeneity in word use patterns over time.
참고문헌 (24)
- 마승혜, "문학작품 기계번역의 한계에 대한 상세 고찰", 통번역학연구, 22(3), pp.65~88 (2018), 통번역연구소[DOI]
- 이준호, "문학번역 적용을 위한 기계번역의 현주소", 통번역학연구, 23(1), pp.143~167 (2019), 통번역연구소[DOI]
- 전혜진, "AI 시대, 문학번역에서 기계번역과 인간번역 비교분석 연구 - 똘스또이의 『유년시절』번역 분석을 중심으로", 노어노문학, 31(1), pp.111~154 (2019), 한국노어노문학회
- "진화하는 번역기 ... 사라지는 번역가?" (2017), 정상혁[URL]
- Aggarwal, Charu C., "Machine Learning for Text" (2018), Springer
- Aggarwal, Charu C, "Mining Text Data", pp.163~222 (2012), Springer
- Alloghani, Mohamed, "Supervised and Unsupervised Learning for Data Science", pp.3~21 (2019), Springer
- Bokka, Karthiek Reddy, "Solve Your Natural Language Processing Problems with Smart Deep Neural Networks" (2019), Packt Publishing
- Brownlee, Jason, "Master Machine Learning Algorithms" (2016), Brownlee
- Castilho, Sheila, "Editors’ Foreword to The Special Issue on Human Factors in Neural Machine Translation", Machine Translation, 33, pp.1~7 (2019)
- Eder, Maciej, "Does Size Matter? Authorship Attribution, Small Samples, Big Problem", Literary and Linguistic Computing, 30(2), pp.167~182 (2013)
- Fu, Han, "Reference Network for Neural Machine Translation", ~ (2019)
- Hassan, Hany, "Achieving Human Parity on Automatic Chinese to English News Translation", ~ (2018)
- Harjule, Priyanka, "Text Classification on Twitter Data", Proceedings of 3rd International Conference on Emerging Technologies in Computer Engineering: Machine Learning and Internet of Things (ICETCE), pp.160~164 (2020)
- Juola, Patrick, "Authorship attribution", Foundations and Trends in Information Retrieval, 1(3), pp.233~334 (2006)
- Kowsari, Kamran, "Text Classification Algorithms: A Survey", Information, 10(4), pp.1~68 (2019)
- Moorkens, Joss, "Translators’ Perceptions of Literary Post-Editing Using Statistical and Neural Machine Translation", Translation Spaces, 7(2), pp.240~262 (2018)
- Papineni, Kishore, "BLEU: a Method for Automatic Evaluation of Machine Translation", Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pp.311~318 (2002)
- Taivalkoski-Shilov, Kristiina, "Ethical Issues Regarding Machine(-assisted) Translation of Literary Texts", Perspectives, 27(5), pp.689~703 (2018)
- Toral, Antonio, "Machine-assisted Translation of Literary Text: A Case Study", Translation Spaces, 4, pp.241~268 (2015)
- Toral, Antonio, "What Level of Quality can Neural Machine Translation Attain on Literary Text?", ~ (2018)
- Toral, Antonio, "Post-editing Effort of a Novel With Statistical and Neural Machine Translation", Front. Digit. Humanit. (2018)[DOI]
- Toral, Antonio, "Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation", Proceedings of the Third Conference on Machine Translation (WMT), 1, pp.113~123 (2018)
- Wu, Yonghui, "Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation", ~ (2016)