한국어-스페인어 기계 번역 성능 분석 연구 -구글 번역기와 네이버 파파고를 중심으로
Analysis of Korean-Spanish machine translation performance based on Google Translate and Naver Papago
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This article performs performance evaluation and error analysis of the Korean-Spanish translation service engine. Unlike previous studies, the research is conducted by diversifying the types of texts to be studied and dividing them into texts with and without official translations. The translation services for study are Google Translate and Naver Papago. The translation engine performance evaluation uses BLEU score, which is one of the types of automatic evaluation, and as a result, both translation services showed relatively low evaluation scores. Also, in the case of error analysis, it is divided into four types: words, grammar, sentences, and typos. As a result of the error evaluation, word-related errors were seen the most, and the word substitution phenomenon was particularly prominent. In the case of word errors, it is characteristic that grammatical errors have a great influence on the meaning transfer of the translation, whereas there are often cases where it does not have a great influence on the meaning transfer of the translation. This study is significant in that it suggested the future direction of the development of Korean-Spanish machine translation through the evaluation of the Korean-Spanish translation service.
Abstract
This article performs performance evaluation and error analysis of the Korean-Spanish translation service engine. Unlike previous studies, the research is conducted by diversifying the types of texts to be studied and dividing them into texts with and without official translations. The translation services for study are Google Translate and Naver Papago. The translation engine performance evaluation uses BLEU score, which is one of the types of automatic evaluation, and as a result, both translation services showed relatively low evaluation scores. Also, in the case of error analysis, it is divided into four types: words, grammar, sentences, and typos. As a result of the error evaluation, word-related errors were seen the most, and the word substitution phenomenon was particularly prominent. In the case of word errors, it is characteristic that grammatical errors have a great influence on the meaning transfer of the translation, whereas there are often cases where it does not have a great influence on the meaning transfer of the translation. This study is significant in that it suggested the future direction of the development of Korean-Spanish machine translation through the evaluation of the Korean-Spanish translation service.
참고문헌 (16)
- 김영주, "대통령 연설문 한서 기계번역의 언어간섭 양상 분석 —인간번역과의 비교를 중심으로", 번역학연구, 21(4), pp.9~38 (2020), 한국번역학회[DOI]
- 박소영, "이베로아메리카 한류와 번역 -방탄소년단 콘텐츠의 스페인어 팬 번역을 중심으로-", 한국언어문화, (69), pp.91~116 (2019), 한국언어문화학회
- 양성혜, "구글 번역기와 네이버 파파고 번역기의 스페인어-한국어 기사 번역 오류 유형 분석", 스페인어문학, (102), pp.67~89 (2022), 한국스페인어문학회
- 어수경, "최신 기계번역 품질 예측 연구", 한국융합학회논문지, 12(7), pp.37~44 (2021), 한국융합학회[DOI]
- 이윤선, "스페인어 수동문의 특성과 효과적인 교수법에 관한 연구 : ser 수동문, se 수동문, se 중간태 구문을 중심으로", 석사, 서어서문학과 어학전공, pp.2013
- 임효상, "한-스페인어 기계번역에 나타나는 제반 특징에 관한 연구", 스페인어문학, (102), pp.113~144 (2022), 한국스페인어문학회
- Bahdanau, Dzmitry, "Neural machine translation by jointly learning to align and translate", ~ (2014)
- Escribe, Marie, "Human evaluation of neural machine translation: The case of deep learning", Proceedings of the Human-Informed Translation and Interpreting Technology Workshop (HiT-IT 2019) (2019)
- Farrús, Mireia, "Overcoming statistical machine translation limitations: error analysis and proposed solutions for the Catalan–Spanish language pair", Language resources and evaluation, 45(2), pp.181~208 (2011)
- Hutchins, W. John, "Looking back to 1952: the first MT conference", Proceedings of the 7th Conference orn Theoretical and Methodological Issues in Machine Translation of Natural Languages, pp.19~30 (1997)
- Kim, A, "Neural machine translation evaluation & error analysis in a Spanish-Korean translation", 박사, pp.2019
- Koehn, Philipp, "Neural machine translation" (2020), Cambridge University Press
- Papineni, Kishore, "Bleu: a method for automatic evaluation of machine translation", Proceedings of the 40th annual meeting of the Association for Computational Linguistics, pp.311~318 (2002)
- Snover, Matthew, "A study of translation edit rate with targeted human annotation", Proceedings of the 7th Conference of the Association for Machine Translation in the Americas: Technical Papers, pp.223~231 (2006)
- Toury, Gideon, "Descriptive Translation Studies and Beyond" (1995), John Benjamins
- Vilar, David, "Error analysis of statistical machine translation output", Proceedings of the fifth international conference on language resources and evaluation (2006)