기계번역 프로그램 품질에 대한 사용자 평가와 사용자의 L2 수준 간 상관관계 고찰 -한중 언어 쌍을 중심으로-
A study of the relationship between user evaluations of machine translation and user's L2 level
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
While the quality of machine translation is getting better and better, it is still not perfect. In this case, how the user treats the imperfect machine translation results determines whether the user achieves the purpose for using machine translation. In this process, user evaluations are a key factor. User evaluations are not objective nor accurate. User evaluations are a subjective evaluation of the user and is related to the user. Therefore, this paper attempts to analyze the relationship between the level of the user's L2 and user evaluations. This paper surveyed 69 Chinese users to understand the current status of their use of machine translation, including frequency of use, purpose of use, favorite machine translation, reasons for preferences, and satisfaction with the quality of the machine translation used. At the same time, for specific translation articles, it lets users evaluate the accuracy and fluency of machine translation articles. The survey results show that users with low L2 levels used machine translation at a higher frequency and were more inclined to evaluate machine translation from the perspective of ease of use. In addition, statistical analysis of the evaluation results found that users’ evaluation of machine translation was related to the user's own level L2. The lower the L2 level, the higher the evaluation of the adequacy and fluency of machine translation, and the higher the assessment of the overall quality of the machine translation.
Abstract
While the quality of machine translation is getting better and better, it is still not perfect. In this case, how the user treats the imperfect machine translation results determines whether the user achieves the purpose for using machine translation. In this process, user evaluations are a key factor. User evaluations are not objective nor accurate. User evaluations are a subjective evaluation of the user and is related to the user. Therefore, this paper attempts to analyze the relationship between the level of the user's L2 and user evaluations. This paper surveyed 69 Chinese users to understand the current status of their use of machine translation, including frequency of use, purpose of use, favorite machine translation, reasons for preferences, and satisfaction with the quality of the machine translation used. At the same time, for specific translation articles, it lets users evaluate the accuracy and fluency of machine translation articles. The survey results show that users with low L2 levels used machine translation at a higher frequency and were more inclined to evaluate machine translation from the perspective of ease of use. In addition, statistical analysis of the evaluation results found that users’ evaluation of machine translation was related to the user's own level L2. The lower the L2 level, the higher the evaluation of the adequacy and fluency of machine translation, and the higher the assessment of the overall quality of the machine translation.
참고문헌 (32)
- 기유미, "한중 기계번역 오류의 문형별 비교분석-네이버 파파고 번역기와 구글 번역기를 중심으로-", 중국연구, 74, pp.3~32 (2018), 중국연구소[DOI]
- 남철진, "中韓(韓中) 번역을 통해 본 구글번역(GNMT)의 문제", 중국과 중국학, 34, pp.1~27 (2018), 중국연구센터[DOI]
- 송연석, "기계번역 담론에 대한 비판적 고찰", 번역학연구, 19(1), pp.119~145 (2018), 한국번역학회[DOI]
- 이인혜, "연관성규칙을 이용한 사용자의 인지차이가 구매행동에 미치는 영향 분석- 기계번역 프로그램 사용자를 중심으로", 한국경영공학회지, 23(4), pp.179~195 (2018), 한국경영공학회[DOI]
- 이인혜, "기계번역 프로그램에 대한 사용자의 언어적 평가와 구매행동의 관계 연구 – 의사결정나무 분석을 적용하여", 한국경영공학회지, 23(3), pp.169~183 (2018), 한국경영공학회[DOI]
- 임희주, "교양영어 수업에서 영어자동번역기 사용에 대한 대학생의 인식 및 태도연구 ― 영작문 수업을 중심으로", 교양교육연구, 11(6), pp.727~751 (2017), 한국교양교육학회
- 임순정, "구글 번역의 사례연구: 번역품질과 번역단위와의 관계를 중심으로", 번역학연구, 15(1), pp.177~209 (2014), 한국번역학회[DOI]
- 장애리, "국내 기계 통번역의 발전 현황 분석: 한·중 언어 쌍을 중심으로", 번역학연구, 18(2), pp.171~206 (2017), 한국번역학회[DOI]
- 정혜연, "번역의 자동평가: 기계번역 평가를 인간번역 평가에 적용해보기", 통번역학연구, 22(4), pp.265~287 (2018), 통번역연구소[DOI]
- 조재옥, "상호작용 모형을 적용한 중등 영어 읽기 지도 방안 연구", 석사, pp.1992
- 황은하, "한중 뉴스 표제의 대조 분석 및 기계번역 응용", 박사, 언어정보학협동과정 말뭉치언어학전공, pp.2012
- 秦颖, "基于神经网络的机器翻译质量评析及对翻译教学的影响", 外语电化教学, (02), pp.51~56 (2018)
- 秦颖, "翻译质量评价的标准与自动评价方法研究" (2018), 外语教学与研究出版社
- 任智, "透视人工智能翻译行业的市场前景", 广西质量监督导报, (08), pp.104~105 (2019)
- 孙瑾, "基于文本类型理论的机器翻译研究", 中国科技翻译, 29(3), pp.27~29 (2016)
- Anderson, N. J., "Individual differences in strategy use in second language reading and testing", The Modern Language Journal, 75(4), pp.460~472 (1991)
- Baker, M., "In Other Words: A Coursebook On Translation" (2011), Routledge
- Callison-Burch, C., "Re-evaluation the role of bleu in machine translation research", Paper presented on the 11th Conference of the European Chapter of the Association for Computational Linguistics (2006)
- Cohen, J., "Statistical Power Analysis For The Behavioral Sciences" (1988), Hillsdale, NJ Lawrence Erlbaum Associates
- MURPHY ODO DENNIS, "Learner Perceptions of Using Machine Translation Tools in the EFL Classroom", The SNU Journal of Education Research, 28(2), pp.63~83 (2019), 교육종합연구원[DOI]
- Goodman, K. S., "Analysis of oral reading miscues: Applied psycholinguistics", Reading Research Quarterly, pp.9~30 (1969)
- Gough, P. B., "One second of reading", Visible Language, 6(4), pp.291~320 (1972)
- Hampshire, S., "Translation and the Internet: evaluating the quality of free online machine translators", Quaderns: Revista de Traducció, (17), pp.197~209 (2010)
- Junczys-Dowmunt, M., "Is neural machine translation ready for deployment", Paper presented on the 13th International Workshop on Spoken Language Translation (2016)
- Karnal, A. R., "Reading strategies in a L2: A study on machine translation", The Reading Matrix : An International Online Journal, 15(2), pp.69~79 (2015)
- Klubička, F., "Fine-grained human evaluation of neural versus phrase-based machine translation", The Prague Bulletin of Mathematical Linguistics, 108(1), pp.121~132 (2017)
- Koehn, P., "Six Challenges for Neural Machine Translation", Proceedings of the First Workshop on Neural Machine Translation (2017)
- Martindale, M. J., "Identifying Fluently Inadequate Output in Neural and Statistical Machine Translation", Proceedings of Machine Translation Summit XVII, 1 (2019)
- Martindale, M. J., "Fluency Over Adequacy: A Pilot Study in Measuring User Trust in Imperfect MT", Paper presented at AMTA 2018 (2018)
- Rumelhart, D. E., "Toward An Interactive Model Of Reading" (1976), Center for Human Information Processing, University of California
- Stanovich, K. E., "Toward an interactive-compensatory model of individual differences in the development of reading fluency", Reading Research Quarterly, pp.32~71 (1980)
- Wuttikrikunlaya, P., "The use of online tools in L2 writing: A study of Thai university students", Pasaa Paritat Journal, 30, pp.107~148 (2016)