전처리 및 후처리에 의한 언어 차이 해소 능력을 개선한 영한 기계번역 시스템
English-Korean Machine Translation System with the Improved Ability to Resolve Linguistic Differences by Pre- and Post-Processing
2
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
The linguistic differences between English and Korean cause difficulties in text processing, especially in machine translation. An English-Korean machine translation system must effectively solve these linguistic differences in order to be used practically. In this paper, we propose pre-processing as a method of solving the linguistic differences. We present pre-processing tasks for the differences and some accompanying post-processing procedures. We explore the differences requiring the pre-processing, devise pre-processing procedures, and determine the proper position where the procedures can be applied during the translation process. In an experiment, we show the usefulness of the proposed pre-processing and post-processing tasks for improving translation quality.
Abstract
The linguistic differences between English and Korean cause difficulties in text processing, especially in machine translation. An English-Korean machine translation system must effectively solve these linguistic differences in order to be used practically. In this paper, we propose pre-processing as a method of solving the linguistic differences. We present pre-processing tasks for the differences and some accompanying post-processing procedures. We explore the differences requiring the pre-processing, devise pre-processing procedures, and determine the proper position where the procedures can be applied during the translation process. In an experiment, we show the usefulness of the proposed pre-processing and post-processing tasks for improving translation quality.
참고문헌 (22)
- 김성동(Kim, Sung-Dong), "영한 기계번역에서 문장 다시 쓰기에 관한 연구(A Study on Sentence Rewriting in English-Korean Machine Translation)", 2008 한국정보과학회 학술대회 프로시딩지(Proceedings of Korean Institute of Information Scientists and Engineers), 35(1), pp.257~261 (2008)
- 안동언(An, Dong Un), "웹용 다국어 기계번역을 위한 전처리기(A Preprocessing System for Multi-Lingual Machine Translation Web Pages)", 1998한국정보과학회 학술대회(Proceedings of Korean Institue of Information Scientists and Engineers), 25(2), pp.204~206 (1998)
- 여상화(Yuh, Sanghwa), "실용적인 영한 기계번역을위한 전처리기의 설계 및 구현(A Preprocessor for Practical English-to-Korean Machine Translation)", 1996 한글 및 한국어 정보처리 학술대회(Proceedings of the 8th Annual Conference on Human and Cognitive Language Technology), 8, pp.313~321 (1996)
- 尹星姬, "영어-한국어 기계 번역을 위한 숙어 기반의 효율적 문장 문석", 박사, 컴퓨터공학, pp.1993
- 최승권, "영어 특허문서 자동번역을 위한 특허번역패턴 연구", 번역학연구, 8(1), pp.301~322 (2007), 한국번역학회[DOI]
- Habash, Nizar, "Arabic Preprocessing Schemes for Statistical Machine Translati", Proceedings of the Human Language Technology Conference of the North American Chapter of the ACL, pp.49~52 (2006)
- Johnson, Melvin, "Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation", Transactions of the Association for Computational Linguistics, 5, pp.339~351 (2017)
- Kavirajan, B., "Improving the Rule Based Machine Translation System Using Sentence Simplification (English to Tamil)", 2017 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (2017)
- Kim, Sung-Dong, "Sentence Analysis using Pattern Matching in English-Korean Machine Translation", Proceedings of 1995 International Conference on Computer Processing on Oriental Languages, pp.199~206 (1995)
- Kim, Sung-Dong, "Reducing Parsing Complexity by Intra-Sentence Segmentation based on Maximum Entropy Model", Proceedings of the 2000 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pp.164~171 (2000)
- Kim, Sung-Dong, "Learning-Based Intrasentence Segmentation for Efficient Translation of Long Sentences", Machine Translation, 16(3), pp.151~174 (2001)
- Kim, Yu Seop, "Semantic Implementation Based on Extended Idiom for English to Korean Machine Translation", Journal of the Asia-Pacific Association for Machine Translation, 20, pp.23~39 (1998)
- Koehn, Pillipp, "Six Challenges for Neural Machine Translation", Proceedings of the 1st Workshop on Neural Machine Translation, pp.28~39 (2017)
- Li, Wei-Chuan, "Parsing Long English Sentences with Pattern Rules", Proceedings of the 25th Conference on Computational Linguists, pp.410~412 (1990)
- Marcus, Mitchell P., "Building a Large Annotated Corpus of English: the Penn Treebank", Computational Linguistics, 19, pp.313~330 (1993)
- Niehues, Jan, "Pre-Translation for Neural Machine Translation", Proceedings of the 26th International Conference on Computational Linguistcs (2016)
- Ostling, Robert, "The Helsinki Neural Machine Translation System", Proceedings of the Conference on Machine Translation, 2, pp.338~347 (2017)
- Oudah, Mai, "The Impact of Preprocessing on Arabic-English Statistical and Neural Machine Translation", Proceedings of the 17th Machine Translation Summit (2019)
- Prasomsuk, Sukchatri, "Thai to Khmer Rule-Based Machine Translation Using Reordering Word to Phrase", International Journal of Computer Theory and Engineering, 9(3), pp.223~228 (2017)
- Sakata, Jun, "Machine Translation Method Based on Non-Compositional Semantics (Word-Level Sentence-Pattern-Based MT)", Proceedings of the 29th PACLIC, pp.225~237 (2015)
- Wu, Yonghui, "Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation", Computing Research Repository, ~ (2016)
- Yashothara, Shanmugarasa, "Improving Phrase-Based Statistical Machine Translation with Preprocessing Techniques", Proceedings of 2018 International Conference on Asian Language Processing (2018)