AI 번역기의 한러 번역성능 비교- 파파고, 구글, 챗GPT를 중심으로
Comparison of Korean-to-Russian Translation Performance Using AI Translation Engine
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This study compares how Papago, Google Translate, and ChatGPT perform when translating police dialogues, using BLEU scores, manual assessment, and error analysis. The analysis results are as follows. All three tools showed low BLEU scores compared to reference translations. In manual evaluation, ChatGPT significantly outperformed others, scoring 8.6 out of 10, compared to Google Translate's 6.5 and Papago's 5.6. Error analysis confirmed ChatGPT's superiority, with only 41 errors, while Google Translate and Papago produced 123 and 152 errors respectively. Across all tools, substitution was the most common accuracy error, followed by omission and addition. These results suggest that ChatGPT is the most reliable tool for police communication with foreign nationals.
Abstract
This study compares how Papago, Google Translate, and ChatGPT perform when translating police dialogues, using BLEU scores, manual assessment, and error analysis. The analysis results are as follows. All three tools showed low BLEU scores compared to reference translations. In manual evaluation, ChatGPT significantly outperformed others, scoring 8.6 out of 10, compared to Google Translate's 6.5 and Papago's 5.6. Error analysis confirmed ChatGPT's superiority, with only 41 errors, while Google Translate and Papago produced 123 and 152 errors respectively. Across all tools, substitution was the most common accuracy error, followed by omission and addition. These results suggest that ChatGPT is the most reliable tool for police communication with foreign nationals.