본문 바로가기
KERD
논문KCI 등재

Extended pivot-based approach for bilingual lexicon extraction

2

조회

0

다운로드

2

인용

0

참고문헌

키워드

주제분류기계공학

초록

This paper describes the extended pivot-based approach for bilingual lexicon extraction. The basicfeatures of the approach can be described as follows: First, the approach builds context vectors between asource (or target) language and a pivot language like English, respectively. This is the same as the standardpivot-based approach which is useful for extracting bilingual lexicons between low-resource languages such asKorean-French. Second, unlike the standard pivot-based approach, the approach looks for similar context vectorsin a source language. This is helpful to extract translation candidates for polysemous words as well aslets the translations be more confident. Third, the approach extracts translation candidates from target contextvectors through the similarity between source and target context vectors. Based on these features, this paperdescribes the extended pivot-based approach and does various experiments in a language pair, Korean-French(KR-FR). We have observed that the approach is useful for extracting the most proper translation candidate aswell as for a low-resource language pair.

Abstract

This paper describes the extended pivot-based approach for bilingual lexicon extraction. The basicfeatures of the approach can be described as follows: First, the approach builds context vectors between asource (or target) language and a pivot language like English, respectively. This is the same as the standardpivot-based approach which is useful for extracting bilingual lexicons between low-resource languages such asKorean-French. Second, unlike the standard pivot-based approach, the approach looks for similar context vectorsin a source language. This is helpful to extract translation candidates for polysemous words as well aslets the translations be more confident. Third, the approach extracts translation candidates from target contextvectors through the similarity between source and target context vectors. Based on these features, this paperdescribes the extended pivot-based approach and does various experiments in a language pair, Korean-French(KR-FR). We have observed that the approach is useful for extracting the most proper translation candidate aswell as for a low-resource language pair.

참고문헌 (20)

  1. P. Fung, "A statistical view on bilingual lexicon extraction: from parallel corpora to non-parallel corpora", Proceedings of the 3rd Conference of the Association for Machine Translation in the Americas, pp.1~16 (1998)
  2. 이공주, "뉴스 댓글의 감정 분류를 위한 자질 가중치 설정", 한국마린엔지니어링학회지, 34(6), pp.871~879 (2010), 한국마린엔지니어링학회
  3. P. Fung, "Finding terminol-ogy translations from non-parallel corpora", Proceedings of the 5th Annual Workshop on Very Large Corpora, pp.192~202 (1997)
  4. R. Rapp, "Automatic identification of word translations from unrelated English and German corpora", Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pp.519~526 (1999)
  5. Y. Cao, "Base noun phrase trans-lation using web data and the EM algorithm", Proceedings of the 19th International Conference on Computational Linguistics, pp.127~133 (2002)
  6. Y. Chiao, "Looking for candidate translational equivalents in specialized, comparable corpora", Proceedings of the 19th International Conference on Computational Linguistics, pp.1208~1212 (2002)
  7. H. Déjean, "Une nouvelle ap-procheà léxtraction de lexiques bilingues à partir de corpus comparables", Lexicometrica, Alignement Lexical Dans les Corpus Multilingues, pp.1~22 (2002)
  8. P. Koehn, "Learning a trans-lation lexicon from monolingual corpora", Proceedings of the Association for Computational Linguistic on Unsupervised Lexical Acquisition, pp.9~16 (2002)
  9. T. Tsunakawa, "Building a bilingual lexicon using phrase-based statistical machine translation via a pivot lan-guage", Proceeding of the 22nd International Conference on Computational Linguistics, Posters Proceedings, pp.18~22 (2008)
  10. P. Koehn, "Statistical phrase-based translation", Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology, pp.48~54 (2003)
  11. H. Déjean, "An ap-proach based on multilingual thesauri and model combination for bilingual lexicon ex-traction", Proceedings of the 19th International Conference on Computational Linguistics, pp.218~224 (2002)
  12. B. Daille, "French-English termi-nology extraction from comparable corpora", Proceedings of the 2nd International Joint Conference on Natural Language Processing, pp.707~718 (2005)
  13. H. -W. Seo, "Context-based bilingual lexicon extraction via a pivot language", Proceedings of the Conference of the Pacific Association for Computational Linguistics (2013)
  14. H. -W. Seo, "Rated recall : Evaluation method for construct-ing bilingual lexicons", Proceedings of the 25th Annual Conference on Human and Cognitive Language Technology, pp.146~151 (2013)
  15. 김재훈, "Bilingual lexicon induction through a pivot language", 한국마린엔지니어링학회지, 37(3), pp.300~306 (2013), 한국마린엔지니어링학회[DOI]
  16. R. Rapp, "Identify word translations in non-parallel texts", Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, pp.320~322 (1995)
  17. G. Grefenstette, "Corpus-derived first, second and third-order word affinities", Proceedings of the 6th Congress of the European Association for Lexicography, pp.279~290 (1995)
  18. A. Hazem, "Bilingual lexicon extraction from comparable corpora as metasearch", Proceeding of the 4th workshop on Building and Using Comparable Corpora, pp.35~43 (2011)
  19. P. Koehn, "Europarl : A parallel corpus for statistical machine translation", Proceedings of the Conference on the 10th Machine Translation Summit, pp.79~86 (2005)
  20. E. Voorhees, "The TREC-8 question answering track report", Proceedings of the 8th Text Retrieval Conference, pp.77~82 (1999)

관련 논문AI추천

이 간행물의 다른 논문 (7건)