단어 중의성 해소를 위한 지도학습 방법의 통계적 자질선정에 관한 연구
A Study on Statistical Feature Selection with Supervised Learning for Word Sense Disambiguation
1
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
이 연구는 지도학습 방법을 이용한 단어 중의성 해소가 최적의 성능을 가져오는 통계적 자질선정 방법과 다양한 문맥의 크기를 파악하고자 하였다. 실험집단인 한글 신문기사에 자질선정 기준으로 정보획득량, 카이제곱 통계량, 문헌빈도, 적합성 함수 등을 적용하였다. 실험 결과, 텍스트 범주화 기법과 같이 단어 중의성 해소에서도 자질선정 방법이 매우 유용한 수단이 됨을 알 수 있었다. 실험에 적용한 자질선중 기준 중에 정보획득량이 가장 좋은 성능을 보였다. SVM 분류기는 자질집합 크기와 문맥 크기가 클수록 더 좋은 성능을 보여 자질선정에 영향을 받지 않았다. 나이브 베이즈 분류기는 10% 정도의 자질집합 크기에서 가장 좋은 성능을 보였다. kNN의 경우 10% 이하의 자질에서 가장 좋은 성능을 보였다. 단어 중의성 해소를 위한 자질선정을 적용할 때 작은 자질집합 크기와 큰 문맥 크기를 조합하거나, 반대로 큰 자질집합 크기와 작은 문맥 크기를 조합하면 성능을 극대화 할 수 있다.
Abstract
This study aims to identify the most effective statistical feature selecting method and context window size for word sense disambiguation using supervised methods. In this study, features were selected by four different methods: information gain, document frequency, chi-square, and relevancy. The result of weight comparison showed that identifying the most appropriate features could improve word sense disambiguation performance. Information gain was the highest. SVM classifier was not affected by feature selection and showed better performance in a larger feature set and context size. Naive Bayes classifier was the best performance on 10 percent of feature set size. kNN classifier on under 10 percent of feature set size. When feature selection methods are applied to word sense disambiguation, combinations of a small set of features and larger context window size, or a large set of features and small context windows size can make best performance improvements.
참고문헌 (19)
- 정영미, "정보검색연구" (2005), 구미무역(주) 출판부
- 정영미, "정보검색 성능 향상을 위한 단어 중의성 해소 모형에 관한 연구", 정보관리학회지, 22(2), pp.125~145 (2005), 한국정보관리학회
- Escudero, G, "Naive Bayes and Exemplar-based Approaches to Word Sense Disambiguation Revisited", Proceedings of the 14th European Conference on Artificial Intelligence, pp.421~425 (2000)
- Fragos, K, "Disambiguation of Greek Polysemous Words Using Hierachical Probabilistic Networks and a Chi-square Feature Selection Strategy", International Journal on Artificial Intelligence Tools, 17(4), pp.687~701 (2008)
- Gale, W, "One Sense per Discourse", Proceedings of the DARPA Speech and Natural Language Workshop, pp.233~237 (1992)
- Guyon, I, "An Introduction to Variable and Feature Selection", Journal of Machine Learning Research, 3, pp.1157~1182 (2003)
- Hoste, V, "Evaluating the Results of a Memory-based Word-expert Approach to Unrestricted Word Sense Disambiguation", Proceedings of the Workshop on Word Sense Disambiguation: Recent Successes and Future Directions, pp.95~101 (2002)
- Jackson, P, "Natural Language Processing for Online Applications:Text Retrieval", Processing for Online Applications:Text Retrieval, Extraction and Categorization (2002), Benjamins Publishing Co
- Joachims, T, "Learning to Classify Text Using Support Vector Machines" (2001), Kluwer Academic Publishers
- Mihalcea, R, "Word Sense Disambiguation with Pattern Learning and Automatic Feature Selection", Natural Language Engineering, 8(4), pp.343~358 (2002)
- Navigli, R, "Word Sense Disambiguation: A Survey", ACM Computing Surveys, 41(2), pp.1~69 (2009)
- Ng, T, "Integrating Multiple Knowledge Sources to Disambiguate Word Senses: An Exemplar-based Approach", Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics, pp.40~47 (1996)
- Orhan, Z, "Impact of Feature Selection for Corpus-based WSD in Turkish", Proceedings of the MICAI 2006: Advances in Artificial Intelligence (LNCS 4293), pp.868~878 (2006)
- Sebastiani, F, "Machine Learning in Automated Text Categorization", ACM Computing Surveys, 34(1), pp.1~47 (2002)
- Stevenson, M, "Word Sense Disambiguation: The Case for Combinations for Knowledge Sources" (2003), CSLI Publications
- Stevenson, M, "The Interaction of Knowledge Sources in Word Sense Disambiguation", Computational Linguistics, 27(3), pp.321~349 (2001)
- Strapparava, C, "Pattern Abstraction and Term Similarity for Word Sense Disambiguation:IRST at Senseval-3", Proceedings of Senseval-3: Third International Workshop on the Evaluation of Systems for the Semantic Analysis of Text, pp.229~234 (2004)
- Suarez, A, "Improving Feature Selection for Maximum Entropybased Word Sense Disambiguation", Proceedings of the PorTAL 2002(LNAI 2389), pp.15~23 (2002)
- Yang, Y, "A Comparative Study on Feature Selection in Text Categorization", Proceedings of the 14th International Conference on Machine Learning, pp.412~420 (1997)