벡터 공간 모델과 HAL에 기초한 단어 의미 유사성 군집
Word Sense Similarity Clustering Based on Vector Space Model and HAL
0
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
본 연구에서는 벡터 공간 모델과 HAL (Hyperspace Analog to Language)을 적용해서 단어 의미 유사성을 군집한다. 일정한 크기의 문맥을 통해서 단어 간의 상관성을 측정하는 HAL을 도입하고(Lund and Burgess 1996), 상관성 측정에서 고빈도와 저빈도에 다르게 측정되는 왜곡을 줄이기 위해서 벡터 공간 모델을 적용해서 단어 쌍의 코사인 유사도를 측정하였다(Salton et al. 1975, Widdows 2004). HAL과 벡터 공간 모델로 만들어지는 공간은 다차원이므로, 차원을 축소하기 위해서 PCA (Principal Component Analysis)와 SVD (Singular Value Decomposition)를 적용하였다. 유사성 군집을 위해서 비감독 방식과 감독 방식을 적용하였는데, 비감독 방식에는 클러스터링을 감독 방식에는 SVM (Support Vector Machine), 나이브 베이즈 구분자(Naive Bayes Classifier), 최대 엔트로피(Maximum Entropy) 방식을 적용하였다. 이 연구는 언어학적 측면에서 Harris (1954), Firth (1957)의 분포 가설(Distributional Hypothesis)을 활용한 의미 유사도를 측정하였으며, 심리언어학적 측면에서 의미 기억을 설명하기 위한 모델로 벡터 공간 모델과 HAL을 결합하였으며, 전산적 언어 처리 관점에서 기계학습 방식 중 감독 기반과 비감독 기반을 적용하였다.
Abstract
In this paper, we cluster similar word senses applying vector space model and HAL (Hyperspace Analog to Language). HAL measures corelation among words through a certain size of context (Lund and Burgess 1996). The similarity measurement between a word pair is cosine similarity based on the vector space model, which reduces distortion of space between high frequency words and low frequency words (Salton et al. 1975, Widdows 2004). We use PCA (Principal Component Analysis) and SVD (Singular Value Decomposition) to reduce a large amount of dimensions caused by similarity matrix. For sense similarity clustering, we adopt supervised and non-supervised learning methods. For non-supervised method, we use clustering. For supervised method, we use SVM (Support Vector Machine), Naive Bayes Classifier, and Maximum Entropy Method.
참고문헌 (22)
- Harris, Z., "Distributional structure", Word, 10(23), pp.146~162 (1954)
- Firth, J. R., "A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis", pp.1~32 (1957), Philological Society
- McDonald, S., "Testing the distributional hypothesis: The influence of context on judgements of semantic similarity", In Proceedings of the 23rd Annual Conference of the Cognitive Science Society, pp.611~616 (2001)
- Lund, K, "Producing high-dimensional semantic spaces from lexical co-occurrence. Behavior Research Methods", Instruments & Computers, 28(2), pp.203~208 (1996)
- Salton, G., "A vector space model for automatic indexing", Communications of the ACM, 18(11), pp.613~620 (1975)
- Widdows, D., "Geometry and Meaning, In Center for the Study of Language and Information" (2004)
- Schutze, H., "Automatic Word Sense Discrimination", Journal of Computational Linguistics, 24(1), pp.97~123 (1998)
- Burgess, C, "Using high-dimensional semantic spaces derived from large text corpora", Proceedings of the Seventeenth Annual Conference of the Cognitive Science Society, 13(14) (1995)
- Landauer. T, "A solution to Plato's problem: The latent semantic analysis theory of the acquisition, induction, and representation of knowledge", Psychological Review, 104, pp.211~241 (1997)
- Steyvers, M, "Combining background knowledge and learned topics", Topics in Cognitive Science, 3(1), pp.18~47 (2007)
- Rohde, D., "An improved method of deriving word meaning from lexical cooccurrence", Cognitive Psychology, 7, pp.573~605 (2005)
- Dunning, T., "Accurate methods for the statistics of surprise and coincidence", Journal of Computational Linguistics, 19, pp.61~74 (1993)
- Lowe, W., "Towards a theory of semantic space", Proceedings of the 23rd Conference of the Cognitive Science Society
- Church, K, "Word association norms, mutual information, and lexicography", Journal of Computational Linguistics, 16, pp.22~29 (1990)
- Song, D., "Concept learning and information inferencing on a highdimensional semantic space", ACM SIGIR 2004 Workshop on Mathematical, 2004, ~
- 21세기 세종계획 전자사전 개발분과 연구보고서, "홍재성", 국립국어원․문화관광부, ~ (2007)
- Baroni, M., "Isa meets Iara: A fully incremental word space model for cognitively plausible simulations of semantic learnin", Proceedings of the 45th Meeting of the Association for Computational Linguistics (2007)
- Jones, M., "High-dimensional semantic space accounts of priming", Journal of Memory and Language, 55, pp.534~552 (2006)
- Turney, P., "From frequency to meaning: vector space models of semantics", Journal of Artificial Intelligence Research, 37, pp.141~188 (2010)
- 이성헌, "서술명사 기술을 위한 대상부류 개념의 활용", 프랑스어문교육, 12, pp.129~149 (2001)
- Tan, P., "Introduction to Data Mining, In Pearson Education" (2006)
- Baayen, H., "Analyzing Linguistic Data" (2008), Cambridge University Press