질문대답 아카이브에서 어휘 연관성을 이용한 질문 분류
Question Classification Based on Word Association for Question and Answer Archives
2
조회
0
다운로드
2
인용
0
참고문헌
키워드
초록
보통 두 세 개의 어휘로 구성된 질문 분류에서 어휘의 다양한 표현으로 인한 어휘 불일치문제는 성능 저하의 주요 원인이다. 따라서 질문 분류에서 어휘 사이의 연관성을 반영하는 것이 필수적이다. 본 논문에서는 같은 범주의 질문-질문 쌍들에 대해 계산한 어휘 번역확률을 번역기반 언어모델에 반영하여 질문을 분류하는 방법을 제안한다. 실험에서 야후!앤써 질문대답 아카이브를 이용해서 전체 질문-대답 쌍들에 대해서 번역확률을 계산하는 것보다 같은 범주에 속하는 질문-질문 쌍들에 대해서 번역확률을 계산하는 것이 질문 분류에서 더 좋은 번역확률인 것을 증명한다.
Abstract
Word mismatch is the most significant problem that causes low performance in question classification, whose questions consist of only two or three words that expressed in many different ways. So, it is necessary to apply word association in question classification. In this paper, we propose question classification method using translation-based language model, which use word translation probabilities for question-question pair that is learned in the same category. In the experiment, we prove that translation probabilities of question-question pairs in the same category is more effective than question-answer pairs in total collection.
참고문헌 (13)
- "KDDCUP"[URL]
- Yangdong Liu, "Predicting Information Seeker Satisfaction in Community Question Answering", Proceeding of the 31st Annual International ACM SIGIR Conference, pp.483~490 (2008)
- A. Berger, "Information retrieval as statistical translation", Proceedings of the 22nd annual international ACM SIGIR conference, pp.222~229 (1999)
- Jiwoon Jeon, "Finding Similar Questions in Large Question and Answer Archives", Proceedings of the 14th ACM SIGIR Conference, pp.84~90 (2005)
- Xiaobing Xue, "Retrieval Models for Question and Answer Archives", Proceedings of the 31st annual international ACM SIGIR conference, pp.475~482 (2008)
- Huanhuan Cao, "Context-Aware Query Classification", Proceedings of the 32nd annual international ACM SIGIR conference, pp.3~10 (2009)
- Dou Shen, "Building Bridges for Web Query Classification", Proceedings of the 29th annual international ACM SIGIR conference, pp.131~138 (2006)
- "ODP"[URL]
- Yu Jingbo, "Automatic Web Query Classification Using Large Unlabeled Web Pages", Proceedings of the 2008 The Ninth International Conference, pp.211~215 (2008)
- Dell Zhang, "Question Classification using Support Vector Machines", Proceedings of the 26th annual international ACM SIGIR conference, pp.26~32 (2003)
- "GIZA tool"[URL]
- ChengXiang Zhai, "A study of smoothing methods for language models applied to information retrieval", ACM Trans.Inf.Syst, 22(2), pp.179~214 (2004)
- Peter F. Brown, "The Mathematics of Statistical Machine Translation: Parameter Estimation", Computational Linguistics, 19(2), pp.263~311 (1993)