중첩 클러스터를 이용한 피드백 문서의 재샘플링 기법
Resampling Feedback Documents Using Overlapping Clusters
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
대부분의 잠정적 적합피드백기법들은 질의에 대해 검색된 상위검색문서들이 적합하다고 가정하고, 그 문서들을 질의 확장을 위한 피드백 문서로 이용하고 있다. 그러나 초기검색결과에는 상당한 양의 부적합 문서를 포함하고 있는 것이 현실이다. 이 논문에서는 보다 좋은 피드백 문서를 선택하기 위해서 중첩클러스터를 이용한 피드백문서의 재샘플링 기법을 제안한다. 주요 아이디어는 질의 중심적인 초기검색문서집합에 대해서 중첩이 허용된 문서클러스터를 이용하여 문서들 사이의 관계를 반영하여 질의에 핵심역할을 하는 지배적 문서를 찾고, 이 문서들을 반복적으로 피드백 하여 질의가 내포하는 핵심 주제를 강조하는 것이다. 대규모 실험집합인 TREC GOV2와 WT10g에 대한 실험비교에서, 최근 잠정적 적합피드백 기법들 중에서 가장 좋은 성능을 보이고 있는 적합모델보다 재샘플링기법이 우수한 성능향상을 보였다. 제안기법에 대한 검증을 위해서 피드백문서에 포함된 적합문서의 정도를 나타내는 적합밀도를 측정하였다. 재샘플링 기법이 TREC 실험집합에 대해서 적합모델에 비해 높은 적합밀도를 보였고, 이 결과 적합피드백에서 검색성능을 향상시키게 되었다. 이는 제안 기법이 잠정적 적합피드백에서 유효한 방법임을 알 수 있다.
Abstract
Typical pseudo-relevance feedback methods assume the top-retrieved documents are relevant and use these pseudo-relevant documents to expand terms. The initial retrieval set can, however, contain a great deal of noise. In this paper, we present a cluster-based resampling method to select better pseudo-relevant documents based on the relevance model. The main idea is to use document clusters to find dominant documents for the initial retrieval set, and to repeatedly feed the documents to emphasize the core topics of a query. Experimental results on large-scale web TREC collections show significant improvements over the relevance model. For justification of the resampling approach, we examine relevance density of feedback documents. The resampling approach shows higher relevance density than the baseline relevance model on all collections, resulting in better retrieval accuracy in pseudo-relevance feedback. This result indicates that the proposed method is effective for pseudo-relevance feedback.
참고문헌 (35)
- Attar, R, "Local Feedback in Full-Text Retrieval Systems", Journal of the ACM, 24(3), pp.397~417 (1977)
- "Reliable information access final workshop report"[URL]
- Buckley, C, "Using clustering and superconcepts within SMART: TREC 6", In Proc. 6th Text REtrieval Conference (TREC-6) (1998)
- "Proposal for relevance feedback 2008 track"[URL]
- Collins-Thompson, K, "Estimation and use of uncertainty in pseudo-relevance feedback", In Proc. 30th ACM SIGIR conference on Research and Development in Information Retrieval, pp.303~310 (2007)
- Diaz,F, "Regularizing ad hoc retrieval scores", In Proc. 14th ACM international conference on Information and knowledge management (CIKM), pp.672~679 (2005)
- Diaz, F, "Improving the Estimation of Relevance Models Using Large External Corpora", In Proc. 29th ACM SIGIR conference on Research and Development in Information Retrieval, pp.154~161 (2006)
- Efron,B, "Bootstrap methods: Another look at the jackknife", The Annals of Statistics, 7, pp.1~26 (1979)
- Discriminatory analysis: nonparametric discrimination: consistency properties, "Fix, E", SAF School of Aviation Medicine, Randolph Field, ~, pp.Project 21-49-004 (1951)
- Freund,Y, "Boosting a weak learning algorithm by majority", In Proc. 3rd Annual Workshop on Computational Learning Theory (1990)
- Jardine. N, "The use of hierarchic clustering in information retrieval", Information Storage and Retrieval, 7, pp.217~240 (1971)
- O. Kurland, "Corpus structure, language models, and ad hoc information retrieval", Proc. 27th ACM SIGIR conference on Research and Development in Information Retrieval, pp.194~201 (2004)
- Kurland, O, "Better than the real thing? Iterative pseudo-query processing using cluster-based language models", In Proc. 28th ACM SIGIR conference on Research and Development in Information Retrieval, pp.19~26 (2005)
- Kurland, O, "Respect my authority! HITS without hyperlinks, utilizing cluster-based language models", In Proc. 29th ACM SIGIR conference on Research and Development in Information Retrieval, pp.83~90 (2006)
- Lavrenko, V, "Relevance-based language models", In Proc. 24th ACM SIGIR conference on Research and Development in Information Retrieval, pp.120~127 (2001)
- Lee, K.S, "Re-ranking model based on document clusters", Information Processing and Management, 37, pp.1~14 (2001)
- Lee, K.S, "Implicit ambiguity resolution based on cluster analysis in cross- language information retrieval", Information Processing and Management, 40, pp.145~159 (2004)
- Liu, X, "Cluster-based retrieval using language models", In Proc. 27th ACM SIGIR conference on Research and Development in Information Retrieval, pp.186~193 (2004)
- Lynam, T, "A multi-system analysis of document and term selection for blind feedback", In Proc. 13th ACM international conference on Information and knowledge management (CIKM), pp.261~269 (2004)
- Metzler, D, "Latent Concept Expansion Using Markov Random Fields", In Proc. 30th ACM SIGIR conference on Research and Development in Information Retrieval, pp.311~318 (2007)
- Ponte, J.M, "A language modeling approach to information retrieval", In Proc. 21st ACM SIGIR conference on Research and Development in Information Retrieval, pp.275~281 (1998)
- Robertson, S.E, "Okapi at TREC-4", In Proc. 4th Text REtrieval Conference (TREC) (1996)
- Rocchio,J.J, "Relevance feedback in information retrieval. The SMART retrieval system", pp.316~321 (1971), Prentice-Hall
- Rosenfeld, R, "Two decades of statistical language modeling: where do we go from here?", In Proc. of the IEEE, 88(8), pp.1270~1278 (2000)
- Sakai, T, "Flexible pseudo-relevance feedback via selective sampling", ACM Transactions on Asian Language Information Processing (TALIP), 4(2), pp.111~135 (2005)
- Salton, G, "Improving retrieval performance by relevance feedback", Journal of the American Society for Information Science, 41(4), pp.288~297 (1990)
- Schapire,R, "Strength of weak learnability", Journal of Machine Learning, 5, pp.197~227 (1990)
- Strohman, T, "Indri: A language model-based search engine for complex queries", In Proc. International Conference on Intelligence Analysis (2005)
- Tao, T, "Regularized estimation of mixture models for robust pseudo-relevance feedback", In Proc. 29th ACM SIGIR conference on Research and Development in Information Retrieval, pp.162~169 (2006)
- "TREC. Call for participation"[URL]
- Xu, J, "Query expansion using local and global document analysis", In Proc. 19th ACM SIGIR conference on Research and Development in Information Retrieval, pp.4~11 (1996)
- Yang, L, "Document re-ranking using cluster validation and label propagation", In Proc. 15th ACM international conference on Information and knowledge management CIKM), pp.690~697 (2006)
- ung, D.L, "Task-specific query expansion", In Proc. 12th Text REtrieval Conference (TREC), pp.810~819 (2004)
- Zhang, B, "Improving web search results using affinity graph", In Proc. 28th ACM SIGIR conference on Research and Development in Information Retrieva, pp.504~511 (2005)
- Zhai, C, "study of smoothing methods for language models applied to information retrieval", ACM Transactions on Information Systems, 22(2), pp.179~214 (2004)