정보검색에서의 사용자 중심 적합성 판단 모형
User-centered relevance judgement model for information retrieval
0
조회
0
다운로드
4
인용
0
참고문헌
키워드
초록
본 연구는 정보검색의 핵심 개념인 적합성을 사용자 중심 관점에서 접근한 연구이다. 적합성에 관한 기존 연구들은 적합성 판단에 영향을 주는 다양한 기준들을 정의해 왔다. 본 연구는 적합성 유형별로 사용자가 적합성을 판단하는 기준과 적합성 유형 간의 관계를 정보 검색 과제별로 연구함으로써 사용자 중심 적합성 판단 모형을 알아보았다. 본 연구는 7개의 사용자 적합성 판단 기준－주제성, 신선성, 신뢰성, 이해가능성, 특수성, 구체성, 흥미성－과 3가지의 사용자 적합성 유형－인지 적합성, 상황 적합성, 정서 적합성－을 고려하였다. 이를 대학생 사용자들을 대상으로 검색 과제 수행 후 설문에 답하는 반 제어(semi-controlled) 설문 방법을 이용하여 자료를 수집하였고, 구조방정식 모형으로 분석하였다. 연구 결과 주제성, 신뢰성은 모든 검색 과제에 중요한 적합성 판단 기준이었고, 과제 유형별로 볼 때 사실 검색 과제에서는 주제성, 신뢰성, 신선성, 구체성, 흥미성이, 문제 해결 검색 과제에서는 주제성, 신뢰성, 이해가능성, 특수성이, 의사 결정 검색 과제에서는 주제성, 신뢰성, 신선성, 이해가능성, 구체성, 특수성, 흥미성이 적합성을 판단하는 주요 기준들이라는 것을 확인할 수 있었다. 또한 적합성 유형들 간의 관계도 실증적으로 밝힐 수 있었다. 본 연구는 적합성 판단 기준과 적합성 유형 간의 관계를 정보 검색 과제별로 확인함으로써 보다 구체적인 사용자 중심의 적합성 판단 모형을 확립하였다는 점에서 의의를 가진다.
Abstract
This research takes a user-centered approach to define relevance, the core concept in information retrieval. The literature on relevance has identified numerous factors affecting such a judgment. We examined the model of user relevance judgment that describes the relationship between user relevance criteria and different types of relevance with information search task. We consider 7 criteria of user relevance－topicality, novelty, reliability, understandability, specificity, richness, and interest－and 3 type of user relevance－cognitive relevance, situational relevance, and affective relevance. Data were collected from a semi-controlled survey and analyzed by a structural equation modeling. As a result, topicality and reliability were found to be the essential relevance criteria in all information retrieval tasks. In the fact search task, topicality, reliability, novelty, richness, and interest were found to be significant. In the problem solving search task, topicality, reliability, understandability, and specificity were found to be significant. In the decision making search task, topicality, reliability, novelty, understandability, richness, specificity, and interest were found to be significant. In addition, the relationships between types of user relevance were determined. This research made theoretical and practical contributions to the field of information retrieval by identifying a definite model of user relevance judgment.
참고문헌 (33)
- Barry, C. L, "Users’ criteria for relevance evaluation: A cross-situational comparison", Information Processing & Management, 34, pp.219~236 (1998)
- Borlund,P, "The concept of relevance in IR", Journal of the American Society for Information Science and Technology, 54(10), pp.913~925 (2003)
- Choi, Y., "Users’ relevance criteria in image retrieval in American history", Information Processing & Management, 38, pp.695~726 (2002)
- Cosijn, E., "Dimensions of relevance", Information Processing & Management, 36, pp.533~550 (2000)
- Greisdorf,H, "Relevance thresholds: A multistage predictive model of how users evaluate information", Information Processing & Management, 39, pp.403~423 (2003)
- Harter,S.P, "Psychological relevance and information science", Journal of the American Society for Information Science, 43, pp.602~615 (1992)
- Hidi,S, "Interest and Its Contribution as a Mental Resource for Learning", Review of Educational Research, 60(4), pp.549~571 (1990)
- Hirschman, E.C, "Hedonic consumption: Emerging concepts, methods, and propositions", Journal of Marketing, 46, pp.92~101 (1982)
- Howard,D.L, "Pertinence as reflected in personal constructs", Journal of the American Society for Information Science, 45(3), pp.172~185 (1994)
- Kekäläinen, J, "Evaluating information retrieval systems under the challenges of interaction and multidimensional dynamic relevance. in Emerging Frameworks and Methods", pp.253~270 (2002), Libraries Unlimited
- Kelly, D., "Features of documents relevant to task and fact-oriented questions", Proceedings of the Eleventh International Conference on Information and Knowledge Management, pp.645~647 (2002), ACM
- Koll,M, "Information retrieval", Bulletin of the American Society for Information Science, 26(2) (2000)
- Limberg,L, "Experiencing information seeking and learning: a study of the interaction between two phenomena", Journal, 5(1) (1999)
- Park,T.K, "The nature of relevance in information retrieval: An empirical study", Library Quarterly, 63, pp.318~351 (1993)
- Rieh, S.Y, "Understanding judgment of information quality and cognitive authority in the WWW", Proceedings of the 61st ASIS Annual Meeting, pp.279~289 (1998)
- Saracevic,T, "Relevance: A review of and a framework for the thinking on the notion in information science", Journal of the American Society for Information Science, 26, pp.321~343 (1975)
- Saracevic,T, "Relevance reconsidered ’96. in Second International Conference on Conceptions of Library and Information Science (CoLIS2)", pp.201~218 (1996), Royal School of Librarianship
- Saracevic,T, "Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: Nature and manifestations of relevance", Journal of the American Society for Information Science and Technology, 58, pp.1915~1933 (2007)
- Savolainen, R., "User-defined relevance criteria in web searching", Journal of Documentation, 62(6), pp.685~707 (2006)
- Schamber,L, "Relevance and information behavior. in Annual review of information science and technology (ARIST)", pp.3~48 (1994), Learned Information
- Schamber, L., "User criteria in relevance evaluation: Toward development of a measurement scale", Proceedings of the 59th Annual Meeting of the American Society for Information Science, pp.218~225 (1996)
- Silvia,P.J, "Exploring the psychology of interest" (2006), Oxford University Press
- Spink, A., "Examining different regions of relevance: From highly relevant to not relevant", Proceedings of the American Society for Information Science, pp.3~12 (1998), Learned Information
- Stein, N.L., "A goal-based approach to memory for emotional events: Implications for theories of understanding and socialization. in Emotion: Interdisciplinary perspectives", pp.91~118 (1996), Erlbaum
- Schamber, L., "User criteria in relevance evaluation: Toward development of a measurement scale", Proceedings of the 59th Annual Meeting of the American Society for Information Science, pp.218~225 (1996)
- Taylor,R.S, "Information use environments", Progress in Communication Sciences, 10, pp.217~255 (1991)
- Tombros, A., "How users assess web pages for information seeking", Journal of the American Society for Information Science and Technology, 56(4), pp.327~344 (2005)
- Toms, E. G, "Searching for relevance in the relevance of search", Proceedings of Fourth International Conference on Conceptions of Library and Information Science (CoLIS 2005), pp.59~78 (2005), Springer
- Wang, P, "cognitive model of document use during a research project: Study I. Document selection", Journal of the American Society for Information Science, 49(2), pp.115~133 (1998)
- Wilson,P, "Second-hand knowledge: An inquiry into cognitive authority" (1983), Greenwood Press
- Wurman,R.S, "Information Anxiety" (1989), Doubleday
- Xu, Y, "Relevance judgment - What do information consumers consider beyond topicality?", Journal of the American Society for Information Science and Technology, 57(7), pp.961~973 (2006)
- Xu,Y, "Relevance judgment in epistemic and hedonic information searches", Journal of the American Society for Information Science and Technology, 58(2), pp.179~189 (2007)