An Experimental Study on the Effect of Domain Expertise on the Consistency of Relevance Judgements

키워드

참고문헌 (40)

1. Bailey, P., "Relevance assessment:are judges exchangeable and does it matter", Proceedings of the 31st annual International ACM Sigir Conference on Research and Development in Information Retrieval, pp.667~674 (2008)
2. Stefanie Beck, "Analyses of inter-rater reliability between professionals, medical students and trained school children as assessors of basic life support skills", BMC Medical Education, 16(1), pp.263~ (2016), Springer Science and Business Media LLC[DOI]
3. Tim J Cole, "Statistics Notes: What is a percentage difference?", BMJ: British Medical Journal (Online), pp.358~ (2017), BMJ
4. Matthew J. C. Crump, "Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral Research", PLoS ONE, 8(3), pp.e57410~ (2013), Public Library of Science (PLoS)[DOI]
5. Peng Dong, "Relevance similarity: an alternative means to monitor information retrieval systems", Biomedical Digital Libraries, 2(1), pp.6~6 (2005), Springer Science and Business Media LLC[DOI]
6. D.J. Foskett, "A note on the concept of “relevance”", Information Storage and Retrieval, 8(2), pp.77~78 (1972), Elsevier BV[DOI]
7. Stephen P. Harter, "Psychological Relevance and Information Science", Journal of the American Society for Information Science, 43(9), pp.602~615 (1992), Wiley[DOI]
8. Birger Hjørland, "Toward a new horizon in information science: Domain-analysis", Journal of the American Society for Information Science, 46(6), pp.400~425 (1995), Wiley[DOI]
9. Birger Hjørland, "Epistemology and the socio-cognitive perspective in information science", Journal of the American Society for Information Science and Technology, 53(4), pp.257~270 (2002), Wiley[DOI]
10. Hjørland, B., "The foundation of the concept of relevance", Journal of the American Society for Information Science and Technology, 61(2), pp.217~237 (2010)[DOI]
11. Mu-hsuan Huang, "The influence of document presentation order and number of documents judged on users' judgments of relevance", Journal of the American Society for Information Science and Technology, 55(11), pp.970~979 (2004), Wiley[DOI]
12. Xiaoli Huang, "Relevance: An improved framework for explicating the notion", Journal of the American Society for Information Science and Technology, 64(1), pp.18~35 (2013), Wiley[DOI]
13. Peter Ingwersen, "Information retrieval in context: IRiX", ACM SIGIR Forum, 39(2), pp.31~39 (2005), Association for Computing Machinery (ACM)[DOI]
14. Joseph W. Janes, "Other people's judgments: A comparison of users' and others' judgments of document relevance, topicality, and utility", Journal of the American Society for Information Science, 45(3), pp.160~171 (1994), Wiley[DOI]
15. Jiang, J., "Ephemeral Relevance and User Activities in a Search Session", Doctoral, pp.2017
16. Koo, T. K., "A guideline of selecting and reporting intraclass correlation coefficients for reliability research", Journal of Chiropractic Medicine, 15(2), pp.155~163 (2016)[DOI]
17. Kwon, H., "On the social epistemological nature of questions: A comparison of knowledge domains'question formulations on the topic of “memory”", Doctoral, pp.2016
18. Jingjing Liu, "The role of domain knowledge in document selection from search results", Journal of the Association for Information Science and Technology, 70(11), pp.1236~1247 (2019), Wiley[DOI]
19. "Relevance"[URL]
20. Stefano Mizzaro, "Relevance: The whole history", Journal of the American Society for Information Science, 48(9), pp.810~832 (1997), Wiley[DOI]
21. Stefano Mizzaro, "How many relevances in information retrieval?", Interacting with Computers, 10(3), pp.303~320 (1998), Oxford University Press (OUP)[DOI]
22. Winifred C. Nweke, "Reliability Analysis of Complementary Assessment Tools for Measuring Teacher Candidate Dispositions", Georgia Educational Researcher, 16(2) (2019), Georgia Southern University[DOI]
23. David Quarfoot, "How Robust Are Multirater Interrater Reliability Indices to Changes in Frequency Distribution?", The American Statistician, 70(4), pp.373~384 (2016), Informa UK Limited[DOI]
24. A Field Experimental Approach to the Study of Relevance Assessments in Relation to Document Searching. Final Report to the National Science Foundation. Volume II, Appendices, "Rees, A.", Clearinghouse for Federal Scientific and Technical Information, ~ (1967)
25. Professor Peter Willett, "Relevance behaviour in TREC", Journal of Documentation, 70(6), pp.1098~1117 (2014), Emerald[DOI]
26. Tefko Saracevic, "RELEVANCE: A review of and a framework for the thinking on the notion in information science", Journal of the American Society for Information Science, 26(6), pp.321~343 (1975), Wiley[DOI]
27. Saracevic, T., "The stratified model of information retrieval interaction: Extension and applications", Proceedings of the American Society for Information Science, 34, pp.313~327 (1997)
28. Tefko Saracevic, "Relevance: A review of the literature and a framework for thinking on the notion in information science. Part II: nature and manifestations of relevance", Journal of the American Society for Information Science and Technology, 58(13), pp.1915~1933 (2007), Wiley[DOI]
29. Saracevic, T., "The Notion of Relevance in Information Science: Everybody knows what relevance is. But, what is it really?" (2017), Morgan and Claypool Publishers
30. Spink, A., "Regions and levels : measuring and mapping users' relevance judgments", Journal of the American Society for Information Science and Technology, 52(2), pp.161~173 (2001)[DOI]
31. Sanna Talja, "Reasons for the use and non-use of electronic journals and databases: A domain analytic study in four scholarly disciplines", Journal of Documentation, 59(6), pp.673~691 (2003), Emerald[DOI]
32. Lynda Tamine, "On the impact of domain expertise on query formulation, relevance assessment and retrieval performance in clinical settings", Information Processing & Management, 53(2), pp.332~350 (2017), Elsevier BV[DOI]
33. Rong Tang, "Towards the identification of the optimal number of relevance categories", Journal of the American Society for Information Science, 50(3), pp.254~264 (1999), Wiley[DOI]
34. Vakkari, P., "The influence of relevance levels on the effectiveness of interactive information retrieval", Journal of the American Society for Information Science and Technology, 55(11), pp.963~969 (2004)[DOI]
35. Van der Veer Martens, B., "Opening the black box of “relevance work”: A domain analysis", Journal of the American Society for Information Science and Technology, 63(5), pp.936~947 (2012)[DOI]
36. Van Rijsbergen, C. J., "A new theoretical framework for information retrieval", ACM SIGIR Forum, 21(1-2), pp.23~29 (1986)[DOI]
37. Voorhees, E. M., "TREC: Experiment and evaluation in information retrieval" (2005), MIT Press
38. White, R., "Characterizing the influence of domain expertise on web search behavior", Proceedings of the Second ACM International Conference on Web Search and Data Mining, pp.132~141 (2009)
39. Maayan Zhitomirsky-Geffet, "Analysis of change in users' assessment of search results over time", Journal of the Association for Information Science and Technology, 68(5), pp.1137~1148 (2017), Wiley[DOI]
40. Maayan Zhitomirsky-Geffet, "Categorical relevance judgment", Journal of the Association for Information Science and Technology, 69(9), pp.1084~1094 (2018), Wiley[DOI]

관련 논문AI추천