본문 바로가기
KERD
논문KCI 등재

JCR의 영향력지수 순위를 활용한 문헌정보학 분야 학술지 평가의 한계

Limitations in Using JCR Impact Factor Rankings for LIS Journals

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

주제분류문헌정보학

초록

최근 문헌정보학 연구자의 연구업적 평가에 JCR의 도서관학․정보학 카테고리 분류가 영향을 주고 있어 주목을 끈다. 도서관학․정보학 핵심 학술지에 출판하면 영향력지수 순위에서 밀려 좋은 평가를 받기 어렵고, 도서관학․정보학 카테고리 내에서 영향력지수 상위권인 MIS 학술지에 출판하면 우수하다는 평가를 받는다는 것이다. 이에 이 연구는 JCR의 도서관학․정보학 카테고리에 속한 학술지의 세부 주제영역을 규명한 선행연구를 토대로, 학술지 저자분석을 통해 문헌정보학과 MIS의 교차 상황을 분석하였다. 분석결과 문헌정보학과 MIS 간의 교차점은 크지 않았고, 연결강도도 강하지 않았다. 또한 서울소재 문헌정보학과 개설 대학의 약 55%가 JCR의 주제 카테고리별 학술지의 영향력지수 순위를 구성원의 연구업적 평가에 직접 반영하고 있었다. 이로써 JCR의 주제 카테고리 분류가 연구자의 연구업적평가에 부정적인 영향을 줄 수 있고, 학술 출판을 왜곡시킬 가능성이 있음을 알게 되었다. 이와 같은 연구업적평가 기준의 문제점은 시급히 보완되고 개선되어야 할 것이며, 이 연구결과는 이러한 정책 개선의 기초자료로 활용될 수 있을 것으로 기대된다.

Abstract

JCR’s categorization significantly impacts the evaluation of research achievements in the field, particularly in information science and library science (IS & LS). Publishing in prestigious IS & LS journals often leads to lower evaluations due to their lower impact factor rankings. In contrast, publishing in higher-ranked Management Information Systems (MIS) journals classified under the IS & LS category is evaluated more favorably. Accordingly, this study analyzed the intersection of Library and Information Science (LIS) and MIS through an analysis of journal authors. This analysis was based on previous research that identified detailed subject areas of academic journals categorized under the IS & LS category in the JCR. As a result of the analysis, the intersection between the subfields of LIS and MIS was not substantial, and the strength of the connection was weak. Additionally, approximately 55% of universities in Seoul with LIS departments use JCR’s journal rankings by subject category to assess research achievements. The findings suggest that JCR’s subject category classification may negatively influence researchers’ evaluations and potentially distort the academic publishing landscape. In the future, the issues with research achievement evaluation standards will need to be supplemented and improved. The results of this study are expected to serve as valuable fundamental data for policy improvement.

참고문헌 (27)

  1. 노영희, "학술 활동 건전성 제고를 위한 연구업적평가 개선에관한 연구", 한국비블리아학회지, 33(4), pp.93~114 (2022)[DOI]
  2. "서울대학교 교원 인사 규정" (2020), 서울대학교[URL]
  3. 유소영, "연구성과평가 지침 리뷰 및 국내 적용 제안을 위한 고찰", 정보관리학회지, 32(4), pp.249~272 (2015)[DOI]
  4. 이혜경, "국내대학의 학술논문 연구업적평가기준 비교 분석", 한국도서관․정보학회지, 48(2), pp.295~322 (2017)[DOI]
  5. Abrizah, A., "LIS journals categorization in the Journal Citation Report : a stated preference study", Scientometrics, 102, pp.1083~1099 (2015)[DOI]
  6. Åström, F., "Changes in the LIS research front : Time-sliced cocitation analyses of LIS journal articles, 1990-2004", Journal of the American Society for Information Science and Technology, 58(7), pp.947~957 (2007)[DOI]
  7. Frey, B. S., "Do rankings reflect research quality?", Journal of Applied Economics, 13(1), pp.1~38 (2010)[DOI]
  8. Garfield, E., "The history and meaning of the journal impact factor", Journal of the American Medical Association, 295(1), pp.90~93 (2006)[DOI]
  9. Huang, M. H., "One category, two communities: subfield differences in “Information Science and Library Science”", Journal Citation Reports. Scientometrics, 119, pp.1059~1079 (2019)[DOI]
  10. Järvelin, K., "LIS research across 50 years : content analysis of journal articles", Journal of Documentation, 78(7), pp.65~88 (2022)[DOI]
  11. Khurshid, Z., "Measuring the quality of contributions of Saudi authors to LIS journals using journal impact factor(JIF), SCImago journal rank(SJR), and google scholar metrics(GSM)", The Serials Librarian, 67(1), pp.81~98 (2014)[DOI]
  12. Mason, S., "When a journal is both at the ‘top’ and the ‘bottom’ : the illogicality of conflating citation-based metrics with quality", Scientometrics, 127, pp.3683~3694 (2022)[DOI]
  13. Miró, Ò., "Relationship between category size and journals’ impact factor : implications for emergency medicine journals and researchers", European Journal of Emergency Medicine, 22(5), pp.355~362 (2015)[DOI]
  14. Ni, C., "Journal clustering through interlocking editorship information", Proceedings of the American Society for Information Science and Technology, 47(1), pp.1~10 (2010)[DOI]
  15. Ni, C., "Visualizing and comparing four facets of scholarly communication : Producers, artifacts, concepts, and gatekeepers", Scientometrics, 94, pp.1161~1173 (2013)[DOI]
  16. Ni, C., "Venue-author-coupling : A measure for identifying disciplines through author communities", Journal of the American Society for Information Science and Technology, 64(2), pp.265~279 (2013)[DOI]
  17. Nisonger, T. E., "The perception of library and information science journals by LIS education deans and ARL library directors : A replication of the Kohl-Davis study", College & Research Libraries, 66(4), pp.341~377 (2005)[DOI]
  18. Safón, V., "What are you reading? From core journals to trendy journals in the Library and Information Science(LIS)field", Scientometrics, 128(5), pp.2777~2801 (2023)[DOI]
  19. "All science journal classification" (2024)[URL]
  20. Seglen, Per O., "Why the impact factor of journals should not be used for evaluating research", British Medical Journal, 314, pp.498~502 (1997)[DOI]
  21. Sugimoto, C. R., "Using field cocitation analysis to assess reciprocal and shared impact of LIS", MIS fields, 2008, pp.59(9), 1441~1453
  22. "Whitepaper using bibliometrics: A guide to evaluating research performance with citation data" (2008)[URL]
  23. Tseng, Y. H., "Journal clustering of library and information science for subfield delineation using the bibliometric analysis toolkit : CATAR", Scientometrics, 95, pp.503~528 (2013)[DOI]
  24. "Text mining and visualization using VOSviewer" (2011)[URL]
  25. Vȋiu, G. A., "The lack of meaningful boundary differences between journal impact factor quartiles undermines their independent use in research evaluation", Scientometrics, 126, pp.1495~1525 (2021)[DOI]
  26. Xie, Y., "Information Science and Library Science(IS-LS)journal subject categorisation and comparison based on editorship information", Journal of Informetrics, 14(4), pp.1~15 (2020)[DOI]
  27. Zhao, Y., "Assessing the popularity of the top-tier journals in the LIS field on Twitter", Proceedings of the Association for Information Science and Technology, 52(1), pp.1~4 (2015)[DOI]

관련 논문AI추천

이 간행물의 다른 논문 (10건)