본문 바로가기
KERD
논문

학술논문 알트메트릭스의 피인용 영향과 오픈액세스의 조절효과에 관한 연구

A Study on the Effect of Altmetrics about Academic Papers on Citations and Moderating Effect of Open Access

조재인
한국문헌정보학회|2022.05|한국문헌정보학회지 (Journal of the Korean Society for Library and Information Science)|제56권 제2호|pp. 35-55|DOI http://doi.org/10.4275/KSLIS.2022.56.2.035

0

조회

0

다운로드

3

인용

0

참고문헌

키워드

학술논문Citation알트메트릭스Altmetrics오픈액세스Open Access피인용도MendeleyArticles
주제분류문헌정보학

초록

연구의 다면적 영향력 평가 도구로 알트메트릭스가 등장하면서 피인용 기반의 연구 성과 평가 체계를 대체 또는 보완할 수 있을지 주목되고 있다. 본 연구는 최근 10년간 Scopus에 색인된 고피인용 논문(Sample A)과 연도를 제한하지 않은 고피인용 논문(Sample B)을 각 1,600건씩 샘플링해 알트메트릭스와 피인용이 어떠한 영향 관계에 있는지 비교 분석해 보았다. 또한 논문의 OA(Open Access) 여부가 피인용에 미치는 영향에 있어 조절효과(Moderating effect)를 수행하는지 분석하고 집단에 따른 차이를 확인하였다. 분석 결과, 두 집단 모두에서 Mendeley 북마크 독자수만이 피인용에 정(+)적 영향을 미치는 것으로 검증되었으며, 이러한 영향관계에서 OA 여부는 유의한 조절 효과를 하는 것으로 확인되었다. 그러나 최근 논문 집단인 Sample A에서는 강화효과가, Sample B에서는 약화효과가 나타나는 차이를 보였다. 한편 언론보도와 같은 사회적 언급은 OA 조건에 무관하게 대부분 피인용에 유의미한 정(+)의 영향력을 발휘하지 못하지만, 학계 밖 대중적 독자들을 대상으로 한 사회적 영향력을 이해하는데 활용될 수 있다.

Abstract

As altmetrics has received a lot of attention as an muti-dimensional impact assessment tool, it is necessary to verify whether it can supplement the citation-based research performance evaluation system. This study analyzed and compared the effects of each altmetrics sources on citation by sampling 1,600 high-cited papers published in the last 10 years (Sample A) and non-year-limited papers (Sample B) indexed in Scopus. In addition, it was analyzed whether the OA of the paper had a moderating effect on the numbers of cited-by, and the difference according to the samples was verified. As a result of the analysis, only the number of Mendeley bookmark readers was analyzed to have a positive (+) effect on the numbers of cited-by, and OA status had a significant moderating effect in both groups. However, in sample A, OA showed a reinforcing effect on cited-by, whereas Sample B showed a weakening effect, showing a difference. On the other hand, social mention such as media reports do not have a significant effect on the cited-by regardless of OA conditions, but they can be used to understand the social impact of non-academic mass readers.

참고문헌 (54)

  1. 박진호, "연구데이터 서비스의 유용성 평가 모형 연구", 정보관리학회지, 36(4), pp.129~159 (2019), 한국정보관리학회[DOI]
  2. 이현창, "Development Tendency of Altmetrics Research: Using Social Network Analysis and Co-word Analysis", 한국정보통신학회논문지, 21(11), pp.2089~2094 (2017), 한국정보통신학회[DOI]
  3. 조재인, "Altmetrics를 통한 연구의 영향력 평가에 관한 연구", 한국도서관·정보학회지, 46(1), pp.65~81 (2015), 한국도서관·정보학회[DOI]
  4. 최호철, "정부지원 기초연구 성과의 사회적 영향력 분석: altmetrics 분석툴 적용가능성 탐색", 사회과학연구, 45(3), pp.321~344 (2019), 사회과학연구원[DOI]
  5. 허원무, "매개효과 분석 방법의 최근 트랜드 : 부트스트래핑을 이용한 단순, 다중, 이중매개효과 분석 방법", 한국비즈니스리뷰, 6(3), pp.43~59 (2013)
  6. 홍세희, "회귀분석과 구조방정식 모형에서의 상호작용효과 검증 : 이론과 절차", 인간발달연구, 21(4), pp.1~24 (2014), 한국인간발달학회[DOI]
  7. "Attention! A study of open access vs non-open access articles" (2014)[URL]
  8. Alhoori, H., "On the Relationship between Open Access and Altmetrics", iConference 2015 Proceedings (2015)
  9. Altmetric, "Altmetric database in CSV format", ~ (2021)
  10. "Research Impact of Paywalled Versus Open Access Papers" (2016)[URL]
  11. Bornmann, L., "Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000 Prime data", PLoS ONE, 13(5), pp.e0197133~ (2018)[DOI]
  12. Bornmann, L., "Validity of altmetrics data for measuring societal impact : a study using data from Altmetric and F1000Prime", Journal of Informetrics, 8(4), pp.935~950 (2014)
  13. Bornmann, L., "Alternative metrics in scientometrics : a meta-analysis of research into three altmetrics", Scientometrics, 103, pp.1123~1144 (2015)[DOI]
  14. Cho, J., "Altmetrics of highly cited research papers in social science", Serials Review, 47(1), pp.17~27 (2021)
  15. Clements, J., "Open access articles receive more citations in hybrid marine ecology journals", FACETS, 2, pp.1~14 (2017)
  16. Costas, R., "The thematic orientation of publications mentioned on social media Large-scale disciplinary comparison of social media metrics with citations", Aslib Journal of Information Management, 67(3), pp.260~288 (2015)
  17. Costas, R., "Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective", asis&t, 66(10), pp.2003~2019 (2015)[DOI]
  18. "The San Francisco Declaration on Research Assessment" (2012)[URL]
  19. Ebrahimy, S., "Path analysis of the relationship between visibility and citation : the mediating roles of save, discussion, and recommendation metrics", Scientometrics, 109, pp.1497~1510 (2016)
  20. Gorraiz, J., "Usage versus citation behaviours in four subject areas", Scientometrics, 101, pp.1077~1095 (2014)
  21. Hajjem, C., "Ten-year cross-disciplinary comparison of the growth of open access and how it increases research citation impact", IEEE Data Engineering Bulletin, 28(4), pp.39~47 (2005)
  22. Haustein, S., "Characterizing social media metrics of scholarly papers : The effect of document properties and collaboration patterns", PLOS ONE, 10(3) (2015)
  23. Hayes, A. F., "Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach" (2017), Guilford Press
  24. Holmberg, K., "Do articles in open access journals have more frequent altmetric activity than articles in subscription-based journals? An investigation of the research output of Finnish universities", Scientometrics, 122, pp.645~659 (2020)
  25. Kousha, K., "The citation impact of Open Access agricultural research : A comparison between OA and non-OA publications", Online Information Review, 34(5), pp.772~785 (2010)
  26. Lewis, C., "The Open Access Citation Advantage : Does It Exist and What Does It Mean for Libraries?", Information Technology and Libraries, 37(3), pp.50~65 (2018)[DOI]
  27. Li, X., "F1000, Mendeley and traditional bibliometric indicators", Proceedings of the 17th International Conference on Science and Technology Indicators, pp.541~551 (2012)
  28. Liu, X., "How researchers view altmetrics : an investigation of ISSI participants", Aslib Journal of Information Management, 72(3), pp.361~378 (2020)
  29. McGillivray, B., "The relationship between usage and citations in an open access mega-journal, Scientometrics", Springer; Akadémiai Kiadó, 121(2), pp.817~838 (2019)
  30. Mohammadi, E., "Mendeley readership altmetrics for the social sciences and humanities : Research evaluation and knowledge flows", JASIST, 65(8), pp.1627~1638 (2014)
  31. Mohammadi, E., "Who reads research articles? an altmetrics analysis of mendeley user categories", Journal of the American Society for Information Science, 66(9), pp.1832~1846 (2015)
  32. "Output of the NISO Alternative Assessment Metrics Project" (2016)[URL]
  33. Ortega J. L., "Disciplinary differences of the impact of altmetric", FEMS Microbiol Lett, 365(7) (2018)[DOI]
  34. Ouchi, A., "Do altmetrics correlate with citations? A study based on the 1, 000 most-cited articles", Information Discovery and Delivery, 47(4), pp.192~202 (2019)[DOI]
  35. Piwowar, H., "The state of oa : a large-scale analysis of the prevalence and impact of open access articles", PeerJ, 6, pp.e4375~ (2018)
  36. "Altmetrics: a manifesto" (2010)[URL]
  37. "Will Trump White House tear down journal paywalls? Many anxiously await a decision" (2020)[URL]
  38. Singh, V. K., "The journal coverage of web of science, scopus and dimensions: a comparative analysis", Scientometrics, 126, pp.5113~5142 (2021)
  39. "The Open Access Citation Advantage Service (OACA)" (2015)[URL]
  40. "Rumours fly about changes to US government open-access policy" (2019)[URL]
  41. Sutton, S., "Awareness of altmetrics among LIS scholars and faculty", Journal of Education for Library and Information Science, 59(1-2), pp.33~47 (2018)
  42. Tang, M., "Open access increases citations of papers in ecology", Ecosphere, 8(7), pp.e01887~ (2017)[DOI]
  43. Teplitskiy, M., "Amplifying the impact of open access : wikipedia and the diffusion of science", Journal of the Association for Information Science and Technology, 68, pp.2116~2127 (2017)
  44. Thelwall, M., "Are Mendeley reader counts useful impact indicators in all fields?", Scientometrics, 113(1), pp.1721~1731 (2017)[DOI]
  45. Thelwall, M., "Could scientists use Altmetric.com scores to predict longer term citation counts?", Journal of Informetrics, 12(1), pp.237~248 (2018)[DOI]
  46. Thelwall, M., "Mendeley reader counts for us computer science conference papers and journal articles", Quantitative Science Studies, 1(1), pp.347~359 (2020)
  47. Thelwall, M., "Mendeley readership altmetrics for medical articles : an analysis of 45 fields", JASIST, 67(8), pp.1962~1972 (2016)[DOI]
  48. Tint, T. H. H., "Disciplinary differences in altmetrics for social sciences", Online Information Review, 41(2), pp.235~251 (2017)
  49. Wang Z., "Preprints as accelerator of scholarly communication : an empirical analysis in mathematics", Journal of Informetrics, 14(4), pp.101097~ (2020)[DOI]
  50. "Sharing research data and findings relevant to the novel coronavirus (nCoV) outbreak" (2020)[URL]
  51. Winter, J. C. F., "The relationship between tweets, citations, and article views for PLOS ONE articles", Scientometrics, 102, pp.1773~1779 (2015)
  52. Xu, L., "Analysis on open access citation advantage : an empirical study based on Oxford open journals", iConference February, 2011, pp.426~432 (2011)[DOI]
  53. Zahedi, Z., "On the relationships between bibliographic characteristics of scientific documents and citation and Mendeley readership counts : a large-scale analysis of Web of Science publications", Journal of Informetrics, 12(1), pp.191~202 (2018)
  54. Zahedi, Z., "How well developed are altmetrics? a crossdisciplinary analysis of the presence of ‘alternative metrics’ in scientific publications", Scientometrics, 101(2), pp.1491~1513 (2014)

이 간행물의 다른 논문 (11건)

학교도서관 융합독서교육을 위한 교육방법 및 모형개발조수연, 조미아pp. 5-33학술정보자원의 사회적 공유에 관한 연구 - 일반인의 정보요구와 행위를 중심으로 -김초해, 박지홍pp. 57-82공공도서관의 희망도서바로대출제 개선방안에 관한 연구 - 경기도 공공도서관을 중심으로 -이윤정, 정연경pp. 83-107공공도서관의 독서마라톤 대회 운영 현황 비교 연구임성관pp. 109-132경기도 책꾸러미 사업을 통한 양육자의 독서육아 효과 분석을 위한 지표개발 및 효과성 연구윤성은, 황금숙, 이선애, 최인자, 김수경pp. 133-155
원문 보기