국내 연구자의 국제 학술지 동료 심사 활동에 관한 연구: Publons를 중심으로
A Study on the Peer Review Activity of Domestic Researchers in International Journals: Focused on Publons
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
과학지식 생산 유통의 투명성, 효율성, 신속성을 제고하기 위하여 새로운 학술 출판 모델이 시도되면서, 동료 심사 이력의 검증과 개방을 위한 피어 리뷰 플렛폼도 활성화되고 있다. Publons는 3백만명 이상의 전 세계 연구자들의 동료 심사 이력을 추적해 검증하고 공개할 뿐 아니라 업적으로 인정하기 위한 글로벌 플렛폼이다. 본 연구는 Publons를 활용해 국제 학술지 심사 위원으로 활동하는 국내 대학 소속 연구자 579명을 선별해 동료 심사 활동을 분석하였다. 분석 결과 첫 번째, 국제 학술지에서 활발한 심사 활동을 하는 국내 연구자는 공학, 의약학 분야에 많으며, 대부분의 분야에서 높은 국제 학술지 출판 실적을 보유한 조교수급 이상의 교수들인 것으로 나타났다. 두 번째, 모든 학문 분야에서 극단적으로 높은 심사 논문수를 보이는 소수의 심사자가 존재하였으며, 심사자의 신분, 나이, 국적에 따라서 심사 논문수와 심사 보고서 길이에 유의미한 차이는 존재하지 않았다. 마지막으로 심사자의 심사 논문수와 SCI 급 출판 논문수 사이에는 약한 상관성(r = 0.311)이 존재했지만, 많은 연구실적을 보유한 연구자가 그만큼 많은 국제 학술지 심사 활동을 한다고 말하기 어려운 것으로 분석되었다.
Abstract
As a new academic publication model is attempted to improve the transparency, efficiency, and speed of scientific knowledge production and distribution, the open peer review platform for verification and openness of peer review history is also activated. Publons is a global platform for tracking, validating, disclosing, and recognizing the peer-reviewed histories of more than 3 million researchers worldwide. This study analyzed the review activities of 579 researchers from domestic universities who are actively reviewing international journals through Publons. As a result of the analysis, first, researchers from domestic universities who actively review international academic journals were found to be in the fields of medicine and electrical and electronics, and in most fields, assistant professors or higher with high WOS indexed research papers are participating. Second, there was a long-tail phenomenon in which a small number of reviewers with extremely high number of review papers existed in all academic fields, and there was no significant difference in the number of review papers and review report length depending on the nationality, academic status, and age of the reviewers. Lastly, although there was a weak correlation between the amount of papers reviewed by reviewers and the number of published papers, it was found that researchers with an extremely large number of reviews do not necessarily produce as many research papers.
참고문헌 (30)
- Black, N., "What makes a good reviewer and a good review for a general medical journal?", Journal of the American Medical Association, 280, pp.231~233 (1998)
- Bornmann, L., "Selecting manuscripts for a high-impact journal through peer review : a citation analysis of communications that were accepted by angewandte chemie international edition, or rejected but published elsewhere", Journal of the American Society for Information Science and Technology, 59(11), pp.1841~1852 (2008)
- "It’s not the size that matters" (2018)[URL]
- "Publons Reviewer Connect - ScholarOne" (2020)[URL]
- "Guidance on the Implementation of Plan S" (2019)[URL]
- "Computer Generated Papers as a New Challenge to Peer Review. Master of Science in Technical Communication, Montana Tech" (2019)[URL]
- Evans, A. T., "The characteristics of peer reviewers who produce good-quality reviews", Journal of General Internal Medicine, 8(8), pp.422~428 (1993)
- Falkenberg, L. J., "Reviewing reviews : an evaluation of peer reviews of journal article submissions", Limnology and Oceanography Bulletin, 27(1), pp.1~5 (2018)[DOI]
- Gasparyan, A. Y., "Best peer reviewers and the quality of peer review in biomedical journals", Croatian Medical Journal, 53(4), pp.386~389 (2012)
- Ketevan Glonti, "Journal editors’ perspectives on the roles and tasks of peer reviewers in biomedical journals: a qualitative study", BMJ Open, 9(11), pp.e033421~ (2019), BMJ[DOI]
- Scott Goldstein, "Publons Peer Evaluation Metrics are not Reliable Measures of Quality or Impact", Evidence Based Library and Information Practice, 14(3), pp.153~155 (2019), University of Alberta Libraries[DOI]
- Kliewer, M. A., "Reviewing the reviewers : comparison of review quality and reviewer characteristics at the American journal of roentgenology", American Journal of Roentgenology, 184(6), pp.1731~1735 (2005)
- Ortega, J. L., "Are peer-review activities related to reviewer bibliometric performance? a scientometric analysis of publons", Scientometrics, 112, pp.947~962 (2017)[DOI]
- Ortega, J. L., "Exploratory analysis of publons metrics and their relationship with bibliometric and altmetric impact", Aslib Journal of Information Management, 71(1), pp.124~136 (2019)[DOI]
- Michael S. Patterson, "The relationship between reviewers’ quality-scores and number of citations for papers published in the journal Physics in Medicine and Biology from 2003–2005", Scientometrics, 80(2), pp.343~349 (2009), Springer Science and Business Media LLC[DOI]
- Marco Pautasso, "Peer review delay and selectivity in ecology journals", Scientometrics, 84(2), pp.307~315 (2009), Springer Science and Business Media LLC[DOI]
- "What are Scored Publications?" (2021)[URL]
- Tony Ross-Hellauer, "Survey on open peer review: Attitudes and experience amongst editors, authors and reviewers", PLOS ONE, 12(12), pp.e0189311~ (2017), Public Library of Science (PLoS)[DOI]
- Schriger, D. L., "Are reviewers’ scores influenced by citations to their own work? an analysis of submitted manuscripts and peer reviewer reports", Annuals of Emergency Medicine, 67(3), pp.401~406 (2016)[DOI]
- Swiontkowski, M., "Publons : the next step in reviewer recognition", Journal of Bone and Joint Surgery, 101(13), pp.1137~ (2019)[DOI]
- Teixeira da Silva, J. A., "Are negative reviews, predatory reviewers or failed peer review rewarded at Publons?", International Orthopaedics(SICOT), 44, pp.2193~2194 (2020)[DOI]
- Thomas, P. R., "Institutional research rankings via bibliometric analysis and direct peer review : a comparative case study with policy implications", Scientometrics, 41(3), pp.335~355 (1998)
- Ule, J., "Open access, open data and peer review", Genome Biol, 21, pp.86~ (2020)[DOI]
- Wiechert, K., "Recognizing our experts : global spine journal partners with publons to establish reviewers' platform", Global Spine Journal, 8(3), pp.217~ (2018)[DOI]
- Wilkinson, J., "Publons : releasing the untapped power of peer review for universities", Insights, 31, pp.20~ (2018)[DOI]
- Wolfram, D., "Open peer review : promoting transparency in open science", Scientometrics, 125, pp.1033~1051 (2020)[DOI]
- Yankauer, A., "Who are the peer reviewers and how much do they review?", Journal of the American Medical Association, 263(10), pp.1338~1340 (1990)
- Zong, Q., "The relationship of polarity of post-publication peer review to citation count : evidence from publons", Online Information Review, 44(3), pp.583~602 (2020)[DOI]
- "査読をめぐる新たな問題. カレントアウェアネス, 321" (2014)[URL]
- 佐藤, 翔, "査読の抱える問題とその対応策", 情報の科学と技術, 66(3), pp.115~121 (2016)