Analysis of Academic Evaluation Indicators Based on Citation Quality
2
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting thecitation quality to some extent. However, these frequency-based indicators are usually carried out based onthe assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of theciting objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, wereview various citation quality-based evaluation indicators, and categorize them considering the algorithmsbeing applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.
Abstract
The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting thecitation quality to some extent. However, these frequency-based indicators are usually carried out based onthe assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of theciting objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, wereview various citation quality-based evaluation indicators, and categorize them considering the algorithmsbeing applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.
참고문헌 (25)
- L. Bornmann, "Does evaluative scientometrics lose its main focus on scientific quality by the new orientation towards societal impact", Scientometrics, 110(2), pp.937~943 (2017)[DOI]
- D. Zhao, "Dimensions and uncertainties of author citation rankings: lessons learned from frequency-weighted in-text citation counting", Journal of the Association for Information Science and Technology, 67(3), pp.671~682 (2016)[DOI]
- X. Wan, "Are all literature citations equally important? Automatic citation strength estimation and its applications", Journal of the Association for Information Science and Technology, 65(9), pp.1929~1938 (2014)[DOI]
- Y. Ding, "The distribution of references across texts: some implications for citation analysis", Journal of Informetrics, 7(3), pp.583~592 (2013)[DOI]
- Y. Ding, "Content-based citation analysis: the next generation of citation analysis", Journal of the Association for Information Science and Technology, 65(9), pp.1820~1833 (2014)[DOI]
- D. Walker, "Ranking scientific publications using a model of network traffic", Journal of Statistical Mechanics: Theory and Experiment, 2007(6) (2007)
- K. Jarvelin, "The DCI index: discounted cumulated impact-based research evaluation", Journal of the American Society for Information Science and Technology, 59(9), pp.1433~1440 (2008)[DOI]
- E. Yan, "Weighted citation: an indicator of an article's prestige", Journal of the American Society for Information Science and Technology, 61(8), pp.1635~1643 (2010)
- C. Li, "Research on journal evaluation using the weighted impact factors considering cited quality: taking CSSCI source journals of LIS as an example", Journal of Academic Libraries, 30(1), pp.29~34 (2012)
- M. Zheng, "Impact factor modification based on the journal quality of citations", Acta Editologica, 27(1), pp.19~21 (2015)
- Z. Lin, "Application and discussion of weights of journal quality in the calculation formula of impact factor", Chinese Journal of Scientific and Technical Periodicals, 26(12), pp.1295~1300 (2015)
- D. Fiala, "Do PageRank-based author rankings outperform simple citation counts?", Journal of Informetrics, 9(2), pp.334~348 (2015)[DOI]
- G. Pinski, "Citation influence for journal aggregates of scientific publications: theory, with application to the literature of physics", Information Processing & Management, 12(5), pp.297~312 (1976)[DOI]
- M. Dunaiski, "Evaluating paper and author ranking algorithms using impact and contribution awards", Journal of Informetrics, 10(2), pp.392~407 (2016)[DOI]
- J. D. West, "The Eigenfactor Metrics: a network approach to assessing scholarly journals", College & Research Libraries, 71(3), pp.236~244 (2010)[DOI]
- "SJR-SCImago Journal & Country Rank" (2018)[URL]
- G. Herlach, "Can retrieval of information from citation indexes be simplified? Multiple mention of a reference as a characteristic of the link between cited and citing article", Journal of the American Society for Information Science, 29(6), pp.308~310 (1978)[DOI]
- K. W. McCain, "Citation context analysis and aging patterns of journal articles in moleculargenetics", Scientometrics, 17(1-2), pp.127~163 (1989)[DOI]
- B. Finney, "The reference characteristics of scientific texts", City University of London, Centre for Information Science, ~ (1979)
- H. Nanba, "Towards multi-paper summarization using reference information", Journal of Natural Language Processing, 6(82), pp.79~86 (1999)
- B. C. Peritz, "A classification of citation roles for the social sciences and related fields", Scientometrics, 5(5), pp.303~312 (1983)[DOI]
- P. Vinkler, "A quasi-quantitative citation model", Scientometrics, 12(1-2), pp.47~72 (1987)[DOI]
- Q. Zhao, "Research on citation character and citation depth in literature", Journal of Information, 29(10), pp.46~50 (2010)
- J. Ye, "Analyzing the essence of citations and their functions in academic assessment", Journal of Library Science in China, 36(1), pp.35~39 (2010)
- S. Liu, "Research on the citation evaluation based on citation context nature", Information Studies: Theory & Application, 38(3), pp.77~81 (2015)