설명가능한 인공지능을 활용한 수학교육 연구의 영향력 분석
Analysis of the impact of mathematics education research using explainable AI
0
조회
0
다운로드
3
인용
0
참고문헌
키워드
초록
본 연구는 수학 교육 분야에서 중요한 영향을 미치는 논문을 판별하고 분석하기 위한 설명가능한 인공지능(XAI) 모델을 개발하였다. 29개 국내외수학교육 학술지의 논문 메타정보를 활용하여 수학교육 학술연구 네트워크 구조를 구축하였다. 구축된 네트워크는 ‘논문과 다른 논문의 인용네트워크’, ‘논문과 저자 네트워크’, ‘논문과 학술지 네트워크’, ‘공동 저자 네트워크’, ‘저자와 소속기관 네트워크’ 등 총 5개의 세부 네트워크로구성되었다. 랜덤포레스트 기계학습 모델을 사용하여 네트워크 내의 개별 논문의 영향력을 평가하였으며, SHAP을 이용해 영향력 있는 논문의판별 기준을 분석하였다. '논문 네트워크 PageRank', ‘논문당 인용횟수의 변화량’, ‘총 인용횟수’, ‘저자의 h-index 변화량’, ‘학술지의 논문당인용횟수’ 등이 중요한 판별 요인으로 나타났다. 국내와 국외 수학교육 연구의 판별 패턴을 비교 분석한 결과, 국내 연구에서는 '공동 저자네트워크 PageRank'의 중요성이 도드라졌다. 본 연구의 XAI 모델은 논문의 영향력 판별 도구로써 연구자에게 논문 작성 시 전략적인 방향성을제공할 수 있게 해준다. 논문 네트워크 확장, 학술대회 발표, 공동 저술 활동을 통한 저자 네트워크 활성화 등이 논문의 영향력 증진에 크게기여한다는 결과를 얻었다. 이를 통해 연구자는 학계에서 자신의 연구가 어떠한 평가 기준에 따라 어떻게 인식되고 있는지, 그리고 그 평가에기여하는 주요 요인이 무엇인지를 명확히 파악할 수 있을 것이다. 본 연구는 설명가능한 인공지능을 활용하여 전통적으로 많은 시간과 비용이필요하던 수학교육 논문의 영향력 평가 방식을 혁신하였다. 이 방법은 수학교육 연구 뿐만 아니라 다른 학문 분야에서도 활용될 수 있으며, 연구활동의 효율성과 효과성을 향상시킬 것으로 기대된다.
Abstract
This study primarily focused on the development of an Explainable Artificial Intelligence (XAI) model to discern and analyze papers with significant impact in the field of mathematics education. To achieve this, meta-information from 29 domestic and international mathematics education journals was utilized to construct a comprehensive academic research network in mathematics education. This academic network was built by integrating five sub-networks: 'paper and its citation network,' 'paper and author network,' 'paper and journal network,' 'co-authorship network,' and 'author and affiliation network.' The Random Forest machine learning model was employed to evaluate the impact of individual papers within the mathematics education research network. The SHAP, an XAI model, was used to analyze the reasons behind the AI's assessment of impactful papers. Key features identified for determining impactful papers in the field of mathematics education through the XAI included 'paper network PageRank,' ‘changes in citations per paper,’ ‘total citations,’ ‘changes in the author's h-index,’ and ‘citations per paper of the journal.’ It became evident that papers, authors, and journals play significant roles when evaluating individual papers. When analyzing and comparing domestic and international mathematics education research, variations in these discernment patterns were observed. Notably, the significance of 'co-authorship network PageRank' was emphasized in domestic mathematics education research. The XAI model proposed in this study serves as a tool for determining the impact of papers using AI, providing researchers with strategic direction when writing papers. For instance, expanding the paper network, presenting at academic conferences, and activating the author network through co-authorship were identified as major elements enhancing the impact of a paper. Based on these findings, researchers can have a clear understanding of how their work is perceived and evaluated in academia and identify the key factors influencing these evaluations. This study offers a novel approach to evaluating the impact of mathematics education papers using an explainable AI model, traditionally a process that consumed significant time and resources. This approach not only presents a new paradigm that can be applied to evaluations in various academic fields beyond mathematics education but also is expected to substantially enhance the efficiency and effectiveness of research activities.
참고문헌 (37)
- Adadi, A., "Peeking inside the black-box : a survey on explainable artificial intelligence(XAI)", IEEE access, 6, pp.52138~52160 (2018)[DOI]
- 안도연, "학업성취도 예측 요인 분석 및 인공지능 예측 모델 개발 - 블렌디드 수학 수업을 중심으로", 수학교육, 61(2), pp.257~271 (2022), 한국수학교육학회[DOI]
- Alonso, J. M., "Teaching explainable artificial intelligence to high school students", International Journal of Computational Intelligence Systems, 13(1), pp.974~987 (2020)[DOI]
- Andrade-Molina, M., "Beyond quality metrics : defying journal rankings as the philosopher’s stone of mathematics education research", Educational Studies in Mathematics, 103(3), pp.359~374 (2020)[DOI]
- Arik, S. Ö., "Tabnet: Attentive interpretable tabular learning", Proceedings of the AAAI conference on artificial intelligence, 35(8), pp.6679~6687 (2021)
- Arrieta, A. B., "Explainable Artificial Intelligence(XAI) : Concepts, taxonomies, opportunities and challenges toward responsible AI", Information Fusion, 58, pp.82~115 (2020)[DOI]
- Bollen, J., "Journal status", Scientometrics, 69(3), pp.669~687 (2006)[DOI]
- Brin, S., "The anatomy of a large-scale hypertextual web search engine", Computer Networks and ISDN Systems, 30(1-7), pp.107~117 (1998)[DOI]
- Chung, K., "The effects of explainable artificial intelligence education program based on AI literacy", Journal of The Korean Association of Artificial Intelligence Education, 3(1), pp.1~12 (2022)[DOI]
- Broad Agency Announcement, Explainable Artificial Intelligence (XAI), "DARPA", 7~8, pp.DARPA-BAA-16-53 (2016)
- Datta, A., "Algorithmic transparency via quantitative input influence: Theory and experiments with learning systems", 2016 IEEE Symposium on Security and Privacy (SP) IEEE, pp.598~617 (2016)
- Funk, R. J., "A dynamic network measure of technological change", Management Science, 63(3), pp.791~817 (2017)[DOI]
- Garfield, E., "From the science of science to Scientometrics visualizing the history of science with HistCite software", Journal of Informetrics, 3(3), pp.173~179 (2009)[DOI]
- González-Alcaide, G., "The impact factor in non-English-speaking countries", Scientometrics, 92(2), pp.297~311 (2012)[DOI]
- Haensly, P. J., "Acceptance rates and journal quality : An analysis of journals in economics and finance", Journal of Business & Finance Librarianship, 14(1), pp.2~31 (2008)[DOI]
- Hamilton, W. L., "Representation learning on graphs : Methods and applications" (2017)
- Inhaber, H., "Quality of research and the Nobel prizes", Social Studies of Science, 6(1), pp.33~50 (1976)[DOI]
- 김세영, "개별화 맞춤형 수학 학습을 지원하는 AI 기반 플랫폼 분석", 수학교육 논문집, 36(3), pp.417~438 (2022), 한국수학교육학회[DOI]
- 김성훈, "설명 가능한 AI 학습 지원 시스템 개발", 컴퓨터교육학회 논문지, 24(1), pp.107~115 (2021), 한국컴퓨터교육학회[DOI]
- 이재윤, "공동연구 네트워크 분석을 위한 중심성 지수에 대한 비교 연구", 정보관리학회지, 31(3), pp.153~179 (2014), 한국정보관리학회[DOI]
- Lundberg, S. M., "A unified approach to interpreting model predictions", Advances in Neural Information Processing Systems, 30 (2017)
- Mariani, M. S., "Identification of milestone papers through time-balanced network centrality", Journal of Informetrics, 10(4), pp.1207~1223 (2016)[DOI]
- Moed, H. F., "Citation analysis of scientific journals and journal impact measures", Current Science, pp.1990~1996 (2005)[DOI]
- Molnar, C., "Interpretable machine learning", Lulu. com, ~ (2020)
- Nivens, R. A., "Assessing journal quality in mathematics education", Journal for Research in Mathematics Education, 48(4), pp.348~368 (2017)[DOI]
- 오세준, "기계학습과 네트워크를 이용한 수학교육 연구의 영향력 판별 프로그램 개발", 수학교육 논문집, 37(1), pp.21~45 (2023), 한국수학교육학회[DOI]
- 박다빈, "초등 인공지능 교육을 위한 설명 가능한 인공지능의 교육적 의미 연구", 정보교육학회논문지, 25(5), pp.803~812 (2021), 한국정보교육학회[DOI]
- 박혜연, "수학 교수·학습을 위한 인공지능 플랫폼 분석 연구", 수학교육 논문집, 36(1), pp.1~21 (2022), 한국수학교육학회[DOI]
- Price, D., "Little science, big science... and beyond (Vol. 480)" (1963), Columbia University Press
- Ribeiro, M. T., "Why should i trust you: Explaining the predictions of any classifier", Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp.1135~1144 (2016)
- Sarigöl, E., "Predicting scientific success based on coauthorship networks", EPJ Data Science, 3, pp.1~16 (2014)[DOI]
- Stolerman, I. P., "The language barrier and institutional provincialism in science Drug and Alcohol Dependence", 92(1-3), pp.1~2 (2008)[DOI]
- Weihs, L., "Learning to predict citation-based impact measures", 2017 ACM, 2017, 1~10[DOI]
- Weis, J. W., "Learning on knowledge graph dynamics provides an early warning of impactful research", Nature Biotechnology, 39(10), pp.1300~1307 (2021)[DOI]
- Williams, S. R., "Journal quality in mathematics education", Journal for Research in Mathematics Education, 48(4), pp.369~396 (2017)
- Zhou, Y., "Predicting the popularity of scientific publications by an age-based diffusion model", Journal of Informetrics, 15(4), pp.101177~ (2021)[DOI]
- Zhu, X., "Measuring academic influence : Not all citations are equal", Journal of the Association for Information Science and Technology, 66(2), pp.408~427 (2015)[DOI]