NIST AI 위험 관리 프레임워크 적용: NTIS 데이터베이스 분석의 MAP, MEASURE, MANAGE 접근 사례 연구
Applying NIST AI Risk Management Framework: Case Study on NTIS Database Analysis Using MAP, MEASURE, MANAGE Approaches
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Fueled by international efforts towards AI standardization, including those by the European Commission, the United States, and international organizations, this study introduces a AI-driven framework for analyzing advancements in drone technology. Utilizing project data retrieved from the NTIS DB via the “drone” keyword, the framework employs a diverse toolkit of supervised learning methods (Keras MLP, XGboost, LightGBM, and CatBoost) enhanced by BERTopic (natural language analysis tool). This multifaceted approach ensures both comprehensive data quality evaluation and in-depth structural analysis of documents. Furthermore, a 6T-based classification method refines non-applicable data for year-on-year AI analysis, demonstrably improving accuracy as measured by accuracy metric. Utilizing AI’s power, including GPT-4, this research unveils year-on-year trends in emerging keywords and employs them to generate detailed summaries, enabling efficient processing of large text datasets and offering an AI analysis system applicable to policy domains. Notably, this study not only advances methodologies aligned with AI Act standards but also lays the groundwork for responsible AI implementation through analysis of government research and development investments.
Abstract
Fueled by international efforts towards AI standardization, including those by the European Commission, the United States, and international organizations, this study introduces a AI-driven framework for analyzing advancements in drone technology. Utilizing project data retrieved from the NTIS DB via the “drone” keyword, the framework employs a diverse toolkit of supervised learning methods (Keras MLP, XGboost, LightGBM, and CatBoost) enhanced by BERTopic (natural language analysis tool). This multifaceted approach ensures both comprehensive data quality evaluation and in-depth structural analysis of documents. Furthermore, a 6T-based classification method refines non-applicable data for year-on-year AI analysis, demonstrably improving accuracy as measured by accuracy metric. Utilizing AI’s power, including GPT-4, this research unveils year-on-year trends in emerging keywords and employs them to generate detailed summaries, enabling efficient processing of large text datasets and offering an AI analysis system applicable to policy domains. Notably, this study not only advances methodologies aligned with AI Act standards but also lays the groundwork for responsible AI implementation through analysis of government research and development investments.
참고문헌 (34)
- Ahn, J. M., "Ensemble Machine Learning of Gradient Boosting (XGBoost, LightGBM, CatBoost) and Attention-Based CNN-LSTM for Harmful Algal Blooms Forecasting", Toxins, 15(10) (2023)[DOI]
- Asmussen., "Smart Literature Reivew: A Practical Topic Modelling Approach to Exploratory Literature Review", Journal of Big Data, pp.6~93 (2019)
- "BERTopic, c-TF-IDF" (2024)[URL]
- "Hierarchical Topic Modeling" (2024)[URL]
- Candice, B., "A Comparative Analysis of Gradient Boosting Algorithms", Artificial Intelligence, 54, pp.1937~1967 (2020)
- "Carnegie Mellon University, Carnegie Mellon University Human-Computer Interaction Institute" (2024)[URL]
- "ChatGPT4" (2024)[URL]
- Feasibility study for and EU monitoring mechanism on key enabling technologies, "EC(European Commission)", European Commission, ~ (2012)
- KETs obsevatory phase ii methodology report, "EC", European Commission, ~ (2017)
- Advanced Technologies for Industry – Methodological Report, "EC", European Commission, ~ (2021)
- Monitoring European Industryal Ecosystems–Conceptual, Monitoring and Indicator Framework, "EC", European Commission, ~ (2023)
- "EU AI Act: first regulation on artificial intelligence" (2024)[URL]
- Hovart, M., "The New Framework for EU Research and Innovation", Science, 334, pp.1066~1068 (2011)
- "What is human-centered AI?" (2024)[URL]
- "ISO 3100: 2018 Risk-Management Guidelines" (2024)[URL]
- Jeong, E.H., "The Analysis of Changes in East Coast Tourism using Topic Modeling", JKIIECT, 13(6), pp.489~495 (2020)
- Lane, J., "Let’s make science metrics more scientific", Nature, 464, pp.488~489 (2010)
- "The STAR METRICS Project:Current and Future Uses for S&E Workforce Data" (2010)[URL]
- Lim, J. S., "Quantifying Innovation Characteristics of National R&D Investment through Cross-Cutting Data Analysis : Case Study on NTIS Nanotechnology", Journal of The Korean Operations Research and Management Science Society, 45(2), pp.13~23 (2020)
- Lim, J. S., "Research on Regional Spatial Information Analysis Platform about NTIS Raw Data", Journal of Cadastre & Land InformatiX, 50(2), pp.21~35 (2020)
- Lim, J. S., "Study on Measurement of National R&D Investment Spillover : Linking Multilateral Big Data", Korea CEO Academy, 24(1), pp.311~330 (2021)
- Lim, J. S., "Text Based Explainable AI for Monitoring National Innovations", Journal of Korean Society of Industrial and Systems Engineering, 45(4), pp.1~7 (2022)
- Lim, J. S., "A Study on Human-AI Collaboration Process to Support Evidence-Based National Innovation Monitoring : Case Study on Ministry of Oceans and Fisheries", Korean Society of Industrial and Systems Engineering, 46(2), pp.22~31 (2023)
- "Legislation on fostering the artificial intelligence industry and creating a foundation for trust" (2024)[URL]
- AI Risk Management Frame 1.0, "NIST(National Institute of Standards and Technology)", US Department of Commerce, ~ (2023)
- "NTIS(National Science & Technology Information Service)" (2024)[URL]
- Advancing accountability in AI; Governing and managing risks throughout the lifecycle for trustworthy AI, "OECD", ~
- "R&D Platform for Investment and Evaluation (“R&D PIE”)" (2024)[URL]
- Park, D. J., "Topic Modeling Analysis Comparison for Research Topic in Korean Society of Industrial and Systems Engineering:Concentrated on Research Papers from 1978∼ 1999", Journal of Korean Society of Industrial and Systems Engineering, 44(4), pp.113~127 (1978)
- Park, J. H., "National R&D investment performance analysis based on NTIS raw data : Gyeongsangnam-do Smart Farm Industrialization Case", Regional Industry Review, 45(4), pp.243~263 (2022)
- "Stanford University Human-Centered AI" (2024)[URL]
- "University of California Berkeley, UC Berkeley Center for Human-Compatible AI" (2024)[URL]
- Yoon, S. U., "Topic Modeling on Fine Dust Issues Using LDA Analysis", Journal of Energy Engineering, 29, pp.23~29 (2020)