본문 바로가기
KERD
논문KCI 등재

Human-AI 협력 프로세스 기반의 증거기반 국가혁신 모니터링 연구: 해양수산부 사례

A Study on Human-AI Collaboration Process to Support Evidence-Based National Innovation Monitoring: Case Study on Ministry of Oceans and Fisheries

배성훈|김상국|임정선|류길호
한국산업경영시스템학회 (KOREAN SOCIETY OF INDUSTRIAL AND SYSTEMS ENGINEERING)|2023.06|한국산업경영시스템학회지 (Journal of Korean Society of Industrial and Systems Engineering)|제46권 제2호|pp. 22-31

0

조회

0

다운로드

2

인용

0

참고문헌

키워드

Topic ModelingHuman-CentricHuman-AI Collaboration
주제분류산업공학

초록

Governments around the world are enacting laws mandating explainable traceability when using AI(Artificial Intelligence) to solve real-world problems. HAI(Human-Centric Artificial Intelligence) is an approach that induces human decision-making through Human-AI collaboration. This research presents a case study that implements the Human-AI collaboration to achieve explainable traceability in governmental data analysis. The Human-AI collaboration explored in this study performs AI inferences for generating labels, followed by AI interpretation to make results more explainable and traceable. The study utilized an example dataset from the Ministry of Oceans and Fisheries to reproduce the Human-AI collaboration process used in actual policy-making, in which the Ministry of Science and ICT utilized R&D PIE(R&D Platform for Investment and Evaluation) to build a government investment portfolio.

Abstract

Governments around the world are enacting laws mandating explainable traceability when using AI(Artificial Intelligence) to solve real-world problems. HAI(Human-Centric Artificial Intelligence) is an approach that induces human decision-making through Human-AI collaboration. This research presents a case study that implements the Human-AI collaboration to achieve explainable traceability in governmental data analysis. The Human-AI collaboration explored in this study performs AI inferences for generating labels, followed by AI interpretation to make results more explainable and traceable. The study utilized an example dataset from the Ministry of Oceans and Fisheries to reproduce the Human-AI collaboration process used in actual policy-making, in which the Ministry of Science and ICT utilized R&D PIE(R&D Platform for Investment and Evaluation) to build a government investment portfolio.

참고문헌 (57)

  1. 임도현, "Doc2vec을 활용한 개인간 중고거래 사기탐지에 관한 연구", 한국컴퓨터정보학회논문지, 27(3), pp.173~182 (2022), 한국컴퓨터정보학회[DOI]
  2. Asmussen., C.B., "Smart literature review:A practical topic modelling approach to exploratory liter-ature review", Journal of Big Data, pp.6~93 (2019)
  3. Angelov, P. P., "Explainable artificial intelligence: an analytical review", Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 11(5), pp.1~13 (2021)
  4. Bedenkov, A., "Customer Centricity in Medical Affairs Needs Human-Centric Artificial Intelligence", Pharmaceutical Medicine, 35, pp.21~29 (2021)
  5. Calisto, F. M., "Introduction of human-centric AI assistant to aid to radiologists for multimodal breast image classification", Int. J. Human–Computer Studies, 150, pp.102607~ (2021)
  6. Cao., "Feature importance sampl-ing-based adaptive random forest as a useful tool to screen underlying lead compounds", J. Chemometrics, 25, pp.201~207 (2011)
  7. 진요요, "설명 가능한 개인화 영화 추천 서비스를 위한 딥러닝 기반 텍스트 요약 모델", 한국IT서비스학회지, 21(2), pp.109~126 (2022), 한국IT서비스학회[DOI]
  8. 천강민, "설명 가능한 AI를 적용한 기계 예지 정비 방법", 한국산업경영시스템학회지, 44(4), pp.227~233 (2021), 한국산업경영시스템학회
  9. "Explainable Artificial Intelligence(XAI)" (2022)[URL]
  10. Feasibility study for an EU monitoring mechanism on key enabling technologies, "EC(European Commission)", European Commission, ~ (2012)
  11. KETs obsevatory phase ii methodology report, "EC", European Commission, ~ (2017)
  12. "Advanced Technologies for Industry" (2022)[URL]
  13. Communication from the Commission to the European Parliament, the Council, the European Econo-mic and Social Committee and the Committee of The Regions: Building Trust in Human-Centric Artificial Intelligence(COM(2019) 168 final), "EC", European Commission, ~ (2019)
  14. Semantic Text Analysis tool : SeTA, "EC", European Commission, ~ (2019)
  15. Policy and Investment Recommendations for Trustworthy AI, "EC", European Commission, ~ (2019)
  16. Sectoral Considerations on the Policy and Invest-ment Recommendations for Trustworthy Artificial Intelligence, "EC", European Commission, ~ (2020)
  17. Proposal for a Regulation of the European Parliament and of the Council on Machinery Products(COM(2021)202 final), "EC", European Commission, ~ (2021)
  18. Proposal for Directive of the European Parliament and of the Council on adapting non-contractual civil liability rules to artificial intelligence(COM(2022)496final), "EC", European Commission, ~ (2022)
  19. "Economic Ministers’ Meeting 18-3, Government R&D investment innovation plan to support innovative growth", Joint ministry of Korea Government, ~ (2018)
  20. Fabris, F., "A new approach for interpreting Random Forest models and its application to the biology of ageing", Bioinformatics, 34(14), pp.2449~
  21. Garcia-Magarino, I., "Human-Centric AI for Trustworthy IoT Systems with Explainable Multilayer Perceptrons", Data Mining for Internet of Things-IEEE Access, 7, pp.125562~ (2019)
  22. Griffiths, T. L., "Finding Scientific Topics", PNAS, 101, pp.5228~5235 (2004)
  23. 하태현, "An Exploratory Approach to Discovering Salary-Related Wording in Job Postings in Korea", Journal of Information Science Theory and Practice, 10, pp.86~95 (2022), 한국과학기술정보연구원[DOI]
  24. "Machine Learning Interpretability with H2O Driverless AI" (2022)[URL]
  25. Henckaerts, R., "When stakes are high: Balancing accuracy and transparency with Model-Agnostic Interpretable Data-driven suRRogates", Expert Systems With Applications, 202, pp.1~13 (2022)
  26. Meng-Leong How, "Artificial Intelligence-Enhanced Predictive Insights for Advancing Financial Inclusion: A Human-Centric AI-Thinking Approach", Big Data and Cognitive Computing, 4(2), pp.8~ (2020), MDPI AG[DOI]
  27. Meng-Leong How, "Artificial Intelligence-Enhanced Decision Support for Informing Global Sustainable Development: A Human-Centric AI-Thinking Approach", Information, 11(1), pp.39~ (2020), MDPI AG[DOI]
  28. Hu, Y., "Interactive topic modeling", Mach Learn, 95, pp.423~469 (2014)
  29. Hwang, H., "Semi-Supervised Learning based on Auto-generated Lexicon using XAI in Sentiment Analysis", Proceedings of Recent Advances in Natural Language Processing, pp.593~600 (2021)
  30. "What is human-centered AI?" (2023)[URL]
  31. 정은희, "토핑 모델링을 활용한 동해안 관광의 변화 분석", 한국정보전자통신기술학회 논문지, 13(6), pp.489~495 (2020), 한국정보전자통신기술학회
  32. 김도연, "XAI기반 악성코드 그룹분류 결과 해석 연구", 정보보호학회논문지, 31(4), pp.559~571 (2021), 한국정보보호학회[DOI]
  33. Kling, R., "Human Centered Systems in the Perspective of Organizational and Social Informatics", Computers and Society, pp.22~29 (1998)
  34. Kumar, S. A., "A machine-learning scraping tool for data fusion in the analysis of sentiments about pandemics for supporting business decisions with human-centric AI explanations", PeerJ Comput. Sci, 7, pp.e713~ (2021)[DOI]
  35. Lane, J., "Let’s make science metrics more scientific", Nature, 464, pp.488~489 (2010)
  36. "The Star Metrics Project: Current and Future Uses for S&E Workforce Data" (2010)[URL]
  37. Lepri, B., "Ethical machines : The human-centric use of artificial intelligence", iScience, 24, pp.102249~ (2021)
  38. Lee, H. S., "iVisClustering: An Interactive Visual Document Clustering vis Topic Modeling", Eurographics Confer-ence on Visualization, pp.1155~1164 (2021)
  39. Lee, T. Y., "The human touch:How non-expert users perceive, interpret, and fix topic models", Int. J. Human-Computer Studies, 105, pp.28~42 (2017)
  40. 임정선, "Study of US", EU National Innovation Policies Based on Nanotechnology Development, and Implications for Korea, 2015, pp.3(1), 50~65[DOI]
  41. 임정선, "Cross-Cutting 데이터분석을 통한 국가연구개발 투자의 혁신특성 정량화 연구 : NTIS 나노기술 사례를 중심으로", 한국경영과학회지, 45(2), pp.13~23 (2020), 한국경영과학회
  42. 임정선, "국가과학기술지식 원시데이터에 관한 지역 공간정보 분석 플랫폼 연구", 지적과 국토정보, 50(2), pp.21~35 (2020), 한국국토정보공사[DOI]
  43. 임정선, "국가 연구개발 투자 성과 측정 연구 : 다측면 빅데이터 연계", 전문경영인연구, 24(1), pp.311~330 (2021), 한국전문경영인학회[DOI]
  44. 임정선, "텍스트 기반 Explainable AI를 적용한 국가연구개발혁신 모니터링", 한국산업경영시스템학회지, 45(4), pp.1~7 (2022), 한국산업경영시스템학회
  45. 박진한, "NTIS 원시데이터 기반 국가R&D투자 성과 분석: 경상남도 스마트팜 산업화 사례", 지역산업연구, 45(4), pp.243~263 (2022), 산업경영연구소[DOI]
  46. Messalas, A., "Model-Agnostic Interpretability with Shapley Values", 10th International Conference on IISA, pp.1~7 (2019)
  47. Naili, M., "Arabic topic identification based on empirical studies of topic models", INRIA, 27 (2017)
  48. 노설현, "토픽모델링을 활용한 인공지능 관련 이슈 분석", 디지털융복합연구, 18(5), pp.75~87 (2020), 한국디지털정책학회[DOI]
  49. "National Science & Technology Information Service" (2022)[URL]
  50. "R&D Platform for Investment and Evaluation (“R&D PIE”)" (2022)[URL]
  51. 박동준, "한국산업경영시스템학회지 연구 주제의 토픽모델링 분석 비교: 1978년∼99년 논문을 중심으로", 한국산업경영시스템학회지, 44(4), pp.113~127 (2021), 한국산업경영시스템학회
  52. 박종도, "토픽 모델링을 활용한 다문화 연구의 이슈 추적 연구", 한국문헌정보학회지, 53(3), pp.273~289 (2019), 한국문헌정보학회[DOI]
  53. Schonderwoerd, T. A. J., "Human-centered XAI: Developing design patterns for explanations of clinical decision sup-port systems", Int. J. Human-Computer Studies, 154, pp.102684~ (2021)
  54. Smith, A., "Closing the Loop: User-Centered Design and Evaluation of a Human-in-the-Loop Topic Modeling System", IUI 2018(Session 3B: Interactive Machine Learning and Analysis), pp.293~304 (2018)
  55. "How will AI change jobs?" (2023)[URL]
  56. Steyvers, M., "Handbook of Latent Semantic Analysis", pp.424~440 (2007), Lawrence Erlbaum Associates, Inc
  57. 윤순욱, "LDA 기법을 이용한 미세먼지 이슈의 토픽모델링 분석", 에너지공학, 29(2), pp.23~29 (2020), 한국에너지학회[DOI]

이 간행물의 다른 논문 (16건)

FCDD 기반 웨이퍼 빈 맵 상의 결함패턴 탐지배석주, 장승준pp. 1-12조직의 자율적 근로환경과 구성원 간 신뢰가 근로자의 직무몰입에 미치는 영향이동형, 황종현, 한은수pp. 13-21QFD에 기반한 스마트공장의 요구기능과 운영성과지표 우선순위 도출한관희, 전영준pp. 32-46항공정비 품질 엔지니어의 핵심역량에 관한 연구최병선, 박종훈, 이상천pp. 47-56확률적 밀어내기 정책을 가지는 공간-시간 우선순위 대기행렬김길환pp. 57-71
원문 보기