Development of an artificial intelligence-based nursing simulation scenario evaluation tool: a methodological study using the Real-Time Delphi method in South Korea
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Purpose: Simulation-based education plays a critical role in nursing by allowing stu- dents to acquire clinical competencies in a safe and controlled environment. However, current evaluation tools for simulation scenarios often lack standardization, resulting in inconsistencies when assessing the effectiveness of such programs. Methods: This study aimed to develop a comprehensive Nursing Simulation Scenario Evaluation Tool using the Real-Time Delphi method. A panel of 10 experts in nursing and simulation education participated in two rounds of surveys. The evaluation criteria were derived from the International Nursing Association for Clinical Simulation and Learning Standards of Best Practice and relevant literature. Survey items were refined through expert consensus using content validity ratios and coefficient of variation val- ues. The finalized tool was further enhanced with artificial intelligence (AI)–based evalu- ation capabilities to support objective and systematic assessment. The tool was registered and patented in the Republic of Korea (Korean Intellectual Property Office Registration No. 10-2024-0051234) to acknowledge its innovation and technical merit. Results: The process resulted in an evaluation tool comprising eight key domains and 36 items, covering scenario structure, learning objectives, preparation, script development, debriefing, facilitation, expected outcomes, and scenario validity. A Kendall’s coefficient of concordance of 0.739 indicated strong agreement among the experts. Conclusion: This study successfully developed a standardized and validated tool to im- prove the reliability and effectiveness of simulation-based education in nursing. The tool addresses a key gap in current educational practices and enhances consistency in evalu- ating nursing simulation scenarios. Future studies should focus on validating its applica- tion across diverse educational environments.
Abstract
Purpose: Simulation-based education plays a critical role in nursing by allowing stu- dents to acquire clinical competencies in a safe and controlled environment. However, current evaluation tools for simulation scenarios often lack standardization, resulting in inconsistencies when assessing the effectiveness of such programs. Methods: This study aimed to develop a comprehensive Nursing Simulation Scenario Evaluation Tool using the Real-Time Delphi method. A panel of 10 experts in nursing and simulation education participated in two rounds of surveys. The evaluation criteria were derived from the International Nursing Association for Clinical Simulation and Learning Standards of Best Practice and relevant literature. Survey items were refined through expert consensus using content validity ratios and coefficient of variation val- ues. The finalized tool was further enhanced with artificial intelligence (AI)–based evalu- ation capabilities to support objective and systematic assessment. The tool was registered and patented in the Republic of Korea (Korean Intellectual Property Office Registration No. 10-2024-0051234) to acknowledge its innovation and technical merit. Results: The process resulted in an evaluation tool comprising eight key domains and 36 items, covering scenario structure, learning objectives, preparation, script development, debriefing, facilitation, expected outcomes, and scenario validity. A Kendall’s coefficient of concordance of 0.739 indicated strong agreement among the experts. Conclusion: This study successfully developed a standardized and validated tool to im- prove the reliability and effectiveness of simulation-based education in nursing. The tool addresses a key gap in current educational practices and enhances consistency in evalu- ating nursing simulation scenarios. Future studies should focus on validating its applica- tion across diverse educational environments.