본문 바로가기
KERD
논문KCI 등재

화학안전 교육훈련 프로그램 평가 방안 및 문항 개발: Kirkpatrick 모델을 활용한 방법론적 접근

Design and Validation of Evaluation Methods and Assessment Items for Chemical Safety Training Programs: A Kirkpatrick Model Approach

장선영|유병태|김수연
(사)위기관리이론과실천 (Crisis and Emergency Management: Theory and Praxis)|2024.12|Crisisonomy|제20권 제12호|pp. 81-102

0

조회

0

다운로드

0

인용

0

참고문헌

키워드

satisfaction만족도 평가training program evaluationKirkpatrick model화학안전 교육훈련교육훈련 프로그램 평가Kirkpatrick 모델chemical safety training

초록

본 연구는 화학안전 교육훈련 프로그램의 효과성을 평가하기 위한 방안을 탐색하고, 구체적인 평가 항목 및 문항을 개발하는 것을 목적으로 하였다. 이를 위해 Kirkpatrick의 4단계 모델에 기반하여, 화학안전 교육훈련 프로그램과 관련된 자료 분석, 전문가 인터뷰, 선행연구 분석, 전문가 델파이 조사를 수행하였으며, 주요 연구 결과는 다음과 같다. 첫째, 화학안전 교육훈련 프로그램 평가는 개인, 부서, 조직에 대한 기여도를 확인하는 데 중점을 두었으며, 각 4단계에서 12개의 구체적인 평가 방안이 도출되었다. 둘째, 평가 방안 도출 결과를 토대로 만족도 평가 공통문항 10개 항목 20개 문항, 현업적용도 평가 6개 문항이 확정되었다. 이 연구는 프로그램과 관련한 이해관계자들의 요구를 반영하고, 프로그램의 목적이 의도대로 진행되었는지 확인할 수 있는 실효성 있는 평가 방안과 문항을 개발했다는 데 의의가 있다. 이를 통해 화학안전 교육훈련 프로그램의 전반적인 효과를 종합적으로 평가할 수 있는 기반을 마련하고 화학안전 훈련교육 평가의 즉각적인 활용에 기여할 것으로 기대한다.

Abstract

This study aimed to explore evaluation methods and assessment items for chemical safety training programs utilizing Kirkpatrick's four-level evaluation model. The research included an in-depth analysis of program materials, expert interviews, literature review, and a Delphi survey. The resulting twelve specific evaluation strategies which derived across the four evaluation levels were utilized to find twenty items across ten categories for the satisfaction level and six items for the behavior level. These results provide actionable insights for improving current evaluation practices for chemical safety training programs by establishing a foundational framework for a comprehensive evaluation of the overall effectiveness of these programs. This study is significant in that it reflects the needs of stakeholders and develops effective evaluation strategies and items to ensure that the program objectives are achieved as intended.

참고문헌 (43)

  1. Attia, A. M., "Measuring and Evaluating Sales Force Training Effectiveness : A Proposed and an Empirically Tested Model", Ph. D., pp.1998
  2. Bates, R., "A Critical Analysis of Evaluation Practice : the Kirkpatrick Model and the Principle of Beneficence", Evaluation and Program Planning, 27(3), pp.341~347 (2004)
  3. Bledsoe, M. D., "Correlations in Kirkpatrick's Training Evaluation Model", Ph. D., pp.1999
  4. Campbell, D. T., "Assessing the Impact of Panned Scial Change", Evaluation and Program Planning, 2(1), pp.67~90 (1979)
  5. Custer, R. L., "The Modified Delphi Technique-A Rotational Modification", Journal of Vocational and Technical Education, 15(2), pp.1~10 (1999)
  6. Choi, Heesook, "The Relationships among the Transfer of Training and Individual and Organizational Performance of Participants in Job Training Programs for Small and Medium-sized Enterprises", Journal of Corporate Education and Talent Research, 21(2), pp.29~55 (2019)
  7. Chung, Jaesam, "Program Evaluation Proces" (2022), KyoYookBook
  8. Forest, L. B., "Extension Handbook: Process and Practices" (1994), Thompson Educational Publishing
  9. Humphrey-Murto, S., "Using Consensus Group Methods Such As Delphi and Nominal Group in Medical Education Research", Medical Teacher, 39(1), pp.14~19 (2017)
  10. Jeon, Ju Sung, "Validating an Evaluation Model to Measure the Effectiveness of Educational Programs of Lifelong Education Centers Affiliated with Universities", Journal of Educational Studies, 42, pp.125~150 (2011)
  11. Jones, C., "The Evaluation of a Home-based Paediatric Nursing Service : Concept and Design Development Using the Kirkpatrick Model", Journal of Research in Nursing, 23(6), pp.492~501 (2018)
  12. Kim, So Young, "Evaluation Research on the Outcomes of Consortium Training Programs for Small and Middle-sized Corporations by Using CIPP Model and Kirkpatrick`s Model", The Journal of Vocational Education Research, 30(1), pp.51~74 (2011)
  13. Kim, Hye-Sook, "Theory and Practice of Program Evaluation" (2014), KyoYookBook
  14. Kirkpatrick, D., "Evaluating Training Programs : The Four Levels" (1998), Berrett-Koehler
  15. Kirkpatrick, D. L., "Evaluating Training Programs: The Four Levels" (2006), BK
  16. Koh, Gi-Soon, "A Study on the Transfer of Education Training : The Moderating Effects of Learning Organization Factors", Journal of Organization and Management, 26(3), pp.25~54 (2002)
  17. "Korea Gas Safety Corporation Cyber Education" (2023)[URL]
  18. "Korea Occupational Safety and Health Agency" (2023)[URL]
  19. Ku, Kyung-hee, "Development of Stakeholder-based Evaluation Scales for the Lifelong Education Field Training Program", The Journal of Vocational Education Research, 37(1), pp.55~75 (2018)
  20. Lawshe, C. H., "A Quantitative Approach to Content Validity", Personnel Psychology, 28(4), pp.563~575 (1975)
  21. Lee, Eunjeong, "A Study for the Development of the Evaluation Indicators for the Middle-aged and Elderly Lifelong Education Program Based on the Kirkpatrick Model", The Journal of Core Competency Education Research, 7(2), pp.113~140 (2022)
  22. Lee, Hong-Jae, "A Study on Measuring the Educational Effects of the Officials Applying the Kirkpatrick Model : Focusing on the Privacy Education", Journal of Korean Association for Regional Information Society, 19(1), pp.165~189 (2016)
  23. Lee, Jiwon, "Evaluation of the Basic Course of the Teacher Training Program for STEAM Education Based on Kirkpatrick’s 4-level Model", School Science Journal, 12(4), pp.437~452 (2018)
  24. Lee, Ju Gab, "A Study on Factors Affecting the Learning Transfer of Occupational Safety and Health Education", Master, pp.2021
  25. Lee, Seung Hee, "‘Evaluation of First Year Outcomes of Lee Jong-Wook Seoul Project Using Kirkpatrick’s Four-level Evaluation Approach", Korean Journal of Medical Education, 26(1), pp.41~51 (2014)
  26. Lee, Sungheum, "Dimension Classification and Questionnaire Design Criteria for Reaction Evaluation of Educational", Training Programs, 2005, pp.21(3), 187~214
  27. Development of Training Operation Manual for Measuring On-the-job Application and Performance Improvement, "Lee, Sungheum", National Education Training Institute, ~, pp.2017-152 (2017)
  28. Lim, Yun-Jin, "Evaluation of Teacher Training Program Effectiveness and Exploration of Improvement for Specialized High-school Teacher in Invention an Patent Field", Journal of the Korean Institute of Industrial Educators, 40(1), pp.23~39 (2015)
  29. Nadler, Leonard, "Managing Human Resource Development" (1986), Jossey-Bass Publishers
  30. "National Civil Defense and Disaster Management Training Institute" (2023)[URL]
  31. "National Fire Service Training Center" (2023)[URL]
  32. "National Institute of Chemical Safety" (2023)[URL]
  33. Oh, Euikyung, "A Study on Measuring the Effects of Continuing Education of Librarian Teachers Using Kirkpatrick Education Model", Journal of the Korean BIBLIA Society for Library and Information Science, 34(2), pp.295~311 (2023)
  34. Park, Byoung Sik, "The Evaluation of Work-site Application to the Youth-Leaders Training Program and Its Improvement", Korean Public Personnel Administration Review, 14(1), pp.155~184 (2015)
  35. Park, Yoon Joo, "A Study on Measuring the Educational Effects of Service Training Program in Call Center : Focused on Kirkpatrick Model", Journal of Coorporation and Innovation, 42(2), pp.65~87 (2019)
  36. Praslova, L., "Adaptation of Kirkpatrick’s Four Level Model of Training Criteria to Assessment of Learning Outcomes and Program Evaluation in Higher Education", Educational Assessment Evaluation and Accountability, 22, pp.215~225 (2010)
  37. Reio Jr, T. G., "A Critique of Kirkpatrick's Evaluation Model", New Horizons in Adult Education and Human Resource Development, 29(2), pp.35~53 (2017)
  38. Ruiller, J. Z., "The Relationship between Organizational Transfer Climate and Positive Transfer of Training", Human Resource Development Quarterly, 12(4), pp.377~390 (1993)
  39. "Key Evaluation Checklist" (2007)[URL]
  40. Smidt, A., "A Communication Training Programme for Residential Staff Working with Adults with Challenging Behaviour : Pilot Data on Intervention Effects", Journal of Applied Research in Intellectual Disabilities, 20, pp.16~29 (2007)
  41. Smidt, A., "The Kirkpatrick Model : A Useful Tool for Evaluating Training Outcomes", Journal of Intellectual and Developmental Disability, 34(3), pp.266~274 (2009)
  42. Waggoner, J., "Is There a Consensus on Consensus Methodology? Descriptions and Recommendations for Future Consensus Research", Academic Medicine, 91(5), pp.663~668 (2016)
  43. Yaw, D. C., "An Evaluation of e-Learning in Industry at Level Three Based upon the Kirkpatrick Model", Ph. D., pp.2005

관련 논문AI추천

안전보건교육사업 성과평가 지표 개발을 위한 델파이 연구박윤희, 장주희한국인력개발학회 · HRD연구2019 · 제21권 제3호CIPP 모형에 기반한 산업안전보건 직무교육기관의 교육운영 실태 진단 및 개선 방안 연구박윤희, 배광민한국기업교육학회 · 기업교육과인재연구2016 · 제18권 제1호현업 HRD 담당자들의 Kirkpatrick 평가 모형에 대한 인식: 적용 현장에서의 장점, 한계, 개선 방향을 중심으로우성미, 정은정, 성세실리아한국인력개발학회 · HRD연구2016 · 제18권 제3호유해화학물질 안전교육 체계화 및 표준화 방안 연구윤이, 김소영, 마병철, 안수빈, 이슬기, 임경민(사)위기관리이론과실천 · Crisisonomy2020 · 제16권 제4호고용서비스 전문인력 대상 이러닝 교육 프로그램 평가체계 개발김민희, 박은규한국농·산업교육학회 · 농업교육과 인적자원개발2023 · 제55권 제3호농업인 리더 대상 농작업 안전보건 교육 프로그램 효과성 평가김민지, 김진모, 손규태, 유영주, 이은표, 정지용, 황영훈한국농·산업교육학회 · 농업교육과 인적자원개발2017 · 제49권 제4호

이 간행물의 다른 논문 (14건)

극단치 분석 및 극한 현상 모델링에 관한 연구남호수, 신희건pp. 1-13에너지 정책 네트워크에서 정책행위자 간 관계구조와 상호작용 분석 독일과 한국의 시민참여 사례분석을 통한 함의 찾기박지민, 김서용, 노유경, 전세혁, 이시현, 임진영pp. 15-35노후 댐의 안전 및 유지관리 개선을 위한 신뢰성 평가 기법문장원, 최병한, 권현한pp. 37-47향정신성의약품 오·남용에 관한 연구 동향김영호, 김혜선, 이연재, 라세원pp. 49-65지방소멸 대응을 위한 사회안전에 영향을 미치는 위험요인 규명에 관한 연구 - 충청남도 소멸고위험지역과 보통지역의 20~39세 여성을 대상으로 -박근오pp. 67-80
원문 보기