본문 바로가기
KERD
논문KCI 등재

이론과 실제에 대한 비판적 고찰을 통한HRD 효과성 평가 체계 개발

A development of HRD effectiveness assessment system through critical review of theory and practice

정보영
한국인력개발학회 (The Korean Society For Human Resource Development)|2021.11|HRD연구 (The Korean Journal of Human Resource Development Quarterly)|제23권 제4호|pp. 307-337|DOI 10.18211/kjhrdq.2021.23.4.011

0

조회

0

다운로드

1

인용

0

참고문헌

키워드

HRD 평가HRD EvaluationHRD 효과성 평가학제간 고찰비판적 고찰HRD Effectiveness AssessmentInterdisciplinary ReviewCritical Review

초록

HRD에서 효과성 평가는 여전히 회색지대로 남아있다. HRD에 유관된 이론, 연구, 실제에서 각각 효과성(effectiveness)의 대상, 검증 방식, 평가원 구성 등이 전수를 파악하기에 곤란할 만큼 다양하기 때문에 ‘HRD 효과성 평가’ 의 합의된 정의가 없는 실정이다. 한편, 실무자들은 Kirkpatrick 모형 등 기존에 알려진 교육훈련 프로그램 평가 위주로 사고하여 효과성 평가의 외연을 확장시키지 못하고 있는 실정이다. 이에 이 연구에서는 이론적인 고찰을 중심으로 비판적 관점에서 선행연구를 검토하며, 이를 바탕으로 HRD 효과성 평가의 정의를 내리고, 동시에 HRD 효과성 평가의 근간을 이루는 학문 영역을 다학제적으로 살펴보았다. HRD 효과성 평가는 교육평가학, 심리측정학 및 산업조직심리학, 계량경제학의 영향을 받아 정의될 수 있었다. 이 연구에서는 HRD 효과성 평가를 HRD 정책, 제도, 프로그램 및 개입의 결과로 인하여 변화하는 인적자원의 정서, 인식, 행동, 역량 및 그로 인한 비즈니스 성과 등 효과를 파악하는 체계적 활동으로 정의하였다. 또한, 이러한 정의를 통해 실효성 있는 HRD 효과성 평가 체계를 개발하고 실무 적용을 제안하였다. 이 연구에서 제안하는 체계는 기업 HRD 환경의 거시, 중간, 미시 평가 체계에서 1) 회고적 측정, 2) 사전-사후 측정, 3) 준실험설계 측정, 4) 다면적 측정, 5) 횡단 및 종단적 측정을 원칙으로 제시하였다.

Abstract

The effectiveness assessment in HRD remains a grey area even up to this date. The subject, method of verification, composition of the sources to clarify the effectiveness in theories, studies, and practices related to HRD are too diverse, making it challenging to identify the whole concept. Therefore, there is no consensus definition of the 'HRD effectiveness assessment.' On the other hand, practitioners have been on a passive stance towards expanding the scope of effectiveness assessment by restricting its limit to the existing training program evaluation models, such as the Kirkpatrick model. Therefore, this research examines prior studies from a critical standpoint based on the theoretical review and defines the HRD effectiveness assessment. Also, the research explores multidisciplinary academic areas, including psychometrics, industrial-organizational psychology, and econometrics, that underlies the concept of HRD effectiveness assessments. This study defines HRD effectiveness assessments as 'the human resources' competency or emotion/awareness/behavior through HRD programs or interventions.' It was defined as a systematic activities that have ensured the reliability/validity of an organization to determine whether the degree of consequent change in performance is significant. In addition, this definition has led to the development of a practical HRD effectiveness assessment system and its application to practice. The system proposed in this study suggests organizations have a macro, meso, and micro-level assessment and principles to measure: 1) retrospective, 2) pre-and-post, 3) quasi-experimental design, 4) multifaceted measurements, and 5) cross-sectional and longitudinal perspectives.

참고문헌 (100)

  1. 강상진, "다층모형" (2016), 학지사
  2. 고길곤, "자료기반 평가에서 질문주도 평가의 필요성과 효과크기 중심 평가의 한계", 정책분석평가학회보, 27(2), pp.201~229 (2017), 한국정책분석평가학회[DOI]
  3. 고영선, "재정사업 심층평가 지침" (2006), 한국개발연구원
  4. 김광해, "한자 합성어", 국어학, 24, pp.467~484 (1994)
  5. 김태성, "HRD 평가" (2019), 박영스토리
  6. 박소연, "기업교육 프로그램 평가 설계에의 프로그램 논리의 활용 가능성 탐색: K사의사례를 중심으로", 산업교육연구, 12, pp.55~70 (2006)
  7. 박소연, "HRD 평가의 미래에 대한 델파이 연구", HRD연구, 18(4), pp.25~48 (2016), 한국인력개발학회[DOI]
  8. 박소연, "HRD 평가 국내 연구동향: 2007~2016년 학술지 게재 논문을 중심으로", HRD연구, 19(2), pp.1~27 (2017), 한국인력개발학회[DOI]
  9. 박원우, "다면평가의 구체적 내용으로 관리자 능력에 대한 본인, 상사, 부하평가의 특성과 그들간의 관계", 경영논집, 33(2), pp.66~69 (1999)
  10. 박찬호, "비교교육학과 교육평가학", 비교교육연구, 28(1), pp.135~151 (2018), 한국비교교육학회[DOI]
  11. 배호순, "프로그램 평가론" (1994), 원미사
  12. 백영민, "R를 이용한 사회과학 데이터 분석" (2015), 커뮤니케이션북스
  13. 신현중, "공기업의 효과성 평가를 위한 인과분석기법의 추정방법에 대한 논의", 한국지방공기업학회보, 3(2), pp.1~24 (2007)
  14. 원효헌, "교수효과성의 본질에 관한 고찰", 수산해양교육연구, 18(3), pp.218~228 (2006), 한국수산해양교육학회
  15. 윤선경, "HRD 분야 이론활용 연구동향 분석: 국내 HRD 주요 학술지 논문(2007~2016년)을 중심으로", HRD연구, 19(3), pp.1~37 (2017), 한국인력개발학회[DOI]
  16. 윤승원, "교육과 학습에서 빅데이터" (2017), 커뮤니케이션북스
  17. 이석원, "훈련유형에 따른 장애인 직업훈련사업의 효과: 통합훈련과 전용훈련의 비교분석", 장애와 고용, 20(3), pp.5~27 (2010), 한국장애인고용공단 고용개발원[DOI]
  18. 고용영향 분석·평가 방법론 연구, "이인재", 한국노동연구원, ~ (2007)
  19. 임채성, "과학학습의 정의적 영역에서 사전-사후 통합 검사 설계의 타당화 연구: 과학영재를 대상으로", 초등과학교육, 36(3), pp.219~226 (2017), 한국초등과학교육학회[DOI]
  20. 장상호, "학문과 교육(상)" (1997), 서울대학교출판부
  21. 정보영, "대기업의 전략적 인적자원개발 활동 유형과 개인 및 조직 특성의 관계", 기업교육과인재연구, 16(2), pp.25~56 (2014), 한국기업교육학회
  22. 정은정, "현업 HRD 담당자들의 Kirkpatrick 평가 모형에 대한 인식: 적용 현장에서의 장점, 한계, 개선 방향을 중심으로", HRD연구, 18(3), pp.115~143 (2016), 한국인력개발학회[DOI]
  23. 정재삼, "교육프로그램평가" (2004), 교육과학사
  24. 채충일, "인적자원개발 연구동향(2006-2015): AHRD 학술지 논문의 주제어 연결망 분석", HRD연구, 19(1), pp.99~127 (2017), 한국인력개발학회[DOI]
  25. 정책실험의 개념과 필요성: 청년 기본소득 지급 실험 모델 제안, "최영준", LAB2050, 1~34 (2020)
  26. organizational psychology: An applied approach, "Industrial", pp.2015, Aamodt, M. G.
  27. Alvarez, K., "An integrated model of training evaluation and effectiveness", Human Resource Development Review, 3(4), pp.385~416 (2004)[DOI]
  28. Anderson, N., "The practitioner-researcher divide in Industrial, Work and Organizational(IWO)psychology : Where are we now, and where do we go from here?", Journal of Occupational and Organizational Psychology, 74(4), pp.391~411 (2001)[DOI]
  29. Bell, E., "Business research methods" (2018), Oxford university press
  30. Birknerová, Z., "Differences in evaluation of corporate training from the viewpoint of the work position and sector", International Journal for Infonomics, 9(1), pp.1131~1138 (2016)[DOI]
  31. Bray, J. H., "Methodological considerations in the evaluation of a teacher-training program", Journal of Educational Psychology, 72(1), pp.62~70 (1980)[DOI]
  32. Cascio, W. F., "Applied Psychology in Human Resource Management" (2011), Prentice-Hall
  33. Dahler-Larsen, P., "The Sage handbook of evaluation", pp.141~160 (2006)
  34. Daniel, B. K., "Big data and learning analytics in higher education: current theory and practice" (2016), Springer
  35. Davidson, E. J., "Evaluation methodology basics: The nuts and bolts of sound evaluation" (2005), Sage
  36. Dixon, N. M., "Evaluation: A tool for improving quality" (1990), University Associates, Inc.
  37. Drennan, J., "Controlling response shift bias: the use of the retrospective pre‐test design in the evaluation of a master's programme", Assessment & Evaluation in Higher Education, 33(6), pp.699~709 (2008)[DOI]
  38. Easterby-Smith, M., "Turning course evaluation from an end to a means", Personnel Management, 17(4), pp.25~27 (1985)
  39. Eseryel, D., "Approaches to evaluation of training : Theory & practice", Journal of Educational Technology & Society, 5(2), pp.93~98 (2002)
  40. Ferraro, P. J., "Counterfactual thinking and impact evaluation in environmental policy", New Directions for Evaluation, 2009(122), pp.75~84 (2009)[DOI]
  41. Foxon, M., "Evaluation of training and development programs: A review of the literature", Australasian Journal of Educational Technology, 5(2), pp.89~104 (1989)[DOI]
  42. Galanou, E., "A model for evaluating the effectiveness of middle managers' training courses : evidence from a major banking organization in Greece", International Journal of Training and Development, 13(4), pp.221~246 (2009)[DOI]
  43. Goldberger, A. S., "Econometrics and psychometrics : A survey of communalities", Psychometrika, 36(2), pp.83~107 (1971)
  44. Goldberger, A. S., "Introductory econometrics" (2009), Harvard University Press
  45. Gritz, R. M., "The impact of training on the frequency and duration of employment", Journal of Econometrics, 57(1-3), pp.21~51 (1993)[DOI]
  46. Hamlin, B., "What is HRD? A definitional review and synthesis of the HRD domain", Journal of European Industrial Training, 35(3), pp.199~220 (2011)[DOI]
  47. Han, H., "Reflections and future prospects for evaluation in human resource development", New Horizons in Adult Education and Human Resource Development, 25(2), pp.6~18 (2013)[DOI]
  48. Halverson, S. K., "Self-other agreement on a 360-degree leadership evaluatio", 17th Annual Conference of the Society for Industrial and Organizational Psychology (2002)
  49. Holton III, E. F., "A critical analysis of HRD evaluation models from a decision‐making perspective", Human Resource Development Quarterly, 16(2), pp.257~280 (2005)[DOI]
  50. Hytönen, T., "Exploring the practice of human resource development as a field of professional expertise (No. 202)" (2002), Jyväskylän yliopisto.
  51. Young-Sup Hyun, "Landscape of human resource development research in Korea: results from author co-citation network analysis", Human Resource Development International, 18(5), pp.446~463 (2015), Informa UK Limited[DOI]
  52. Ronald L. Jacobs, "Human resource development as an interdisciplinary body of knowledge", Human Resource Development Quarterly, 1(1), pp.65~71 (1990), Wiley[DOI]
  53. John Jerrim, "What happens when econometrics and psychometrics collide? An example using the PISA data", Economics of Education Review, 61, pp.51~58 (2017), Elsevier BV[DOI]
  54. Chang-Wook Jeung, "The contributions of human resource development research across disciplines: A citation and content analysis", Human Resource Development Quarterly, 22(1), pp.87~109 (2011), Wiley[DOI]
  55. Jones, M. M., "Assessing research impact: An international review of the Excellence in Innovation for Australia Trial" (2013)
  56. Kirkpatrick, D., "Evaluating training programs: The four levels" (2006), Berrett-Koehler Publishers
  57. Kirkpatrick, D. L., "Evaluating training programs: The four levels" (1994), Berrett-Koehler
  58. Koppes, L. L., "Historical perspectives in industrial and organizational psychology" (2014), Psychology Press
  59. LaLonde, R. J., "Evaluating the econometric evaluations of training programs with experimental data", The American Economic Review, 76(4), pp.604~620 (1986)
  60. Lang, C., "Handbook of learning analytics" (2017), Society for Learning Analytics and Research
  61. Lawler III, E. E., "HR metrics and analytics–uses and impacts", Human Resource Planning Journal, 27(4), pp.27~35 (2004)
  62. Susan A. Lynham, "The General Method of Theory-Building Research in Applied Disciplines", Advances in Developing Human Resources, 4(3), pp.221~241 (2002), SAGE Publications[DOI]
  63. Alessandro Margherita, "Human resources analytics: A systematization of research topics and directions for future research", Human Resource Management Review (2021), Elsevier BV[DOI]
  64. Mark, M. M., "Evaluation: An integrated framework for understanding, guiding, and improving policies and programs" (2000), Jossey-Bass
  65. Scott E. Maxwell, "Bias in Cross-Sectional Analyses of Longitudinal Mediation: Partial and Complete Mediation Under an Autoregressive Model", Multivariate Behavioral Research, 46(5), pp.816~841 (2011), Informa UK Limited[DOI]
  66. Derrick McIver, "A strategic approach to workforce analytics: Integrating science and agility", Business Horizons, 61(3), pp.397~407 (2018), Elsevier BV[DOI]
  67. Dickson Mdhlalose, "An Evaluation of the Impact of Training and Development on Organisational Performance: A Case Study of the Gauteng Provincial Department of Economic Development", Journal of Human Resource and Sustainability Studies, 08(01), pp.48~74 (2020), Scientific Research Publishing, Inc.[DOI]
  68. Dickson Mdhlalose, "An Evaluation of the Impact of Training and Development on Organisational Performance: A Case Study of the Gauteng Provincial Department of Economic Development", Journal of Human Resource and Sustainability Studies, 08(01), pp.48~74 (2020), Scientific Research Publishing, Inc.[DOI]
  69. Muchinsky, P. M., "Psychology applied to work: An introduction to industrial and organizational psychology", pp.2000, Wadsworth
  70. Kim F. Nimon, "Improving the Rigor of Quantitative HRD Research: Four Recommendations in Support of the General Hierarchy of Evidence", Human Resource Development Quarterly, 26(3), pp.231~247 (2015), Wiley[DOI]
  71. RAYMOND A. NOE, "THE INFLUENCE OF TRAINEE ATTITUDES ON TRAINING EFFECTIVENESS: TEST OF A MODEL", Personnel Psychology, 39(3), pp.497~523 (1986), Wiley[DOI]
  72. Nowack, K. M., "360-degree feedback: The whole story", Training & Development, 47(1), pp.69~73 (1993)
  73. Jonathan Passmore, "SOAP‐M: a training evaluation model for HR", Industrial and Commercial Training, 44(6), pp.315~325 (2012), Emerald[DOI]
  74. Ted A. Paterson, "Revisiting the rigor-relevance relationship: An institutional logics perspective", Human Resource Management, 57(6), pp.1371~1383 (2018), Wiley[DOI]
  75. Michael Quinn Patton, "Overview: Language matters", New Directions for Evaluation, 2000(86), pp.5~16 (2000), Wiley[DOI]
  76. Pease, G., "Human capital analytics: How to harness the potential of your organization's greatest asset (Vol. 64)" (2012), John Wiley & Sons
  77. Andrew M. Pettigrew, "Longitudinal Field Research on Change: Theory and Practice", Organization Science, 1(3), pp.267~292 (1990), Institute for Operations Research and the Management Sciences (INFORMS)[DOI]
  78. Clara C. Pratt, "Measuring Program Outcomes: Using Retrospective Pretest Methodology", American Journal of Evaluation, 21(3), pp.341~349 (2000), SAGE Publications[DOI]
  79. Arthur J. Reynolds, "Quasi-Experimental Estimates of the Effects of a Preschool Intervention", Evaluation Review, 19(4), pp.347~373 (1995), SAGE Publications[DOI]
  80. Óscar Martín Rodríguez, "Do course evaluation systems have an influence on e-learning student satisfaction?", Higher Education Evaluation and Development, 13(1), pp.18~32 (2019), Emerald[DOI]
  81. Rosenbaum, P. R., "The central role of the propensity score in observational studies for causal effect", Biometrika, 70(1), pp.41~55 (1983)[DOI]
  82. Rosenberg, M. J., "Handbook of Performance Technology", pp.1999, Jossey-Bass
  83. Andy Rowe, "Rapid impact evaluation", Evaluation, 25(4), pp.496~513 (2019), SAGE Publications[DOI]
  84. Russ-Eft, D., "Research in organizations: Foundations and methods of inquiry", pp.75~95 (2005), Berrett-Koehler Publishers
  85. Sally Sambrook, "‘No, I didn't want to be part of HR’", Human Resource Development International, 1(2), pp.171~188 (1998), Informa UK Limited[DOI]
  86. Scriven, M., "An Introduction to Meta-Evaluation", Educ Prod Rep., ~ (1969)
  87. Spector, P. E., "Industrial and organizational psychology: Research and practice" (2021), John Wiley & Sons
  88. Stanley, L., "Making it Count: The Improvement of Social Research and Theory" (1985), University of California Press
  89. Laurie Stevahn, "Establishing Essential Competencies for Program Evaluators", American Journal of Evaluation, 26(1), pp.43~59 (2005), SAGE Publications[DOI]
  90. Stufflebeam, D. L., "Evaluation Theory, Models, and Applications" (2007), Jossey-Bass, An Imprint of Wiley
  91. Swanson, R. A., "Human resource development: Performance is the key", Human Resource Development Quarterly, 6(2), pp.207~213 (1995)
  92. Phyllis Tharenou, "A review and critique of research on training and organizational-level outcomes", Human Resource Management Review, 17(3), pp.251~273 (2007), Elsevier BV[DOI]
  93. 이영희, "난임 여성의 난임 관련 삶의 질 영향 요인", 한국모자보건학회지, 23(3), pp.191~201 (2019), 한국모자보건학회[DOI]
  94. Tomé, E., "The Future of HRD, Volume II", pp.247~265 (2020), Palgrave Macmillan
  95. Walter W. Tornow, "Perceptions or reality: Is multi-perspective measurement a means or an end?", Human Resource Management, 32(2-3), pp.221~229 (1993), Wiley[DOI]
  96. Richard J. Torraco, "What HRD Is Doing—What HRD Should be Doing: The Case for Transforming HRD", Human Resource Development Review, 19(1), pp.39~65 (2020), SAGE Publications[DOI]
  97. Aizhan Tursunbayeva, "People analytics—A scoping review of conceptual boundaries and value propositions", International Journal of Information Management, 43, pp.224~247 (2018), Elsevier BV[DOI]
  98. Greg G. Wang, "A systems approach to measuring return on investment for HRD interventions", Human Resource Development Quarterly, 13(2), pp.203~224 (2002), Wiley[DOI]
  99. Worthen, B. R., "Program evaluation: Alternative approaches and practical guidelines" (1997), Longman
  100. Yoon, S. W., "Human Resource Development in South Korea", pp.159~180 (2020), Palgrave Macmillan

관련 논문AI추천

현업 HRD 담당자들의 Kirkpatrick 평가 모형에 대한 인식: 적용 현장에서의 장점, 한계, 개선 방향을 중심으로우성미, 정은정, 성세실리아한국인력개발학회 · HRD연구2016 · 제18권 제3호HRD 평가 국내 연구동향: 2007~2016년 학술지 게재 논문을 중심으로박소연한국인력개발학회 · HRD연구2017 · 제19권 제2호조직 상황을 고려한 HRD 평가 모형의 활용: 조직의 HRD 수준과 평가력을 중심으로박소연HRD정책연구소 · 휴먼웨어연구2022 · 제5권 제1호HRD 평가의 미래에 대한 델파이 연구박소연한국인력개발학회 · HRD연구2016 · 제18권 제4호HRD 프로그램 평가에의 논리주도적 평가체제 적용가능성 탐색박소연한국기업교육학회 · 기업교육과인재연구2007 · 제9권 제2호HRD 프로그램 평가의 질이 평가결과 활용에 미치는 영향박소연한국인력개발학회 · HRD연구2009 · 제11권 제2호

이 간행물의 다른 논문 (10건)

상사의 임파워링 리더십과 조직구성원의 창의성 관계에서 심리적 안전감과 직무 자율성의 매개효과김지혜, 김준희, 이재은pp. 1-29직업상담사의 직무만족과 직무자율성, 경력개발지원 및 전문직업성의 구조적 관계김민규pp. 31-58대학교원의 교수역량 교육요구도 분석김인숙pp. 59-80지방자치단체 관리자의 개발 리더십과 부하 직원의 경력 몰입의 관계에서 자기주도학습 능력의 조절 효과박상오, 배을규, 이명숙pp. 81-109경영진의 인적자원개발지원과 조직 효과성의 관계: HR부서 중요성 인식의 매개효과와 조직 공정성의 조절된 매개효과 분석주재홍, 송지훈pp. 111-139
원문 보기