HRD 프로그램 평가의 질이 평가결과 활용에 미치는 영향
The effect of quality of evaluation on utilization of HRD program evaluation results
0
조회
0
다운로드
10
인용
0
참고문헌
키워드
초록
평가가 프로그램에 대한 개선과 판단이라는 본질적인 기능을 수행하기 위해서는 평가결과의 활용도를 높일 필요가 있다. 본 연구는 HRD 프로그램 평가의 질이 프로그램 평가 결과에 영향을 미치는 영향을 분석함으로써 HRD 부문에서의 평가결과 활용 제고를 위한 시사점을 도출하는 것을 목적으로 한다. 이를 위해 15개 기업의 HRD 담당자 188명을 대상으로 설문조사를 실시하여, 현재 HRD 프로그램 평가 결과의 활용 수준을 점검하고 평가의 질이 평가결과 활용에 미치는 영향력을 분석하였으며, 주요 결과는 다음과 같다. 첫째, HRD 프로그램 평가 결과는 프로그램에 대한 학습을 위해 가장 많이 활용되고 있다. 즉, 평가를 통해 프로그램 운영 모니터링을 실시함으로써 프로그램 자체를 이해하는 데 도움을 주고 있으나, 상대적으로 프로그램과 관련한 판단 혹은 설득을 위한 활용 수준은 낮다고 할 수 있다. 둘째, HRD 프로그램 평가의 질은 평가결과 활용의 35.4%를 설명하고 있으며, 특히 정확성과 유용성이 유의미한 변수로 나타났다. 즉, 평가결과의 활용도를 높이기 위해서는 평가가 정확하게 이루어지고 유용한 정보를 제공할 필요가 있다. 한편 보다 구체적으로는 평가결과 활용의 유형에 따라 이에 영향을 미치는 변인이 다르게 나타났는데, 이는 평가결과 활용도를 높이기 위해서는 사전에 평가 목적을 구체화하고 평가 시에 이를 고려하여 평가를 실시할 필요가 있음을 보여준다.
Abstract
To evaluation effectively play it's roles, improvement of HRD program and judgement on it, utilization of the evaluation results should be first considered. The purpose of this study is to imply how to promote the utilitzation of HRD program evaluation results by analyzing the effect of quality of evaluation on it. Surveys were conducted with 188 HRD practitioners from 15 large enterprises. The findings of study are as follows. First, HRD evaluation results were utilized conceptual type to understand the program itself. HRD program could be monitored by evaluation activities and the results of this type of evaluation could provide detailed information about program itself. However instrumental utilization and symbolic utilization are less activated. Second, the quality of evaluation explained 35.4% of utilization of HRD program evaluation and specially accuracy and utility were significant factor that effect on utilization. To promote utilization of evaluation result evaluation should be conducted accurately and the evaluation information should be useful. The factor that effect on utilization were different in type of utilization so the purpose of evaluation should be considered when evaluation planning to promote utilization of HRD program evaluation result.
참고문헌 (52)
- 강영철, "공공조직 구성원의 성과평가결과 활용에 대한 인식과 영향요인 분석: 조직특성적 요인을 중심으로", 한국정책과학학회보, 12(3), pp.245~273 (2008), 한국정책과학학회
- 국무조정실, "정부업무평가기본계획안(2007-2009)", ~ (2006)
- 노유진, "한국정부에 있어서 정책평가결과 활용의 영향요인과 활용유형의 특성", 정책분석평가학회보, 14(3), pp.226~268 (2004), 한국정책분석평가학회
- 박소연, "기업의 조직풍토가 프로그램 평가 결과 활용에 미치는 영향", 인력개발연구, 7(2), pp.27~46 (2005)
- 박소연, "HRD 프로그램의 반응평가에 대한 메타평가 연구", 기업교육연구, 10(2), pp.119~137 (2008), 한국기업교육학회
- 배을규, "기업 교육훈련 평가정보에 대한 이해관계자의 인식수준 비교분석", 농업교육과 인적자원개발, 37(1), pp.175~198 (2005), 한국농·산업교육학회
- 배호순, "프로그램평가론" (1994), 서울: 원미사
- 이윤식, "기관평가 결과 활용의 개선방안에 관한 연구: ICT활용과 평가결과 활용의 관계를 중심으로", 정책분석평가학회보, 12(2), pp.53~83 (2002), 한국정책분석평가학회
- 이혜영, "평가영향의 관점에서 평가결과 활용에 관한 연구: 지방자치단체 합동평가를 중심으로", 한국사회와 행정연구, 16(1), pp.131~149 (2005), 서울행정학회
- 정명주, "정책평가결과활용에 관한 연구", 한국행정학회 2000년도 춘계학술대회, pp.439~445 (2000)
- Alkin,M.C., "A Guide for Evaluation Decision makers" (1985), Beverly Hills, CA: Sage
- Alkin,M.C., "Title I evaluation: Utility and factors influencing use. Northirdge" (1982), CA: Educational Evaluation Association
- American Evaluation Association, "Guiding principles for evaluators. In Guiding principles for evaluators", evaluation, 34, pp.19~26 (1995)
- Utilization of evaluation in formation: A case study approach investigation factors related to evaluation utilization in a arge state agency, "Barrios,N.B.", the annual meeting of the American Evaluation Association, Boston, ~ (1987)
- Bullock,C.D., "A Study of the Utility of Results from the 1992 Trial State Assessment(TSA) in Reading for State-Level Administrators of Assessment", Educational Evaluation and Policy Analysis, 20(1), pp.47~51 (1998)
- Boettcher,D.L., "A follow-up of two guidance program evaluation projects assessing the degree of implementation of recommendations and the influence of factors which affect utilization" (1991), Boston College Graduate School of Arts and Sciences department of education
- Caplan,N., "Social research and national policy: What gets used, by whom, for what purposes, and with what effects, Evaluation studies review annual. (Vol.2)" (1977), Beverly Hills, CA: Sage
- Chelimsky,E., "The definition and measurement of evaluation quality as a management tool", New directions for program evaluation, 18통권 : 18, pp.113~126 (1983)
- Cousins,J.B., "Current empirical research on evaluation utilization", Review of Educational Research,, 통권 : 56, pp.331~364 (1986)
- Garaway,G.B., "Participatory evaluation", Studies in educational evaluation, 통권 : 21, pp.85~102 (1995)
- Greene,J.G., "Stakeholder participation and utilization in program evaluation", Evaluation Review, 통권 : 12, pp.91~116 (1988)
- Johnson,R.B., "Toward ad theoretical model of evaluation utilization", Evaluation and program planning, 21(1), pp.93~110 (1998)
- Joint Committee on Standards for Educational Evaluation, "The program evaluation standards (2nd ed.)" (1994), Thousand Oaks, CA: Sage
- Kim,H.B., "The politics of evaluation for human resource development: A stakeholder perspective", University of Georgia, Georgia, ~, pp.Unpublished doctoral dissertation (2004)
- Evaluation utilization: An annotated bibliography, "King,J.A.", NIE grant, ~, pp.80-0082 (1981)
- Kirkhart,K., "Reconceptualizing evaluation use: An integrated theory of influence,in The expending scope of evaluation use. New directions for evaluation 88", pp.5~24 (2000), San Francisco, CA: Jossey-Bass
- Larson,R., "On evaluating evaluation", Policy sciences, 16(2), pp.147~163 (1983)
- Leviton,L.C., "Research on the utilizations: A review and synthesis", Evaluation Review, 5(4), pp.524~548 (1981)
- McCormick,E.R., "Factors influencing the use of evaluation results", Doctor, pp.1997
- Improving evaluation practices: Best practice guidelines for evaluation and background paper, "OECD", Paris, OECD., ~ (1999)
- Towards a meta-model of evaluation utilization, "Owen,J.M.", the annual meeting of the American evaluation association, Seattle, WA, ~ (1992)
- Patton,M.Q., "Utilization-focused Evaluation" (1978), Beverly Hills, CA: Sage
- Patton,M.Q., "Towards utility in review of multivocal literatures", Review of educational research, 61(3), pp.287~292 (1991)
- Phillips,J.J., "HRD Trends Worldwide: Shared Solutions to compete in a global economy" (1999), TX: Gulf Publishing Company
- Preskill,H., "The cultural lens: Bringing utilization into focus, In New directions for program evaluation. 49" (1991), San Francisco, CA: Jossey-Bass
- Rossi,P.H., "Standards for evaluation practice", New direction for program evaluation, 통권 : 15 (1982)
- Scriven,M., "The methodology of evaluation. In Curriculum evaluation. American Educational Research Association Monograph Series on Evaluation No. 1" (1967), Chicago: Rand McNally
- Scriven,M., "Key evaluation checklist. In Evaluation thesaurus" (1991), Thousand Oaks, CA: Sage
- Shadish,W.R., "Foundations of Program Evaluation: Theories of Practice" (1991), CA: Sage
- Shulha,L.M., "Evaluation use: Theory, research, and practice since 1986", Evaluation practice, 18(3), pp.195~208 (1997)
- Stake,R.E., "Objectives, priorities, and other judgement data", Review of educational research, 통권 : 40, pp.181~212 (1970)
- Stufflebeam,D.L., "Evaluation as enlightenment for decision making" (1968), Columbus: Ohio state university evaluation center
- Stufflebeam,D.L., "The relevance of the CIPP evaluation model for educational accountability", Journal of Research and Development in Education, 통권 : 5, pp.19~25 (1971)
- Metaevaluation(Occasional Paper No. 3), "Stufflebeam,D.L.", Kalamazoo: Western michigan university evaluation center, ~, pp.No. 3 (1974)
- The revised program evaluation standards and their correlation with the evaluation use literature, "Thompson,B.", the annual meeting of the American educational research association. New Orleans, ~ (1994)
- Turnbull,B., "The mediating effect of participation efficacy of evaluation use", Evaluation and program planning, 통권 : 22, pp.131~140 (1999)
- Turner,S.D., "Fostering utilization through multiple data-gathering methods", Studies in Educational evaluation, 통권 : 14, pp.113~133 (1988)
- Tyler,R.W., "Basic Principles of Curriculum and Instruction" (1950), Chicago: University of Chicago Press
- The usefullness of comparative product research for the use of evaluation results in curriculum development, "Van den Berg,G.", the annual meeting of the American educational research association(67th). San Francisco, CA, ~ (1986)
- Weiss,C.H., "Measuring the use of evaluation, In Evaluation studies review annual, (Vol. 7)" (1981), Beverly Hills, CA: Sage
- Weiss,C.H., "If program decisions hinged only of information", Evaluation practice, 9(3), pp.87~92 (1988)
- Worthen,B.R., "Program evaluation" (1997), NY:Longman