AHP를 이용한 국방연구개발사업 메타평가 지표개발
A Study on the Development of Meta Evaluation Indicators based on AHP Technique for Defense R&D Programs
0
조회
0
다운로드
6
인용
0
참고문헌
초록
Abstract
The purpose of this study is to develop Meta Evaluation Indicators for Defense R&D Programs in Korea. At first, the four components of this meta evaluation model were designed, which are evaluation context, evaluation input, evaluation process and evaluation outcome. And fifty two indicators for this meta evaluation were developed by experts who performed evaluations for Defense R&D Programs. The reliability of components and items was verified by Cronbach’s α coefficient. It was over 0.6 in all areas. The validity of components and items was verified by Factor Analysis. Analytic Hierarchy Process method was used in assigning the evaluation weight. The survey of twenty two evaluators participated in Defense R&D Programs showed that the Consistency Ratio was under 0.1 in evaluation components and items. In this study, an objective and reasonable set of Defense R&D Meta Evaluation Indicators was developed to increase the responsibility of Defense R&D Programs and improve the quality of evaluation results.
참고문헌 (21)
- 과학기술부, "국가연구개발사업 등의 성과 평가 및 성과관리에 관한 법률", 법률 제7808호, ~ (2005)
- 김명수, "공공정책 평가론", pp.194~199 (2000), 박영사
- 노유진, "우리나라 정부부처에 있어서 정책평가결과의 저활용요인에 관한 연구", 행정논총, 43(4), pp.245~299 (2005), 한국행정연구소
- 류영수, "기술영향평가의 메타평가 모형 개발 및 적용", 박사, pp.2007
- 박종수, "정보화 사업 메타평가를 위한 CIPOU 모형 개발", 박사, pp.2003
- 방위사업청, "방위력개선사업관리규정", 훈령, 제13호, ~ (2006)
- 이찬구, "영국의 범부처간 과학기술정책 평가제도 - 메타평가와 한국에의 시사점 -", 한국행정논집, 15(4), pp.809~833 (2003), 한국정부학회
- 조근태, "앞서가는 리더 들의 계층분석적 의사결정" (2003), 동현출판사
- 조근태, "계층 분석적 의사결정" (2005), 동현출판사
- 홍형득, "국가연구개발사업의 메타평가에 관한 실증연구 - 선도기술개발사업을 중심으로 -", 한국행정논집, 14(4), pp.867~892 (2002), 한국정부학회
- American Evaluation Association, "Guidelines for Evaluator" (1995), San francisco, Jossey-Bass
- Cook T. D, "Metaevaluation Research", Evaluation Quarterly, 2(1), pp.5~55 (1978)
- Joint Committee on Standards for Educational Evaluation, "The Programme Evaluation Standards" (1994), Thousand Oaks, Sage Publications
- Hong H.D, "Meta-evaluation of National Large-Scale R&D Programs：A Comparison of Evaluation Systems of 6 National R&D Programs", University of Manchester, ~ (2000)
- Larson, "On Evaluating Evaluation", Policy Sciences, 16(2) (1983)
- Leviton, "Research on the Utilization of Evaluations：A Review and Synthesis", Evaluation Review, 5(4) (1981)
- OECD, "Improving Evaluation Practices- Best Practice Guidelines for Evaluation and Background Paper", ~ (1999)
- Saaty,T.L, "The Analytic Hierarchy" (1980), McGraw-Hill, New York.
- Scriven M, "Evaluation Thesaurus" (1991), Newbury Park, CA, Sage Publications
- Stevenson, "Longabaugh and Dwight N. Mcneil" (2000), Beverly Hills, CA, Sage Publications
- Stufflebeam L, "Metaevaluation：Concepts, Standard and Uses" (1981), Educational Evaluation Methodology, The JHU Press