Ex-ante Evaluation Process for Public R&D: Korean Case and its Implications for Indonesian R&D System
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.
Abstract
A variety of approaches are being applied to improve the existing ex-ante evaluation by expert panels in publicly funded R&D. While the objective evaluation criteria are constantly being improved to screen and select the superior projects, alternative approaches such as random prioritization and logical modeling are also underway to overcome the conservative bias of reviewers and to secure disruptive innovation. This study intends to find critical implications for ex-ante evaluation of public R&D system from the comparison of Indonesia and Korea. For the comparative analysis, literature review and expert in-depth interviews are conducted on the national R&D system and the selection evaluation process. In Korea, the selection criteria of projects are legally promulgated for establishing an objective evaluation system, and at the program level, the major considerations in the planning process are specified by Presidential Decree. On the other hand, while Indonesia conducts R&D in 47 strategic fields largely by public research institutes (PRI) based on the non-competitive government contributions. This study draws out implications of institutionalizing the planning process at the level of program, and of increasing the ratio of contract-based competitive funding at the level of project in the national R&D portfolio.
참고문헌 (35)
- Arrow, K., "The rate and direction of inventive activity", pp.609~625 (1962), Princeton University Press
- Brezis, E. S., "Focal randomisation : an optimal mechanism for the evaluation of R&D projects", Science and Public Policy, 34(10), pp.691~698 (2007)
- Bulathsinhala, N. A., "Ex-ante evaluation of publicly funded R&D projects : Searching for exploration", Science and Public Policy, 42, pp.162~175 (2015)
- Duch-Brown, N., "Assessing the assignation of public subsidies: Do the experts choose the most efficient R&D projects?", World Review of Science Technology and Sustainable Development, 9(2) (2008)
- Heinze, T., "How to sponsor ground-breaking research : a comparison of funding schemes", Science and Public Policy, 35(5), pp.302~318 (2008)
- Horrobin, D. F., "Peer review of grant applications: A harbinger for mediocrity in clinical research?", The Lancet, 348, pp.1293~1295 (1996)
- Hwang, H.S., "R&D project evaluation model based on fuzzy set priority", Computers & Industrial Engineering, 35(3-4), pp.567~570 (1998)
- Johnson, R. A., "Evaluating the viability of on-going product oriented internal research and development projects: Fact or fiction?", Computers & Industrial Engineering, 29(1-4), pp.573~577 (1995)
- Klenner, P., "Ex-ante evaluation of disruptive susceptibility in established value networks—When are markets ready for disruptive innovations?", Research Policy, 43, pp.914~927 (2013)
- Klette, T. J., "Do subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies", Research Policy, 29, pp.471~295 (2000)
- Linton, J. D., "Analysis, ranking and selection of R&D projects in a portfolio", R&D Management, 32, pp.139~148 (2002)
- Martin, B., "Suppression Stories", pp.69~83 (1997), Fund for Intellectual Dissent
- National research master plan (Rencana Induk Riset Nasional) (2017-2045), "Ministry of Research, Technology and Higher Education (MORTHE), Republic of Indonesia", ~ (2017)
- Ministry of Research, Technology and Higher Education (MORTHE), Republic of Indonesia, "MORTHE Decree 36", 2018 on procedures for developing national research priorities and monitoring and evaluation mechanisms for the implementation of national research master plan, 2018
- "Prioritas Riset Nasional 2020-2024 Kebijakan untuk Mendorong Pengembangan dan Pemanfaatan Produksi Dalam Negeri" (2019)[URL]
- National research priority (Prioritas Riset Nasional) (2020-2024), "Ministry of Research, Technology and Higher Education, Republic of Indonesia", ~ (2019)
- Ministry of Research, Technology and Higher Education, Republic of Indonesia, "MORTHE Decree no. 38", 2019 on National research priority 2020-2024, 2019
- Ministry of Science and ICT, Republic of Korea, "Regulations on the Management, Etc. of National Research and Development Projects. Presidential Decree No. 28210, July 26, 2017", ~ (2017)
- Ministry of Science and ICT, Republic of Korea, "Framework Act on Science and Technology. Act No. 15556, April 17, 2018", ~ (2018)
- Ministry of Science and ICT, Republic of Korea, "Enforcement Decree of the Framework Act on Science and Technology. Act No. 28800, April 17, 2018", ~ (2018)
- Ministry of Science and ICT, Republic of Korea, "Manual on management of national R&D programs", MSIT, ~ (2020)
- Notification no. 2020 – 0324, "Ministry of Science and ICT, Republic of Korea", MSIT, ~ (2020)
- Ministry of Trade, Industry and Energy, Republic of Korea, "Notification no. 2020 – 537", MOTIE, ~ (2020)
- In search of an identity for the DRN. Final Report, "Oey-Gardiner, M.", Insan Hitawasana Sejahtera, 1~28 (2011)
- 박정민, "Measurement of Public Research Outcomes: A Technology Valuation Method", Asian Journal of Innovation and Policy, 6(2), pp.206~224 (2017), 아시아기술혁신학회[DOI]
- 박선영, "Performance Evaluation Index of TRM: A Korean Case for SMEs", Asian Journal of Innovation and Policy, 2(1), pp.63~96 (2013), 아시아기술혁신학회[DOI]
- Republic of Indonesia, "Law no. 18", 2002 on the National systems of research, development and application of science and technology, 2002
- Republic of Indonesia, "Law no. 19", 2019 on National system of science and technology, 2019
- Expert panels and peer review. In European Commission, RTD Evaluation Toolbox – Assessing the socio-economic impact of RTD policies, "Rigby, J.", Institute for Prospective Technological Studies y Joanneum Research, ~, pp.IPTS Technical Report series EUR 20382 EN (2002)
- Roper, S., "An ex ante evaluation framework for the regional benefits of publicly supported R&D projects", Research Policy, 33, pp.487~509 (2004)
- Roy, R., "The real defects of peer review and an alternative to it", 10(3), pp.73~81 (1985)
- Sampurno-Kuffal, F. H., "The Collapse of Indonesia’s Strategic Industries" (2011), Khazanah Bahari
- Setiadarma, E.G., "Understanding the Evidence-Based Policy Making (EBPM) Discourse in the Making of the Master Plan of National Research (RIRN) Indonesia 2017-2045", STI Policy Review, 9(1), pp.30~54 (2018)[DOI]
- Thee, K. W., "Indonesia’s Economy since Independence" (2012), ISEAS
- Policy Consultation on the Arrangement of Science, Technology and Innovation (STI) Governance: Coordination Mechanism, Institutional Framework & Financial System and Investment in Indonesia, "Yim, D.S.", Science and Technology Policy Institute, ~