Analysis of the realization of the quantitative goals of research and technology in the sixth five-year program of economic, social and cultural development

Document Type : Policy Paper

Authors

1 Department of Policy Evaluation and STI Monitoring, National Research Institute for Science Policy (NRISP), Tehran, Iran

2 Department of Policy Science and Research, National Research Institute for Science Policy (NRISP), Tehran, Iran

Abstract

The continuous monitoring and evaluation of research and technology provides a basis for policy makers to deal with evidence-based policymaking or reforming research and technology policies with a comprehensive view. Based on this, the main goal of this research is to analyze the extent to which the quantitative goals of research and technology have been achieved in the sixth development plan based on a systematic approach under the four categories of input, output, consequence and impact indicators and subsequently to extract key lessons in order to prepare the document for the country's future development plans. To this end, the qualitative methodology of document study has been used for the purpose of indexing analysis of performance evaluation of the sixth development program in the field of research and technology. The findings of the research indicate that from the perspective of conceptual design, the indexing system of research and technology under the sixth development plan lacks sufficient balance. In the final part, it is emphasized that as an alternative to the outdated approach of using absolute indicators, the use of relative and combined indicators brings the possibility of more accurate evaluations of the suitability, efficiency, effectiveness and usefulness of research and technology. Also, the policy makers should provide solutions to focus more on the long-term impact of research and technology at the community level by using appropriate indexing.

Keywords

Main Subjects

References

References
Aken, J. E. V., & Romme, A. G. L. (2012). A design science approach to evidence-based management. In D. M. Rousseau (Ed.), The Oxford handbook of evidence-based management, Oxford library of psychology. Oxford: Oxford Academic. [DOI:10.1093/oxfordhb/9780199763986.013.0003]
Ali, A., Modi Owied, A. M., Virginia, P., Ruth, E., & Abdulellah, A. T. (2020). Using logic model and key performance indicators to construct a field hospital for Coronavirus pandemic cases. [Unpublished] [DOI:10.21203/rs.3.rs-102321/v1]
Amiran, H. (2003). [Performance measurement, dos and don’ts (Persian)]. Tadbir, 136, 77-80. [Link]
Bazargan Harandi, A., & Ferasatkhah, M. (2017). [Monitoring and evaluation in higher education (Persian)]. Tehran: Samt. [Link]
Cornell University, INSEAD., &WIPO. (2021). Global Innovation Index 2018: Energizing the world with innovation. Geneva: World Intellectual Property Organization (WIPO). [Link]
Dadd, D., & Hinton, M. (2022). Performance measurement and evaluation: Applying return on investment (ROI) to human capital investments. International Journal of Productivity and Performance Management, Vol. ahead-of-print No. ahead-of-print. [DOI:10.1108/IJPPM-10-2021-0573]
Dresch, A., Lacerda, D. P., & Antunes, J. A. V. (2015). Design science research. In A. Dresch, D. P. Lacerda, & J. A. V. Antunes (Eds.), Design science research (pp. 67-102). Cham: Springer.‏ [DOI:10.1007/978-3-319-07374-3_4]
European Commission. (2014). Indicators for monitoring and evaluation: A practical guide. Brussels: European Commission.[Link]
Farazkish, M. (2016). [Designing an evaluation model for Science, Technology and Innovation process of Iranian governmental organizations (Persian)] [PhD dissertation]. Tehran: Tarbiat Modares University. [Link]
Fartash, K., Elyasi, M., Ghazinoori, S. S., & Tabatabeian, S. H. (2017). [Policy learning in Iran’s technology and innovation development (the study of Third, Fourth and Fifth Development Plan regulations) (Persian)]. Innovation Management Journal, 6(2), 1-30. [Link]
Ghazinoory, S., & Farazkish, M. (2018). [A modal for STI national evaluation based efficiency, effectiveness and Utility index (Persian)]. Strategic Studies of Public Policy, 8(27), 205-229. [Link]
Ghazinoory, S., Farazkish, M., Nasri, S., & Mardani, A. (2021). Designing a science, technology, and innovation (STI) evaluation dashboard: A comprehensive and multidimensional approach. Technology Analysis & Strategic Management, 1-19. [DOI:10.1080/09537325.2021.1990877]
Gholami, Z., Arasteh, H. R., Naveh Ebrahim, A., & Zein Abadi, H. R. (2018). [Designing a model for universities’ research functions with auxiliary industry orientation (Persian)]. Strategic Studies of Public Policy, 8(27), 231-253. [Link]
Godin, B. (2004). Measurement and statistics on science and technology: 1920 to the Present. London: Routledge. [DOI:10.4324/9780203481523]
Griffin, G. P., Radtke, A. R., Metsker-Galarza, M., Stoeltje, G., Geiselbrecht, T., & Ettelman, B., et al. (2020). A phased logic model approach to public involvement performance measurement. SocArXiv gjr9h, Center for Open Science. [DOI:10.31235/osf.io/gjr9h]
ISC. (2017). [National ranking system of Islamic world science reference base (Persian)]. Shiraz: ISC. [Link]
Kheradmandnia, S., & Faghihi, M.(2015). [Familiarity with citation analysis indicators in scientometrics (Persian). Tehran: Islamic Parliament Research Center of The Islamic Republic Of Iran. [Link]  
Mahmoudi, M., Karimi, M. H., & Zamani, M. (2013). [An overview of performance evaluation models and statistics of the basic challenges in their application (Persian)]. Standard and Quality Management Quarterly, 3(7), 20-37. [Link]
Manual, C. (1995). The measurement of scientific and technological activities: Manual on the measurement of human resources devoted to S&T. Brussels: Luxembourg.[Link]
Mehrabi, M., & Manouchehri, A. (2000). [Research institutions of the country (public sector) (Persian)]. Tehran: Ministry of Science Research and Technology. [Link]
Ministry of Science Research and Technology. (2017). [Priority communicated to the Minister of Science, Research and Technology / Research, Program and Budget Organization (Persian)]. Tehran: Ministry of Science Research and Technology.
Ministry of Science Research and Technology. (2021). [Performance report letter from the Ministry of Science, Research and Technology to the Presidential Institution (Persin)]. Tehran: Ministry of Science Research and Technology.
Ministry of Science Research and Technology. (2021). [The report of the indicators of the Ministry of Science, Research and Technology based on the performance of the 11th and 12th government (Persian)]. Tehran: Ministry of Science Research and Technology.
Montazer, G., & Farazkish, M. (2020). [Chronological evaluation of Iran’S top universities from the input indicators in the recent fifty years (Persian)]. Iranian Journal of Engineering Education, 22(87), 91-111.[Link]
Montazer, Gh. A., Sharanji, M., Morasipor, H., & Farazkish, M. (2019). [Sanandaj manual: The national evaluation model for research institutions. (Persian)]. Tehran: University Publication Center. [Link]
Mytelka, L. K., & Smith, K. (2002). Policy learning and innovation theory: An interactive and co-evolving process. Research Policy, 31(8-9), 1467-1479. [DOI:10.1016/S0048-7333(02)00076-8]
Nasehi, A. (2006). [A look at the state of science and technology in the country ((manpower indicators) (Persian)]. Library And Information Science, 9(3), 68-85. [Link]
Noroozi Chakoli, A., Ghazavi, R., & Taheri Dolatabadi, B. (2016). [Valuation of research evaluation indicators in different areas of science in Iran (Persian)]. Journal of Science and Technology Policy, 8(4), 31-40. [Link]
Organization for Economic Co-operation and Development (OECD). (1999). Technology Balance of Payments (TBP) Manual. Paris: Organization for Economic Co-operation and Development (OECD). [Link]
Organization for Economic Co-operation and Development (OECD). (2015). Frascati manual 2015: Guidelines for collecting and reporting data on research and experimental development. Paris: Organization for Economic Co-operation and Development (OECD). [Link]
Organization for Economic Co-operation and Development (OECD). (2005). Oslo manual 2005: Guidelines for collecting and interpreting innovation data. Paris: Organization for Economic Co-operation and Development (OECD). [Link]
Organization for Economic Co-operation and Development. (2009). OECD patent statistics manual. Paris: Organization for Economic Co-operation and Development (OECD). [Link]
Planning and Budget Organization. (2018). [A collection of reports on the performance of the Law o The Sixth Development Plan (Persian)]. Tehran: Planning and Budget Organization. [Link]
Planning and Budget Organization. (2019). [A collection of reports on the performance of the Law o The Sixth Development Plan (Persian)]. Tehran: Planning and Budget Organization. [Link]
Planning and Budget Organization. (2020). [A collection of reports on the performance of the Law o The Sixth Development Plan (Persian)]. Tehran: Planning and Budget Organization. [Link]
Rahimi, T. (2006). [New model of organizational performance evaluation (Persian)]. Tadbir, 171, 22-27.
Sadeqi Fasai, S., & Erfanmanesh, I. (2015). [Methodological principles of documentary research in social sciences; Case of study: Impacts of modernization on Iranian family (Persian)]. Rahbord-e-Farhang, 8(29), 61-91. [Link]
Sanderson, I. (2002). Evaluation, policy learning and evidence‐based policy making. Public Administration, 80(1), 1-22. [DOI:10.1111/1467-9299.00292]
Supreme Council of Science, Research and Technology. (2016). [Executive regulation of the country’s science, technology and innovation monitoring and evaluation system (Persian)]. Tehran:Supreme Council of Science, Research and Technology.
Supreme Council of Science, Research and Technology. (2018).[Science and technology monitoring reportm (Persian]. Tehran: Scientific Policy Research Center of the Country.
Tabatabaeian, H., Faateh, M., & Raad, M. H. (2009). [ Evaluating implementation of science and technology policies in public and ministries’ research centers (Persian)]. Journal of Science and Technology Policy, 2(3), 61-75. [Link]
Tofigh, F. (2003). [Budgeting in Iran (issues and challenges): Feasibility assessment of economic budget preparation (Persian)]. Tehran: Islamic Parliament Research Center of The Islamic Republic of Iran.
Vice President of Research and Technology of the Ministry of Science, Research and Technology. (2013). [The results of evaluating the research and technology performance of universities, research units and science and technology parks affiliated to the Ministry of Science, Research and Technology (Persian)]. Tehran: Vice President of Research and Technology of the Ministry of Science, Research and Technology.
Vice President of Research and Technology of the Ministry of Science, Research and Technology. (2013). [Summary of the research and technology performance of the country’s research units in 2012 (Persian)]. Tehran: Vice President of Research and Technology of the Ministry of Science, Research and Technology.
Vice President of Research and Technology of the Ministry of Science, Research and Technology. (2017). [Research and technology performance of universities, research institutes and science and technology centers in 2013 (Persian)]. Tehran: University Publication Center.
Strategic Studies of public policy
Volume 12, Issue 44
December 2022
Pages 214-236

Files

Share

How to cite

Statistics