The role of international large-scale assessment performed by international organizations in global governance and implications for Iran; Effectiveness mechanisms and functions

Document Type : Research Paper

Authors

1 PhD Student in Measurement, Faculty of Psychology and Educational Sciences, University of Tehran, Tehran, Iran.

2 Associate Professor, Faculty of Psychology and Educational Sciences, University of Tehran, Tehran, Iran.

3 Assistant Professor, Faculty of Psychology and Educational Sciences, University of Tehran, Tehran, Iran.

Abstract

The present study aims to investigate the importance, Functionalities, and effective mechanisms of international large-scale assessments and their role in global governance through the procedures. With implementing systematic documentary analysis, documents selected in a systematic procedure and then analyzed in a systematic way. Results have shown that ILSAs which perform by Co-operation and economic development organization and international association for the evaluation of educational achievement, in the last decades be as one of the most influential factors on national educational policies of countries in the world. Results about performance show that these assessments can affect as thermometer or whips over multi-layer mechanism on educational structure. The results about role of ILSAs in global governance show that performing and developing of these assessments in the last decades creates softer form of governance such as governance by information, governance by persuasion, governance by rating and ranking, governance by opinion formation, governance by comparison.

Keywords

Main Subjects


Abbasi, M., & Kiani, A. A. (2013). [A survey on globalization and its cultural impacts (Persian)]. Journal of Strategic Studies of Public Policy, 3(9), 180-94. http://sspp.iranjournals.ir/article_2556.html
Addey, C., Sellar, S., Steiner-Khamsi, G., Lingard, B., & Verger, A. (2017). The rise of international large-scale assessments and rationales for participation. Compare: A Journal of Comparative and International Education, 47(3), 434-52. [DOI:10.1080/03057925.2017.1301399]
Auld, E., Rappleye, J., & Morris, P. (2019). PISA for Development: How the OECD and World Bank shaped education governance post-2015. Comparative Education, 55(2), 197-219. [DOI:10.1080/03050068.2018.1538635]
Bahrami, S. (2015). [A critical study on global governing; the western governing or non-polar global system (Persian)]. Political and International Approaches, 6(3), 36-69. https://piaj.sbu.ac.ir/article_99314.html?lang=fa
Best, M., Knight, P., Lietz, P., Lockwood, C., Nugroho, D., & Tobin, M. (2013). The impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London. https://books.google.com/books?id=SYjfoAEACAAJ&dq
Braun, H. (2013). Prospects for the future: A framework and discussion of directions for the next generation of international large-scale assessments. In M. von Davier, E. Gonzalez, I. Kirsch, K. Yamamoto (Eds.), The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research (pp. 149-60). Dordresht: Springer. [DOI:10.1007/978-94-007-4629-9_8]
Braun, H. I., & Singer, J. D. (2019). Assessment for monitoring of education systems: International comparisons. The ANNALS of the American Academy of Political and Social Science, 683(1), 75-92. [DOI:10.1177/0002716219843804]
Carroll, P., & Kellow, A. (2011). The OECD: A study of organisational adaptation. Cheltenham: Edward Elgar Publishing. [DOI:10.4337/9780857939890]
Cresswell, J., Schwantner, U., & Waters, C. (2015). A review of international large-scale assessments in education. Paris: OECD Publishing. [DOI:10.1787/9789264248373-en]
Cussó, R., & D’Amico, S. (2005). From development comparatism to globalization comparativism: Towards more normative international education statistics. Comparative Education, 41(2), 199-216. [DOI:10.1080/03050060500037012]
Davis, K., Fisher, A., Kingsbury, B., & Engle Merry, S. (2012). Governance by indicators: Global power through quantification and rankings. Oxford: OUP Oxford. [DOI:10.1093/acprof:oso/9780199658244.001.0001]
Davoli, M., & Entorf, H. (2018). The PISA shock, socioeconomic inequality, and school reforms in Germany. Retrieved from https://www.iza.org/publications/pp/140/the-pisa-shock-socioeconomic-inequality-and-school-reforms-in-germany
Fischman, G. E., Topper, A. M., Silova, I., Goebel, J., & Holloway, J. L. (2019). Examining the influence of international large-scale assessments on national education policies. Journal of Education Policy, 34(4), 470-99. [DOI:10.1080/02680939.2018.1460493]
Ghavam, S. A., & Bahrami, S. (2013). [Global governance The dominant situation and theory in the contemporary world (Persian)]. International Relations Research Quarterly, 3(8), 9-35. https://www.magiran.com/paper/1235095
Goldmann, M. (2008). The accountability of private vs. public governance’by information’: A comparison of the assessment activities of the OECD and the IEA in the field of education. Rivista Trimestrale di Diritto Pubblico, 58(1), 41-69. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1340957
Gorur, R. (2016). Seeing like PISA: A cautionary tale about the performativity of international assessments. European Educational Research Journal, 15(5), 598-616. [DOI:10.1177/1474904116658299]
Gustafsson, J. E. (2018). International large scale assessments: current status and ways forward. Scandinavian Journal of Educational Research, 62(3), 328-32. [DOI:10.1080/00313831.2018.1443573]
Hanushek, E. A., & Woessmann, L. (2013). The role of international assessments of cognitive skills in the analysis of growth and development. In M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research (pp. 47-65). Dordrecht: Springer. [DOI:10.1007/978-94-007-4629-9_4]
Hartong, S. (2016). Between assessments, digital technologies and big data: The growing influence of ‘hidden’ data mediators in education. European Educational Research Journal, 15(5), 523-36. [DOI:10.1177/1474904116648966]
Heidaryfard, S. (2017). [Development of the concept of global governance in international relations (Persian)]. Political and International Scientific and Research Quarterly, 9(32), 147-76. http://pir.iaush.ac.ir/article_598084.html?lang=fa
Johansson, S. (2016). International large-scale assessments: What uses, what consequences? Educational Research, 58(2), 139-48. [DOI:10.1080/00131881.2016.1165559]
Jules, T. D. (2019). Big “g” and small “g”: The variable geometries of educational governance in an era of big data. International Perspectives on Education and Society, 38, 15-32. [DOI:10.1108/S1479-367920190000038002]
Kirsch, I., Lennon, M., von Davier, M., Gonzalez, E., & Yamamoto, K. (2013). On the growing importance of international large-scale assessments. In M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research (pp. 1-11). Dordrecht: Springer. [DOI:10.1007/978-94-007-4629-9_1]
Klieme, E. (2013). The role of large-scale assessments in research on educational effectiveness and school development. M. von Davier, E. Gonzalez, I. Kirsch, & K. Yamamoto (Eds.), The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research (pp. 115-47). Dordrecht: Springer. [DOI:10.1007/978-94-007-4629-9_7]
Kloepfer, M. (1998). [State information as a means of control: presented in particular on the problem of official warnings and recommendations in environmental law; Lecture given to the Berlin Legal Society on January 14, 1998 (German)]. Berlin: Walter de Gruyter. [DOI:10.1515/9783110901177]
Lehmkuhl, D. (2005). Governance by rating and ranking. Annual Meeting of the International Studies Association (ISA). Honolulu, 2-6. https://scholar.google.com/scholar?hl=en&as_sdt=0%2C5&q=Governance+by+rating+and+ranking.+Annual+Meeting+of+the+International+Studies+Association+%28ISA%29%2C+&btnG=
Lewis, S., & Lingard, B. (2015). The multiple effects of international large-scale assessment on education policy and research. Discourse: Studies in the Cultural Politics of Education, 36(5), 621-37. [DOI:10.1080/01596306.2015.1039765]
Lockhead, M. E. (2010). Does participating in international and regional assessments build assessment capacity in developing countries? An independent evaluation of IEA’s Program on the Assessment of Student Achievement (PASA). https://www.iea.nl/publications/publications/craft-education-assessment
Lockheed, M. (2012). Policies, Performance and Panaceas: the role of international large-scale assessments in developing countries. Compare-A Journal of Comparative and International Education, 42(3), 512-8. [DOI:10.1080/03057925.2012.670480]
Lockheed, M. E. (2015). Why do countries participate in international large-scale assessments? The case of PISA. Policy Research Working Papers. [DOI:10.1596/1813-9450-7447]
Lockheed, M. E., & Wagemaker, H. (2013). International large-scale assessments: Thermometers, whips or useful policy tools? Research in Comparative and International Education, 8(3), 296-306. [DOI:10.2304/rcie.2013.8.3.296]
Maddox, B. (2018). International large-scale assessments in education: Insider research perspectives. New York: Bloomsbury Academic. https://books.google.com/books?id=wpwyEAAAQBAJ&dq
Martens, K., Balzer, C., Sackmann, R., & Weymann, A. (2004). Comparing governance of international organisations: The EU, the OECD and educational policy. https://books.google.com/books?id=seqzMAAACAAJ&dq
Martens, K., & Niemann, D. (2010). Governance by comparison: How ratings & rankings impact national policy-making in education. TranState working papers. Retrieved from https://ideas.repec.org/p/zbw/sfb597/139.html
Martens, K., Niemann, D., & Teltemann, J. (2016). Effects of international assessments in education - a multidisciplinary review. European Educational Research Journal, 15(5), 516-22. [DOI:10.1177/1474904116668886]
Merry, S. E., & Conley, J. M. (2011). Measuring the world: Indicators, human rights, and global governance. Current Anthropology, 52(S3), S83-95. [DOI:10.1086/657241]
Mullis, I. V. S., & Martin, M. O. (2014). TIMMS advanced 2015 assessment frameworks. Chestnut Hill: TIMSS & PIRLS International Study Center. http://timssandpirls.bc.edu/timss2015-advanced/frameworks.html
Mullis, I. V. S., Martin, M. O., Goh, S., & Cotter, K. (2017). TIMSS 2015 Encyclopedia: Education policy and curriculum in mathematics and science. Chestnut Hill: TIMSS & PIRLS International Study Center. http://timssandpirls.bc.edu/timss2015/encyclopedia/
Mundy, K, Green, A., Lingard, B., & Verger, A. (2016). Handbook of global education policy. Hoboken: Wiley Blackwell. [DOI:10.1002/9781118468005]
Mundy, Karen. (2007). Global governance, educational change. Comparative Education, 43(3), 339-57. [DOI:10.1080/03050060701556281]
National Council on Measurement in Education. (2019). (2019). (Standards for educational and psychological testing [A. Moghdamzadeh, M. Kazemi Tabar, K. Salehi, & M. Ghorbankhani, Persian Trans]. Tehran: University of Tehran Press. http://opac.nlai.ir/opac-prod/bibliographic/5629868
Noaksson, N., & Jacobsson, K. (2003). The Production of Ideas and Expert Knowledge in OECD: The OECD Jobs Strategy in contrast with the EU employment strategy. StockholmL Score. https://books.google.com/books?id=bD4tNAAACAAJ&dq
Pons, X. (2012). Going beyond the “PISA Shock” Discourse: an analysis of the cognitive reception of PISA in six European countries, 2001-2008. European Educational Research Journal, 11(2), 206-26. [DOI:10.2304/eerj.2012.11.2.206]
Ranjbar, H., Daei Karimzadeh, S., & Marvi, A. [Global Governance; Parameters and Instruments (Persian)]. Journal of Strategic Studies of Public Policy, 3(9), 29-66. http://sspp.iranjournals.ir/article_2551.html
Ritzen, J. (2013). International Large-Scale Assessments as Change Agents. In M. von Davier, E. Gonzalez, I. Kirsch, K. Yamamoto (Eds.), The Role of International Large-Scale Assessments: Perspectives from Technology, Economy, and Educational Research (pp. 13-24). Dordresht: Springer. [DOI:10.1007/978-94-007-4629-9_2]
Rutkowski, L., Davier, M. von, & Rutkowski, D. (2013). Handbook of International large-scale assessment : Background, technical issues, and methods of data analysis. New York: CRC Press. [DOI:10.1201/b16061]
Sellar, S., & Lingard, B. (2013a). The OECD and global governance in education. Journal of Education Policy, 28(5), 710-25. [DOI:10.1080/02680939.2013.779791]
Sellar, S., & Lingard, B. (2014). The OECD and the expansion of PISA: New global modes of governance in education. British Educational Research Journal, 40(6), 917-36. [DOI:10.1002/berj.3120]
Simon, M., Ercikan, K., & Rousseau, M. (2012). Improving large-scale assessment in education: Theory, issues, and practice. New York: Routledge. [DOI:10.4324/9780203154519]
Smith, W. C. (2017). The global testing culture: Shaping education policy, perceptions and practice. Milton Park: Taylor & Francis. [DOI:10.15730/books.94]
Thrift, N. (2005). Knowing capitalism. London: Sage. https://books.google.com/books?id=DigOBiiCUgIC&dq
Tobin, M., Lietz, P., Nugroho, D., & Vivekanandan, R. Nyamkhuu, T. (2015). Using large-scale assessments of students’ learning to inform education policy: Insights from the Asia-Pacific region. Retrieved from https://unesdoc.unesco.org/ark:/48223/pf0000235469
Torney-Purta, J., & Amadeo, J. A. (2013). International large-scale assessments: Challenges in reporting and potentials for secondary analysis. Research in Comparative and International Education, 8(3), 248-58. [DOI:10.2304/rcie.2013.8.3.248]
Tröhler, D. (2015). The medicalization of current educational research and its effects on education policy and school reforms. Discourse: Studies in the Cultural Politics of Education, 36(5), 749-64. [DOI:10.1080/01596306.2014.942957]
UNESCO Institute for Statistics. (2018). The impact of large-scale learning assessment. Retrieved from https://learningportal.iiep.unesco.org/en/library/the-impact-of-large-scale-learning-assessments
UNESCO Institute for Lifelong Learning (UIL). (2014). UIL medium-term strategy (2014-2021): Laying foundations for equitable lifelong learning for all. Retrieved from https://uil.unesco.org/uil-medium-term-strategy-2014-2021-laying-foundations-equitable-lifelong-learning-all
Von Bogdandy, A., & Goldmann, M. (2008). The exercise of international public authority through national policy assessment: The OECD’s PISA policy as a paradigm for a new international standard instrument. International Organizations Law Review, 5(2), 241-98. [DOI:10.1163/157237408X412907]
Wach, E., & Ward, R., & Jacimovic, R. (2013). Learning about qualitative document analysis. Retrieved from https://www.ids.ac.uk/publications/learning-about-qualitative-document-analysis/
Wagemaker, H. (2013). International large-scale assessments: From research to policy. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of International Largescale Assessment: Background, Technical Issues, and Methods of Data Analysis (pp. 11-36). New York: Chapman and Hall/CRC. [DOI:10.1201/b16061]
Waldow, F. (2009). What PISA Did and Did Not Do: Germany after the “PISA-shock”. European Educational Research Journal, 8(3), 476-83. [DOI:10.2304/eerj.2009.8.3.476]
Ward, M., & Zoido, P. (2015). PISA for development. ZEP: Zeitschrift Für Internationale Bildungsforschung Und Entwicklungspädagogik, 38(4), 21-5. https://pdfs.semanticscholar.org/c4ac/db4b3f0315cf4c9768d744e9a57fd2de8e70.pdf
Williamson, B. (2016). Digital education governance: data visualization, predictive analytics, and ‘real-time’ policy instruments. Journal of Education Policy, 31(2), 123-41. [DOI:10.1080/02680939.2015.1035758]
Wiseman, A. W. (2010). Introduction: The advantages and disadvantages of national education policymaking informed by international achievement studies. In A. W. Wiseman (Ed.), The Impact of International Achievement Studies on National Education Policymaking (pp. xi-xxii). Bingley: Emerald Group Publishing. [DOI:10.1108/S1479-3679(2010)0000013003]
Woodward, R. (2009). The Organisation for Economic Co-operation and Development (OECD). London: Routledge. [DOI:10.4324/9780203875773]