This article assesses the ability of the European Commission’s current approach to policy evaluation to evaluate gender mainstreaming and, in turn, other cross-cutting social agendas (Articles 8–10 TFEU). Taking European Union research policy as a case study, through our analysis, we reveal mismatches between current evaluation standards adopted within the Better Regulation framework and requirements for effectively assessing progress towards cross-cutting social objectives, such as gender equality. The article concludes with a series of recommendations to overcome the identified shortcomings. Our analysis constitutes a key contribution to the development of feminist scholarship on the post-implementation phase of the policy process.
Abels, G. (2012) Research by, for and about women: gendering science and research policy, in G. Abels and J.M. Mushaben (eds) Gendering the European Union: New Approaches to Old Democratic Deficits, Basingstoke: Palgrave Macmillan, pp 187–207.
Allwood, G. (2013) Gender mainstreaming and policy coherence for development: unintended gender consequences and EU policy, paper presented at the Women’s Studies International Forum.
Braithwaite, M. (2000) Mainstreaming gender in the European structural funds, paper presented at the Mainstreaming Gender in European Public Policy Workshop, University of Wisconsin-Madison, http://eucenter.wisc.edu/Conferences/Gender/braith.htm
Bustelo, M. (2003) Evaluation of gender mainstreaming: ideas from a meta-evaluation study, Evaluation, 9(4): 383–403. doi: 10.1177/135638900300900402
Bustelo, M. (2017) Evaluation from a gender+ perspective as a key element for (re)gendering the policymaking process, Journal of Women, Politics & Policy, 38(1): 84–101. doi: 10.1080/1554477X.2016.1198211
Bustelo, M. and Verloo, M. (2009) Grounding policy evaluation in a discursive understanding of politics, in E. Lombardo, P. Meier and M. Verloo (eds) The Discursive Politics of Gender Equality. Stretching, Bending and Policy-making, London: Routledge, pp 153–68.
Caffrey, L. and Munro, E. (2017) A systems approach to policy evaluation, Evaluation, 23(4): 463–78. doi: 10.1177/1356389017730727
Callerstig, A.-C. (2014) Can public procurement be an instrument for policy learning in gender mainstreaming?, Offentlig förvaltning. Scandinavian Journal of Public Administration, 18(4): 51–71.
Cavaghan, R. (2012) Gender mainstreaming as a knowledge process: towards an understanding of perpetuation and change in gender blindness and gender bias, doctoral thesis, University of Edinburgh, UK.
Cavaghan, R. (2013) Gender mainstreaming in the DGR as a knowledge process: epistemic barriers to eradicating gender bias, Critical Policy Studies, 7(4): 407–21. doi: 10.1080/19460171.2013.804330
Cavaghan, R. (2017) Making Gender Equality Happen: Knowledge, Change and Resistance in EU Gender Mainstreaming, London: Routledge.
Debusscher, P. (2011) Mainstreaming gender in European Commission development policy: conservative Europeanness?, paper presented at the Women’s Studies International Forum.
Debusscher, P. and Van der Vleuten, A. (2012) Mainstreaming gender in European Union development cooperation with sub-Saharan Africa: promising numbers, narrow contents, telling silences, International Development Planning Review, 34(3): 319–38. doi: 10.3828/idpr.2012.19
De Gregorio Hurtado, S. (2017) A critical approach to EU urban policy from the viewpoint of gender, Journal of Research in Gender Studies, 7(1): 200–17.
Engeli, I. and Mazur, A. (2018) Taking implementation seriously in assessing success: the politics of gender equality policy, European Journal of Politics and Gender, 1(1/2): 111–29. doi: 10.1332/251510818X15282097548558
Espinosa, J. (2013) Promoting human rights and gender sensitive evaluations: key ideas for evaluating gender equality results, discussion paper presented at UN Women Expert Group Meeting on Gender Mainstreaming Approaches in Development Programming: Being Strategic and Achieving Results in an Evolving Development Context, Santo Domingo, 29 April–3 May.
European Commission (1996) Communication on evaluation, concrete steps towards best practice across the Commission (Document No. SEC 96/659), Brussels.
European Commission (2010) Smart regulation in the European Union, Communication, COM(2010) 543 final, 8 October.
European Commission (2012) A reinforced European Research Area partnership for excellence and growth, Communication, COM(2012) 392 final, 17 July, Brussels.
European Commission (2013) Strengthening the foundations of smart regulation – improving evaluation, 2 October, Brussels.
European Commission (2016) Terms of reference for the interim evaluation of Horizon 2020, approved 2 September, Brussels.
European Commission (2017a) Better Regulation guidelines, Staff Working Document, SWD (2017) 350, 7 July, Brussels.
European Commission (2017b) Better Regulation 2 “Toolbox” (complementing the Better Regulation guidelines), SWD(2017) 350, https://ec.europa.eu/info/sites/info/files/better-regulation-toolbox_1.pdf
European Commission (2017c) Research and innovation – evaluations, https://ec.europa.eu/research/evaluations/index_en.cfm
European Evaluation Society (2007) EES statement: the importance of a methodologically diverse approach to impact evaluation – specifically with respect to development aid and development interventions, December, www.europeanevaluation.org/sites/default/files/EES%20Statement_0.pdf
Greene, J.C., Caracelli, V.J. and Graham, W.F. (1989) Toward a conceptual framework for mixed-method evaluation designs, Educational Evaluation and Policy Analysis, 11(3): 255–74. doi: 10.3102/01623737011003255
Højlund, S. (2014a) Evaluation in the European Commission – for accountability or learning?, paper presented at the Jean Monnet Workshop on Policy Evaluation in the European Union, Cardiff, Jean Monnet Centre.
Højlund, S. (2014b) Evaluation use in evaluation systems – the case of the European Commission, Evaluation, 20(4): 428–46.
Howard, P.L. (2002) Beyond the ‘grim resisters’: towards more effective gender mainstreaming through stakeholder participation, Development in Practice, 12(2): 164–76. doi: 10.1080/09614520220127685
Hubert, A. (2011) Gendering employment policy: from equal pay to work–life balance, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: new approaches to old democratic deficits, Basingstoke: Palgrave Macmillan, pp 146–68.
Krizsan, A. and Roggeband, C. (2018) Towards a conceptual framework for struggles over democracy in backsliding states: gender equality policy in Central Eastern Europe, Politics and Governance, 6(3): 90–100. doi: 10.17645/pag.v6i3.1414
Kronsell, A. (2012) Gendering theories of European integration, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: new approaches to old democratic deficits, Basingstoke: Palgrave Macmillan, pp 23–40.
Kronsell, A. (2015) The power of EU masculinities: a feminist contribution to European integration theory, JCMS: Journal of Common Market Studies 54(1): 104–120.
Lijphart, A. (1971) Comparative politics and the comparative method, The American Political Science Review, 65(3): 682–93. doi: 10.2307/1955513
Linková, M. and Červinková, A. (2011) What matters to women in science? Gender, power and bureaucracy, European Journal of Women’s Studies, 18(3): 215–30.
Longwe, S.H. (1997) The evaporation of gender policies in the patriarchal cooking pot, Development in Practice, 7(2): 148–56.
Marra, M. (2015) Cooperating for a more egalitarian society: complexity theory to evaluate gender equity, Evaluation, 21(1): 32–46. doi: 10.1177/1356389014564856
Mazur, A.G. (2017) Toward the systematic study of feminist policy in practice: an essential first step, Journal of Women, Politics & Policy, 38(1): 64–83. doi: 10.1080/1554477X.2016.1198210
Mergaert, L. (2012) The reality of gender mainstreaming implementation. The case of the EU research policy, doctoral thesis, Radboud Universiteit Nijmegen.
Mergaert, L. and Demuynck, K. (2011) The Ups and Downs of Gender Mainstreaming in the EU Research Policy – The Gender Toolkit and Training Activities in FP7, Antwerp, Belgium: Policy Research Centre on Equal Opportunities.
Mergaert, L. and Minto, R. (2015) Ex ante and ex post evaluations: two sides of the same coin? The case of gender mainstreaming in EU research policy, European Journal of Risk Regulation, 1: 47–56. doi: 10.1017/S1867299X0000427X
Mergaert, L. and Wuiame, N. (2013) Report on institutional capacity for gender mainstreaming in the European Commission, unpublished report from the European Institute for Gender Equality.
Mertens, D.M. and Hesse-Biber, S. (2013) Mixed methods and credibility of evidence in evaluation, New Directions for Evaluation, 138: 5–13. doi: 10.1002/ev.20053
Minto, R. and Mergaert, L. (2018) Gender mainstreaming and evaluation in the EU: comparative perspectives from feminist institutionalism, International Feminist Journal of Politics, 20(2): 204–20. doi: 10.1080/14616742.2018.1440181
Moser, C. (2005) Has gender mainstreaming failed? A comment on international development agency experiences in the South, International Feminist Journal of Politics, 7(4): 576–90. doi: 10.1080/14616740500284573
Pollack, M. and Hafner-Burton, E. (2000) Mainstreaming gender in the European Union, Journal of European Public Policy, 7(3): 114–38. doi: 10.1080/13501760050086116
Prügl, E. (2012) The common agricultural policy and gender equality, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: New Approaches to Old Democratic Deficits, Basingstoke: Palgrave Macmillan, pp 127–45.
Shaw, I. (1999) Qualitative Evaluation, London: Sage.
Stern, E. (2009) Evaluation policy in the European Union and its institutions, New Directions for Evaluation, 123(special issue), Evaluation Policy and Evaluation Practice, W.M.K. Trochim, M.M. Mark and L.J. Cooksy (eds), pp 67–85. doi: 10.1002/ev.306
Summa, H. and Toulemonde, J. (2002) Evaluation in the European Union: addressing complexity and ambiguity, in J.-E. Furubo, R.C. Rist and R. Sandahl (eds) International atlas of evaluation, New Brunswick, NJ, and London: Transaction Publishers, pp 407–25.
True, J. (2009) Trading-in gender equality: gendered meanings in EU trade policy, in Lombardo, E., Meier, P. and Verloo, P. (eds) The Discursive Politics of Gender Equality: Stretching, Bending, and Policy-making, Abingdon: Routledge, pp 141–57.
Van der Vleuten, A. (2016) The Price of Gender Equality: Member States and Governance in the European Union, London: Routledge.
Verloo, M. (2018) Varieties of Opposition to Gender Equality in Europe: Theory, Evidence and Practice, Abingdon: Routledge.
Versluis, E., Van Keulen, M. and Stephenson, P. (2011) Analyzing the European Union Policy Process, Basingstoke and New York, NY: Palgrave Macmillan.
Verweij, S. and Gerrits, L. (2014) Managing unplanned events in large infrastructure projects: results from an in-depth comparative case evaluation, in J.W. Meek and K.S. Marshall (eds) Compact II: Administrative Strategies for Complex Governance Systems, Litchfield Park: Emergent Publications pp 81–108.
Walby, S. (2007) Complexity theory, systems theory, and multiple intersecting social inequalities, Philosophy of the Social Sciences, 37(4): 449–70. doi: 10.1177/0048393107307663
|May 2022 onwards||Past Year||Past 30 Days|
|Full Text Views||29||29||3|