Policy evaluation and gender mainstreaming in the European Union: the perfect (mis)match?
This article assesses the ability of the European Commission’s current approach to policy evaluation to evaluate gender mainstreaming and, in turn, other cross-cutting social agendas (Articles 8–10 TFEU). Taking European Union research policy as a case study, through our analysis, we reveal mismatches between current evaluation standards adopted within the Better Regulation framework and requirements for effectively assessing progress towards cross-cutting social objectives, such as gender equality. The article concludes with a series of recommendations to overcome the identified shortcomings. Our analysis constitutes a key contribution to the development of feminist scholarship on the post-implementation phase of the policy process.
-
Abels, G. (2012) Research by, for and about women: gendering science and research policy, in G. Abels and J.M. Mushaben (eds) Gendering the European Union: New Approaches to Old Democratic Deficits, Basingstoke: Palgrave Macmillan, pp 187–207.
-
Allwood, G. (2013) Gender mainstreaming and policy coherence for development: unintended gender consequences and EU policy, paper presented at the Women’s Studies International Forum.
-
Braithwaite, M. (2000) Mainstreaming gender in the European structural funds, paper presented at the Mainstreaming Gender in European Public Policy Workshop, University of Wisconsin-Madison, http://eucenter.wisc.edu/Conferences/Gender/braith.htm
-
Bustelo, M. (2003) Evaluation of gender mainstreaming: ideas from a meta-evaluation study, Evaluation, 9(4): 383–403. doi: 10.1177/135638900300900402
-
Bustelo, M. (2017) Evaluation from a gender+ perspective as a key element for (re)gendering the policymaking process, Journal of Women, Politics & Policy, 38(1): 84–101. doi: 10.1080/1554477X.2016.1198211
-
Bustelo, M. and Verloo, M. (2009) Grounding policy evaluation in a discursive understanding of politics, in E. Lombardo, P. Meier and M. Verloo (eds) The Discursive Politics of Gender Equality. Stretching, Bending and Policy-making, London: Routledge, pp 153–68.
-
Caffrey, L. and Munro, E. (2017) A systems approach to policy evaluation, Evaluation, 23(4): 463–78. doi: 10.1177/1356389017730727
-
Callerstig, A.-C. (2014) Can public procurement be an instrument for policy learning in gender mainstreaming?, Offentlig förvaltning. Scandinavian Journal of Public Administration, 18(4): 51–71.
-
Cavaghan, R. (2012) Gender mainstreaming as a knowledge process: towards an understanding of perpetuation and change in gender blindness and gender bias, doctoral thesis, University of Edinburgh, UK.
-
Cavaghan, R. (2013) Gender mainstreaming in the DGR as a knowledge process: epistemic barriers to eradicating gender bias, Critical Policy Studies, 7(4): 407–21. doi: 10.1080/19460171.2013.804330
-
Cavaghan, R. (2017) Making Gender Equality Happen: Knowledge, Change and Resistance in EU Gender Mainstreaming, London: Routledge.
-
Debusscher, P. (2011) Mainstreaming gender in European Commission development policy: conservative Europeanness?, paper presented at the Women’s Studies International Forum.
-
Debusscher, P. and Van der Vleuten, A. (2012) Mainstreaming gender in European Union development cooperation with sub-Saharan Africa: promising numbers, narrow contents, telling silences, International Development Planning Review, 34(3): 319–38. doi: 10.3828/idpr.2012.19
-
De Gregorio Hurtado, S. (2017) A critical approach to EU urban policy from the viewpoint of gender, Journal of Research in Gender Studies, 7(1): 200–17.
-
Engeli, I. and Mazur, A. (2018) Taking implementation seriously in assessing success: the politics of gender equality policy, European Journal of Politics and Gender, 1(1/2): 111–29. doi: 10.1332/251510818X15282097548558
-
Espinosa, J. (2013) Promoting human rights and gender sensitive evaluations: key ideas for evaluating gender equality results, discussion paper presented at UN Women Expert Group Meeting on Gender Mainstreaming Approaches in Development Programming: Being Strategic and Achieving Results in an Evolving Development Context, Santo Domingo, 29 April–3 May.
-
European Commission (1996) Communication on evaluation, concrete steps towards best practice across the Commission (Document No. SEC 96/659), Brussels.
-
European Commission (2010) Smart regulation in the European Union, Communication, COM(2010) 543 final, 8 October.
-
European Commission (2012) A reinforced European Research Area partnership for excellence and growth, Communication, COM(2012) 392 final, 17 July, Brussels.
-
European Commission (2013) Strengthening the foundations of smart regulation – improving evaluation, 2 October, Brussels.
-
European Commission (2016) Terms of reference for the interim evaluation of Horizon 2020, approved 2 September, Brussels.
-
European Commission (2017a) Better Regulation guidelines, Staff Working Document, SWD (2017) 350, 7 July, Brussels.
-
European Commission (2017b) Better Regulation 2 “Toolbox” (complementing the Better Regulation guidelines), SWD(2017) 350, https://ec.europa.eu/info/sites/info/files/better-regulation-toolbox_1.pdf
-
European Commission (2017c) Research and innovation – evaluations, https://ec.europa.eu/research/evaluations/index_en.cfm
-
European Evaluation Society (2007) EES statement: the importance of a methodologically diverse approach to impact evaluation – specifically with respect to development aid and development interventions, December, www.europeanevaluation.org/sites/default/files/EES%20Statement_0.pdf
-
Greene, J.C., Caracelli, V.J. and Graham, W.F. (1989) Toward a conceptual framework for mixed-method evaluation designs, Educational Evaluation and Policy Analysis, 11(3): 255–74. doi: 10.3102/01623737011003255
-
Højlund, S. (2014a) Evaluation in the European Commission – for accountability or learning?, paper presented at the Jean Monnet Workshop on Policy Evaluation in the European Union, Cardiff, Jean Monnet Centre.
-
Højlund, S. (2014b) Evaluation use in evaluation systems – the case of the European Commission, Evaluation, 20(4): 428–46.
-
Howard, P.L. (2002) Beyond the ‘grim resisters’: towards more effective gender mainstreaming through stakeholder participation, Development in Practice, 12(2): 164–76. doi: 10.1080/09614520220127685
-
Hubert, A. (2011) Gendering employment policy: from equal pay to work–life balance, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: new approaches to old democratic deficits, Basingstoke: Palgrave Macmillan, pp 146–68.
-
Krizsan, A. and Roggeband, C. (2018) Towards a conceptual framework for struggles over democracy in backsliding states: gender equality policy in Central Eastern Europe, Politics and Governance, 6(3): 90–100. doi: 10.17645/pag.v6i3.1414
-
Kronsell, A. (2012) Gendering theories of European integration, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: new approaches to old democratic deficits, Basingstoke: Palgrave Macmillan, pp 23–40.
-
Kronsell, A. (2015) The power of EU masculinities: a feminist contribution to European integration theory, JCMS: Journal of Common Market Studies 54(1): 104–120.
-
Lijphart, A. (1971) Comparative politics and the comparative method, The American Political Science Review, 65(3): 682–93. doi: 10.2307/1955513
-
Linková, M. and Červinková, A. (2011) What matters to women in science? Gender, power and bureaucracy, European Journal of Women’s Studies, 18(3): 215–30.
-
Longwe, S.H. (1997) The evaporation of gender policies in the patriarchal cooking pot, Development in Practice, 7(2): 148–56.
-
Marra, M. (2015) Cooperating for a more egalitarian society: complexity theory to evaluate gender equity, Evaluation, 21(1): 32–46. doi: 10.1177/1356389014564856
-
Mazur, A.G. (2017) Toward the systematic study of feminist policy in practice: an essential first step, Journal of Women, Politics & Policy, 38(1): 64–83. doi: 10.1080/1554477X.2016.1198210
-
Mergaert, L. (2012) The reality of gender mainstreaming implementation. The case of the EU research policy, doctoral thesis, Radboud Universiteit Nijmegen.
-
Mergaert, L. and Demuynck, K. (2011) The Ups and Downs of Gender Mainstreaming in the EU Research Policy – The Gender Toolkit and Training Activities in FP7, Antwerp, Belgium: Policy Research Centre on Equal Opportunities.
-
Mergaert, L. and Minto, R. (2015) Ex ante and ex post evaluations: two sides of the same coin? The case of gender mainstreaming in EU research policy, European Journal of Risk Regulation, 1: 47–56. doi: 10.1017/S1867299X0000427X
-
Mergaert, L. and Wuiame, N. (2013) Report on institutional capacity for gender mainstreaming in the European Commission, unpublished report from the European Institute for Gender Equality.
-
Mertens, D.M. and Hesse-Biber, S. (2013) Mixed methods and credibility of evidence in evaluation, New Directions for Evaluation, 138: 5–13. doi: 10.1002/ev.20053
-
Minto, R. and Mergaert, L. (2018) Gender mainstreaming and evaluation in the EU: comparative perspectives from feminist institutionalism, International Feminist Journal of Politics, 20(2): 204–20. doi: 10.1080/14616742.2018.1440181
-
Moser, C. (2005) Has gender mainstreaming failed? A comment on international development agency experiences in the South, International Feminist Journal of Politics, 7(4): 576–90. doi: 10.1080/14616740500284573
-
Pollack, M. and Hafner-Burton, E. (2000) Mainstreaming gender in the European Union, Journal of European Public Policy, 7(3): 114–38. doi: 10.1080/13501760050086116
-
Prügl, E. (2012) The common agricultural policy and gender equality, in Abels, G. and Mushaben, J.M. (eds) Gendering the European Union: New Approaches to Old Democratic Deficits, Basingstoke: Palgrave Macmillan, pp 127–45.
-
Shaw, I. (1999) Qualitative Evaluation, London: Sage.
-
Stern, E. (2009) Evaluation policy in the European Union and its institutions, New Directions for Evaluation, 123(special issue), Evaluation Policy and Evaluation Practice, W.M.K. Trochim, M.M. Mark and L.J. Cooksy (eds), pp 67–85. doi: 10.1002/ev.306
-
Summa, H. and Toulemonde, J. (2002) Evaluation in the European Union: addressing complexity and ambiguity, in J.-E. Furubo, R.C. Rist and R. Sandahl (eds) International atlas of evaluation, New Brunswick, NJ, and London: Transaction Publishers, pp 407–25.
-
True, J. (2009) Trading-in gender equality: gendered meanings in EU trade policy, in Lombardo, E., Meier, P. and Verloo, P. (eds) The Discursive Politics of Gender Equality: Stretching, Bending, and Policy-making, Abingdon: Routledge, pp 141–57.
-
Van der Vleuten, A. (2016) The Price of Gender Equality: Member States and Governance in the European Union, London: Routledge.
-
Verloo, M. (2018) Varieties of Opposition to Gender Equality in Europe: Theory, Evidence and Practice, Abingdon: Routledge.
-
Versluis, E., Van Keulen, M. and Stephenson, P. (2011) Analyzing the European Union Policy Process, Basingstoke and New York, NY: Palgrave Macmillan.
-
Verweij, S. and Gerrits, L. (2014) Managing unplanned events in large infrastructure projects: results from an in-depth comparative case evaluation, in J.W. Meek and K.S. Marshall (eds) Compact II: Administrative Strategies for Complex Governance Systems, Litchfield Park: Emergent Publications pp 81–108.
-
Walby, S. (2007) Complexity theory, systems theory, and multiple intersecting social inequalities, Philosophy of the Social Sciences, 37(4): 449–70. doi: 10.1177/0048393107307663
| May 2022 onwards | Past Year | Past 30 Days | |
|---|---|---|---|
| Abstract Views | 193 | 193 | 17 |
| Full Text Views | 32 | 32 | 6 |
| PDF Downloads | 38 | 38 | 7 |
We are a leading social science publisher
committed to making a difference.
Bristol University Press and
Policy Press
bristoluniversitypress.co.uk