How evidence-based policymaking helps and hinders policy conflict

Authors:
Lars Dorren Leiden University, The Netherlands

Search for other papers by Lars Dorren in
Current site
Google Scholar
Close
and
Eva E.A. Wolf Tilburg University, The Netherlands

Search for other papers by Eva E.A. Wolf in
Current site
Google Scholar
Close
Restricted access
Get eTOC alerts
Rights and permissions Cite this article

A popular explanation for governments’ persistent enthusiasm for evidence-based policymaking (EBPM) is its expected capacity to solve policy conflict. However, research is divided on whether or not EBPM actually has a positive impact on conflict. On the one hand, EBPM is said to introduce a set of principles that helps overcome political differences. Simultaneously, EBPM has been criticised for narrowing the space for democratic debate, fuelling the very conflict it is trying to prevent. This article explores how EBPM structures policy conflict by studying the example of Environmental Impact Assessments (EIAs) in policy processes through reconstructive interviews and ethnographic observations. It argues that, although EBPM channels conflict in a way that prompts engagement from stakeholders, it also escalates conflict by misrepresenting the nature of policy processes. As such, the findings suggest that managing process participants’ expectations about what evidence is and can do is key in fostering productive policy conflict.

  • Ansell, C. and Geyer, R. (2016) ‘Pragmatic complexity’ a new foundation for moving beyond ‘evidence-based policymaking’?, Policy Studies, 11(2): 14967, doi: 10.1080/01442872.2016.1219033.

    • Search Google Scholar
    • Export Citation
  • Barker, A. and Guy Peters, B. (1993) Introduction: science policy and government, in A. Barker and B. Guy Peters (eds) The Politics of Expert Advice, Pittsburgh, PA: University of Pittsburgh Press.

    • Search Google Scholar
    • Export Citation
  • Bartlett, R.V. and Kurian, P.A. (1999) The theory of environmental impact assessment: implicit models of policymaking, Policy and Politics, 27(4): 41533, doi: 10.1332/030557399782218371.

    • Search Google Scholar
    • Export Citation
  • Bertolini, L. (2017) Planning the Mobile Metropolis. Transport for People, Places and the Planet, London: Palgrave Macmillan.

  • Boswell, J. (2014) Hoisted with our own petard: evidence and democratic deliberation on obesity, Policy Sciences, 47(4): 34565, doi: 10.1007/s11077-014-9195-4.

    • Search Google Scholar
    • Export Citation
  • Boswell, J. (2017) What makes evidence-based policy making such a useful myth? The case of NICE guidance on bariatric surgery in the United Kingdom, Governance, 31(2): 199214, doi: 10.1111/gove.12285.

    • Search Google Scholar
    • Export Citation
  • Breeman, G.G., Termeer, C.C. and van Lieshout, M.M. (2013) Decision-making on mega stables: understanding and preventing citizens’ distrust, NJAS-Wageningen Journal of Life Sciences, 66: 3947. doi: 10.1016/j.njas.2013.05.004

    • Search Google Scholar
    • Export Citation
  • Cairney, P. and Oliver, K. (2017) Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy?, Health Research Policy and Systems, 15(1): 111, doi: 10.1186/s12961-017-0192-x.

    • Search Google Scholar
    • Export Citation
  • Cairney, P., Oliver, K. and Wellstead, A. (2016) To bridge the divide between evidence and policy: reduce ambiguity as much as uncertainty, Public Administration Review, 76(3): 399402, doi: 10.1111/puar.12555.

    • Search Google Scholar
    • Export Citation
  • Carnevale, P.J. (2006) Creativity in the outcomes of conflict, in D. Morton, P.T. Coleman and E.C. Marcus (eds) The Handbook of Conflict Resolution, San Francisco, CA: Jossey-Bass, pp 41435.

    • Search Google Scholar
    • Export Citation
  • Coser, R.L. (1956) A home away from home, Social Problems, 4(1): 317. doi: 10.2307/798562

  • Cuppen, E. (2012) Diversity and constructive conflict in stakeholder dialogue: considerations for design and methods, Policy Sciences, 45(1): 2346. doi: 10.1007/s11077-011-9141-7

    • Search Google Scholar
    • Export Citation
  • Departement Omgeving (z.d.) Complexe Projecten – Routeplanner. Geraadpleegd 20 Februari 2023, van https://omgeving.vlaanderen.be/nl/complexe-projecten.

    • Search Google Scholar
    • Export Citation
  • Dorren, L. (2021) Analysis as Therapy. The Therapeutic Function of Ex Ante Analyses in Infrastructure Policy Processes, Antwerp: University of Antwerp. 

    • Search Google Scholar
    • Export Citation
  • Dorren, L. and Böhme, M. (2021) The practice of motivated reasoning: observing knowledge use in real-world policy processes, International Review of Administrative Sciences, 82(2), doi: 10.1177/00208523211047355.

    • Search Google Scholar
    • Export Citation
  • Dorren, L. and Van Dooren, W. (2021) Chameleonic knowledge: a study of ex ante analysis in large infrastructure policy processes, Policy Sciences, 54(2), doi: 10.1007/s11077-021-09423-5.

    • Search Google Scholar
    • Export Citation
  • Douglas, H.E. (2009) Science, Policy, and the Value-Free Ideal, Pittsburgh, PA: University of Pittsburgh Press.

  • Durnova, A. (2018) A tale of ‘fat cats’ and ‘stupid activists’: contested values, governance and reflexivity in the Brno railway station controversy, Journal of Environmental Policy and Planning, 20(6): 72033. doi: 10.1080/1523908X.2013.829749

    • Search Google Scholar
    • Export Citation
  • ECMT (European Conference of Ministers of Transport) (2005) ECMT round tables national systems of transport infrastructure planning, in ECMT Round Tables, Paris: OECD Publishing, http://www.oecd-ilibrary.org/transport/national-systems-of-transport-infrastructure-planning_9789282123423-en.

    • Search Google Scholar
    • Export Citation
  • Feitsma, J.N.P. (2020) ‘Rationalized incrementalism’: how behavior experts in government negotiate institutional logics, Critical Policy Studies, 14(2): 15673, doi: 10.1080/19460171.2018.1557067.

    • Search Google Scholar
    • Export Citation
  • Fleming, J. and Rhodes, R. (2018) Can experience be evidence? Craft knowledge and evidence-based policing, Policy and Politics, 46(1): 326. doi: 10.1332/030557317X14957211514333

    • Search Google Scholar
    • Export Citation
  • Flinders, M. and Wood, M. (2015) When politics fails: hyper-democracy and hyper-depoliticization, New Political Science, 37(3): 36381, doi: 10.1080/07393148.2015.1056431.

    • Search Google Scholar
    • Export Citation
  • Flyvbjerg, B., Bruzelius, N. and Rothengatter, W. (2003) Megaprojects and Risk, Cambridge: Cambridge University Press.

  • French, R.D. (2019) Is it time to give up on evidence-based policy? Four answers, Policy and Politics, 47(1): 15168, doi: 10.1332/030557318X15333033508220.

    • Search Google Scholar
    • Export Citation
  • Gieryn, T.F. (1995) Boundaries of science, in S. Jasanoff, G.E. Markle, J.C. Petersen, and T. Pinch (eds) Handbook of Science and Technology Studies, Thousand Oaks, CA: SAGE Publications, pp 39342.

    • Search Google Scholar
    • Export Citation
  • Head, B.W. (2008) Three lenses of evidence-based policy, Australian Journal of Public Administration, 67(1): 111, doi: 10.1111/j.1467-8500.2007.00564.x.

    • Search Google Scholar
    • Export Citation
  • Head, B.W. (2016) Toward more ‘evidence‐informed’ policymaking?, Public Administration Review, 76: 47284, doi: 10.1111/puar.12475.

    • Search Google Scholar
    • Export Citation
  • Heikkila, T. and Weible, C.M. (2017) Unpacking the intensity of policy conflict: a study of Colorado’s oil and gas subsystem, Policy Sciences, 50(2): 17993. doi: 10.1007/s11077-017-9285-1

    • Search Google Scholar
    • Export Citation
  • Howlett, M. and Newman, J. (2010) Policy analysis and policy work in federal systems: policy advice and its contribution to evidence-based policy-making in multi-level governance systems, Policy and Society, 29(2): 12336, doi: 10.1016/j.polsoc.2010.03.004.

    • Search Google Scholar
    • Export Citation
  • Jasanoff, S. (1990) The Fifth Branch: Science Advisers as Policy Makers, Cambridge, MA: Harvard University Press.

  • Jovchelovitch, S. and Bauer, M.W. (2007) Narrative interviewing, Gerontology and Geriatrics Education, 28(1): 7999, doi: 10.1300/J021v28n01_06.

    • Search Google Scholar
    • Export Citation
  • Karl, H.A., Susskind, L.E. and Wallace, K.H. (2007) A dialogue, not a diatribe: effective integration of science and policy through joint fact finding, Environment: Science and Policy for Sustainable Development, 49(1): 2034. doi: 10.3200/ENVT.49.1.20-34

    • Search Google Scholar
    • Export Citation
  • Klaassen, H. and Hakvoort, J. (2015) Management Control Techniques for Government and Non-Profit Organizations, The Hague: SDU.

  • Kriesberg, L. (2007) Constructive Conflicts: From Escalation to Resolution, Washington, DC: Rowman and Littlefield.

  • Laws, D. and Forester, J. (2007) Learning in practice: public policy mediation, Critical Policy Analysis, 1(4): 34270.

  • Maybin, J. (2015) Policy analysis and policy know-how: a case study of civil servants in England’s department of health, Journal of Comparative Policy Analysis: Research and Practice, 17(3): 286304, doi: 10.1080/13876988.2014.919738.

    • Search Google Scholar
    • Export Citation
  • Miles, M.B. and Huberman, A.M. (1994) Qualitative Data Analysis: Expanded Sourcebook, 2nd edn, Thousand Oaks, CA: SAGE Publications.

  • Mouffe, C. (2009) The Democratic Paradox, Brooklyn, NY: Verso.

  • Mouritsen, J. and Kreiner, K. (2016) Accounting, decisions and promises, Accounting, Organizations and Society, 49: 2131. doi: 10.1016/j.aos.2016.02.002

    • Search Google Scholar
    • Export Citation
  • Mouter, N. (2016) Dutch politicians’ use of cost–benefit analysis, Transportation, 28(1): 7919, doi: 10.1007/s11116-016-9697-3.

  • Mouter, N. (2017) Dutch politicians’ attitudes towards cost–benefit analysis, Transport Policy, 54: 110, doi: 10.1016/j.tranpol.2016.11.001.

    • Search Google Scholar
    • Export Citation
  • Newman, J. (2017) Deconstructing the debate over evidence-based policy, Critical Policy Studies, 11(2): 21126, doi: 10.1080/19460171.2016.1224724.

    • Search Google Scholar
    • Export Citation
  • Nowell, B. and Albrecht, K. (2019) A reviewer’s guide to qualitative rigor, Journal of Public Administration Research and Theory, 29(2): 34863, doi: 10.1093/jopart/muy052.

    • Search Google Scholar
    • Export Citation
  • Nutley, S.M., Walter, I. and Davies, H.T.O. (2007) Using Evidence: How Research Can Inform Public Services, Bristol: Policy Press.

  • OECD (2015a) Policy Framework for Investment, Paris: OECD.

  • OECD (2015b) Towards a Framework for the Governance of Infrastructure, Paris: OECD.

  • Oliver, K. and Pearce, W. (2017) Three lessons from evidence-based medicine and policy: increase transparency, balance inputs and understand power, Palgrave Communications, 3(1): 43, doi: 10.1057/s41599-017-0045-9.

    • Search Google Scholar
    • Export Citation
  • Oliver, K., Innvar, S., Lorenc, T., Woodman, J. and Thomas, J. (2014) A systematic review of barriers to and facilitators of the use of evidence by policymakers, BMC Health Services Research, 14(1): 2, doi: 10.1186/1472-6963-14-2.

    • Search Google Scholar
    • Export Citation
  • Parkhurst, J. (2017) The Politics of Evidence: from Evidence-Based Policy to the Good Governance of Evidence, Abingdon: Taylor and Francis.

    • Search Google Scholar
    • Export Citation
  • Parsons, W. (2002) From muddling through to muddling up: evidence based policymaking and the modernisation of British Government, Public Policy and Administration, 17(3): 4360, doi: 10.1177/095207670201700304.

    • Search Google Scholar
    • Export Citation
  • Pearce, W. and Raman, S. (2014) The new randomised controlled trials (RCT) movement in public policy: challenges of epistemic governance, Policy Sciences, 47(4): 387402, doi: 10.1007/s11077-014-9208-3.

    • Search Google Scholar
    • Export Citation
  • Portelli, A. (1991) The Death of Luigi Transtulli and Other Stories. Form and Meaning in Oral History, Albany, NY: State University of New York Press.

    • Search Google Scholar
    • Export Citation
  • Rein, M. and Schön, D. (1996) Frame-critical policy analysis and frame-reflective policy practice, Knowledge and Policy, 9(1): 85104. doi: 10.1007/BF02832235

    • Search Google Scholar
    • Export Citation
  • Roberts, A. (2010) The Logic of Discipline. Global Capitalism and the Architecture of Government, Oxford: Oxford University Press.

  • Rothstein, B.O. and Teorell, J.A. (2008) What is quality of government? A theory of impartial government institutions, Governance, 21(2): 16590. doi: 10.1111/j.1468-0491.2008.00391.x

    • Search Google Scholar
    • Export Citation
  • Sanderson, I. (2006) Complexity, ‘practical rationality’ and evidence-based policymaking, Policy and Politics, 34(1): 11532, doi: 10.1332/030557306775212188.

    • Search Google Scholar
    • Export Citation
  • Saumure, K. and Given, L.M. (2008) Data saturation, in L.M. Given (Red) The SAGE Encyclopedia of Qualitative Research Methods, Thousand Oaks, CA: SAGE Publications, pp 19596.

    • Search Google Scholar
    • Export Citation
  • Schattschneider, E.E. (1960) The Semi-Sovereign People: A Realist’s View of Democracy in America, New York: Holt, Rinehart and Winston. 

    • Search Google Scholar
    • Export Citation
  • Schlaufer, C., Stucki, I. and Sager, F. (2018) The political use of evidence and its contribution to democratic discourse, Public Administration Review, 78(4): 64549, doi: 10.1111/puar.12923.

    • Search Google Scholar
    • Export Citation
  • Schwartz-Shea, P. and Yanow, D. (2009) Reaing and writing as method: In search of trustworthy texts, in S. Ybema, D. Yanow, H. Wels and F. Kamsteeg (Red) Organizational Ethnography. Studying the Complexities of Everyday Life, Thousand Oaks, CA: SAGE Publications.

    • Search Google Scholar
    • Export Citation
  • Schwartz-Shea, P. and Yanow, D. (2012) Interpretive Research Design: Concepts and Processes, Abingdon: Routledge.

  • Strassheim, H. and Kettunen, P. (2014) When does evidence-based policy turn into policy-based evidence? Configurations, contexts and mechanisms, Evidence and Policy, 10(2): 25977, doi: 10.1332/174426514X13990433991320.

    • Search Google Scholar
    • Export Citation
  • Strauss, A. and Corbin, J. (1998) Basics of Qualitative Research. Techniques and Procedures for Developing Grounde Theory, Thousand Oaks, CA: SAGE Publications.

    • Search Google Scholar
    • Export Citation
  • Stevens, A. (2007) Survival of the ideas that fit. An evolutionary analogy for the use of evidence in policy, Social Policy and Society, 6(1): 2535, doi: 10.1017/S1474746406003319.

    • Search Google Scholar
    • Export Citation
  • Stevens, A. (2011) Telling policy stories. An ethnographic study of the use of evidence in policy-making in the UK, Journal of Social Policy, 40(2): 23755, doi: 10.1017/S0047279410000723.

    • Search Google Scholar
    • Export Citation
  • Timmermans, S. and Tavory, I. (2012) Theory construction in qualitative research: from grounded theory to abductive analysis, Sociological Theory, 30(3): 16786. doi: 10.1177/0735275112457914

    • Search Google Scholar
    • Export Citation
  • Topf, R. (1993) Science, public policy and the authoritativeness of the governmental process, in A. Barker and B. Guy Peters (eds) The Politics of Expert Advice. Creating, Using and Manipulating Scientific Knowledge for Public Policy, Pittsburgh, PA: University of Pittsburgh Press.

    • Search Google Scholar
    • Export Citation
  • Triantafillou, P. (2015) The politics of neutrality and the changing role of expertise in public administration, Administrative Theory and Praxis, 37(3): 17487, doi: 10.1080/10841806.2015.1053362.

    • Search Google Scholar
    • Export Citation
  • Tyler, T.R. and Blader, S.L. (2000) Cooperation in groups: procedural justice, Social Identity, and Behavioral Engagement, Philadelphia, PA.

    • Search Google Scholar
    • Export Citation
  • van Eeten, M.J. (1999) Dialogues of the deaf’. On science in policy controversies, Science and Public Policy, 26(3): 18592. doi: 10.3152/147154399781782491

    • Search Google Scholar
    • Export Citation
  • Verhoeven, I. and Metze, T. (2022) Heated policy: policy actors’ emotional storylines and conflict escalation, Policy Sciences, 55(2): 22337, doi: 10.1007/s11077-022-09459-1.

    • Search Google Scholar
    • Export Citation
  • Verloo, N. (2015) Negotiating Urban Conflict: Conflicts as Opportunity for Urban Democracy, Amsterdam: University of Amsterdam.

  • Verloo, N. and Davis, D. (2021) Learning from conflict, Built Environment, 47(1): 512. doi: 10.2148/benv.47.1.5

  • Wegrich, K., Kostka, G. and Hammerschmid, G. (eds) (2016) The Governance of Infrastructure, Oxford: Oxford University Press.

  • Weiss, C.H. (1979) The many meanings of research utilization, Public Administration Review, 39(5): 42631, doi: 10.2307/3109916.

  • Weible, C.M. and Heikkila, T. (2017) Policy conflict framework, Policy Sciences, 50(1): 2340. doi: 10.1007/s11077-017-9280-6

  • Weible, C.M., Pattison, A. and Sabatier, P.A. (2010) Harnessing expert-based information for learning and the sustainable management of complex socio-ecological systems, Environmental Science and Policy, 13(6): 52234, doi: 10.1016/j.envsci.2010.05.005.

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. (2021a) Dismissing the ‘vocal minority’: how policy conflict escalates when policymakers label resisting citizens, Policy Studies Journal, 49(2): 64063. doi: 10.1111/psj.12370

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. (2021b) How policy institutions filter conflict: the (de)escalation of policy conflict through closing down or opening up the space for contestation, Built Environment, 47(1): 5674. doi: 10.2148/benv.47.1.56

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. and Van Dooren, W. (2017) How policies become contested: a spiral of imagination and evidence in a large infrastructure project, Policy Sciences, 50(3): 44968. doi: 10.1007/s11077-017-9275-3

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. and Van Dooren, W. (2018a) Conflict reconsidered: the boomerang effect of depoliticization in the policy process, Public Administration, 96(2): 286301. doi: 10.1111/padm.12391

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. and Van Dooren, W. (2018b) ‘Time to move on’ or ‘taking more time’? How disregarding multiple perspectives on time can increase policy-making conflict, Environment and Planning C: Politics and Space, 36(2): 34056. doi: 10.1177/2399654417712243

    • Search Google Scholar
    • Export Citation
  • Wolf, E.E.A. and Van Dooren, W. (2021) Fatal remedies: how dealing with policy conflict can backfire in a context of trust‐erosion, Governance, 34(4): 10971114. doi: 10.1111/gove.12630

    • Search Google Scholar
    • Export Citation
  • World Bank (2014a) Public-Private Partnerships Reference Guide, Washington, DC: World Bank.

  • World Bank (2014b) Formulating an Urban Transport Policy, Washington, DC: World Bank, https://openknowledge.worldbank.org/handle/10986/20950.

    • Search Google Scholar
    • Export Citation
  • World Economic Forum (2012) Strategic Infrastructure. Steps to Prioritize and Deliver Infrastructure Effectively and Efficiently, Cologny: World Economic Forum.

    • Search Google Scholar
    • Export Citation
  • Williams, K. (2018) Three strategies for attaining legitimacy in policy knowledge: coherence in identity, process and outcome, Public Administration, 96(1): 5369, doi: 10.1111/padm.12385.

    • Search Google Scholar
    • Export Citation
  • Wu, J. and Laws, D. (2003) Trust and other‐anxiety in negotiations: dynamics across boundaries of self and culture, Negotiation Journal, 19(4): 32967. doi: 10.1111/j.1571-9979.2003.tb00792.x

    • Search Google Scholar
    • Export Citation

Supplementary Materials

    • Supplementary_AppendixS1.pdf (PDF 99.8 KB)
Lars Dorren Leiden University, The Netherlands

Search for other papers by Lars Dorren in
Current site
Google Scholar
Close
and
Eva E.A. Wolf Tilburg University, The Netherlands

Search for other papers by Eva E.A. Wolf in
Current site
Google Scholar
Close

Content Metrics

May 2022 onwards Past Year Past 30 Days
Abstract Views 728 728 0
Full Text Views 759 759 226
PDF Downloads 556 556 104

Altmetrics

Dimensions

You are not currently authorised to access the full text of this chapter or article.
Access options
To access the full chapter or article then please choose one of the options below.
Purchase
Pay to access content (PDF download and unlimited online access)
Other access options
Redeem Token
Institutional Login
Log in via Open Athens or Shibboleth. Please contact your librarian if you need any help.
Login with Institutional Access
Personal Login
Login to your BUP account with your individual credentials.
Login with BUP account

Institutional librarians can find more information about free trials here

Policy & Politics
Advancing knowledge in public and social policy