The debate over rational decision making in evidence-based medicine: implications for evidence-informed policy

Authors:
R. Christopher Sheldrick Boston University School of Public Health, USA

Search for other papers by R. Christopher Sheldrick in
Current site
Google Scholar
Close
,
Justeen Hyde Center for Healthcare Outcomes and Implementation Research ENRM Veteran’s Affairs Medical Center, USA

Search for other papers by Justeen Hyde in
Current site
Google Scholar
Close
,
Laurel K. Leslie Tufts University School of Medicine, USA

Search for other papers by Laurel K. Leslie in
Current site
Google Scholar
Close
, and
Thomas Mackie Rutgers, The State University of New Jersey, USA

Search for other papers by Thomas Mackie in
Current site
Google Scholar
Close
Restricted access
Get eTOC alerts
Rights and permissions Cite this article

Many of the resources developed to promote the use of evidence in policy aspire to an ideal of rational decision making, yet their basis in the decision sciences is often unclear. Tracing the historical development of evidence-informed policy to its roots in evidence-based medicine (EBM), we distinguish between two understandings of how research evidence may be applied. Advocates for EBM all seek to use research evidence to optimise clinical care. However, some proponents argue that ‘uptake’ of research evidence should be direct and universal, for example through wide-scale implementation of ‘evidence-based practices’. In contrast, other conceptualisations of EBM are rooted in expected utility theory, which defines rational decisions as choices that are expected to result in the greatest benefit. Applying this theory to medical care, clinical decision-making models clearly demonstrate that rational decisions require not only a range of relevant evidence, but also expertise to inform judgments regarding the credibility of estimates and to assess fit-to-context, and stakeholder preferences and values to weigh trade-offs among competing outcomes. Using these models as exemplars, we argue that attempts to apply research evidence directly to practice or policy without consideration of expert judgement or preferences and values reflect fundamental misconceptions about the theory of rational decision making that can impede implementation. In turn, the decision sciences highlight the need to consider the role of expertise and judgment when interpreting research evidence, the role of preferences and values when applying it to specific decisions, and the practical limits imposed by the uncertainty inherent in each.

  • Alliance for Useful Evidence (2016) Alliance for useful evidence, www.alliance4usefulevidence.org/publication/

  • Bernstein, R.J. (1983) Beyond objectivism and relativism: Science, hermeneutics, and praxis, Philadelphia, PA: University of Pennsylvania Press.

    • Search Google Scholar
    • Export Citation
  • Bosch-Capblanch, X., Lavis, J.N., Lewin, S., Atun, R., Røttingen, J.-A., Dröschel, D., Beck, L., Abalos, E., El-Jardali, F., Gilson, L., Oliver, S., Wyss, K., Tugwell, P., Kulier, R., Pang, T. and Haines, A. (2012) Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development, PLoS Medicine, 9(3): e1001185. doi: 10.1371/journal.pmed.1001185

    • Search Google Scholar
    • Export Citation
  • Cairney, P. and Oliver, K. (2017) Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy?, Health Research Policy and Systems, 15(1): 35. doi: 10.1186/s12961-017-0192-x

    • Search Google Scholar
    • Export Citation
  • Cautin, R.L. and Lilienfeld, S.O. (eds) (2015) In Encyclopedia of clinical psychology, Chichester: John Wiley & Sons, pp 2551.

  • Claridge, J.A. and Fabian, T.C. (2005) History and development of evidence-based medicine, World Journal of Surgery, 29(5): 54753. doi: 10.1007/s00268-005-7910-1

    • Search Google Scholar
    • Export Citation
  • Claxton, K., Sculpher, M. and Drummond, M. (2002) A rational framework for decision making by the National Institute For Clinical Excellence (NICE), The Lancet, 360(9334): 7115. doi: 10.1016/S0140-6736(02)09832-X

    • Search Google Scholar
    • Export Citation
  • Ducey, A., Pott, T., Thompson, C. and Ross, S. (2017) The moral economy of health technology assessment: an empirical qualitative study, Evidence & Policy, 13(1): 727.

    • Search Google Scholar
    • Export Citation
  • Ebrahim, S., Sohani, Z.N., Montoya, L., Agarwal, A., Thorlund, K., Mills, E.J. and Ioannidis, J.P.A. (2014) ‘Reanalyses of randomized clinical trial data’, JAMA, 312(10): 102432. doi: 10.1001/jama.2014.9646

    • Search Google Scholar
    • Export Citation
  • Elstein, A.S., Fryback, D.G., Weinstein, M.C., Pauker, S.G., Holmes-Rovner, M., Young, M.J., Barry, M.J., Eckman, M.H., Hunink, M.M. and Tsevat, J. (2004) ‘Presidential reflections on the 25th anniversary of the Society for Medical Decision Making’, Medical Decision Making, 24(4): 40820. doi: 10.1177/0272989X04267676

    • Search Google Scholar
    • Export Citation
  • Frank Porter Graham Child Development Institute (2017) National professional development center on autism spectrum disorder: evidence based practices, http://autismpdc.fpg.unc.edu/evidence-based-practices

    • Search Google Scholar
    • Export Citation
  • Gadamer, H.G. (1996) The enigma of health: the art of healing in a scientific age, Stanford University Press, Stanford, CA: USA.

  • Gadamer, H.G. (2013) Truth and method, London, UK: Bloomsbury Publishing.

  • Gilboa, I. (2009) Theory of decision under uncertainty, Cambridge: Cambridge University Press.

  • Gough, D. and Boaz, A. (2017) Applying the rational model of evidence-informed policy and practice in the real world, Evidence & Policy, 13(1): 35.

    • Search Google Scholar
    • Export Citation
  • Greenhalgh, T. and Russell, J. (2009) Evidence-based policymaking: a critique, Perspectives in Biology and Medicine, 52(2): 30418. doi: 10.1353/pbm.0.0085

    • Search Google Scholar
    • Export Citation
  • Greenhalgh, T., Howick, J. and Maskrey, N. (2014) Evidence based medicine: a movement in crisis?, BMJ, 348: g3725. doi: 10.1136/bmj.g3725

    • Search Google Scholar
    • Export Citation
  • Han, P.K.J., Klein, W.M.P. and Arora, N.K. (2011) Varieties of uncertainty in health care: a conceptual taxonomy, Medical Decision Making, 31(6): 82838. doi: 10.1177/0272989X10393976

    • Search Google Scholar
    • Export Citation
  • Hartung, D.M., Zarin, D.A., Guise, J.M., McDonagh, M., Paynter, R. and Helfand, M. (2014) Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications, Annals of Internal Medicine, 160(7): 47783. doi: 10.7326/M13-0480

    • Search Google Scholar
    • Export Citation
  • Hawkins, B. and Parkhurst, J. (2016) The ‘good governance’ of evidence in health policy, Evidence & Policy, 12(4): 57592.

  • Hofmann, B., Bond, K. and Sandman, L. (2018) Evaluating facts and facting evaluations: on the fact-value relationship in HTA, Journal of Evaluation in Clinical Practice, 24(5): 95765. doi: 10.1111/jep.12920

    • Search Google Scholar
    • Export Citation
  • Hunink, M.M., Weinstein, M.C., Wittenberg, E., Drummond, M.F., Pliskin, J.S., Wong, J.B. and Glasziou, P.P. (2014) Decision making in health and medicine: Integrating evidence and values, Cambridge: Cambridge University Press.

    • Search Google Scholar
    • Export Citation
  • Hyde, J.K., Mackie, T.I., Palinkas, L.A., Niemi, E. and Leslie, L.K. (2016) Evidence use in mental health policy making for children in foster care, Administration and Policy in Mental Health and Mental Health Services Research, 43(1): 5266. doi: 10.1007/s10488-015-0633-1

    • Search Google Scholar
    • Export Citation
  • Jones, A. and Steel, D. (2018) Evaluating the quality of medical evidence in real-world contexts, Journal of Evaluation in Clinical Practice, 24(5): 95056. doi: 10.1111/jep.12983

    • Search Google Scholar
    • Export Citation
  • Jones, C.W., Handler, L., Crowell, K.E., Keil, L.G., Weaver, M.A. and Platts-Mills, T.F. (2013) Non-publication of large randomized clinical trials: cross sectional analysis, BMJ, 347.

    • Search Google Scholar
    • Export Citation
  • Kahneman, D. and Klein, G. (2009) Conditions for intuitive expertise: a failure to disagree, American Psychologist, 64(6): 51526. doi: 10.1037/a0016755

    • Search Google Scholar
    • Export Citation
  • Kasper, J., Geiger, F., Freiberger, S. and Schmidt, A. (2008) Decision-related uncertainties perceived by people with cancer – modelling the subject of shared decision making, Psycho-Oncology, 17(1): 428. doi: 10.1002/pon.1190

    • Search Google Scholar
    • Export Citation
  • Keirns, C.C. and Goold, S. (2009) Patient-centered care and preference-sensitive decision making, JAMA, 302(16): 180506. doi: 10.1001/jama.2009.1550

    • Search Google Scholar
    • Export Citation
  • Kelly, M.P. (2018) The need for a rationalist turn in evidence-based medicine, Journal of Evaluation in Clinical Practice, 24(5): 115865. doi: 10.1111/jep.12974

    • Search Google Scholar
    • Export Citation
  • Lavis, J.N., Oxman, A.D., Lewin, S. and Fretheim, A. (2009) SUPPORT Tools for evidence-informed health policymaking (STP), Health Research Policy and Systems, 7(1): I1. doi: 10.1186/1478-4505-7-1

    • Search Google Scholar
    • Export Citation
  • Mathieu, S., Boutron, I., Moher, D., Altman, D.G. and Ravaud, P. (2009) Comparison of registered and published primary outcomes in randomized controlled trials, JAMA, 302(9): 97784. doi: 10.1001/jama.2009.1242

    • Search Google Scholar
    • Export Citation
  • National Academies of Sciences, E. [?], and Medicine (2015) Improving diagnosis in health care, Washington, DC: The National Academies Press.

    • Search Google Scholar
    • Export Citation
  • Neuman, M.D., Goldstein, J.N., Cirullo, M.A. and Schwartz, J. (2014) Durability of class 1 American College Of Cardiology/American Heart Association clinical practice guideline recommendations, JAMA, 311(20): 2092100. doi: 10.1001/jama.2014.4949

    • Search Google Scholar
    • Export Citation
  • Oliver, K., Lorenc, T. and Innvær, S. (2014) New directions in evidence-based policy research: a critical analysis of the literature, Health Research Policy and Systems, 12(1): 34. doi: 10.1186/1478-4505-12-34

    • Search Google Scholar
    • Export Citation
  • Owens, D.K., Whitlock, E.P., Henderson, J., Pignone, M.P., Krist, A.H., Bibbins-Domingo, K., Curry, S.J., Davidson, K.W., Ebell, M., Gillman, M.W., Grossman, D.C., Kemper, A.R., Kurth, A.E., Maciosek, M., Siu, A.L. and LeFevre, M.L. (2016) Use of decision models in the development of evidence-based clinical preventive services recommendations: methods of the US preventive services task force, Annals of Internal Medicine, 165(7): 5018. doi: 10.7326/M15-2531

    • Search Google Scholar
    • Export Citation
  • Pauker, S.G. and Kassirer, J.P. (1975) Therapeutic decision making: a cost-benefit analysis, New England Journal of Medicine, 293(5): 22934. doi: 10.1056/NEJM197507312930505

    • Search Google Scholar
    • Export Citation
  • Pauker, S.G. and Kassirer, J.P. (1980) The threshold approach to clinical decision making, New England Journal of Medicine, 302(20): 110917. doi: 10.1056/NEJM198005153022003

    • Search Google Scholar
    • Export Citation
  • Prasad, V., Vandross, A., Toomey, C., Cheung, M., Rho, J., Quinn, S., Chacko, S.J., Borkar, D., Gall, V., Selvaraj, S., Ho, N. and Cifu, A. (2013) A decade of reversal: an analysis of 146 contradicted medical practices, Mayo Clinic Proceedings, 88(8): 7908. doi: 10.1016/j.mayocp.2013.05.012

    • Search Google Scholar
    • Export Citation
  • Rabin, B.A., Brownson, R.C., Haire-Joshu, D., Kreuter, M.W. and Weaver, N.L. (2008) A glossary for dissemination and implementation research in health, Journal of Public Health Management and Practice, 14(2): 11723. doi: 10.1097/01.PHH.0000311888.06252.bb

    • Search Google Scholar
    • Export Citation
  • Rawlins, M. (2008) De testimonio: on the evidence for decisions about the use of therapeutic interventions, Clinical Medicine, 8(6): 57988. doi: 10.7861/clinmedicine.8-6-579

    • Search Google Scholar
    • Export Citation
  • Richardson, W. and Detsky, A.S. (1995) Users’ guides to the medical literature: VII. how to use a clinical decision analysis, a. are the results of the study valid?, JAMA, 273(16): 129295. doi: 10.1001/jama.1995.03520400062046

    • Search Google Scholar
    • Export Citation
  • Sackett, D.L. and Rosenberg, W.M.C. (1995) On the need for evidence-based medicine, Journal of Public Health, 17(3): 33034.

  • Sackett, D.L., Rosenberg, W.M.C., Gray, J.A.M., Haynes, R.B. and Richardson, W.S. (1996) Evidence based medicine: what it is and what it isn’t, BMJ, 312(7023): 712. doi: 10.1136/bmj.312.7023.71

    • Search Google Scholar
    • Export Citation
  • Saini, P., Loke, Y.K., Gamble, C., Altman, D.G., Williamson, P.R. and Kirkham, J.J. (2014) Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews, BMJ, 349. doi: 10.1136/bmj.g6501

    • Search Google Scholar
    • Export Citation
  • Schlander, M. (2008) The use of cost-effectiveness by the National Institute for Health and Clinical Excellence (NICE): no (t yet an) exemplar of a deliberative process, Journal of Medical Ethics, 34(7): 53439. doi: 10.1136/jme.2007.021683

    • Search Google Scholar
    • Export Citation
  • Shadish, W., Cook, T. and Campbell, D. (2002) Experimental and quasi-experimental designs for generalized causal inferences, Boston, MA: Houghton Mifflin Company.

    • Search Google Scholar
    • Export Citation
  • Spring, B. (2007) Evidence-based practice in clinical psychology: what it is, why it matters; what you need to know, Journal of Clinical Psychology, 63(7): 61131. doi: 10.1002/jclp.20373

    • Search Google Scholar
    • Export Citation
  • Steinbrook, R., Kassirer, J.P. and Angell, M. (2015) Justifying conflicts of interest in medical journals: a very bad idea, BMJ, 350: h2942.

    • Search Google Scholar
    • Export Citation
  • Tonelli, M. (1998) The philosophical limits of evidence-based medicine, Academic Medicine, 73: 123440. doi: 10.1097/00001888-199812000-00011

    • Search Google Scholar
    • Export Citation
  • Tversky, A. (1977) ‘Features of similarity’, Psychological Review, 84(4): 32752. doi: 10.1037/0033-295X.84.4.327

  • US Department of Health and Human Services (2016) The National Cancer Institute, https://www.cancer.gov/

  • US Department of Health and Human Services (2017) Substance abuse and mental health services administration, https://www.samhsa.gov/

  • United States Preventive Services Task Force (2007) Screening for sickle cell disease in newborns: U.S. Preventive Services Task Force recommendation statement. Agency for Healthcare Research and Quality, https://www.aafp.org/afp/2008/0501/p1300.html, Accessed June 1, 2019.

    • Search Google Scholar
    • Export Citation
  • Walker, V.R. (1991) The siren songs of science: toward a taxonomy of scientific uncertainty for decisionmakers, Connecticut Law Review, 23(567).

    • Search Google Scholar
    • Export Citation
R. Christopher Sheldrick Boston University School of Public Health, USA

Search for other papers by R. Christopher Sheldrick in
Current site
Google Scholar
Close
,
Justeen Hyde Center for Healthcare Outcomes and Implementation Research ENRM Veteran’s Affairs Medical Center, USA

Search for other papers by Justeen Hyde in
Current site
Google Scholar
Close
,
Laurel K. Leslie Tufts University School of Medicine, USA

Search for other papers by Laurel K. Leslie in
Current site
Google Scholar
Close
, and
Thomas Mackie Rutgers, The State University of New Jersey, USA

Search for other papers by Thomas Mackie in
Current site
Google Scholar
Close

Content Metrics

May 2022 onwards Past Year Past 30 Days
Abstract Views 3154 1498 56
Full Text Views 173 51 1
PDF Downloads 201 73 3

Altmetrics

Dimensions

Evidence & Policy
A journal of research, debate and practice