Many of the resources developed to promote the use of evidence in policy aspire to an ideal of rational decision making, yet their basis in the decision sciences is often unclear. Tracing the historical development of evidence-informed policy to its roots in evidence-based medicine (EBM), we distinguish between two understandings of how research evidence may be applied. Advocates for EBM all seek to use research evidence to optimise clinical care. However, some proponents argue that ‘uptake’ of research evidence should be direct and universal, for example through wide-scale implementation of ‘evidence-based practices’. In contrast, other conceptualisations of EBM are rooted in expected utility theory, which defines rational decisions as choices that are expected to result in the greatest benefit. Applying this theory to medical care, clinical decision-making models clearly demonstrate that rational decisions require not only a range of relevant evidence, but also expertise to inform judgments regarding the credibility of estimates and to assess fit-to-context, and stakeholder preferences and values to weigh trade-offs among competing outcomes. Using these models as exemplars, we argue that attempts to apply research evidence directly to practice or policy without consideration of expert judgement or preferences and values reflect fundamental misconceptions about the theory of rational decision making that can impede implementation. In turn, the decision sciences highlight the need to consider the role of expertise and judgment when interpreting research evidence, the role of preferences and values when applying it to specific decisions, and the practical limits imposed by the uncertainty inherent in each.
Alliance for Useful Evidence (2016) Alliance for useful evidence, www.alliance4usefulevidence.org/publication/
Bernstein, R.J. (1983) Beyond objectivism and relativism: Science, hermeneutics, and praxis, Philadelphia, PA: University of Pennsylvania Press.
Bosch-Capblanch, X., Lavis, J.N., Lewin, S., Atun, R., Røttingen, J.-A., Dröschel, D., Beck, L., Abalos, E., El-Jardali, F., Gilson, L., Oliver, S., Wyss, K., Tugwell, P., Kulier, R., Pang, T. and Haines, A. (2012) Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development, PLoS Medicine, 9(3): e1001185. doi: 10.1371/journal.pmed.1001185
Cairney, P. and Oliver, K. (2017) Evidence-based policymaking is not like evidence-based medicine, so how far should you go to bridge the divide between evidence and policy?, Health Research Policy and Systems, 15(1): 35. doi: 10.1186/s12961-017-0192-x
Cautin, R.L. and Lilienfeld, S.O. (eds) (2015) In Encyclopedia of clinical psychology, Chichester: John Wiley & Sons, pp 25–51.
Claridge, J.A. and Fabian, T.C. (2005) History and development of evidence-based medicine, World Journal of Surgery, 29(5): 547–53. doi: 10.1007/s00268-005-7910-1
Claxton, K., Sculpher, M. and Drummond, M. (2002) A rational framework for decision making by the National Institute For Clinical Excellence (NICE), The Lancet, 360(9334): 711–5. doi: 10.1016/S0140-6736(02)09832-X
Ducey, A., Pott, T., Thompson, C. and Ross, S. (2017) The moral economy of health technology assessment: an empirical qualitative study, Evidence & Policy, 13(1): 7–27.
Ebrahim, S., Sohani, Z.N., Montoya, L., Agarwal, A., Thorlund, K., Mills, E.J. and Ioannidis, J.P.A. (2014) ‘Reanalyses of randomized clinical trial data’, JAMA, 312(10): 1024–32. doi: 10.1001/jama.2014.9646
Elstein, A.S., Fryback, D.G., Weinstein, M.C., Pauker, S.G., Holmes-Rovner, M., Young, M.J., Barry, M.J., Eckman, M.H., Hunink, M.M. and Tsevat, J. (2004) ‘Presidential reflections on the 25th anniversary of the Society for Medical Decision Making’, Medical Decision Making, 24(4): 408–20. doi: 10.1177/0272989X04267676
Frank Porter Graham Child Development Institute (2017) National professional development center on autism spectrum disorder: evidence based practices, http://autismpdc.fpg.unc.edu/evidence-based-practices
Gadamer, H.G. (1996) The enigma of health: the art of healing in a scientific age, Stanford University Press, Stanford, CA: USA.
Gadamer, H.G. (2013) Truth and method, London, UK: Bloomsbury Publishing.
Gilboa, I. (2009) Theory of decision under uncertainty, Cambridge: Cambridge University Press.
Gough, D. and Boaz, A. (2017) Applying the rational model of evidence-informed policy and practice in the real world, Evidence & Policy, 13(1): 3–5.
Greenhalgh, T. and Russell, J. (2009) Evidence-based policymaking: a critique, Perspectives in Biology and Medicine, 52(2): 304–18. doi: 10.1353/pbm.0.0085
Greenhalgh, T., Howick, J. and Maskrey, N. (2014) Evidence based medicine: a movement in crisis?, BMJ, 348: g3725. doi: 10.1136/bmj.g3725
Han, P.K.J., Klein, W.M.P. and Arora, N.K. (2011) Varieties of uncertainty in health care: a conceptual taxonomy, Medical Decision Making, 31(6): 828–38. doi: 10.1177/0272989X10393976
Hartung, D.M., Zarin, D.A., Guise, J.M., McDonagh, M., Paynter, R. and Helfand, M. (2014) Reporting discrepancies between the ClinicalTrials.gov results database and peer-reviewed publications, Annals of Internal Medicine, 160(7): 477–83. doi: 10.7326/M13-0480
Hawkins, B. and Parkhurst, J. (2016) The ‘good governance’ of evidence in health policy, Evidence & Policy, 12(4): 575–92.
Hofmann, B., Bond, K. and Sandman, L. (2018) Evaluating facts and facting evaluations: on the fact-value relationship in HTA, Journal of Evaluation in Clinical Practice, 24(5): 957–65. doi: 10.1111/jep.12920
Hunink, M.M., Weinstein, M.C., Wittenberg, E., Drummond, M.F., Pliskin, J.S., Wong, J.B. and Glasziou, P.P. (2014) Decision making in health and medicine: Integrating evidence and values, Cambridge: Cambridge University Press.
Hyde, J.K., Mackie, T.I., Palinkas, L.A., Niemi, E. and Leslie, L.K. (2016) Evidence use in mental health policy making for children in foster care, Administration and Policy in Mental Health and Mental Health Services Research, 43(1): 52–66. doi: 10.1007/s10488-015-0633-1
Jones, A. and Steel, D. (2018) Evaluating the quality of medical evidence in real-world contexts, Journal of Evaluation in Clinical Practice, 24(5): 950–56. doi: 10.1111/jep.12983
Jones, C.W., Handler, L., Crowell, K.E., Keil, L.G., Weaver, M.A. and Platts-Mills, T.F. (2013) Non-publication of large randomized clinical trials: cross sectional analysis, BMJ, 347.
Kahneman, D. and Klein, G. (2009) Conditions for intuitive expertise: a failure to disagree, American Psychologist, 64(6): 515–26. doi: 10.1037/a0016755
Kasper, J., Geiger, F., Freiberger, S. and Schmidt, A. (2008) Decision-related uncertainties perceived by people with cancer – modelling the subject of shared decision making, Psycho-Oncology, 17(1): 42–8. doi: 10.1002/pon.1190
Keirns, C.C. and Goold, S. (2009) Patient-centered care and preference-sensitive decision making, JAMA, 302(16): 1805–06. doi: 10.1001/jama.2009.1550
Kelly, M.P. (2018) The need for a rationalist turn in evidence-based medicine, Journal of Evaluation in Clinical Practice, 24(5): 1158–65. doi: 10.1111/jep.12974
Lavis, J.N., Oxman, A.D., Lewin, S. and Fretheim, A. (2009) SUPPORT Tools for evidence-informed health policymaking (STP), Health Research Policy and Systems, 7(1): I1. doi: 10.1186/1478-4505-7-1
Mathieu, S., Boutron, I., Moher, D., Altman, D.G. and Ravaud, P. (2009) Comparison of registered and published primary outcomes in randomized controlled trials, JAMA, 302(9): 977–84. doi: 10.1001/jama.2009.1242
National Academies of Sciences, E. [?], and Medicine (2015) Improving diagnosis in health care, Washington, DC: The National Academies Press.
Neuman, M.D., Goldstein, J.N., Cirullo, M.A. and Schwartz, J. (2014) Durability of class 1 American College Of Cardiology/American Heart Association clinical practice guideline recommendations, JAMA, 311(20): 2092–100. doi: 10.1001/jama.2014.4949
Oliver, K., Lorenc, T. and Innvær, S. (2014) New directions in evidence-based policy research: a critical analysis of the literature, Health Research Policy and Systems, 12(1): 34. doi: 10.1186/1478-4505-12-34
Owens, D.K., Whitlock, E.P., Henderson, J., Pignone, M.P., Krist, A.H., Bibbins-Domingo, K., Curry, S.J., Davidson, K.W., Ebell, M., Gillman, M.W., Grossman, D.C., Kemper, A.R., Kurth, A.E., Maciosek, M., Siu, A.L. and LeFevre, M.L. (2016) Use of decision models in the development of evidence-based clinical preventive services recommendations: methods of the US preventive services task force, Annals of Internal Medicine, 165(7): 501–8. doi: 10.7326/M15-2531
Pauker, S.G. and Kassirer, J.P. (1975) Therapeutic decision making: a cost-benefit analysis, New England Journal of Medicine, 293(5): 229–34. doi: 10.1056/NEJM197507312930505
Pauker, S.G. and Kassirer, J.P. (1980) The threshold approach to clinical decision making, New England Journal of Medicine, 302(20): 1109–17. doi: 10.1056/NEJM198005153022003
Prasad, V., Vandross, A., Toomey, C., Cheung, M., Rho, J., Quinn, S., Chacko, S.J., Borkar, D., Gall, V., Selvaraj, S., Ho, N. and Cifu, A. (2013) A decade of reversal: an analysis of 146 contradicted medical practices, Mayo Clinic Proceedings, 88(8): 790–8. doi: 10.1016/j.mayocp.2013.05.012
Rabin, B.A., Brownson, R.C., Haire-Joshu, D., Kreuter, M.W. and Weaver, N.L. (2008) A glossary for dissemination and implementation research in health, Journal of Public Health Management and Practice, 14(2): 117–23. doi: 10.1097/01.PHH.0000311888.06252.bb
Rawlins, M. (2008) De testimonio: on the evidence for decisions about the use of therapeutic interventions, Clinical Medicine, 8(6): 579–88. doi: 10.7861/clinmedicine.8-6-579
Richardson, W. and Detsky, A.S. (1995) Users’ guides to the medical literature: VII. how to use a clinical decision analysis, a. are the results of the study valid?, JAMA, 273(16): 1292–95. doi: 10.1001/jama.1995.03520400062046
Sackett, D.L. and Rosenberg, W.M.C. (1995) On the need for evidence-based medicine, Journal of Public Health, 17(3): 330–34.
Sackett, D.L., Rosenberg, W.M.C., Gray, J.A.M., Haynes, R.B. and Richardson, W.S. (1996) Evidence based medicine: what it is and what it isn’t, BMJ, 312(7023): 71–2. doi: 10.1136/bmj.312.7023.71
Saini, P., Loke, Y.K., Gamble, C., Altman, D.G., Williamson, P.R. and Kirkham, J.J. (2014) Selective reporting bias of harm outcomes within studies: findings from a cohort of systematic reviews, BMJ, 349. doi: 10.1136/bmj.g6501
Schlander, M. (2008) The use of cost-effectiveness by the National Institute for Health and Clinical Excellence (NICE): no (t yet an) exemplar of a deliberative process, Journal of Medical Ethics, 34(7): 534–39. doi: 10.1136/jme.2007.021683
Shadish, W., Cook, T. and Campbell, D. (2002) Experimental and quasi-experimental designs for generalized causal inferences, Boston, MA: Houghton Mifflin Company.
Spring, B. (2007) Evidence-based practice in clinical psychology: what it is, why it matters; what you need to know, Journal of Clinical Psychology, 63(7): 611–31. doi: 10.1002/jclp.20373
Steinbrook, R., Kassirer, J.P. and Angell, M. (2015) Justifying conflicts of interest in medical journals: a very bad idea, BMJ, 350: h2942.
Tonelli, M. (1998) The philosophical limits of evidence-based medicine, Academic Medicine, 73: 1234–40. doi: 10.1097/00001888-199812000-00011
Tversky, A. (1977) ‘Features of similarity’, Psychological Review, 84(4): 327–52. doi: 10.1037/0033-295X.84.4.327
US Department of Health and Human Services (2016) The National Cancer Institute, https://www.cancer.gov/
US Department of Health and Human Services (2017) Substance abuse and mental health services administration, https://www.samhsa.gov/
United States Preventive Services Task Force (2007) Screening for sickle cell disease in newborns: U.S. Preventive Services Task Force recommendation statement. Agency for Healthcare Research and Quality, https://www.aafp.org/afp/2008/0501/p1300.html, Accessed June 1, 2019.
Walker, V.R. (1991) The siren songs of science: toward a taxonomy of scientific uncertainty for decisionmakers, Connecticut Law Review, 23(567).
May 2022 onwards | Past Year | Past 30 Days | |
---|---|---|---|
Abstract Views | 3154 | 1498 | 56 |
Full Text Views | 173 | 51 | 1 |
PDF Downloads | 201 | 73 | 3 |
Institutional librarians can find more information about free trials here