Abstract
Background:
Local government (LG) is ideally placed to influence the determinants of public health (PH) and reduce inequalities, but opportunities are routinely missed.
Aims and objectives:
The aim of the Local Authority Champions of Research (LACoR) study was to explore ways to embed a culture of evidence use in LG.
Methods:
Five linked work packages were undertaken using mixed methods. In this paper, we report data from semi-structured interviews with UK local authority (LA) staff (n=14).
Findings:
Findings show a changing culture of LG: embedded researchers can enhance connectivity and interaction, build linkages, use levers of influence, and learn alongside LG navigators. Understanding the diverse microcultures of evidence use in LG is critical. Research champions can help to navigate the social, financial, political and regulatory context of LG and academia, influencing change dynamically as opportunities emerge.
Discussion:
Changing organisational subcultures is ambitious and unpredictable given the complexities of, and variability in, local contexts. Cumulative changes appear possible by recognising existing assets, using relational approaches to respond to LG priorities. In-house capacity remains underestimated and underutilised in efforts to embed evidence use in LG decision making. Co-located embedded researchers can use contextually specific knowledge and relationships to enhance evidence use in LG in collaboration with system navigators.
Conclusions:
There is a need for academics to adapt their approach, to take account of the context of LG to achieve meaningful health and social impacts with LG and test the contribution of embedded approaches to wider system change.
Key messages
Evidence use in local government is changing but in-house capacity remains underestimated and underutilised.
Embedded, co-located researchers can work with local government navigators to use levers of influence.
Changes to academic funding, career paths, incentives and assumptions are required.
The influence and impact of embedded research in local government requires further testing.
Summary
The question explored in this study was how to embed a culture of research and evidence use in local government (LG). Although studies of LG call for research to reflect the complexity of local populations and systems of influence, taking account of local political accountability requirements (Kneale et al, 2019), there are limited empirical studies of evidence use in public health which focus on the views of LG staff. Qualitative and ethnographic methods were used to understand the complex systems of LG, organisational microcultures and relationships involved. In this paper, we draw on analysis of in-depth qualitative interviews with LG staff in one UK authority to provide a nuanced understanding of context and efforts to influence evidence use. Empirical examples of knowledge mobilisation, co-production and embedded research are examined by a team comprising insider and outsider researchers. We identify the changes required in academia and LG to better utilise existing assets and support long-term collaborative endeavours aimed at diffuse kinds of conceptual and attitudinal influence in LG.
Background and literature review
The relocation of public health (PH) responsibilities from the NHS to local government in England in 2013, following implementation of the Health and Social Care Act (2012) placed LG in an ideal position to generate and use evidence to influence the upstream determinants of PH and reduce inequalities (Hunter et al, 2016). The reorganisation of PH structures means PH decision-making processes are shaped by different actors, and existing patterns of evidence use have been disrupted (Kneale et al, 2019), requiring qualitative methods to understand these in context.
In this study, we apply a complexity frame of reference which views local authorities as not just a single uniform entity but as a ‘social system’ with internal (that is, staff, structures, cultural values) and external (that is, political environment, national directives) influences (Rutter et al, 2017). Both academia and LG can be conceptualised as workplaces with complex, dynamic, ecological systems of interacting activity, social networks and feedback loops influencing one another (Hawe et al, 2009; South et al, 2014). A study of evidence use in LG then requires understanding of the multilayered organisational context and culture (Haynes et al, 2020), the systems that influence such a culture, and which are in turn influenced by it (Braithwaite et al, 2018). Our co-produced study sought to harness opportunities to improve system-level research capability in collaboration with LG actors (Hawe et al, 2009: 4), given the emerging consensus that evidence is not generated in isolation and passed on to those who use it (Holmes et al, 2017; Cheetham et al, 2018).
Factors influencing evidence use
Multiple factors, including power and politics, influence evidence use and policy implementation, and these vary across LG decision making (Armstrong et al, 2013; Lorenc et al, 2014; Oliver et al, 2014). Studies of UK LG show that the relationship between evidence, policy and practice is nuanced, dynamic, political and contested (Boaz et al, 2019), values-driven and contentious (Cairney, 2019). Financial pressures in LG drive a focus on cost-effective interventions to improve health and reduce inequalities (Hunter et al, 2016), with capacity of PH teams limited and control over resources negotiated and contested. Evidence use in LG has been described as patchy, slow and haphazard (Allen et al, 2014), suggesting different approaches are required to understand and encourage its use.
Organisational churn, rising demands, fragmentation, siloed thinking, governance and access issues, capacity, workload and resource pressures have been shown to limit the ability, time and space to use evidence as a part of routine decision making (Allen et al, 2014; Oliver et al, 2014; Hunter, 2019; Kneale et al, 2019). The complex relationships between research, policy and practice are concerns which the COVID-19 pandemic has brought to prominence. The challenges are likely to have intensified in light of the pressures on LG as a result of the pandemic.
Much is known from previous research in the UK and internationally, about the complexities of using evidence in policy and practice: research timescales often do not align with policy processes; research findings are inaccessible; different types of evidence are valued (Oliver et al, 2014; Powell et al, 2018; Van der Graaf et al, 2018), and local evidence prioritised (Kneale et al, 2019). Formal research evidence competes with informal knowledge influenced by personal, social and political processes (Fox et al, 2019). There is recognition that closer interaction between those working in PH policy and practice and academic researchers increases the likelihood of evidence being used to improve outcomes (Nutley et al, 2007), but progress remains slow (Boaz et al, 2019). A systematic scoping review of barriers and opportunities to evidence use in English PH decision making highlighted the importance of local experts in providing evidence and knowledge (Kneale et al, 2017). The need to develop a deeper understanding of evidence requirements from the perspective of LG decision makers was identified, given that most published studies are from the perspectives of researchers (Kneale et al, 2017). This study addresses this gap by focusing on LG actors’ experiences and their perceptions of potential solutions.
Knowledge brokering
The world of academic research is sometimes seen as detached from the ‘messy’ and ‘complex real-world’ of commissioning (Wye et al, 2019), policymaking (Cairney, 2019) and practice (French et al, 2009), causing barriers to research impact in LG settings (Sanders et al, 2017). The absence of trusting relationships between researchers and LG partners has been identified as an important barrier to effective evidence use (Wilkinson et al, 2012; Armstrong et al, 2013; Allen et al, 2014; Wye et al, 2019). In acknowledging the importance of personal interaction, the concept of knowledge brokering (KB) has emerged in efforts to facilitate social interaction between researchers and policymakers (Wye et al, 2019). Although conceptually appealing, presentations of KB models have been criticised for failing to discuss the practical difficulties of operationalising roles with significant user investment in settings where politics matter and evidence is not considered neutral (Contandriopoulos et al, 2010).
While the strengthening of networks and communications between evidence producers and evidence users is seen as central to meeting the needs of decision makers in health (Wilkinson et al, 2012), the ways in which this applies to LG have been relatively under-researched. Policymakers and researchers are unhelpfully seen as occupying separate worlds (Mackillop et al, 2020), but limited research has been undertaken into efforts to address this perceived division. Further critical interrogation is required of the assumptions underpinning the distinction between research user and producer in the context of LG (Kneale et al, 2017).
Embedded research
Pragmatic efforts to enhance connectivity and interaction between research users and producers are growing, including through embedded research (ER) or researcher-in-residence initiatives (Vindrola-Padros et al, 2019). These have been piloted in various forms in NHS settings and healthcare organisations (Wolfenden et al, 2017; Holmes et al, 2017; Coates and Mickan, 2020), integrated care organisations (Gradinger et al, 2019), healthcare commissioning (Wye et al, 2019), PH (Lewis and Russell, 2011), children’s services (Wong et al, 2009), and education (Duggan, 2014). The pros and cons of embedded models have been explored in health service quality improvement initiatives (Vindrola-Padros et al, 2017; Charucca et al, 2019) but factors influencing their scope and impact in LG require further exploration (Gagliardi et al, 2016). A study in NE England identified favourable contextual ingredients for ER in LG, but noted its limits in facilitating system-wide organisational transformation (Cheetham et al, 2018), suggesting further research is required to understand its contribution alongside other measures in LG beyond PH.
Given the conceptual complexities surrounding the meanings of ‘research’ and ‘evidence’, and because ‘use’ itself is rarely a directly observable phenomenon (Gitomer and Crouse, 2019: 78), we explore how evidence is found, contextualised, mobilised and negotiated in PH policy, practice and commissioning processes, including its ‘deliberate, strategic and inherently political role in persuasion’ (Yanovitsky and Weber, 2018: 67). In this paper, we examine participants’ perspectives about evidence use in LG, including the views of LG officers, their experiences, and perceptions of embedded, co-located research models.
Theorising research-policy relations
The study draws on theoretical models which define collaborative problem solving between researchers and decision makers through linkage and exchange (Lomas, 2000), resulting in mutual learning through the process of planning, producing, disseminating and applying new or existing research in decision making (Canadian Health Services Research Foundation cited in Graham et al, 2006: 15).
In calling for a rethink of policy impact drawing on political and social science, Boswell and Smith (2017) outline four models of research-policy relations, each underpinned by distinct assumptions about knowledge and policy, with implications for how to define and measure impact. These include an alternative model of research-policy relations as ‘autonomous spheres’, each operating according to separate logic and systems of meaning. Boswell and Smith (2017) challenge any assumptions that research impact can be achieved by findings created independently of policy or politics through externally-generated researcher-led steps. Instead, models are recommended which promote engagement with knowledge users and are attentive to the complex pathways to research impact. We return to these models in the discussion to help interrogate the political context of knowledge utilisation in LG.
Our study addresses an under-explored topic of research use in LG, offering pragmatic examples of collaborative efforts to build a culture of evidence use in PH. It contributes to a growing literature on knowledge brokering (Phipps and Morton, 2013; Wye et al, 2019; MacKillop et al, 2020), knowledge mobilisation (Powell et al, 2018; Haynes et al, 2020) and co-production (Metz et al, 2019), in the context of LG. It offers a detailed analysis of the relationships between researchers and policymakers, contributing to an understanding of why valuable research insights may not be fully realised in efforts to address PH priorities.
Methods
Five linked work packages were undertaken using mixed methods. The views of LG staff who participated in four workshops across the UK (n = 54) are reported elsewhere (Van der Graaf et al, 2021), informed by a rapid literature review, and an online scoping survey. In this paper, we report findings from qualitative interviews (n=14) undertaken in one LA.
Interviews
A purposive sample of LA staff and stakeholders from partner organisations in one area (n=14) were recruited to explore perceptions of what, why and how evidence is used in LG: factors influencing efforts to build a culture of evidence use and any examples of ways in which evidence had been used to effect change. The LA was selected for pragmatic reasons, given the time and resource limitations of a nine-month project. We recognise that generalisability is limited by the small number of participants working in a LA which is likely to be geographically, culturally and politically distinct, and findings may not be representative of views and experiences of LG staff across the UK.
One to one, face-to-face, semi-structured interviews were conducted between February and August 2019 by an experienced university-employed researcher with expertise in ER in LG. Two LA colleagues operated as organisational navigators, helping to familiarise the research team with LA structures and processes, and assisted with data analysis. Research team members included one LG employee and university-employed researchers with backgrounds in LG commissioning, NHS health promotion and PH. As such, the research team consisted of ‘outsider’ and ‘insider’ researchers, defined by Brannick and Coghlan (2007: 59) as ‘complete members of organizational systems conducting research in and on their own organisations’ alongside university researchers with academic expertise in ER, evidence use, knowledge mobilisation and co-production, who temporarily study an organisation for the purposes of research, each committed to learning through action research. Participant Information Sheets (PIS) and consent forms were circulated, on behalf of the research team, to all potential participants by the Director of Public Health, to inform people about the study and invite them to contact the researchers with any questions. Participants made arrangements with the researcher directly if they were willing to take part. The sample included LA staff (n=10), an elected member (n=1), a senior representative from the Clinical Commissioning Group (n=1), the voluntary and community sector (VCS) (n=1), and an academic co-located in the LA (n=1). Council officers who participated were located in three different directorates and included representatives from PH (n=3), insights and informatics (n=4), community safety (n=2), and commissioning and procurement (n=1).
Data collection and analysis
A draft interview schedule (see Appendix 1) was piloted and amended using feedback from one LG interviewee. Interviews lasted between 40 minutes and one hour 20 minutes (average 65 minutes), were audio-recorded with permission and transcribed verbatim. Transcripts were coded and analysed thematically using a coding framework informed by published literature. Interviews explored views about factors influencing evidence use; practical examples of collaboration and co-production; and relationships with, and implications for, academia. Verbatim quotes (with interviewee signifier and page number where extract appears in transcript) are included to illustrate participants’ views about evidence use, experience of collaboration, and examples of ER. Some avenues of enquiry and participant responses may have been influenced by our interests in knowledge mobilisation, ER and co-production. In the following section, we report the findings from interviews with local government staff.
Views about evidence use in local government
Some departments in the authority see real value in research and analysis, and some departments don’t. And I think that’s a real shame. So, it’s how do we give those departments the confidence and kind of sell how important this is, not just at that really senior level, but actually mid-level management. (IV4:28)
I think it’s fair to say that capacity has been affected quite significantly by austerity over the last 8–10 years. On the other hand, I would say there has probably been, because of the lack of resources, more of a sense that it’s really important that the way in which the policies and practices that local authorities have adopted is informed by evidence. (IV14:1)
The luxury of having time for detailed evidence-informed scenario planning was sometimes felt to be sacrificed in place of a more pragmatic approach, in which LG policymakers ‘corral the evidence you think you’ve got… you almost start with what you want but then go back and see what evidence would support it’ (IV11:1). LA officers in and out of PH reported frustrations about missed opportunities to use evidence to inform decision making: ‘I think part of it is very much down to capacity. We’re all so busy doing the day jobs sometimes it’s hard to lift your head up and think’ (IV5:17).
Academic peer-reviewed research was not always accessible or seen as relevant. Lack of time, the need to spend money quickly, reluctance to decommission and lack of knowledge about what works, beyond what neighbouring authorities were doing, and uncertainty over how to interpret research findings and jargon, were all said to hinder use of published evidence. Local data was prioritised, and information overload, workload pressures and concerns about data sharing, meant that available evidence was not routinely used or shared, particularly in light of reduced PH capacity.
Opportunities for collaboration
… a desire to collaborate with different partners around how we actually build a more nuanced and rounded picture of evidence (IV14:1).
What I see in people across the council is actually a desire to move towards a stronger basis for the things they’re doing… I think there’s a willingness to go that way. We also have to deal with reality which requires us often to move quite quickly, without the sort of timescales that are available if you’re doing a pure academic project (IV8:1).
Moves to support research and evidence use in LG included LA staff with analytical skills supporting different LA teams to use existing data to inform planning and commissioning; partnerships with university-based academic researchers generating new evidence; and staff with research backgrounds being recruited to LA positions to build research capacity from within. It was suggested these developments coincided with, and reflected, the changing profile and priorities of senior leadership in LG: ‘We’ve definitely got more academically-minded and research-minded people leading the council now. So, that’s become more of a normal conversation with that kind of side of it. So, that’s quite a good thing, so that helps shift that culture’ (IV13:16).
Leadership (at all levels) was identified as important in normalising evidence use and addressing some of the pressures that hampered its use. Participants identified the importance of leadership style; relational approaches; inter/intraorganisational dialogue and opportunities for in/formal interaction between researchers and practitioners; and an open-learning culture within and between council departments and wider stakeholders.
Examples of co-production and capacity building
Universities were identified among a broad range of partners, engaged in a complex system of interactions between senior leaders, managers, officers, elected members, residents and wider stakeholders. Although academic expertise is not necessarily privileged in this system, our findings suggest there is energy and enthusiasm to build on existing assets and maximise the use of existing research capacity. People with finely-tuned interpersonal, political and analytical skills were identified. They operated as ‘research and evidence champions’ ‘system navigators’ and ‘boundary spanners’ in LG, indicating these roles are being fulfilled by practitioners and policymakers working alongside academics to routinely integrate different types of evidence in LA decision-making processes, in and out of PH. The moves to build in-house analytical and relational capacity to enhance understanding, taking a systems approach to addressing public health priorities, was recognised as challenging and necessary across different departments:
It is not only about processing information and looking at trends; it is also about how we interpret that, and what does that mean. (IV4:3)
In simple terms, our job is very much about collection of data, interpretation of it, determining what the patterns and trends and so on might be, linking in with practitioner partners and saying okay, we’re seeing this, what does that mean to you, and really that interpretational aspect of it and trying to develop an evidence base for the sort of policies that we might put in place. (IV13:2)
The strategic needs assessment is both a science and an art form together and it is there to help you make a decision. That’s all it’s there to do. It’s not there to give you hard and fast statistics that nail down what you should be doing. You, in the end, make a decision based on what your professional opinion is of what the evidence base is telling us we should do. (IV13:5)
I think that we got a lot of really, really valuable analysis and information from it. I think what we also did with that group of social workers, was to support them to think differently about data. (IV1:6)
I think that we do need to be much, much cleverer about how we can co-ordinate or understand those pieces of research… it’s nobody’s job in a local authority to ask the wider questions… from a research point of view, trying to piece together the wider picture. (IV3:19)
University-employed academic researchers ‘hosted’ by different LA departments working alongside LA staff, including data analysts, is attracting growing interest. Many participants voiced enthusiasm about working alongside co-located, embedded researchers with understanding of local decision-making processes, who could identify new and existing sources of evidence, undertake and feed in academic research and use levers of influence to facilitate knowledge mobilisation in real time.
Perceptions of embedded research in local government
What I like about that [embedded] model is it does enable you to get a degree of depth and trust, which I think is sometimes quite difficult to do if you’re doing a project which is time limited and remote. I think it’s that sort of depth, when you’re actually based in an organisation, the nuances which you’re able to pick up around where some of the different pressure points are, and the different drivers, I think can result in a much more meaningful or deep understanding of the issues. (IV14:8)
The ‘counter argument’ centred on concerns about perceived independence, academic credibility and rigour. Other participants suggested closer working relationships helped to challenge accepted norms and facilitate organisational change. Co-located models can help academic researchers build trust, recognise the assets available in LG, and question assumptions held about LA staff’s willingness or ability to use evidence. One LG interviewee commented that some academics could be ‘very very rigid and come with a little bit of a chip on their shoulder’, without necessarily appreciating the complexities of LG: ‘There is a lot of really skilled and talented and competent people in here (LA) and sometimes it takes a bit of time for people to deal with some of their own perceptions, I think, who come from universities’ (IV4:27).
Where collaborations were seen as successful, for example through visiting academics / internships working on specific policy issues, the fresh perspective was welcome: ‘I think it worked really well because she was able to bring in the expertise, the academic expertise that we don’t have and that together was able to bring about change, and work together and look at what was the best way of doing things differently going forward’ (IV5:9).
I think there’s a problem in that quite a lot of academics have fled the harsh realities of real life if I’m honest about it. Academia attracts people who like to be able to control out all of the extraneous noise, so there are quite a lot of academics who don’t want that messiness… What I really want is academics who want to partner and who care about the outcome as you do and who want to get involved and do that, which is probably the reason for veering towards the embedded thinking, rather than just commissioning pieces of academic work. (IV8:9)
Partnerships with universities
The right people aren’t necessarily the most powerful people at the top of the organisation. There is a lot of value in bottom up cultural change... I also find it’s a good way to influence using practitioners and people with lived experience, their perspectives as well. Senior managers are often quite reluctant to argue against the views of those individuals. (IV12: 17)
The university has committed to the idea of social justice being something that’s really important. Part of that wider commitment with the university being a civic university, being part of the city and trying to work to improve things rather than the business led approach that universities take where it is completely around your career is based on maximising income for the university. (IV12:20)
In efforts to realise their civic responsibilities, universities gained from LG experience as part of a wider system promoting reciprocal, inclusive, community-centred, advocacy-based approaches to impact. Co-located research posts with clear accountability and support structures in place can complement in-house capacity.
Jointly funded ER posts could bring potential benefits to both host and research organisations, resulting in improved understanding of LG decision-making processes and determinants of organisational culture and behaviour. ERs could support LA colleagues to access published evidence; spot researchable questions; work out how to respond; co-design and undertake timely research; understand the needs of local communities; secure external research funding; and increase awareness of the contextual factors influencing evidence use. ER is not without risks, and these findings suggest that careful consideration is needed of the pros and cons of different embedded models (or combinations), and to evaluate their effects in LG.
Discussion
This paper sets out findings from qualitative interviews undertaken as part of a wider study exploring evidence use in LG. Drawing on the perspectives of decision makers immersed in LG, we describe the context from those who have working knowledge of the complex, multilayered organisational context of LG to understand factors influencing evidence use. Despite pressures on LG staff, we identified high levels of commitment, energy and enthusiasm to use evidence, with examples of ‘sustained interactivity’ between researchers, policymakers and practitioners, involving longstanding partnership approaches. Familiarity with the cultures, structures and pressures of both LG and academia helped the joint development, sharing and use of evidence.
Our findings concur with Oliver et al (2019), who suggest that the current culture of ‘hit and run’ research (get funding, do research, achieve impact, leave) hampers meaningful opportunities to reflect and learn together. With an in-depth understanding of the social, political, financial and regulatory context of LG, a relational approach, and open attitudes, researchers can maximise opportunities for research evidence to inform, and support decision making as part of multi-agency teams, alongside other forms of knowledge, co-produced with policymakers, practitioners, politicians and the public. In this study, traditional distinctions between research user and producer are blurred, with LG staff actively contributing to the co-production of research. Our findings provide reminders that interpersonal skills, including openness, honesty, humility, assertiveness, political astuteness and diplomacy are required for researchers to work alongside stakeholders in different parts of LG to normalise evidence use. Changes are required in academic methods, incentives, recruitment and funding arrangements to encourage this to happen routinely. Our findings support multidimensional views of research implementation processes (Fox et al, 2019), requiring practitioner engagement, a nuanced understanding of external and organisational context and political dynamics, in which research use is conceptualised as a learning process shaped by pre-existing knowledge and personal experience, judgements and values, as well as evidence (Kislov et al, 2014; Fox et al, 2019: 26). Many of the organisational attributes and enablers that support evidence use in policy (Oliver et al, 2014; Cairney, 2019) and practice (French et al, 2009) can be found in LG, including a supportive organisational culture that values and assimilates knowledge, and its application (Armstrong et al, 2013). An understanding of the specific micro-, meso- and macro-organisational contexts is critical to identify appropriate strategies that match the organisational culture.
In Table 1, we highlight principles and recommendations drawn from our findings, including in-house champions in different LG departments who can help navigate different microcultures of evidence use and reduce fragmentation, through meaningful partnerships, localised and tailored approaches (Rushmer et al, 2015; Van der Graaf et al, 2018), alongside understanding of the policymaking process and politics in LG, the role of officers and elected members, relevance of the political cycle, use of electoral tactics, interests, ideologies, conflicts and alliances that characterise LG (MacKillop et al, 2020).
Principles and recommendations to support evidence-informed policy and practice in local government
Conceptual clarity |
---|
• Work on defining the ‘problem’ together drawing on multiple perspectives from different departments and/or organisations |
• Be clear about how evidence is defined and articulated through the creation of shared language and meanings |
• Recognise that different kinds of evidence are valued differently by stakeholders |
• Take account of context |
Co-production |
• Support organisational learning |
• Engage in dialogue from the outset to build relationships and shared understanding |
• Create conversational spaces through the research process |
• Identify and support dialogue between research champions in different teams/departments |
• Listen to people’s anxieties and fears about change |
• Explore what co-production means to all stakeholders involved |
• Identify and engage willing partners, including community members, LA staff, elected members, academic staff and service providers |
• Be open and inclusive of people with different levels of responsibility |
• Recognise that leaders and potential leaders exist in unlikely places |
• Leadership (at all levels) is essential to create opportunities and address fears |
• Be aware of the impact of power differentials |
• Focus on where the energy is / where there is a desire for change |
• Demonstrate the need for research/data usage through practical examples |
Co-design |
• Co-design a flexible plan, not a detailed roadmap |
• Embrace and respond to the views and experiences of staff delivering services and people using them |
• Recognise and develop the assets and expertise which people bring |
• Be honest about the limitations of existing research, and explore what it can offer |
• Appreciate different ways of learning |
Learn and grow |
• Don’t parachute in, take account of existing staff skills and expertise |
• Make space and time to reflect on what evidence is needed for decision making, invest in staff |
Encourage curiosity |
• Build a culture in which it is okay to test out ideas and learn from implementing these |
• Co-locate people in multi-disciplinary teams to surface new insider/outside insights |
• Consider honorary arrangements and visiting university status between local authorities and universities |
• Encourage ‘constructively clueless’ questions of one another |
• Use what we know about organisational change |
• Be patient, expect resistance, explore how to resolve tensions collectively |
• Connect people with drive and energy to maintain momentum in terms of embedding evidence in practice |
• Seek sustainable funding and expect long-term commitment |
• Evaluate and share learning |
• Invest in research capacity along with relevant support, supervision and mentoring in the LA and in academia |
Opportunities for collaboration
The importance of ‘evidence champions’ (Vindrola-Padros et al, 2017), ‘credible intermediaries’, boundary spanners and knowledge brokers has been identified in previous studies and reviews (Contandriopoulos et al, 2010; Phipps and Morton 2013; Cheetham et al, 2019). These roles already exist in LG, and have been shown to provide collective brokering opportunities (Wye et al, 2020). Identified as essential elements of co-creation, knowledge brokers can connect individuals and groups of people with evidence enabling timely knowledge exchange (Metz et al, 2019). Using embedded models of co-production, the examples we identified provide potential entry points for staff in LG and academia to collaborate, weaving in research evidence and local data when opportunities present themselves, such as those identified by Wye et al (2019), informed by an understanding of the messy, nuanced social processes of decision making in LG (Cairney, 2019). ER holds promise, but not all departments are equally open or receptive to these models of co-production in LG. Different kinds of methodological and topic-specific expertise will be valued by stakeholders, requiring facilitation strategies to match the readiness of individuals, teams and context (Kitson et al, 2008). Further testing of diverse models is required by universities to harness LG capacity and build on the learning from embedded initiatives and researcher-in-residence improvement models in other settings, including health (Vindrola-Padros et al, 2019; Gradinger et al, 2019; Coates and Mickan, 2020; Marshall et al, 2022).
Implications for universities
The challenges facing universities are significant, not least in defining and achieving meaningful impact. There is scope for universities to contribute by encouraging a more diverse, equally valued, academic research workforce, nurturing and supporting a full range of differing skills (Hunter, 2019). Encouraging academics to work at the boundaries between academia, LG policy and practice, through knowledge mobilisation opportunities, secondments, internships, Knowledge Transfer Partnerships, joint training, work shadowing, co-funded PhDs, masters degrees and apprenticeship opportunities, will address questions of mutual interest (Allen et al, 2014). With carefully matched skills and expertise, potential risks related to social and academic isolation, and possible conflicts managed, university-based staff could also broker links between stakeholders and relevant academic teams, thereby strengthening connections between civic universities and the places where they are based.
Our findings indicate that combinations of co-produced approaches can produce cumulative impacts over time on questions of mutual interest. A shift in thinking is required akin to the capacity-building approaches in healthcare organisations outlined by Kislov et al (2014), who advocate practice-based, multilevel approaches, developing relevant capabilities at different levels of complexity. Measuring and evaluating their effects are important for accountability and learning (Boaz et al, 2019), using tools adapted for use in local government (for example, Canadian Foundation for Healthcare Improvement, 2014).
Moving forward, there is a need to develop methodological expertise, building on opportunities presented by ‘insider researchers’ (Brannick and Coghlan, 2007) and ‘in-house ethnographers’ (Hawe et al (2009), able to navigate the political context and social networks of LG. Efforts to build a culture of evidence use could be seen as interventions in complex systems that seek to improve outcomes by changing ways of working and enhancing evidence-informed decision making (Hawe et al, 2009). Our study suggests that new interactions, conversational spaces, and shared meanings can be created through participation in research processes, but academics need to adapt their approach to take account of the context of LG. Learning across multiple LG sites can provide opportunities for partners to come together to test and evaluate what is being done, and their impact.
Our findings suggest that significant attention is already being given to measuring what can be counted, and longitudinal qualitative research needs greater emphasis to develop an ecological approach to evidence use in LG. This chimes with calls for the more theoretically-informed approaches to policy impact proposed by Boswell and Smith (2017), whose ‘enlightenment’ model suggests that research impact involves incremental and diffuse ideational adjustments over long periods of time, generated by a wide range of research insights rather than through specific individual findings. In our study, elements of all four theoretical models outlined by Boswell and Smith (2017) could be identified in the accounts provided by LG staff, who said they valued opportunities to work alongside academic staff to use evidence to shape policy.
Some described how politics in LG could be seen to shape knowledge production, suggesting knowledge is employed for political rather than intellectual reasons, while others highlighted the benefits of co-production and collaboration, resulting in mutual gains. ER models could be said to be better suited to impact frameworks which reward such collaborative endeavours that build incrementally on a wide body of work; that develop long-term relationships with a range of non-academic audiences; and that bring about subtle conceptual shifts rather than clearly identifiable policy changes.
Given the reminder that policy impact may not always be benign, attention also needs to focus on the unintended/unanticipated consequences of efforts to build a culture of evidence use in LG (Oliver et al, 2019). Our findings suggest these may include continued missed opportunities; increased workload pressures; reduced capacity and confidence; increased frustrations; inter/intra-organisational tensions; entrenched positions; political disagreements and pressures; competing priorities; reputational risks; disagreement about what kinds of evidence is valued; and resistance to change among academics, LG officers and/or elected members. Anticipating potential challenges would avoid the paradox that those advocating greater research use often struggle to practice in research-informed ways themselves (Powell et al, 2018). This study predates COVID-19, but provides a timely reminder of the importance of embedding a meso-level organisational focus in its social, political and economic context, and understanding the dynamics of power relationships between different actors at local and national level (Geddes et al, 2007). Co-located ER offers opportunities to explore the profound consequences of the pandemic with local communities affected, working through the tensions of co-production while generating insights about the complex relationships between local and central government in their use and interpretation of evidence.
Conclusions
The findings from this study confirm there is an appetite to strengthen the use of evidence in LG, utilising personal networks and building trusting relationships between academics and LA staff. Research champions with relevant skills can act as change agents, as part of wider systems of evidence use. Further research is needed to capture the views of residents, elected members, and staff in NHS and partner organisations, funding bodies and academics working in LG. The study identified practical ways to build a culture of evidence use. ERs are one part of this changing landscape, with the potential to enhance connectivity and interaction, build linkages and networks across LG, acting as a critical friend and knowledge broker alongside system navigators. They rely on a receptive organisational culture, and in-house alliances may extend their potential influence and impact. In complex systems, like local authorities, change is unpredictable and emergent. Building social networks and relationships with officers and politicians can enable researchers to make the case for evidence-informed approaches relevant to the organisational microcultures of LG, monitoring and influencing change as it happens. Sustainable funding and incentives are required to facilitate system-wide changes, and grow networks of research champions within and between local authorities, connected to academia, to address questions which reflect the priorities of LG and local communities.
Funding
‘Developing Local Authority Champions of Research (LACoR) through an embedded research culture: a Proof of Concept project’ was supported by the Health Foundation, an independent charity committed to bringing about better health and healthcare for people in the UK (https://health.org.uk/). The Health Foundation was not involved in the design of the study, nor the collection and analysis of the data. MC is Research Fellow and PvG is Deputy Theme lead in the Knowledge Mobilisation and Implementation Science theme of the NIHR Applied Research Collaboration North East and North Cumbria (NIHR200173). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
MC and PvG are members of Fuse, the Centre for Translational Research in Public Health (www.fuse.ac.uk). Fuse is a UK Clinical Research Collaboration (UKCRC) Public Health Research Centre of Excellence. Funding for Fuse from the British Heart Foundation, Cancer Research UK, National Institute of Health Research, Economic and Social Research Council, Medical Research Council, Health and Social Care Research and Development Office, Northern Ireland, National Institute for Social Care and Health Research (Welsh Assembly Government) and the Wellcome Trust, under the auspices of the UKCRC, is gratefully acknowledged. The views expressed in this paper do not necessarily represent those of the funders or UKCRC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Acknowledgements
We would like to thank all the policymakers, practitioners and stakeholders who engaged in the Local Authority Champions of Research study, Laura Ritson and all co-investigators: Eugene Milne, Frank Kee, Harry Rutter, Mark Tully, Paul Roderick, David Hunter, Clare Bambra, Luke Vale, Vera Araujo-Soares, Ruth Hunter, Brendan Bonner, Nisreen Alwan, Jason Horsley, Helen Walters, and Nigel Grimshaw.
Ethics statement
Ethical approval for this study was obtained from Newcastle University (ref no. 48424) in April 2019, and written informed consent to participate was obtained from all study participants.
Contributors’ statement
AA conceived the idea for the study, developed the study design and sought funding from the Health Foundation, with input from all authors and co-investigators. Data collection, analysis and interpretation were undertaken by AA, MC, SR, CH, DH and PvdG. MC wrote the first and subsequent drafts of the manuscript, which were commented on by all co-authors. All co-authors read and approved the final manuscript.
Conflict of interest
The authors declare that there is no conflict of interest.
References
Allen, T., Grace, C. and Martin, S. (2014) From analysis to action: connecting research and local government in an age of austerity, report, Local Government Knowledge Navigator.
Armstrong, R.M. et al. (2013) Knowledge translation strategies to improve the use of evidence in public health decision making in local government: intervention design and implementation plan, Implementation Science, 8: 121. doi: 10.1186/1748-5908-8-121
Boaz, A., Davies, H., Fraser, A. and Nutley, S. (2019) What Works Now? Evidence-Informed Policy and Practice, Bristol: Policy Press.
Boswell, C. and Smith, K. (2017) Rethinking policy ‘impact’: four models of research policy relations, Palgrave Communications, 3: 44, doi: 10.1057/s41599-017-0042-z.
Braithwaite, J., Churruca, K., Long, J.C., Ellis, L.A. and Herkes, J. (2018) When complexity science meets implementation science: a theoretical and empirical analysis of systems change, BMC Medicine, 16: 63. doi: 10.1186/s12916-018-1057-z
Brannick, T. and Coghlan, D. (2007) In defense of being ‘Native’: the case for insider academic research, Organizational Research Methods, 10(1): 59–74. doi: 10.1177/1094428106289253
Cairney, P. (2019) Evidence and policy making, in A., Boaz, H., Davies, A., Fraser and S. Nutley, What Works Now? Evidence-Informed Policy and Practice, Bristol: Policy Press, pp 21–40.
Canadian Foundation for Healthcare Improvement (2014) Is research working for you? A self-assessment tool and discussion guide for health services management and policy organizations, www.cfhi-fcass.ca.
Charruca, K., Ludlow, K., Taylor, N., Long, J., Best, S. and Braithwaite, J. (2019) The time has come: embedded implementation research for health care improvement, Journal of Evaluation in Clinic Practice, 25(3): 373–80. doi: 10.1111/jep.13100
Cheetham, M., Redgate, S., Humble, C., Van der Graaf, P. and Adamson, A. (2019) Local authority champions of research: a mixed method proof of concept study, meeting abstract, The Lancet, 394(Suppl.2): 511, doi: 10.1016/S0140-6736(19)32808–9.
Cheetham, M., Wiseman, A., Khazaeli, B., Gibson, E., Gray, P., Van Der Graaf, P. and Rushmer, R. (2018) Embedded research; a promising way to create evidence-informed impact in public health, Journal of Public Health, 40(Suppl.1): i64–i70, doi: 10.1093/pubmed/fdx125.
Coates, D. and Mickan, S. (2020) Challenges and enablers of the embedded researcher model, Journal of Health Organisation and Management, 34(7): 743–64. doi: 10.1108/JHOM-02-2020-0043
Contandriopoulos, D., Lemire, M., Demis, J. and Tremblay, E. (2010) Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature, Milbank Quarterly, 88(4): 444–83. doi: 10.1111/j.1468-0009.2010.00608.x
Duggan, J. (2014) Critical friendship and critical orphanship: embedded research of an English local authority initiative, Management in Education, 28(1): 12–18. doi: 10.1177/0892020613510118
Fox, C., Gray, S. and O’Sullivan, J. (2019) Transforming Research and Policy. A Handbook to Connect Research with Policy Making, Manchester: Manchester Metropolitan University.
French, B., Thomas, L.H., Baker, P., Burton, C.R., Pennington, L. and Roddam, H. (2009) What can management theories offer evidence-based practice? A comparative analysis of measurement tools for organisational context, Implementation Science, 4: 28. doi: 10.1186/1748-5908-4-28
Gagliardi, A.R., Berta, W., Kothari, A., Boyko, J. and Urquhart, R. (2016) Integrated knowledge translation (IKT) in health care: a scoping review, Implementation Science, 11: 38, doi: 10.1186/s13012-016-0399-1.
Geddes, M., Davies, J. and Fuller, C. (2007) Evaluating local strategic partnerships: theory and practice of change, Local Government Studies, 33(1): 97–116. doi: 10.1080/03003930601081358
Gitomer, D. and Crouse, K. (2019) Studying the Use of Research Evidence: A Review of Methods, New York: William T. Grant Foundation.
Gradinger, F., Elston, J., Asthana, S., Martin, S. and Byng, R. (2019) Reflections on the researcher-in-residence model Co-producing knowledge for action in an integrated care organisation: a mixed methods case study using an impact survey and field notes, Evidence & Policy, 15(2): 197–215.
Graham, I.D., Logan, J., Harrison, M., Straus, S., Tetroe, J., Caswell, W. and Robinson, N. (2006) Lost in translation: time for a map?, Journal of Continuing Education in the Health Professions, 26(1): 13–24. doi: 10.1002/chp.47
Hawe, P., Shiell, A. and Riley, T. (2009) Theorising interventions as events in systems, American Journal of Community Psychology, 43(3–4): 267–76. doi: 10.1007/s10464-009-9229-9
Haynes, A., Rychetnik, L., Finegood, D., Irving, M., Freebairn, L. and Hawe, P. (2020) Applying systems thinking to knowledge mobilisation in public health, Health Research Policy and Systems, 18: 134, doi: 10.1186/s12961-020-00600-1.
Holmes, B., Best, A., Davies, H., Hunter, D., Kelly, M., Marshall, M. and Rycroft-Malone, J. (2017)Mobilising knowledge in complex health systems: a call to action, Evidence & Policy, 13(3): 539–60.
Hunter, D. (2019) Meeting the challenge of the ‘know-do’ gap, International Journal of Health Policy and Management, 8(8): 498–500. doi: 10.15171/ijhpm.2019.37
Hunter, D.J., Marks, L., Brown, S., Scalabrini, S., Salway, S., Vale, L., Gray, J. and Payne, N. (2016) The potential value of priority-setting methods in public health investment decisions: qualitative findings from three English local authorities, Critical Public Health, 26(5): 578–87. doi: 10.1080/09581596.2016.1164299
Kislov, R., Waterman, H., Gill Harvey, G. and Boaden, R. (2014) Rethinking capacity building for knowledge mobilisation: developing multilevel capabilities in healthcare organizations, Implementation Science, 9: 166. doi: 10.1186/s13012-014-0166-0
Kitson, A.L., Rycroft-Malone, J., Harvey, G., McCormack, B., Seers, K. and Titchen, A. (2008) Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges, Implementation Science, 3: 1. doi: 10.1186/1748-5908-3-1
Kneale, D., Rojas-García, A. and Thomas, J. (2019) Obstacles and opportunities to using research evidence in local public health decision making in England, Health Research Policy and Systems, 17: 61. doi: 10.1186/s12961-019-0446-x
Kneale, D., Rojas-Garcia, A., Raine, R. and Thomas, J. (2017) The use of evidence in English local public health decision-making: a systematic scoping review, Implementation Science, 12: 53. doi: 10.1186/s13012-017-0577-9
Lewis, S. and Russell, A. (2011) Being embedded: a way forward for ethnographic research, Ethnography, 12(3): 398–416. doi: 10.1177/1466138110393786
Lomas, J. (2000) Using ‘linkage and exchange’ to move research into policy at a Canadian foundation, Health Affairs, 19(3): 236–40. doi: 10.1377/hlthaff.19.3.236
Lorenc, T., Tynerm, E., Petticrew, M., Duffy, S., Martineau, F.P., Phillips, G. and Lock, K. (2014) Cultures of evidence across policy sectors: systematic review of qualitative evidence, European Journal of Public Health, 24(6): 1041–47. doi: 10.1093/eurpub/cku038
MacKillop, E., Quarmby, S. and Downe, J. (2020) Does knowledge brokering facilitate evidence-based policy? A review of existing knowledge and agenda for future research, Policy & Politics, 48(2): 335–53.
Marshall, M., Mear, E., Ward, V., O’Brien, B., Davies, H., Waring, J. and Fulop, N., (2022) Optimising the impact of health services research on the organisation and delivery of health services: a study of embedded models of knowledge co-production in the NHS, National Institute for Health Care and Research, https://www.journalslibrary.nihr.ac.uk/programmes/hsdr/165221#/.
Metz, A., Boaz, A. and Robert, G. (2019) Co-creative approaches to knowledge production: what next for bridging the research to practice gap?, Evidence & Policy, 15(3): 1–7.
Nutley, S., Walter, I. and Davies, H.T.O. (2007) Using Evidence; How Research Can Inform Public Services, Bristol: Policy Press.
Oliver, K., Innvaer, S., Lorenc, T., Woodman, J. and Thomas, J. (2014) A systematic review of barriers and facilitators of the use of evidence by policymakers, BMC Health Services Research, 14(1): 1. doi: 10.1186/1472-6963-14-1
Oliver, K., Kothari, A. and Mays, N. (2019) The dark side of coproduction: do the costs outweigh the benefits for health research? Health Research Policy and Systems, 17: 33. doi: 10.1186/s12961-019-0432-3
Phipps, D. and Morton, S. (2013) Qualities of knowledge brokers: reflections from practice, Evidence & Policy, 9(2): 255–65.
Powell, A.E., Davies, H.T.O. and Nutley, S. (2018) Facing the challenges of research informed knowledge mobilization: ‘practising what we preach’, Public Administration, 96(1): 36–52. doi: 10.1111/padm.12365
Rushmer, R.K. et al. (2015) Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach, Health and Social Care Delivery Research, 3(33).
Rutter, H. et al. (2017) The need for a complex systems model of evidence for public health, The Lancet, 390(10112): 2602–4. doi: 10.1016/S0140-6736(17)31267-9
Sanders, T., Grove, A., Salway, S., Hampshaw, S. and Goyder, E. (2017) Incorporation of a health economic modelling tool into public health commissioning: evidence use in a politicised context, Social Science & Medicine, 186: 122–29.
South, J., Hunter, D.J. and Gamsu, M. (2014) Need to know review number 2: what local government needs to know about public health, project report, Local Government Knowledge Navigator.
Van der Graaf, P., Cheetham, M., McCabe, K. and Rushmer, R. (2018) Localising and tailoring research evidence helps public health decision making, Health Information & Libraries Journal, 35(3): 202–212, doi: 10.1111/hir.12219.
Van der Graaf, P., Cheetham, M., Redgate, S., Clare, H. and Adamson, A. (2021) Co-production in local government: process, codification and capacity building of new knowledge in collective reflection spaces: workshops findings from a UK mixed methods study, Health Research Policy and Systems, 19: 12, https://rdcu.be/cesKm. doi: 10.1186/s12961-021-00677-2
Vindrola-Padros, C., Pape, T., Utley, M. and Fulop, N. (2017) The role of embedded research in quality improvement: a narrative review, BMJ Quality and Safety, 26(1): 70–80. doi: 10.1136/bmjqs-2015-004877
Vindrola-Padros, C. et al. (2019) Addressing the challenges of knowledge co-production in quality improvement: learning from the implementation of the researcher-in-residence model, BMJ Quality & Safety, 28(1): 67–73. doi: 10.1136/bmjqs-2017-007127
Wilkinson, H., Gallagher, M. and Smith, M. (2012) A collaborative approach to defining the usefulness of impact: lessons from a knowledge exchange project involving academics and social work practitioners, Evidence & Policy, 8(3): 311–27.
Wolfenden, L., Yoong, S.L., Williams, C.M., Grimshaw, J., Durrheim, D.N., Gillham, K. and Wiggers, J. (2017)Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example, Journal of Clinical Epidemiology, 85: 3–11. doi: 10.1016/j.jclinepi.2017.03.007
Wong, S. (2009) Tales from the frontline: the experiences of early childhood practitioners working with an ‘embedded’ research team, Evaluation and Program Planning, 32(2): 99–108. doi: 10.1016/j.evalprogplan.2008.10.003
Wye, L., Cramer, H., Beckett, K., Farr, M., Le May, A., Carey, J., Robinson, R., Anthwal, R., Rooney, J. and Baxter, H. (2020) Collective knowledge brokering: the model and impact of an embedded team, Evidence & Policy, 16(3): 429–52.
Wye, L., Cramer, H., Carey, J., Anthwal, R., Rooney, J., Robinson, R., Beckett, K., Farr, M., le May, A. and Baxter, H. (2019) Knowledge brokers or relationship brokers? The role of an embedded knowledge mobilisation team, Evidence & Policy, 15(2): 277–92.
Yanovitsky, I. and Weber, M. (2018) Analysing use of evidence in public policymaking processes: a theory-grounded content analysis methodology, Evidence & Policy, 16(1): 65–82.
Appendix 1
Interview schedule
Explain aims of study; reminder there are no right or wrong answers.
Talk through Participant Information Sheet and complete consent form.
Check if there are any questions, and respond.
Current practice
What do you understand by evidence in a LG context?
What’s in place already to support evidence-informed decision making in public health in this LA? (map current structures / processes or prompt with Ward and Marshall’s NIHR study icons)
What data is collected currently in LA / public health (related to school readiness)? By whom?
How is this information used? Prompt: to inform commissioning / service planning / policy? If it is not used, why not? Prompt: what gets in the way?
Evidence use
What different kinds of data / evidence are valued and by whom in this LA?
Who holds power and control over the data / evidence used?
What currently works well in using evidence?
What could be improved?
What is missing or not working so well in this LA?
What would you say helps / hinders evidence-informed decision making in LG? Prompt: what are the barriers / facilitators?
What needs to be in place for research use to be embedded in everyday practice?
What examples, if any, do you have of approaches or models or collaborations that you would recommend to other LAs?
Looking forward
How would you like to work with academic researchers in your LA to improve evidence use?
Are there messages for universities / researchers / academics which would help ensure evidence is used in LG?
What would success look like for you?
How can we evaluate efforts to improve evidence use in this LA? Prompt: for example how can we measure success?
Anything else you would like to say?