Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-22T11:33:39.922Z Has data issue: false hasContentIssue false

Development of the Prevention of Suicide Behaviour in Prisons: Enhancing Access to Therapy (PROSPECT) logic model and implementation strategies

Published online by Cambridge University Press:  06 May 2024

Rebecca Crook
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK Greater Manchester NHS Foundation Trust, Manchester, UK
Charlotte Lennox
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK
Yvonne Awenat
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK Greater Manchester NHS Foundation Trust, Manchester, UK
Dawn Edge
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK
Sarah Knowles
Affiliation:
University of York, York, UK
David Honeywell
Affiliation:
Arden University, Coventry, UK
Patricia Gooding
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK Greater Manchester NHS Foundation Trust, Manchester, UK
Gillian Haddock
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK Greater Manchester NHS Foundation Trust, Manchester, UK
Helen Brooks
Affiliation:
University of Manchester, Manchester, UK
Daniel Pratt*
Affiliation:
University of Manchester, Manchester, UK Manchester Academic Health Science Centre, Manchester, UK Greater Manchester NHS Foundation Trust, Manchester, UK
*
Correspondence to Daniel Pratt ([email protected])
Rights & Permissions [Opens in a new window]

Abstract

Aims and method

This study aimed to develop and articulate a logic model and programme theories for implementing a new cognitive–behavioural suicide prevention intervention for men in prison who are perceived to be at risk of death by suicide. Semi-structured one-to-one interviews with key stakeholders and a combination of qualitative analysis techniques were used to develop programme theories.

Results

Interviews with 28 stakeholders resulted in five programme theories, focusing on: trust, willingness and engagement; readiness and ability; assessment and formulation; practitioner delivering the ‘change work’ stage of the intervention face-to-face in a prison environment; and practitioner training, integrating the intervention and onward care. Each theory provides details of what contextual factors need to be considered at each stage, and what activities can facilitate achieving the intended outcomes of the intervention, both intermediate and long term.

Clinical implications

The PROSPECT implementation strategy developed from the five theories can be adapted to different situations and environments.

Type
Original Papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
Copyright © The Author(s), 2024. Published by Cambridge University Press on behalf of Royal College of Psychiatrists

Understanding how complex interventions work and how their casual pathways interact with implementation strategies requires careful consideration. The Medical Research Council (MRC) guidance for evaluating complex interventions has recently been updated and now recognises the importance of understanding that interventions and implementation strategies must consider their context and wider systems, in addition to measuring effectiveness.Reference Skivington, Matthews, Simpson, Craig, Baird and Blazeby1

Logic models diagrammatically illustrate the causal processes between core components and intended outcomes of an intervention. They are also beneficial in understanding the dynamic implementation process, where implementation may occur across multiple levels within a number of organisations,Reference Smith, Li and Rafferty2,Reference Czosnek, Zopf, Cormie, Rosenbaum, Richards and Rankin3 and provide a consistent and structured approach to implementation.Reference Mills, Lawton and Sheard4 Mills and colleaguesReference Mills, Lawton and Sheard4 have provided a typology of logic models, consisting of four types that vary according to whether or not the model describes the relationships between factors (e.g. between activities and outcomes) and whether or not the model considers context (e.g. individual or environmental characteristics that can affect, or be affected by, implementation). A type 4 logic model dubbed the ‘real-world’ logic model (RWLM)Reference Mills, Shannon, O'Hara, Lawton and Sheard5 includes both the causal relationships between model factors and the context of the intervention. This type of logic model captures how an intervention's success is dependent on its ability to adapt to different situations and environments. In the development of the RWLM, aspects of implementation science were included, with the introduction of the Promoting Action on Research Implementation in Health Services (PARIHS) framework. This framework conceptualises successful implementation as a function of the nature and type of evidence, the context of the environment where the intervention will be implemented and how implementation is facilitated.Reference Kitson, Harvey and McCormack6

Prevention of Suicide Behaviour in Prisons: Enhancing Access to Therapy (PROSPECT)

The PROSPECT programme aims to refine and evaluate a psychological intervention, cognitive–behavioural suicide prevention (CBSP),Reference Tarrier, Gooding, Pratt, Awenat, Kelly and Maxwell7 for men in prison who are identified as being at risk of death by suicide, through a series of interrelated work packages. The CBSP intervention comprises a formulation-driven approach to understanding suicide schema and a tailored intervention that is delivered over a 6-month period of up to 20 one-to-one talking therapy sessions with a CBSP-trained practitioner.Reference Tarrier, Gooding, Pratt, Awenat, Kelly and Maxwell7

Prior to being evaluated in a randomised controlled trial (RCT) and concurrent process evaluation, CBSP, as applied to prison work, needed to be refined based on evidence from a pilot trialReference Pratt, Tarrier, Dunn, Awenat, Shaw and Ulph8 to meet the diverse needs of patients in prison and to develop an implementation strategy. CBSP is a multi-component psychological intervention and when delivered by healthcare professionals in a prison environment must consider prison-related complexities.Reference Watson, Stimpson and Hostick9Reference Hunter, Anderson, Kirkpatrick, Lennox, Warren and Taylor12 Consequently, the development of a logic model was necessary to delineate how the intervention was perceived to bring about its outcomes and thus support the production of an implementation strategy. This paper sets out the approach used to develop the PROSPECT logic model and the resultant initial understanding of the model's components. We aimed to develop a real-world logic model,Reference Mills, Shannon, O'Hara, Lawton and Sheard5 as the PROSPECT RCT requires consideration of (a) the interplay between different model factors (e.g. how different parts of the CBSP intervention are delivered and facilitated, and by whom) and (b) how local context might affect implementation (i.e. any specific adaptations needed to successfully deliver CBSP in the prison environment and across different prisons).

Method

Design

Data collection involved semi-structured qualitative one-to-one interviews scaffolded by (a) flexible and iteratively generated topic guides; (b) bespoke vignettes designed to elicit open discussion of potentially sensitive contextual factors; and (c) deliberately focused questions probing for any unknown barriers to successful implementation of the CBSP intervention in prison. Purposive sampling was used to identify and recruit participants (n = 28) to take part in interviews that took place over a 12-month period from November 2020 to October 2021. Inclusion criteria for participation in each stage of data collection are given in the respective sections below. As depicted in Fig. 1, data collection and analyses followed an iterative approach in which data collection tools were refined and theory developed simultaneously as the study progressed.Reference Busetto, Wick and Gumbinger13,Reference Brand, Quinn, Pearson, Lennox, Owens and Kirkpatrick14

Fig. 1 Iterative process of data collection and analysis for developing the PROSPECT logic model (adapted from Busetto et al, 2020).Reference Busetto, Wick and Gumbinger13 The process for data collection and analysis begins in the centre of the diagram and works outwards following the connecting arrows. CBSP, cognitive–behavioural suicide prevention; TIDieR, Template for Intervention Description and Replication checklist; CMO, context, mechanisms and outcomes (O); i-PARIHS, integrated-Promoting Action on Research Implementation in Health Services.

As advocated by the approach of Mills and colleagues,Reference Mills, Lawton and Sheard4,Reference Mills, Shannon, O'Hara, Lawton and Sheard5 features of implementation science, specifically the ‘integrated-Promoting Action on Research Implementation in Health Services’ (i-PARIHS) framework, were incorporated into the study design to develop a real-world logic model for PROSPECT, aiming to illustrate the relationships between activities and outcomes, and to consider the context where the intervention would be implemented. The i-PARIHS framework proposes that successful implementation requires consideration of four interrelated factors – (a) facilitatory components, (b) types of innovation, (c) characteristics of recipients and (d) local contextReference Harvey and Kitson15 – and it has proven valuable when applied to multi-site implementation projects.Reference Hunter, Kim, Mudge, Hall, Young and McRae16 The i-PARIHS constructs were applied in the development of the PROSPECT logic model to optimise the subsequent process evaluation that will run concurrently with the RCT of CBSP in prison; incorporating i-PARIHS as this stage meant that problems could be tracked back and framed in a consistent way.

Ethics

For interviews with practitioners and patients with relevant lived experience, ethical approval was obtained from the University of Manchester Research Ethics Committee (reference: 2020-9443-16034 and 2020-10252-16604). Ethical approval was obtained from the Health Research Authority and Health and Care Research Wales for interviews with prison healthcare professionals (reference: 20/SS/0021). Written or verbal informed consent was obtained from all participants. Interview recordings were transcribed verbatim and pseudo-anonymised.

Stage 1: establishing a starting point logic

As a first step, relevant literatureReference Pratt, Tarrier, Dunn, Awenat, Shaw and Ulph8,Reference Pratt, Gooding, Awenat, Eccles and Tarrier17,Reference Kirkpatrick, Lennox, Taylor, Anderson, Maguire and Haddad18 and descriptions of CBSP used in previous trialsReference Tarrier, Gooding, Pratt, Awenat, Kelly and Maxwell7,Reference Pratt19 were reviewed to identify any ‘unknowns’ about implementing the CBSP intervention in prison settings. The research team's initial perceptions of their knowledge of the underlying mechanisms of the intervention, based on their clinical, research or lived experience and wider reading, were recorded, along with any prejudices and biases that could be identified. These consultations took the form of individual interviews conducted either in person or over the telephone. The research team comprised PROSPECT co-investigators with distinct experiences as clinical psychologists (n = 2) and lived experience of prison (n = 1). The chief investigator of PROSPECT (D.P.) was interviewed at three time points across the 12-month period of data collection to ensure that the developing logic was representative of their understanding. The Template for Intervention Description and Replication (TIDieR) checklistReference Hoffmann, Glasziou, Boutron, Milne, Perera and Moher20 was used to extract prior knowledge about the CBSP intervention from both the existing literature and co-investigator interviews. Gaps arising from the application of the TIDieR checklist formed ‘unknowns’ and were developed into questions for subsequent interviews.

Stage 2: including the perspective of ‘experts by experience’

In this next stage, clinical and forensic practitioners (n = 5) who were independent of PROSPECT but who had experience of delivering psychological interventions to similar patient groups at risk of suicide and self-harm in prisons, forensic settings and the community were consulted to understand how psychological interventions were used in these environments from their perspectives. Participants were purposively sampled via the research team's professional network. Individual interviews took place via a phone call (or via teleconferencing software) at a time convenient for the participant, and lasted approximately 45–60 min. Interviews were semi-structured and guided by a topic guide probing ‘unknowns’ that had been identified from the TIDieR checklist in stage 1. These probes were tailored to the interviewee. For example, practitioners with experience of working in secure settings provided further information on the practical aspects of delivering similar types of intervention – such as how practitioners had previously integrated clinical/forensic psychology programmes into the prison regime.

In addition to collating practitioner perspectives, interviews were also conducted with men with wide-ranging personal (lived) experiences of suicidal thoughts and/or behaviours during a period of imprisonment (n = 12). These interviews lasted around 60 min and aimed to understand further ‘unknowns’, specifically the perceived barriers and facilitators to engaging with the CBSP intervention in a male prison. At the time of data collection these 12 participants were residing in the community and were recruited via third-sector organisations.

Stage 3: identifying core context and mechanisms of implementation

The aim at this stage was to understand the core context and mechanisms for implementing the CBSP intervention in prison settings. Framework analysis was used to analyse all data from stages 1 and 2 (literature extracts and interview transcripts). Data were coded for instances of related context (C), mechanisms (M) and outcomes (O), working backwards from outcomes.Reference Jackson and Kolla21 Data were sifted, charted and sorted, whereby the C, M and O categories were used for each column of the framework matrix and participants were assigned a separate row and grouped as either (a) existing literature, (b) PROSPECT co-investigators, (c) independent practitioner ‘experts by experience’ or (d) patient ‘experts by experience’. Separating the data in this way highlighted both convergence and divergence in the data. Any remaining unknowns or conflicting evidence were marked to be explored more deeply in the subsequent interviews and in the process evaluation of the RCT.

Where possible, expressed explanatory accounts from the CMO configurations were written in the form of ‘if … then’ statements that specified linked context, and/or mechanism and/or outcomes(s) – for example ‘If we do [MECHANISM] in [CONTEXT], then we achieve [OUTCOME]’.Reference Ebenso, Manzano, Uzochukwu, Etiaba, Huss and Ensor22 However, a decision was made not to limit accounts to only those expressed in this way, recognising that partial accounts were also informative at this stage – for example ‘If [CONTEXT], then [OUTCOME]’ or ‘If [MECHANISM], then [OUTCOME]’. The explanatory accounts were expressed and documented in a ‘narrative’, representing a coherent linear description of what was expected at each stage of implementation.

Stage 4: incorporating the i-PARIHS framework

Once the core context and mechanisms for implementing the CBSP intervention in prison settings had been identified through CMO analysis, the next step was to understand how local context could affect implementation. In preparation for the next stage of data collection (stage 5), the i-PARIHS frameworkReference Harvey and Kitson15 was introduced.

Applying i-PARIHS terminology to PROSPECT, the innovation is the CBSP psychological intervention and the training and supervision package for CBSP practitioners who deliver the therapy. Facilitation of CBSP is provided by practitioners who are clinical or forensic psychologists or cognitive–behavioural therapists.Reference Tarrier, Gooding, Pratt, Awenat, Kelly and Maxwell7 These trained practitioners might be novice facilitators (if new to the role), more experienced or even expert facilitators. The expert facilitator is responsible for training and supervising the more novice facilitators who deliver the CBSP intervention as part of the RCT. For PROSPECT the expert facilitator was the chief investigator (D.P.), who has extensive experience of delivering CBSP in prisons and developing CBSP with diverse patient groups (e.g. psychiatric in-patients, people in the community with non-affective psychosis), supervising therapists in delivering CBSP across different settings (e.g. prison, hospital, community) and working with associated National Health Service (NHS) mental health teams.

There are three categories of ‘recipient’ in PROSPECT. First, the men in prison who are perceived to be at risk of death by suicide and who participate in the CBSP programme. Second, novice facilitators delivering the CBSP programme who receive the CBSP training and supervision package. Third, the prison staff, who are considered recipients because they will affect, and be affected by, the implementation of the CBSP intervention.

The context in which PROSPECT is situated is the prison environment, including the prison culture, staff attitudes and organisational structures and priorities. PROSPECT is a multi-site trial, so it was important to consider how the local environment might differ across locations. Individual characteristics, such as prisoners’ previous experience of therapy and PROSPECT practitioners’ experience of working with people who are suicidal and/or had been in the criminal justice system, were important contextual factors that needed to be considered.

Stage 5: developing context-sensitive implementation strategies

Four prisons in the North of England were selected to host PROSPECT and evaluate the CBSP intervention within an RCT. At this stage, we wanted to assess key stakeholders’ views on how the above i-PARIHS factors might affect, or be affected by, implementation. The aim was to investigate how these factors might be customised in different contexts, i.e. each prison site, and what each site would need for successful implementation. Often with implementation research, this is achieved by forging consensus among stakeholders.Reference Bussières, Al Zoubi, Quon, Ahmed, Thomas and Stuber23Reference Flottorp, Oxman, Krause, Musila, Wensing and Godycki-Cwirko25 However, Mills and colleaguesReference Mills, Lawton and Sheard4 suggest that this is not appropriate for complex interventions that need adaptations to context. It was clear from the outset that PROSPECT would require localised customisation to support implementation.

For this stage of data collection, which comprised qualitative one-to-one interviews, participants were targeted who were NHS healthcare staff with experience of working with suicidal prisoners and who had supported a suicidal prisoner in the past 6 months in one of the four host prisons. Potential NHS staff participants were identified by an appropriate service manager, who sent an email on behalf of the research team to relevant members of their team. The email contained an introductory letter and a copy of the participant information sheet. Individual interviews took place via a phone call, or via teleconferencing software, at a time convenient for the participants (n = 5). Interviews were semi-structured, based on a topic guide comprising any outstanding ‘unknowns’ or conflicting evidence, and lasted approximately 60 min.

Using the narratives that were created following the CMO framework analysis (stage 3), a series of vignettes were designed to investigate the relationships between core underpinning mechanisms and contextual factors. Vignettes were used to provide a common context around which discussions might be shaped in the interviews with key stakeholders, reducing the need to rely on a personal frame of reference and allowing stakeholders to talk openly and without judgement. The aim was to use the vignettes to guide participants through the current understanding of how the CBSP intervention could bring about outcomes and be successfully implemented in the local prison environment.

An example vignette and related question are as follows:

‘When delivering the CBSP intervention to men in prison, practitioners will require access to a private location that can be made available for one-to-one therapy sessions to ensure confidentiality and promote engagement. It is likely that the practitioner will need access to a variety of intervention rooms throughout the prison site in order to provide easy access to the CBSP intervention for all eligible participants. Decisions on which intervention rooms can be made available to the PROSPECT practitioners should be made in collaboration with host prison staff, with PROSPECT practitioners adhering to any existing room booking procedures. Locations of intervention rooms may include interview rooms on residential wings, clinic rooms in the healthcare centre, office spaces in workshops, or interview rooms within the psychology / programmes centre.

What spaces are available for one-to-one therapy sessions and how would PROSPECT practitioners go about scheduling access to these rooms in your prison?’

This exercise was used to present the core components of implementation to identify stages of the process and ‘walk through’ the process of implementation with stakeholder participants, considering the following questions: What assumptions have we made? What have we missed? Is there anything we have not accounted for? These methods have been found to be helpful when evaluating implementation strategies in healthcare as they help ensure that procedures and protocols can be followed successfully by users in specific healthcare contexts.Reference Lyon, Coifman, Cook, McRee, Liu and Ludwig26 The aim here was to achieve context-sensitive implementation strategies, rather than consensus on context or methods (as these might be site-specific).

Researchers (R.C. and D.H.) independently analysed each transcript from the five key stakeholder interviews, following the approach to reflexive thematic analysis.Reference Braun, Clarke, Hayfield, Terry and Liamputtong27 Data were first analysed inductively following the thematic analysis method so that the analysis was not constricted by the i-PARIHS framework, and the codes were generated from the data using a bottom-up rather than top-down approach. Once data had been analysed in this way, the i-PARIHS framework was ‘layered’ over the top. Data-driven codes were compared with the i-PARIHS constructs and matched so that there was information for all the i-PARIHS constructs: (a) facilitatory components, (b) types of innovation, (c) characteristics of recipients and (d) local context. The data corpus was examined for instances of consensus on feasibility of implementation and also divergence regarding site-specific details on how to approach implementation. These data were then included to develop the PROSPECT logic model and programme theories to support the production of an implementation strategy. Each programme theory was written using data collected from various stakeholders throughout the study, and includes an overarching theory of change and more detailed theory of actionReference Funnell and Rogers28 produced by collating ‘if … then’ statements that have been refined throughout the iterative process of data collection and analysis.

Results

The PROSPECT logic model

The PROSPECT logic model (version 1.0) (Fig. 2) and five programme theories were developed following the principles of a real-world logic modelReference Mills, Shannon, O'Hara, Lawton and Sheard5 and consideration of the i-PARIHS framework.Reference Harvey and Kitson15 Together these describe the causal pathway of the CBSP intervention and the interplay with implementation strategies.

Fig. 2 PROSPECT logic model, version 1.0. CBSP, cognitive–behavioural suicide prevention.

Context includes both inner (individual) and outer (environmental) factors at the top and bottom of the logic model; the arrows going into the centre of the model from the top and bottom in Fig. 2 represent how these contextual factors must be considered throughout implementation. Key features of the implementation and facilitation strategy are included in the left-side shaded rectangle, and the circular arrow illustrates the ordering of key mechanisms for facilitating delivery of the CBSP intervention. Soft outcomes are included in the top right-side box and core outcomes are included in the shaded boxes below. The bi-directional arrow connecting the box containing ‘Implementation and facilitation strategy' and ‘Mechanisms', and the soft outcomes shows the bidirectional relationship between these model components – i.e. activating the mechanism(s) will lead to a change in the soft outcome(s), and a change in the soft outcome(s) can affect implementation and facilitation. For example, if a more novice practitioner is supervised regularly and uses the CBSP manuals to inform intervention delivery, then there will be a change in the practitioner's skills, enabling them to deliver the CBSP intervention in line with the manualised pathway. This soft outcome will then affect the way in which they approach the intervention delivery with the participant. The arrows connecting the soft and core outcomes illustrate the relationship between outcomes – i.e. a change in soft outcomes should lead to a change in intermediate core outcomes, which should lead to a change in long-term outcomes. Constructs in the i-PARIHS framework (the innovation, context, facilitators and recipients) are embedded throughout the PROSPECT logic model.

The different components in the larger left-side box (the ‘Implementation and facilitation strategy' and the ‘Mechanisms' for intervention delivery) provide brief summaries of programme theories that ‘sit behind’ the logic model. These provide further detail explaining the various activities and mechanisms that are required to achieve the outcomes. Drawing on the work of Brand and colleagues,Reference Brand, Quinn, Pearson, Lennox, Owens and Kirkpatrick14 each programme theory also has a diagram presenting the relationships between specific activities and the intermediate outcomes. These offer more detailed models (see Fig. 3 for an example) showing the particular mechanisms required to achieve soft outcomes for each programme theory. Broken arrows in these supplementary models indicate negative consequences that could affect the achievement of the respective intermediate outcomes. It is anticipated that if the various mechanisms that are described in the programme theories are activated and achieve the soft outcomes (included in top right-side boxes in Fig. 2), then this will lead to a change in intermediate outcomes (secondary outcome measures for the PROSPECT RCT relating to mental health and well-being) and long-term (primary) outcomes that are highlighted in shaded boxes under ‘Core outcomes' in the logic model in Fig. 2.

Fig. 3 Model of the core mechanisms for Programme Theory 5: practitioner training, integrating PROSPECT and onward care (pre-, during and post-intervention). CBSP, cognitive–behavioural suicide prevention.

Programme theory 5 (PT5) is included here as an example (see Fig. 3 for the detailed model for this programme theory) and describes the core mechanisms for implementation that will develop practitioners’ skills and help integrate the CBSP intervention in the prison environment.

For each mechanism in PT5 (see the outside ‘Mechanism’ boxes connecting inward to the dotted ‘outcomes’ box in Fig. 3) there are context-sensitive factors that need to be addressed, as included in the logic model in Fig. 2. For example, when training and supervising the PROSPECT practitioners, the supervisor will need to consider the practitioners’ past work experiences and their professional background. The existing structures to support participant engagement and integration of the CBSP intervention will also be context-specific and will vary depending on which prison the PROSPECT practitioners are working in.

The five programme theories and detailed models are available in Supplementary Material 1, available at https://doi.org/10.1192/bjb.2024.22.

Context-sensitive implementation strategy

Stakeholder interviews in the final stages of data collection provided site-specific information, including convergence and divergence. This helped generate the underlying mechanisms for each programme theory, and consideration of how these factors could differ and how implementation could be adapted to different contexts/prisons. The PROSPECT logic model (version 1.0), programme theories and detailed models supported the development of the PROSPECT implementation strategy that uses this information to guide the facilitators and recipients in the PROSPECT RCT. The implementation strategy includes the following sections: (a) information about the CBSP intervention; (b) information for prison governors and healthcare providers and commissioners; (c) information for supervisors overseeing PROSPECT; and (d) information for PROSPECT practitioners. The implementation strategy also includes site-specific sections that were produced for implementation in each of the four prisons in the RCT. These comprise key information about the i-PARIHS factors that needed to be considered and/or adapted in the programme theories for successful implementation in each prison. These include: prisoner population (recipients: e.g. the size and profile of the prisoner population); PROSPECT staff i.e. practitioners and supervisors (facilitators: e.g. what spaces are available for facilitation?); local environment (context: e.g. what does the current prison mental healthcare model look like and what are staff attitudes to suicidal prisoners?); and the CBSP intervention (innovation: e.g. what other psychological interventions are available and how does CBSP compare?).

Discussion

The PROSPECT logic model (version 1.0) was developed to articulate how the CBSP intervention brings about its outcomes in the prison environment and to support the implementation of the CBSP intervention with male participants in prison. Drawing on the work of Mills and colleaguesReference Mills, Lawton and Sheard4,Reference Mills, Shannon, O'Hara, Lawton and Sheard5 and also Brand and colleagues,Reference Brand, Quinn, Pearson, Lennox, Owens and Kirkpatrick14 a logic model and related programme theories illustrating and describing the relationships between activities (mechanisms) and outcomes were generated, while also considering how context can affect implementation. For PROSPECT, the CBSP intervention is being implemented as part of a wider programme of work, specifically in the treatment arm of an RCT whereby half of the participants enrolled into the trial will be offered the intervention over a period of 6 months. The PROSPECT programme theories are now being utilised in the PROSPECT RCT and concurrent process evaluation. The outcome of the RCT will tell us ‘what’ – i.e. is the CBSP intervention clinically effective and cost-effective when implemented in prison? – whereas the process evaluation will tell us ‘how’ and ‘why’, and findings will be considered to develop and refine the PROSPECT logic model for further implementation, as appropriate.

Strengths and limitations of the PROSPECT logic model

Logic models are often used in healthcare research (for examples, seeReference Mills, Lawton and Sheard4,Reference Watson, Broemeling and Wong29Reference Tabriz, Flocke, Shires, Dyer, Schreiber and Lafata31 ). Nevertheless, critiques have noted some key limitations, namely, that they can overlook the complexity underlying interventions, limit exploration of adaptations to enhance contextual compatibility or disregard any undesirable outcomes.Reference Onyura, Mullins and Hamza32 By developing a real-world logic modelReference Mills, Shannon, O'Hara, Lawton and Sheard5 we aimed to navigate these potential limitations. Specifically, the PROSPECT logic model and programme theories consider context throughout implementation, and interviews with key stakeholders at different prison sites allowed for local contextual factors and adaptations to be included. This helped shape context-sensitive implementation strategies, and potential undesirable outcomes that could affect implementation are included in the programme theories and respective diagrams.

That is not to say that the current version is without flaws. Some features of the logic model will require attention. As described earlier, the expert facilitator of CBSP for PROSPECT is the chief investigator (D.P.); logic model development in the process evaluation will need to account for not having this role for wider implementation outside of the trial, among other factors, as D.P. would not have capacity to train and supervise all CBSP practitioners if the intervention were successful and rolled out across the prison estate. Likewise, outside of the PROSPECT RCT, trained psychologists would need to be employed to deliver the CBSP intervention in prison. In an environment where the few trained psychologists working in prison are in high demand, these roles would require funding and resourcing – contextual challenges that require further investigation in the PROSPECT process evaluation.

An additional limitation of the current model is that, owing to restrictions surrounding research activity during the COVID-19 pandemic,Reference Pratt and Crook33 we were not able to interview staff employed by His Majesty's Prison and Probation Service, so these perspectives are not included in the current version of the logic model. Prison staff participants will be approached for interviews in the process evaluation of PROSPECT and their perspectives will be included in the next iteration of the model and developing programme theories. By using the PROSPECT logic model to inform implementation during the trial we can test and evaluate our current understanding of how the CBSP intervention should bring about its outcomes. This will be done through rigorous qualitative analysis in the process evaluation. The process evaluation method includes further investigation of the barriers and facilitators to implementation, and has the benefit of patient and public involvement (both staff and prisoners) actively experiencing implementation of the CBSP intervention during the RCT, and contributing to the logic model development.

Further development of the PROSPECT logic model

Novel findings from this study highlight the value of developing a real-world logic model that considers both the causal relationships between model factors and the context of the interventionReference Mills, Lawton and Sheard4,Reference Mills, Shannon, O'Hara, Lawton and Sheard5 as a crucial initial step in supporting implementation of any complex psychological intervention trial. Recent advances in implementation science, alongside the RWLM, have introduced the implementation research logic model (IRLM).Reference Smith, Li and Rafferty2 Rather than applying implementation framework(s) to the logic of the intervention itself (as we did with i-PARIHS for PROSPECT), the IRLM integrates implementation science into the core logic model, with the aim of improving the rigour and reproducibility of implementation research, and this has been shown to provide structure when developing causal pathways and mechanisms.Reference Czosnek, Zopf, Cormie, Rosenbaum, Richards and Rankin3 Developments in the PROSPECT logic model could consider this approach, drawing on learnings from producing an RWLM in line with guidance from Mills and colleaguesReference Mills, Shannon, O'Hara, Lawton and Sheard5 and considering the most effective way of illustrating and guiding implementation. Further developments should include stakeholders in the final developments of the model, ensuring that the programme theories for implementing the CBSP intervention in prison, and specifically the visualisation of implementation (PROSPECT logic model), could support implementation beyond the research trial.Reference Jones, Azzam, Wanzer, Skousen, Knight and Sabarre34

About the authors

Rebecca Crook is a research associate in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK and in the Suicide Risk and Safety Unit, Greater Manchester NHS Foundation Trust, Manchester, UK. Charlotte Lennox is a senior lecturer in psychology and mental health in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK. Yvonne Awenat is a senior clinical research fellow in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK and a director of the Suicide Risk and Safety Unit, Greater Manchester NHS Foundation Trust, Manchester, UK. Dawn Edge is Professor of Mental Health and Inclusivity in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK. Sarah Knowles is a research fellow in knowledge mobilisation in the Centre for Reviews and Dissemination, University of York, York, UK. David Honeywell is a lecturer in criminology in the School of Criminal Justice, Arden University, Coventry, UK. Patricia Gooding is a senior lecturer in psychology in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK and a director of the Suicide Risk and Safety Unit, Greater Manchester NHS Foundation Trust, Manchester, UK. Gillian Haddock is Professor of Clinical Psychology in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK and a director of the Suicide Risk and Safety Unit, Greater Manchester NHS Foundation Trust, Manchester, UK. Helen Brooks is a senior lecturer in nursing and midwifery in the School of Nursing, Midwifery and Social Work, Faculty of Biology, Medicine and Health, University of Manchester, Manchester, UK. Daniel Pratt is a senior lecturer in clinical psychology in the School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK and director of the Suicide Risk and Safety Unit, Greater Manchester NHS Foundation Trust, Manchester, UK.

Supplementary material

Supplementary material is available online at https://doi.org/10.1192/bjb.2024.22.

Data availability

The data that support the findings of this study are available from the corresponding author, D.P., on reasonable request.

Acknowledgements

We thank all the healthcare professionals and men with lived experience of imprisonment for taking part in interviews and sharing their experiences with us. We also acknowledge Tim Kirkpatrick for his work as PROSPECT Programme Manager, from 2019 to 2022.

Author contributions

R.C., C.L., Y.A. and D.P.: substantial contributions to the concept or design of the work or the acquisition, analysis or interpretation of data for the work; drafting the work or revising it critically for important intellectual content. D.E., S.K. and D.H.: substantial contributions to the concept or design of the work or the acquisition, analysis or interpretation of data for the work. P.G., G.H. and H.B.: drafting the work or revising it critically for important intellectual content. All authors gave final approval of the version to be published and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Funding

This work was funded by the UK National Institute of Health Research (NIHR), Programme Grants for Applied Research (PGfAR) under grant reference number RP-PG-0218-20006 and supported by the NIHR Manchester Biomedical Research Centre (NIHR203308). The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

Declaration of interest

None.

References

Skivington, K, Matthews, L, Simpson, SA, Craig, P, Baird, J, Blazeby, JM, et al. A new framework for developing and evaluating complex interventions: update of medical research council guidance. BMJ 2021; 374: n2061.CrossRefGoogle ScholarPubMed
Smith, JD, Li, DH, Rafferty, MR. The implementation research logic model: a method for planning, executing, reporting, and synthesizing implementation projects. Implement Sci 2020; 15(1): 84.CrossRefGoogle Scholar
Czosnek, L, Zopf, EM, Cormie, P, Rosenbaum, S, Richards, J, Rankin, NM. Developing an implementation research logic model: using a multiple case study design to establish a worked exemplar. Implement Sci Commun 2022; 3(1): 90.CrossRefGoogle ScholarPubMed
Mills, T, Lawton, R, Sheard, L. Advancing complexity science in healthcare research: the logic of logic models. BMC Med Res Methodol 2019; 19(1): 55.CrossRefGoogle ScholarPubMed
Mills, T, Shannon, R, O'Hara, J, Lawton, R, Sheard, L. Development of a ‘real-world’ logic model through testing the feasibility of a complex healthcare intervention: the challenge of reconciling scalability and context-sensitivity. Evaluation 2022; 28: 113–31.CrossRefGoogle Scholar
Kitson, A, Harvey, G, McCormack, B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care 1998; 7: 149–58.CrossRefGoogle ScholarPubMed
Tarrier, N, Gooding, P, Pratt, D, Awenat, Y, Kelly, J, Maxwell, J. Cognitive Behavioural Prevention of Suicide in Psychosis: A Treatment Manual. Routledge, 2013.CrossRefGoogle Scholar
Pratt, D, Tarrier, N, Dunn, G, Awenat, Y, Shaw, J, Ulph, F, et al. Cognitive-behavioural suicide prevention for male prisoners: a pilot randomized controlled trial. Psychol Med 2015; 45: 3441–51.CrossRefGoogle ScholarPubMed
Watson, R, Stimpson, A, Hostick, T. Prison health care: a review of the literature. Int J Nurs Stud 2004; 41: 119–28.CrossRefGoogle ScholarPubMed
Ginn, S. The challenge of providing prison healthcare. BMJ 2012; 345: e5921.CrossRefGoogle Scholar
Steel, J, Thornicroft, G, Birmingham, L, Brooker, C, Mills, A, Harty, M, et al. Prison mental health inreach services. Br J Psychiatry 2007; 190: 373–4.CrossRefGoogle ScholarPubMed
Hunter, RM, Anderson, R, Kirkpatrick, T, Lennox, C, Warren, F, Taylor, RS, et al. Economic evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: a cost-utility and cost-consequences analysis. Eur J Health Econ 2022; 23: 193210.CrossRefGoogle ScholarPubMed
Busetto, L, Wick, W, Gumbinger, C. How to use and assess qualitative research methods. Neurol Res Pract 2020; 2(1): 14.CrossRefGoogle ScholarPubMed
Brand, SL, Quinn, C, Pearson, M, Lennox, C, Owens, C, Kirkpatrick, T, et al. Building programme theory to develop more adaptable and scalable complex interventions: realist formative process evaluation prior to full trial. Evaluation 2019; 25: 149–70.CrossRefGoogle Scholar
Harvey, G, Kitson, A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci 2016; 11: 33.CrossRefGoogle ScholarPubMed
Hunter, S, Kim, B, Mudge, A, Hall, L, Young, A, McRae, P, et al. Experiences of using the i-PARIHS framework: a co-designed case study of four multi-site implementation projects. BMC Health Serv Res 2020; 20(1): 573.CrossRefGoogle ScholarPubMed
Pratt, D, Gooding, P, Awenat, Y, Eccles, S, Tarrier, N. Cognitive behavioral suicide prevention for male prisoners: case examples. Cogn Behav Pract 2016; 23: 485501.CrossRefGoogle ScholarPubMed
Kirkpatrick, T, Lennox, C, Taylor, R, Anderson, R, Maguire, M, Haddad, M, et al. Evaluation of a complex intervention (Engager) for prisoners with common mental health problems, near to and after release: study protocol for a randomised controlled trial. BMJ Open 2018; 8(2): e017931.CrossRefGoogle ScholarPubMed
Pratt, D. The Prevention of Suicide in Prison: Cognitive Behavioural Approaches. Routledge, 2016.Google Scholar
Hoffmann, TC, Glasziou, PP, Boutron, I, Milne, R, Perera, R, Moher, D, et al. Better reporting of interventions: Template for Intervention Description and Replication (TIDieR) checklist and guide. BMJ 2014; 348: g1687.CrossRefGoogle ScholarPubMed
Jackson, SF, Kolla, G. A new realistic evaluation analysis method. Am J Eval 2012; 33: 339–49.CrossRefGoogle Scholar
Ebenso, B, Manzano, A, Uzochukwu, B, Etiaba, E, Huss, R, Ensor, T, et al. Dealing with context in logic model development: reflections from a realist evaluation of a community health worker programme in Nigeria. Eval Program Plann 2019; 73: 97110.CrossRefGoogle ScholarPubMed
Bussières, AE, Al Zoubi, F, Quon, JA, Ahmed, S, Thomas, A, Stuber, K, et al. Fast tracking the design of theory-based KT interventions through a consensus process. Implement Sci 2015; 10(1): 18.CrossRefGoogle ScholarPubMed
Michie, S, Johnston, M, Abraham, C, Lawton, R, Parker, D, Walker, A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Safety Health Care 2005; 14: 2633.CrossRefGoogle ScholarPubMed
Flottorp, SA, Oxman, AD, Krause, J, Musila, NR, Wensing, M, Godycki-Cwirko, M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci 2013; 8(1): 35.CrossRefGoogle ScholarPubMed
Lyon, AR, Coifman, J, Cook, H, McRee, E, Liu, FF, Ludwig, K, et al. The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability. Implement Sci Commun 2021; 2(1): 78.CrossRefGoogle ScholarPubMed
Braun, V, Clarke, V, Hayfield, N, Terry, G. Thematic analysis. In Handbook of Research Methods in Health Social Sciences (ed Liamputtong, P): 843–60. Springer, 2019.CrossRefGoogle Scholar
Funnell, SC, Rogers, PJ. Purposeful Program Theory: Effective Use of Theories of Change and Logic Models. John Wiley & Sons, 2011.Google Scholar
Watson, DE, Broemeling, AM, Wong, ST. A results-based logic model for primary healthcare: a conceptual foundation for population-based information systems. Healthc Policy 2009; 5: 3346.Google ScholarPubMed
Howarth, M, Brettle, A, Hardman, M, Maden, M. What is the evidence for the impact of gardens and gardening on health and well-being: a scoping review and evidence-based logic model to guide healthcare strategy decision making on the use of gardening approaches as a social prescription. BMJ Open 2020; 10(7): e036923.CrossRefGoogle Scholar
Tabriz, AA, Flocke, SA, Shires, D, Dyer, KE, Schreiber, M, Lafata, JE. Logic model framework for considering the inputs, processes and outcomes of a healthcare organisation–research partnership. BMJ Qual Safety 2020; 29: 746–55.CrossRefGoogle ScholarPubMed
Onyura, B, Mullins, H, Hamza, DM. Five ways to get a grip on the shortcomings of logic models in program evaluation. Can Med Educ J 2021; 12: 96–9.Google ScholarPubMed
Pratt, D, Crook, R. Conducting prison-based research during the COVID-19 pandemic and the value of involving people with lived experience. Crim Behav Ment Health 2023; 33: 223–8.CrossRefGoogle ScholarPubMed
Jones, ND, Azzam, T, Wanzer, DL, Skousen, D, Knight, C, Sabarre, N. Enhancing the effectiveness of logic models. Am J Eval 2020; 41: 452–70.CrossRefGoogle Scholar
Figure 0

Fig. 1 Iterative process of data collection and analysis for developing the PROSPECT logic model (adapted from Busetto et al, 2020).13 The process for data collection and analysis begins in the centre of the diagram and works outwards following the connecting arrows. CBSP, cognitive–behavioural suicide prevention; TIDieR, Template for Intervention Description and Replication checklist; CMO, context, mechanisms and outcomes (O); i-PARIHS, integrated-Promoting Action on Research Implementation in Health Services.

Figure 1

Fig. 2 PROSPECT logic model, version 1.0. CBSP, cognitive–behavioural suicide prevention.

Figure 2

Fig. 3 Model of the core mechanisms for Programme Theory 5: practitioner training, integrating PROSPECT and onward care (pre-, during and post-intervention). CBSP, cognitive–behavioural suicide prevention.

Supplementary material: File

Crook et al. supplementary material

Crook et al. supplementary material
Download Crook et al. supplementary material(File)
File 103.2 KB
Submit a response

eLetters

No eLetters have been published for this article.