Design
This study will adopt a single centre, individually randomised, parallel groups, RCT design with an embedded qualitative component. Participants will be randomly allocated to either Treatment as Usual (TAU) or CBTp plus TAU in a 1:1 ratio. Outcome measure assessments will be carried out at baseline, two months post-randomisation (post therapy) and six-months post-randomisation (follow-up) either face to face or remotely. Relapse, rehospitalisation and adverse events data will be again examined twelve-months post-randomisation. This protocol is reported following guidance from the SPIRIT tool (Standard Protocol Items: Recommendations for Intervention Trials, Chan et al., 2013). The trial has been registered on the ISRCTN trial registry (ISRCTN59055607). The study plan is outlined in figure 1 and schedule of participant activities in table 1. Full Health Research Authority (HRA) and NHS Research Ethics Committee (REC) approval has been granted (IRAS ID: 272043; 20/LO/0137/AM01) and the study is sponsored by University College London.
Setting: This trial will be undertaken at a single NHS site, North East London NHS Foundation Trust in the acute mental health inpatient services.
Sample size: We will aim to recruit sixty participants in line with recommendations by Consolidated Standards of Reporting Trials (CONSORT) for feasibility RCTs (Eldridge et al. 2016), thirty of which will be randomly allocated to the therapy arm and thirty to the TAU arm. A sample of sixty is deemed of sufficient size to examine the aims of the study. Data (relevant means and standard deviations) from this study will be used to inform a power calculation for a future larger multi-site trial.
Participants: Purposive sampling will be conducted to ensure that the sample is representative of the service user population, with at least 50% from ethnic minority backgrounds, and at least 30% of the total sample from Black ethnic backgrounds.
Inclusion criteria for participants will be i) aged 18 and above ii) who meet criteria for a schizophrenia-spectrum diagnoses (schizophrenia, schizophreniform disorder, schizoaffective disorder, delusional disorder or psychotic disorder not otherwise specified; ICD-10), or meet criteria for an Early Intervention Service (EIS) for treatment of psychosis to allow for diagnostic uncertainty iii) able to give informed consent and have capacity to consent iv) currently receiving care from an acute psychiatric inpatient team v) able to complete the research in English. Exclusion criteria will be: i) Non-English speakers (due to translation costs and difficulty of producing valid translations of the research instruments and intervention), ii) an acquired brain injury or substance misuse judged to be the acute cause of the psychotic experiences iii) those already undertaking a structured psychological intervention delivered by a psychologist or trained therapist at time of study.
Randomisation and blinding: The randomisation will be undertaken using www.sealedenvelope.com. Participant numbers will be entered into the sealed-envelope website by someone independent from the trial after the research assistant has completed the baseline assessment. Allocations will be emailed to the PI who will then contact the therapists to commence therapy with the service users assigned to the intervention arm and inform participants of their allocation.
All assessments will be completed by research assistants who will be blind to treatment allocation. The research assistants work in a separate team and building to the therapists to minimise blind breaks. The research assistant will be appropriately trained to administer all outcome measures. Blinding will be monitored, and if any blind breaks (i.e. the research assistant being exposed to the participant’s treatment condition) occur they will be systematically recorded.
Stakeholder involvement for the development of this protocol: This research protocol was presented at the North Thames Collaborations for Leadership in Applied Health Research and Care (CLAHRC) Patient and Public Involvement (PPI) panel to shape study conception and research design (twice in 2018). The panel supported of the aims of this project and thought the outlined methodological design was appropriate and recommended the development of a stakeholder consultation group who are consulted throughout the duration of the research study (particularly during the intervention development). The panel also gave some initial feedback on the core components of the intervention which were all integrated into the therapy protocol.
Stakeholder involvement for this research study: A stakeholder group of eleven experts (service users, family/carers, inpatient clinicians and researchers) was convened in August 2020 to contribute to key decisions about the design of the intervention and research trial, and is informed coproduction principles outlined by INVOLVE (2018) and the National Survivor User Network (NSUN 2013) 4pi framework. Recruitment for the panel was conducted through the McPin Foundation and the Mental Health Policy Research Unit (MHPRU) respectively for service user and carer stakeholders, and through social media and the professional network of the lead researcher respectively for mental health inpatient staff and researchers. Purposive recruitment of stakeholders was undertaken to ensure there was ethnic minority service user and carer representation within the group. Meetings were conducted every month whilst the intervention was being developed and will continue at quarterly intervals for the duration of the trial. Six stakeholder meetings have been undertaken to date (August to January 2020) and have focused on the adaptions to the CBTp intervention including: identifying the key underlying values and principles, delivery format, crisis priorities for service users and carers, how to include family/social networks, culturally appropriate adaptations (e.g. including religious spiritual and community understanding and support into the intervention) and ensuring cultural sensitivity. To date, all meetings have been conducted remotely due to COVID-19.
Study arms
Participants will be randomised to one of two conditions: the crisis-focused CBTp intervention arm or treatment as usual arm.
Crisis-focused CBTp intervention: The trial intervention will be delivered by psychological therapists working in the acute inpatient services. All therapists are clinical psychologists or counselling psychologists registered with the UK Health and Care Professions Council [HCPC], with experience of delivering CBTp in inpatient settings. The majority of sessions will be delivered in a private and quiet room on the inpatient ward or outside/off the ward if the service user has the appropriate leave, with some sessions being delivered in community settings or remotely (e.g. via phone or video conferencing technology) if the participant is discharged.
The crisis-focused CBTp intervention is underpinned by a modularised CBTp protocol that aims to deliver approximately six to eight sessions of therapy to participants. The protocol outlines seven modules including: engagement, assessment and identifying priorities; formulation of the crisis; stabilisation and safety; coping, self-management and problem solving; crisis plans and crisis cards; change strategy work focusing on crisis appraisals and safety behaviours; and discharge, relapse planning and recovery toolkits. The first two components (engagement, assessment and identifying priorities, and formulating the crisis) are essential components of the intervention and the remaining ones are flexibly chosen based on the collaboratively chosen service user priorities. The number of sessions will be determined by the collaborative priorities set by the service user and therapist and length of admission, and therefore more or less sessions can be offered. The therapy will also include at least one follow-up sessions post-discharge to ensure support through the discharge process. The intervention will also include strategies to involve the individual’s network, e.g. family sessions, and formulation sharing with the multi-disciplinary team.
Training and supervision of the therapists: The therapists received a training package which involved watching pre-recorded therapy videos (https://www.psychosisresearch.com/cbt-phase-1/), and two days training specifically focusing on crisis-focused CBTp. The training, delivered by LW, CW and a service user with lived experience of therapy and inpatient care, comprised an introduction to the crisis-focused CBTp model, making culturally appropriate adaptations, undertaking a crisis-focused assessment, and developing a crisis-focused formulation, and utilising brief crisis-focused intervention strategies. It included a combination of didactic teaching, role plays, reflective exercises and group discussion. They will also have access to weekly 90-minute group supervision whilst delivering the therapeutic intervention.
Fidelity to therapy: All therapy sessions will be audio recorded, if the participants consents. Ten percent will be rated on the Cognitive Therapy Rating Scale (Blackburn et al. 2001) to ensure adherence to the CBT model. Some adaptations to the application of the fidelity scale will be made, taking into account that the therapy is being delivered as a brief intervention and with people in an acute mental health inpatient population, which may make some of the fidelity items harder to achieve. For example, the agenda may only be brief and only include a single agenda item, specific thoughts/cognitions may not always be identifiable, and only a simple formulation may be possible (making basic links between thoughts, feelings and behaviours).
Monitoring what is delivered: The therapists will record the content and delivery of the sessions, including information on the session length, agenda and types of CBTp strategies utilised (e.g. assessment, formulation, relapse prevention) on a pre-defined database.
Treatment as usual (TAU): This will be the routine care that participants receive within the acute inpatient setting. This includes multi-disciplinary care from mental health nurses, nursing assistants, psychiatrists, pharmacists, occupational therapists and psychologists. TAU will include access to routinely delivered psychosocial intervention, this can include structured psychological therapies delivered by clinical or counselling psychologists, and brief interventions delivered by appropriately trained nurses or occupational therapists. The NHS study site employs a maximum of 0.5 Whole Time Equivalent (WTE) of qualified psychologist (clinical or counselling) and 0.8 WTE of assistant psychologist input per 20 acute care beds. The trial therapists also work in treatment as usual however recruitment will not be conducted on the ward in which they are offering treatment as usual so it is extremely unlikely study participants will be offered therapy from the trial therapists. They will also not use any of the therapy resources in treatment as usual.
Procedure
Participants will be recruited from three male acute wards, three female acute wards, three acute wards for older adults, and one male Psychiatric Intensive Care Unit (PICU) in NELFT. The study will be advertised to the inpatient staff teams who will in turn provide information about the study to eligible participants. Due to the high turnover in acute mental health inpatient wards, inpatient staff will advertise the research to service users as early as the first day on the ward, if appropriate to do so. If participants consent, they will be contacted by a research assistant within 72 hours who will share more detailed information and gain informed consent if the service user wants to participate. The research assistant will undertake all clinician administered and self-report measures with the participant (see table 1). Once complete, the research assistant will inform the PI of the participant number who will randomise the participant to either the CBTp intervention or TAU. The PI will inform the participant of their allocation. The research assistant will then complete further assessment sessions with all participants at two months-post randomisation and six months post randomisation. Relapse and rehospitalisation data will be collected at 12-months which does not involve contact with the participant.
Outcomes:
Feasibility outcomes: Individual patient data will be collected on a pre-developed sheet adhering to CONSORT guidelines (Boutron et al. 2008, Schulz et al. 2010). This will include patient eligibility status, number of referrals received by ward staff, willingness of participant to consent, willingness of participants to be randomised, and attrition. Therapy specific data will include: number of sessions attended, therapy resources used, mode of therapy, location of therapy sessions, number of sessions conducted prior to and post discharge, time and duration of sessions, quantity of homework completed, and any serious adverse events. Patient outcome measure completion will also be examined.
An individual patient demographics sheet will be used to collect sociodemographic and service user data, in order to identify the types of people willing to take part in such a trial.
Clinical outcomes: Clinical outcome measures will be completed by a research assistant blind to treatment allocation. In order to reduce participant burden, a combination of self-report outcomes, assessor-rated outcomes, and a structured clinical interview have been chosen. The measures will be administered during a face to face, or if not possible remote, interview between the participant and the research assistant. Where possible short versions or sub-components of the measures have been chosen for the same reason.
Semi-structured clinical interview:
- Experiences of psychosis will be measured by the Positive and Negative Syndrome Scale (PANSS) (Kay et al. 1987). The PANSS is a frequently used measure of psychosis and has three subscales of positive symptoms, negative symptoms and general pathology. Only the positive subscale will be used to measure positive symptoms. It is a 7-item sub-scale which will be completed by trained research assistants. Participants can score from 1 (absent) to 7 (extreme) on each item. It has good internal consistency (Cronbachs α = .73) and inter-rater reliability (between 0.83 and 0.87).
Self-report outcome measures (to be completed with assistance from the researcher):
- Depression will be measured by the Beck Depression Inventory brief 7-item measure. (BDI-7 (Beck et al. 1997)). This is a self-report measure which has good internal consistency. Participants can score from 0 (not present) to 3 (indicating severe) and have a total score of 21. Items examine symptoms of sadness, pessimism, past failure, loss of pleasure, self-dislike, self-criticism and suicidal thoughts. It has good internal consistency (Cronbachs α = .86).
- Hopelessness will be measured by the short-form of the Beck Hopelessness Scale (BHS; (Beck et al. 1974)), which is a recently developed 9-item version of the scale validated for psychiatric inpatients (Barkham et al. 2012). The 9-item measure includes items 2, 6, 11, 12, 14, 16, 17, 18 and 20 from the original scale. Participants can score 0 (not present) or 1 (present) on each item. Items include “My future seems dark to me” and “I have great faith in the future”. The 9-item version has good internal consistency (Cronbachs α = .86).
- Personal recovery will be measured by the 15-item Process of Recovery Questionnaire (QPR; (Law et al. 2014)). Participants can score from 0 (disagree strongly) to 4 (agree strongly) on each item, and score a total a maximum of 40 on the scale. Items include “I feel better about myself” and “I feel that my life has a purpose”. It has good internal consistency (Cronbachs α = .93).
- Anxiety will be measured on the Generalised Anxiety Disorder – 7 item GAD-7 (Spitzer et al. 2006) Participants can score from 0 (not at all) to 3 (nearly every day) on each item. A potential total score can range from 0 to 21. It has good internal consistency (Cronbachs α = .92).
- Subjective experiences of crisis in psychosis will be examined using a newly developed measure (Wood et al, unpublished). This is a 23 item measure which includes statements such as “I have been feeling very strong distressing emotions” and “I feel able to live my life in line with my morals and values” with scores of between 1 (not at all) to 5 (all of the time) on each item. Participants can score a total of 115. This is not yet validated but its psychometric properties will examined using study data.
- Quality of life will be measured by the Recovering Quality of Life (REQOL-10; Keetharuth et al., 2018). Participants rate their quality of life on 10-items from 0 to 4. A participant can score a total of 40. Example items include “I felt lonely” and “I felt happy”. Internal consistency is high (Cronbach α = .89).
- Service use will also be assessed using an adapted version of the “generic UK mental health” version of the Client Service Receipt Inventory (CSRI; Beecham & Knapp, 2001). This has been adapted to reflect the local care pathways in the recruitment site. This will be completed through participant self-report and information from clinical notes.
Clinician/researcher rated measures:
- Functioning will be assessed on the Global Assessment of Functioning (GAF) measure (Hall 1995, Pederson et al. 2020). GAF scores range from 1 (in some danger of hurting self or others) to 100 (absent or minimal symptoms), examining both symptoms and functioning. It has demonstrated good internal consistency (Cronbachs α = .80).
- The Threshold Assessment Grid (TAG) examines the severity of participants’ mental health difficulties (Slade et al. 2000). It has seven domains measuring three areas of safety, risk and needs and disabilities. Participants can score from 0 (none) to 4 (very severe) on each domain, which are analysed individually/ as a total score. It has good internal consistency (Cronbachs α = .70).
Participants’ clinical records will be examined to gather information on:
- Hospitalisation: Total number of days in hospital and number of incidents.
- Relapse: Total days under the care of acute mental health services (including inpatient wards, crisis home treatment, psychiatric liaison and acute crisis and assessment teams) and number of incidents
- Number of serious incidents and adverse events, including those of harm to self and others
Qualitative interviews: Qualitative interviews will be conducted to explore service users’ and therapists’ experience of the crisis focused CBTp intervention and research trial more broadly. This is to evaluate the acceptability of the therapy and therapists training.
Participants in the CBTp arm will be invited to complete a qualitative semi-structured interview exploring their experiences of the intervention and its perceived impacts. The interview guide will include questions focusing on acceptability following guidance from Sekhon et al. (2017) on examining acceptability including how they felt about the intervention, levels of burden, intervention coherence, perceived effectiveness, and how it fitted with their value system. The interviews will be undertaken approximately four to eight weeks post-intervention. We aim to interview half of the participants in the CBTp arm, therefore an estimated total of n=15 participants, depending on quality, depth and diversity of data collected. Purposive recruitment will aim to obtain an ethnically and gender diverse sample, and also include participants who dropped out of therapy.
Semi-structured interviews will also be conducted with the therapists delivering the CBTp intervention and examine perceived acceptability again following guidance from Sekhon et al. (2017). The sample size will be dependent on the number therapist recruited to deliver therapy but it is estimated that this will be approximately four to six participants. The interview topic guide will include questions on the therapists’ impressions on the usefulness of the training, positive and negative aspects of the training and areas for development. The interview guide includes questions on therapists’ impressions of the usefulness of therapy, expectations and goals, positive and negative aspects of CBTp and relationship with the service user, and suggestions for treatment refinement. This is to evaluate the feasibility and acceptability of the training. The interviews will be undertaken once the therapist has completed all of their allocated therapy cases.
Analysis plan: The study will follow best practice guidance for the reporting of feasibility RCTs (CONSORT, Schulz, Altman & Moher, 2010; Eldridge et al., 2016). The focus of the analysis will be on key indicators of feasibility, including participant recruitment, retention and acceptability of the intervention, which will be summarised descriptively using frequencies and percentages. Continuous clinical outcome measures will be summarised separately by study arm using means and standard deviations or medians and interquartile ranges, as appropriate for the distribution of the data. Binary outcome measures will be summarised using frequencies and percentages. The quantity of missing data for each clinical outcome will be examined and likewise summarised by study arm. This feasibility study will not have sufficient power to assess the effectiveness of the intervention. However, to trial the analysis envisaged for a future, fully powered, effectiveness RCT, clinical outcomes at follow-up time points will be compared between study arms, using linear or logistic regression models as appropriate, and adjusting for the baseline measure of the outcome in question.
The qualitative interviews will be audio recorded, transcribed verbatim, and analysed using thematic analysis (Braun and Clarke 2006) by LW on NViVo (2017). The thematic analysis will be conducted from a critical realist position and will combined inductive and deductive approaches, seeking to both explore participants’ experiences of receiving or delivering CBTp, and to answer questions about the acceptability and feasibility of the therapy, its components and its mode of delivery. Initially each transcript will be read and reread to ensure the researcher is fully immersed in the data, and then initially coded. Codes will be collated together across interviews and grouped together to form analytical themes. Patterns of themes will be explored across the data set focussing on both commonalities and variations, and comparing service user and therapist perspectives. The theme structure will be checked with a small number of participants to check it reflects their experiences. The final theme structure will also be discussed with the research team and stakeholder group (including people with lived experience of psychosis and inpatient admission).
Feasibility criteria: The trial of the CBTp intervention will be deemed feasible if the following criteria, determined by examining published CBTp trials, are met (Jacobsen et al. 2018, Wood et al. 2020):
- Retention rate of 75% two months post-randomisation and 60% at six months post-randomisation
- Recruitment of ≥80% of the target sample size (n=60) over the 12-month recruitment period.
- Qualitative data from service users and therapists support the intervention/indicate that the intervention is acceptable.
Data management and security
Data will be managed in line with the General Data Protection Regulation 2016/679. All personal identifiable data will be stored separately to study data so data remains anonymous. All participants will be allocated a participant number. All paper documentation will be stored in a locked filing cabinet in a locked office on the NHS site. All electronic data will be stored in a password protected database and on an encrypted laptop. All audio recordings will be identifiable by participant number and stored on an encrypted laptop.
Data quality
All data collected through outcome measures and clinical notes will be routinely audited and cross checked to ensure accurate collection and entry.
Study governance and management
The CI will manage the study and have responsibility for the trial data. The CI will have monthly meetings with primary collaborators, and research assistants respectively, to ensure the appropriate management of the trial. The Sponsor and the REC will be provided with relevant study data for auditing and review processes.
Trial steering committee
A Trial Steering Committee (TSC) has been established which will incorporate the duties of a Data Management Committee (DMC) including monitoring adverse events and monitor data. The TSC comprises four members with collective expertise in trial statistics, conducting trials, delivering inpatient psychological therapy, and lived experience of acute mental health inpatient care. The committee will monitor the progress, conduct and safety of the trial, advise on scientific credibility, and consider if the trial should continue, be modified or be stopped (NIHR INVOLVE 2020). The group will meet every six months whilst the trial is undertaken.
Dissemination
This trial will be published in a peer-reviewed journal and data will be made available via the Open Science framework. Findings will also be made available to participants and teams where recruitment was conducted and be presented at relevant national and international conferences.
Trial status
Recruitment commenced on the 18th February 2021 and will be open until May 2022.