The study protocol has been reported in accordance with the Standard Protocol Items: Recommendations for Clinical Interventional Trials (SPIRIT) guidelines [36] (Additional file 1).
Trial design
The current study is designed as a multi-centre, randomised, controlled, investigator-blinded superiority trial with two parallel groups and a primary endpoint of child psychosocial functioning and family functioning at six-month follow up. Randomisation will be performed as block randomisation with a 2:1 allocation (intervention: control).
Study settings
Family Talk will be implemented in 15 sites across the RoI, including 10 sites with the statutory HSE adult, child and primary care mental health services, four sites with the statutory child welfare and protection body (Tusla), and one site with the AMHS in the Saint John of God’s Hospitaller Ministries. Sites are located in both urban and rural areas with catchment populations from a range of socioeconomic backgrounds. A list of study sites can be seen on the PRIMERA website (ref withheld for blind review). Across all organisations, FT will be delivered within community outpatient clinics, with a small minority (< 10%) taking place in the home setting.
Most parent participants (< 80%) across sites will be a current patient of AMHS and will be under the clinical responsibility of the consultant psychiatrist / multi-disciplinary team (MDT). In some cases, a family may be involved with CAMHS or with Tusla, but the parent must have a formally diagnosed mental illness and be in receipt of treatment from their GP. Clinical responsibility will be provided by the GP and the service provider of FT. We will recruit only children aged five years and over because FT is targeted at children who are able to verbally express their experiences [23].
Participants and eligibility criteria
Families are eligible for inclusion according to the following criteria:
- Parent(s) aged over 18 – and with children aged 5-18 years - attending AMHS and who are under the care of a psychiatrist/MDT due to a formal (or working) diagnosis of mental illness; OR
- Parent(s) with a mental illness episode in the last 18 months who had been under the care of a psychiatrist or MDT; OR
- Parent(s) currently attending a GP for mental illness.
It should be noted that while children over five years can receive the FT intervention, data will only be collected from child participants aged 8-18 years, as the selected outcome measures are only suitable for this age group.
Exclusion criteria for families:
Families will be excluded if the parent/family is in a state of crisis/instability such that they cannot engage with the intervention or the research process. This includes:
- Parents/children with active psychosis
- Parents with active substance misuse and unable to engage with FT
- Parents or children who are in hospital
- Parents or children with intellectual disability that affects their capacity to engage with FT or the research process (e.g. completing questionnaires)
- Dispute over child custody
- Urgent need for child protection services.
Where hospitalisation or relapse occur during the delivery of FT, the clinician must make a judgment whether the intervention can be merely postponed or delivered at a later stage when the patient is more stable.
Eligibility criteria for staff delivering Family Talk
Clinicians delivering FT must have at least three years’ experience in working with adult or child mental health and/or welfare and protection services. All clinicians must also have completed the online training in FT (www.emergingminds.com.au) and receive monthly supervision in FT delivery.
Intervention
Family Talk is a manualised, strengths-based, 7 session, weekly programme for families where one or both parents have a mental illness. FT uses an individual family format and the trained clinician meets with parents and the children (and extended family members – e.g. grandparent - if requested by the parents). FT is based on psycho-education, narrative and systemic therapy, and is designed to promote family communication and understanding about mental illness, and to enhance family resilience and social supports [32]. The first two sessions involve the clinician and parents and includes a discussion of the family’s experience of mental illness and psycho-education, as required. In session three, the clinician meets with the children alone to conduct an assessment and to identify any questions which the child(ren) may have in relation to their parent’s mental illness. Next, a planning meeting between the clinician and parents is held, after which a whole family session is organised to support family discussion and provide information on mental disorders as required. The intervention concludes with follow-up meetings (after one week and after 3-6 months) to check in and support the family going forward. Each session lasts 60-90 minutes (Figure 1).
Adherence to intervention protocol
Evidence suggests that more positive outcomes of behavioural and psychosocial programmes tend to be associated with higher levels of adherence/fidelity to intervention protocols [37]. The manualisation, and training and supervision of FT, should help ensure consistency and quality of programme delivery. Clinicians must complete weekly session checklists to check that content is covered and must record family attendance and engagement. In addition, as part of the process evaluation, clinicians must complete an online Fidelity Questionnaire for each family that receives FT to capture overall adherence, attendance and family engagement. The process evaluation will also undertake semi-structured interviews with families and clinicians to assess the degree to which sites implemented FT with fidelity. Clinicians will document if the intervention needed to be modified or discontinued for any reason, including, for example, perceived harm or withdrawal of participant consent.
Wait-list control group
Families assigned to the control group will receive treatment as usual, i.e. the parent with mental illness will receive medication/psychotherapy from their psychiatrist/MDT/GP. The only difference in service utilisation between the intervention and control group will be that the former will receive Family Talk six months earlier. A Services Utilisation Questionnaire will be used to document the types of service supports received by control and intervention group families between T0 and T1 (i.e. baseline to 6-month follow up).
Outcomes
This study involves an RCT, and associated costs and process evaluations. The primary and secondary outcomes for the impact evaluation are outlined below, followed by the data collection measures for the costs and process evaluations. All measures for the impact evaluation are based on a continuous scale and will be analysed using covariance adjusted outcomes. All outcome measures for the impact evaluation will be collected at baseline and at 6- and 12-month follow ups. All children who complete the child-report measures will be over 8 years old. Figure 2 provides an overview of primary and secondary outcomes and data collection points.
Primary outcomes
There are two primary outcomes: child psychosocial functioning and family functioning.
Child psychosocial functioning is measured by the Strengths and Difficulties Questionnaire (SDQ) [38]. The SDQ is a 25-item, widely used, and psychometrically sound questionnaire of child conduct problems, hyperactivity, emotional symptoms, peer problems, and pro-social behaviour for 3-18 year-olds. The SDQ has a parent and child version; in the former, the parent reports on the child’s behaviour whilst in the latter, the child (8-18 years) reports on their own behaviour. Both parents and children will complete the SDQ in the current evaluation.
Family functioning is assessed with the Systematic Clinical Outcome and Routine Evaluation (SCORE-15), a 15-item reliable and validated self-report measure of family communication, relationships and functioning [39]. The SCORE-15 has three dimensions: strengths and adaptability; overwhelmed by difficulty; and disrupted communication. It is validated for use with adults from clinical populations and the child version is suitable for children aged 8-18 years old [40].
Secondary outcomes
Data will be collected for the following 7 secondary outcome measures:
- Child depression will be assessed (via parent and child report) using the 10-item Major Depression subscale from the Revised Children’s Anxiety and Depression Scale (RCADS) [41]. Both the parent and child versions show high internal consistency and convergent validity, and have been shown to accurately assess anxiety and depression symptoms in both clinical and school-based youth [42].
- Child anxiety will be assessed by parent and child report using the 5-item version of the Screen for Child Anxiety Related Disorders (SCARED-5) [43]. Both the parent and child versions of the SCARED and SCARED-5 demonstrate robust psychometric properties. The SCARED-5 measures generalised anxiety disorder, panic/somatic, separation anxiety, social phobia and school phobia. A cut-off of 3 can discriminate anxiety from non-anxiety.
- Understanding and experience of parental mental illness will be measured using the Understanding of Parental Mental Health questionnaire, via parent and child report. This 20-item questionnaire has been devised specifically by the PRIMERA research team in the absence of any psychometrically robust and validated measures to assess a parent’s understanding and experience of how their mental health affects their children, or to assess a child’s understanding of parental mental illness. A key objective of FT is to improve knowledge and understanding of parental mental health difficulties among family members and is therefore an important proximal outcome of the intervention. The questionnaire assesses mental health literacy (e.g. awareness of common myths about mental health), the experience of living with (a parent with) mental illness, and their perceived level of family, social and service supports.
- Child resilience will be assessed with the Child and Youth Resilience Measure 12 (CYRM-12), a brief, validated, 12-item, child-report measure of the child’s individual traits, relationship to caregiver(s), and contextual factors that facilitate a sense of belonging and resilience [44].
- Parental mental health will be assessed with the BASIS-24 (Behaviour and Symptom Identification Scale 24), a 24-item, parent-report questionnaire of mental health functioning in clinical populations (aged>18) across six major areas: depression/functioning, relationships, self-harm, emotional lability, psychosis, and substance abuse [45].
- Parental coping and resilience will be measured with the Coping Self Efficacy questionnaire (CSE), a 26-item self-report measure of parental confidence in performing coping behaviours when faced with life challenges (i.e. use of problem-focused coping, ability to stop unpleasant emotions and thoughts, and receipt of support from friends and family) [46].
- Partner mental health and wellbeing will be measured using the Warwick-Edinburgh Mental Well-being Scale (WEMWBS). The WEMWBS is a 14-item, psychometrically robust, self-report measure used to assess mental health and wellbeing in the general population (during the previous two weeks). It assesses both hedonic (e.g. life satisfaction) and eudemonic (e.g. psychological functioning and self-realisation) perspectives and also incorporates positive affect (e.g. optimism) and positive functioning (e.g. energy) [47].
Socio-demographic questionnaire
Demographic and background information on families will be collected at baseline from parents and will include the physical and mental health of family members, perceived social support, and socioeconomic status (assessed using information on parental income, employment, education and living circumstances). The questionnaire will provide important data for purposes of attrition analysis and for testing the equivalency of the control and intervention groups. A brief follow-up version will be used to assess any changes at 6- and 12-month follow-up (e.g. change of partner, new children etc.)
Process evaluation
The process evaluation will run in parallel to the RCT and will involve the application of mixed methods to investigate the experiences and contextual factors related to receiving/implementing FT. The analysis will be informed by the MRC guidance for complex interventions [35] and will be located within an implementation science framework (e.g. Fixsen’s implementation model [48]). The quantitative and qualitative elements of the process evaluation are outlined below.
Quantitative element: survey and questionnaire
- A Family Satisfaction Questionnaire will ask families (parents and children) to assess their experience of FT following the intervention. The parent version of the questionnaire has 18 items and the child version has 12 items. Participants will be asked to evaluate the extent to which FT was a positive experience for families, helped with family functioning and understanding of mental health, and to provide suggestions for improvement.
- An online Qualtrics survey will be administered to clinicians following FT delivery in order to assess implementation fidelity. The survey takes approximately 15 minutes to complete and assesses clinician adherence to session checklists as well as family attendance and engagement to the intervention.
Qualitative element: Interviews and focus groups
Interviews with parents and partners
Semi-structured interviews will be conducted with a subsample of parents (n≈15-20) and partners (n≈ 10) involved in the RCT in order to explore their experience of participating in FT and to learn to what extent it met their needs. A maximum variation sampling strategy will be employed in order to recruit a heterogeneous sample across different site locations and with different demographic characteristics (e.g. age, marital status, socioeconomic status). Interviews will be conducted at 6- and 12-month follow up. Interviews will take place in the participant’s home/site centre or remotely (phone/video call) and will last approximately 20-40 minutes. A brief interview will also be carried out with parents who dropped out of FT before completion (n ≈ 10) to assess their reasons for attrition.
Interviews with children
Semi-structured interviews (15-30 minutes) will also be conducted with a small sample of children aged 12-18 years (n≈ 10) at six-month follow up in order to explore their experience of the FT programme and the extent to which they think it helped them and other family members.
An alternative interview story approach will be used to interview younger children (8 - 11 years) (n≈ 8-10). The interview story (15-30 minutes) involves a family imagined by the child in which a parent has mental health difficulties. The child is encouraged to build up a picture of the house, location and family members who live in the home. Picture cards are used to help the child identify emotions. The child is also asked to imagine that the family attends FT and to relate the family’s experience of the programme (e.g. what helped, what could be improved). The interview story approach has been used successfully in previous research [49] to discuss sensitive issues with younger children (e.g. children who have experienced domestic abuse). The indirect approach allows the child to externalise the issue and talk about it in a more objective fashion, thereby offering emotional protection to the child. Occasionally, children may slip into ‘I’ language during the course of an interview rather than use the name of the character they have chosen. If that happens, the researcher mirrors the language used by the child. Ethical issues in interviewing children are outlined later.
Interviews /focus groups with clinicians, managers and policymakers
One-to-one semi-structured interviews and/or focus groups will be conducted with FT clinicians/service providers across all participating sites (n≈20). Individual interviews will last 30-60 minutes and focus groups will last approximately 60-90 minutes. This will cover topics such as: the experience of implementing and delivering FT within services; key outcomes and enablers and barriers to delivery; rates of recruitment and attrition, and organisational support, amongst other issues.
A small number of in person/phone/video call interviews (15-30 minutes) will also be held with managers/decision makers within sites where possible (e.g. Area Managers, Executive Clinical Directors, consultant psychiatrists) (n≈10). The purpose of the interview will be to elicit their experience/views of FT within their service and to assess to what extent the intervention fits with their policy and practice objectives.
Cost effectiveness analysis of Family Talk
A Service Utilisation questionnaire (SUQ) and cost diaries will be used to conduct a cost effectiveness analysis of Family Talk compared to usual services on our primary outcome measures. The SUQ is an adapted version of the Client Service Receipt Inventory [50] and has been used in previous research [51, 52]. The form will assess the type and number of contacts families have had with healthcare, social care and educational services in the previous six months, and will be completed at baseline and at 6-month follow up. The form will be administered by means of a face-to-face interview carried out by researchers with parent participants, along with the other psychometric inventories outlined above.
Cost diaries will be administered to programme facilitators asking them to document the time taken to train in FT, recruit and engage families, deliver the programme, materials and costs incurred. Time will be multiplied by salary/wage costs to calculate the approximate cost of delivering FT.
Participant timeline
The flow of participants from recruitment through to the end of the study is shown in Figure 2. Parents and children will be assessed at T0 (pre-intervention), at six-month follow up (T1; 3 months post intervention) and at 12-month follow up (T2). Assessment of the control group will continue up to T1, after which they will be offered FT. Assessment of the intervention group alone will continue at 12-month follow up. Enrolment into the study will be on a staggered basis and will depend on clinicians referring suitable families to the research team.
Data collection and delivery of the intervention were necessarily paused for four months (mid- March to mid-July 2020) due to the COVID-19 lockdown restrictions in the RoI. Therefore, assessments affected by the restrictions will be collected four months later than originally planned. However, taking the pause into account, we still consider the assessment time points to be 6- and 12-month follow up. Assessments affected by the COVID-19 suspension will be noted in the analysis.
Sample size
A power analysis was conducted using the two primary outcome measures – the Strengths and Difficulties Questionnaire (SDQ) and the Systematic Clinical Outcome and Routine Evaluation (SCORE-15) - in order to identify the minimum sample size required to detect an improvement in child and family psychosocial functioning post intervention.
Three of the previous RCTs of FT employed intensive clinician interviews to assess child psychosocial functioning, and reported statistically significant results with varying sample sizes (n = 28 – 105) [23-25]. Similar to two previous evaluations of FT [26, 27], this study intends to use the brief SDQ to measure child psychosocial functioning. These studies reported effect sizes of 0.70 and 1, respectively, at post intervention. The Finnish study [26] involved 109 families and the German study [27] recruited 37 families. The power calculation for the current study was conducted for an independent samples t-test, as this is expected to be the least powerful test in the overall main analysis. Using G*Power t-test calculations for the difference between two independent means (two groups), and assuming α = .05, 80% power, two tailed testing, 15% attrition, and 2:1 allocation, the study will need to recruit 38 participants (FT = 25, TAU = 13) to detect a change between 0.7 and 1. Given that the effect sizes in these two studies are large, we intend to recruit additional families to enable us to detect smaller changes, where they exist.
Family functioning has not been typically assessed in previous evaluations of FT despite the fact that enhanced family communication and cohesion are key intervention goals. One previous study has assessed family functioning using intensive clinician interviewing of families [25], although it should be noted that two ongoing evaluations of FT have included it as an outcome, albeit using measures that take considerably longer to administer than the SCORE-15 [28, 29].The SCORE-15 has been used as a brief measure of family functioning in evaluations of family therapy with populations that share a clinical profile similar to the sample in the current study [53]. An effect size of 0.5 was reported. Similar to above, we conducted a G*Power t-test calculation for the difference between two independent means (two groups) for the outcome of family functioning. Assuming α = .05, 80% power, two tailed testing, 15% attrition, and 2:1 allocation, the study will need to recruit 144 participants (FT = 96, TAU = 48) to detect a change of 0.5.
These sample sizes should be more than sufficient for Mixed Model Repeated Measures (MMRM) across the three time points to have > 80% power and also allow for post-hoc t-tests both between groups and within groups to have ≥ 80%power.
Recruitment
The recruitment phase opened in March 2019 and will close on 30th November 2020 to allow sites time to recruit a sufficient sample of suitable families to the research. Unfortunately, the funding timeline means that we cannot further extend the enrolment period in order to account for the four-month suspension caused by the COVID-19 lockdown restrictions, and as such, recruitment rates will be affected. As indicated above, the early phase of the current study involved a prior installation and implementation period in order to allow sites to train and gain experience in delivering FT [ref withheld for purposes of blind review]. Families (parents and children 5-18 years) will be recruited by clinicians in each site from their existing waiting lists. Recruitment brochures and posters will be used to inform families and clinicians about FT and the PRIMERA research. In addition, each site has nominated a lead contact person who will take responsibility for promoting FT and the PRIMERA research within their area in order to encourage referrals.
Clinicians will meet with families to assess their suitability for FT and the research process using the eligibility criteria outlined above. Once the clinician has secured agreement from the parent that they are interested in participating, they will ask for their written consent (on the family recruitment leaflet) for their contact details to be passed in confidence to the research team. Parents will then be contacted by the research team via telephone to arrange for one of the research team to talk to them in more detail about the study and to arrange to visit them to tell them more about the research and obtain their written informed consent in person. Two children per family - aged 8-18 years - are eligible to participate and their written assent will be obtained once their parent has provided prior consent for their child’s participation. Written informed consent/assent will be obtained at each data collection time point, and also if a parent/child is asked to participate in a qualitative interview. Families will be incentivised to participate with a shopping voucher worth €20 at each data-collection visit. Families will be informed within two weeks about their allocated group.
Given the traditional segregation of adult and child mental health services in Ireland, it is expected that some clinicians and managers will not see a family-focused service as fitting their role and remit. Therefore, throughout the study, we will spend considerable time on awareness raising activities and liaison with mental health professionals (via meetings, stakeholder events) around the need to provide family-focused mental health services to support this neglected population. We will monitor the referral rates across all sites and will problem-solve with clinicians on strategies to increase recruitment if and when such issues emerge. Collectively, the research team have considerable experience of working with vulnerable and difficult-to-engage populations, and their expertise, in conjunction with the advice and support of collaborating sites, will be important in managing the recruitment process.
Sequence generation and allocation concealment
Once the family is enrolled and baseline evaluations are completed, the family will be randomised to either the intervention arm or a wait-list treatment as usual group by an external consultant (NW) who will be blind to evaluation outcomes and will conceal the allocation sequence until the intervention is assigned. Randomisation will not be influenced by the research team or practitioners involved in FT delivery. Randomisation will be stratified by site with families allocated to either the intervention or control group on a 2:1 basis using the SNOSE (sequentially numbered opaque sealed envelopes) method [54]. The use of block randomisation means that the intervention can be delivered in a staggered manner, with some participants beginning the intervention while further recruitment continues. The external consultant will inform the research team of any issues arising relating to randomisation (e.g. failure to contact clinician to inform of randomisation outcome). Practitioners who deliver the intervention are not involved in delivering services to the control group (and vice versa) in order to ensure that there is no contamination between the intervention and control groups.
Blinding
Due to the nature of the intervention, neither participants nor practitioners can be blinded to allocation. Outcome assessors will be blinded to treatment allocation, as well as those conducting the statistical analyses. Randomisation will be conducted by an external consultant who is unconnected to the recruitment, data collection or analysis process. Participants (families) and practitioners will be requested not to disclose their group allocation to the research team. Any evidence of unblinding will be taken into account at the analysis stage.
Data collection
Families
Participants will be invited to complete outcome measures at baseline (T0) and at 6- and 12-month follow up periods (T1 and T2) (Figure 2). Each questionnaire will be coded with the participant’s ID number, date of completion, version (baseline, T1, T2) and the researcher’s name. Qualitative data (i.e. interviews) will be collected from families following the 6-month assessment within the RCT. Copies of the impact evaluation and costs measures, and interview schedules for the process evaluation, can be obtained from the PRIMERA programme coordinator.
For all aspects of the evaluation (RCT, costs and process evaluations), data will be collected by a researcher who will meet with the participant in the family home, or, if preferred, in a local family/health care centre. Data will also be collected from parents by video call where it is not safe, due to COVID-19, to meet in person. Parents and children (8-18 years) will provide written informed consent/assent prior to data collection, and will be assured of ethical protections (e.g. confidentiality) and risks and benefits from participation. Parents will complete a paper version of outcome measures and the assessment will take 45-75 minutes (with a break if required). Whilst electronic devices may sometimes improve data accuracy and the timeliness of data collection and management [55], the experience of the research team and site staff is that vulnerable populations may be alienated by their use and are more comfortable with paper-based data collection methods. Based on feedback from the mental health service professionals with whom we are working, children will be offered an option of completing a paper version of the survey in the presence of the researcher or via the secure online Qualtrics software package [56]. Both options will take 10-15 minutes. The online survey will include voice-recorded files in order to assist comprehension. The online survey will be accessed via the project webpage in compliance with General Data Protection Regulations (GDPR). No personal identifiers of children will be collected using Qualtrics and Qualtrics does not share data with third parties [56].
For the qualitative interviews, parents and children will provide consent/assent for their interview to be digitally recorded. Anonymity and other ethical protections will be assured (Information sheets and consent/assent forms are available upon request).
In order to enhance the quality of the data, all fieldworkers will receive standardised training in how to administer the measures with families. In addition, selected fieldworkers will be experienced in collecting data from vulnerable populations. Missing, incomplete or inaccurate data will be assessed within a week of data collection by the data-input manager, who will liaise with the relevant fieldworkers for information. Families will be re-contacted if necessary for any missing data.
Participant retention will be promoted using the following strategies: scheduling appointments by telephone and reminding participants by text; minimising participant burden during visits; financial reimbursement at each data-collection point; and liaising with study sites to locate hard-to-reach parents. Every effort will be made by both the research team and study sites to engage families for the entire study period. Where a participant withdraws consent for one follow-up assessment, they will be asked if they would consent to participate at another time point, or for another element of the study (e.g. the process or costs evaluation). All participants will be included in an intention-to-treat analysis, regardless of adherence or non-retention. Reasons for missing data – both non-adherence (e.g. family crisis, perceived harm or non-efficacy) and non-retention (e.g. consent withdrawn; lost to follow-up) - will be sought from parents and practitioners and will be recorded and interpreted during analysis.
Data collection – service providers
Semi-structured interviews (30-60 minutes), focus groups (60-90 minutes), video/phone calls (15-30 minutes) will be audio recorded with participants’ consent and transcribed verbatim and in full. A secure online Qualtrics survey (lasting 15 minutes) will be administered on a once-off basis only, to clinicians following FT delivery in order to assess implementation fidelity, participant attendance and engagement.
Data management
Quantitative data will be entered into a database (IBM SPSS Statistics version 26) by a data manager who will conduct regular verification checks and quality audits to ensure accuracy of entry and coding. This process will be overseen by the Programme Coordinator. The data manager will also liaise with fieldworkers to clarify the accuracy of entered data. Qualitative data (i.e. interview and focus-group data) will be transcribed verbatim and stored on a secure, central network, which is encrypted and password protected. Data will be coded and analysed using the qualitative analysis software package MAXQDA [57].
The study will adhere closely to the GDPR and data protection guidelines on research in the health sector by the Data Commissioner of Ireland [58]. All research staff have received GDPR training. All forms will be anonymised through the allocation of a unique identification number and will be stored under lock and key throughout, and following completion of, the study. All computers will be password-protected and the transfer of any information from laptops to the secure central network will be carried out with extreme caution. Encryption software will also be used to encrypt sensitive data which are stored electronically. Encrypted data will be accessible using a key which will only be known to the research team members. A separate (password protected) database of names and contact details will be stored away from the other data and there will be no means of linking the two.
Where participants provide consent/assent, an anonymised version of their data will be placed in the Irish Qualitative Data Archive (IQDA) and the Irish Social Sciences Data Archive (ISSDA) so that it may be used by future researchers if so required. Future researchers will require ethical approval for their study to proceed. In all other instances, data will be destroyed 10 years after the completion of the study; manual data will be shredded confidentially and electronic data will be reformatted or overwritten.
Statistical methods
Data presentation and results will be carried out according to Consolidated Standards of Reporting Trials (CONSORT) guidelines for RCTs. Descriptive statistics (means, standard deviations, frequencies) will be used to describe the pre-treatment characteristics of participants and for primary and secondary outcome measures at each time point. Mixed Model Repeated Measures (MMRM) will be used to investigate the effects of the intervention at two between (intervention and control) and three within (pre-intervention, 6-and 12--month follow ups) levels for all primary and secondary outcome measures (all continuous outcome data). Initial MMRM analysis will control for baseline psychopathology as a fixed covariate. Modelling for the primary outcomes will be conducted using an unstructured repeated measures co-variance matrix and all other variables as fixed effects. Mean difference effect sizes, 95% CIs, and p values will be reported for continuous outcomes. Where parametric test assumptions fail significantly, then non-parametric tests will be used.
MMRM was chosen as the primary method for analysis as it can reduce several analytic problems that may arise within the current study. Firstly, it allows for different numbers of measurements per participant, thereby tolerating a level of missing data, which is particularly problematic with RCTs with vulnerable populations, as follow-up data are often collected many months after treatment has ended and participants may be difficult to contact [59]. This enables us to use all of the data collected as opposed to deleting cases or imputing missing values. Secondly, it has the advantage of modelling change within individuals as well as across groups. Singer and Willet [60] identify this as the best approach for longitudinal data that has three or more time points.
The analysis will follow an intention-to-treat (ITT) principle where all randomised participants, including those who stop receiving the intervention, will be analysed ‘as randomised’. MMRM analysis is a maximum likelihood statistical modelling technique whereby mean estimates and the repeated measures covariance structure for the observed data are based on a statistical model and possible values are generated for the missing data [61]. Attrition will also be analysed to assess the differences between those who ‘dropped out’ and those who stayed, and to assess if there are predictors at baseline to indicate differences. Qualitative data will also inform the identification of predictor variables for attrition. MMRM will be the primary analytic method, although t-tests will be used to provide detail on any significant differences found from the MMRM.
Regression techniques will be used to explore whether intervention effects differ for certain participant groups such as age of children, severity of parental mental illness, other parent also has a mental illness, and socioeconomic status. Analysis will be conducted using SPSS software (IBM SPSS Statistics version 26).
Process evaluation analysis
The qualitative data (interviews, focus groups, meeting minutes) will be coded and organised using MAXQDA and analysed using constructivist grounded theory [62]. The analysis will be informed by the MRC framework for process evaluations and located within an implementation science framework [35, 48]. One researcher will code all the data, with inter-reliability of codes checked by another researcher on 25 per cent of transcripts selected at random. Any differences encountered by the researchers will be discussed and resolved between them.
We will use descriptive statistics to analyse measures of fidelity (therapist adherence, family attendance), and the Family Satisfaction Questionnaire. Frequencies, medians, interquartile ranges, means and standard deviations will be reported as appropriate.
Economic evaluation
The economic evaluation will compare the cost-effectiveness of receiving FT versus a services as usual control group on our primary outcomes at 6-month follow up. The cost-effectiveness analysis CEA will be undertaken in three key steps:
(i) Identify the cost of delivering FT, obtained through cost diaries completed by service providers
(ii) Compare service utilisation for the intervention and control groups conditions (completed by parents on the Services Utilisation Questionnaire at baseline and 6-month follow up); and
(iii) Calculate an incremental cost-effectiveness ratio (ICER) to give the cost of obtaining a one unit decrease on the clinical outcome measures employed in the RCT (i.e. SDQ, SCORE-15) when comparing FT to usual services at 6-month follow up.
The ICER will use a 1000 replication bootstrap to provide a 95% confidence interval accompanied by appropriate sensitivity analyses (e.g. excluding non-recurrent costs of training). The ICER accommodates sampling (or stochastic) uncertainty and varying levels of willingness to pay for reductions in the primary outcomes of interest.The CEA will adopt a multiagency, public sector, analytic perspective and will use official sources (e.g. government pay scales, the Casemix/HIPE unit of the Health Service Executive) to provide estimates of unit costs separate from frequencies of resource utilisation.
Monitoring
A data monitoring committee is not feasible for this trial due to its relatively short duration and size. Only the research team will have access to the data. The data-input manager will ensure that the quality of data is maintained throughout the trial. Only the data-input manager and the team statistician will have access to the outcome data and they will be blind to study groups. The fieldwork coordinator will inform the research team of any issues arising with participant recruitment and data collection.
Due to the relatively short duration of this trial, we will not conduct an interim analysis as sufficient data will not be available at that point. The trial will only be stopped by the Principal Investigator (in conjunction with the PRIMERA funders) if it becomes clear that harm is being caused by the intervention or recruitment rates are unacceptably low.
The research team will report quarterly to the study’s Steering Group on trial conduct and progress. The Steering Group comprises high-level management from the HSE and Tusla, service users, and representatives from mental health advocacy groups and the academic sector.
Harms
Based on previous evaluations of FT, we do not anticipate any harm or adverse effects from participation in the intervention. Families are informed that they are free to withdraw at any stage if they feel that FT is not beneficial for them. Service providers will stop the intervention if they (in conjunction with the family) decide that it is causing any harm. If a parent suffers a relapse in mental health symptoms, or there is a crisis in the family during the delivery of FT, it is recommended that programme delivery is postponed until the family is in a position to re-engage. In all sites, service providers will have clinical responsibility for patients and families involved in the intervention.
We do not anticipate harm arising from the research process; based on our previous experience, it is envisaged that most participants will find the interview sessions helpful. Nevertheless, we indicate in our information sheets that parents with mental health issues may be potentially vulnerable in terms of the sensitivity of the issues discussed in data collection (e.g. history of mental health challenges) and may possibly feel emotionally distressed as a result. In addition, there is a potential risk that parent welfare concerns may arise during the discussions; for instance, it may emerge during the interview process that a parent may need to link into services with regard to their mental illness (e.g. as indicated by their score on the BASIS-24). If a parent welfare concern arises during the interview process, that person will be directed by the researcher to the FT service provider, who will refer the person to their GP, mental health professional, or consultant psychiatrist, as appropriate.
In addition, the study will include dependent children who have a parent with mental health issues. During the research process, we will be highly attentive to child welfare and protection concerns and will follow Children First guidance [63]. All research staff have received training in Children First guidelines. As in the case of parents, we will also be sensitive to any signs of child discomfort and distress during interviews. The information sheet for families, and every page of our online survey for children, provides advice and contact supports in the unlikely event that children may feel distressed at any point during, or following, a survey or face-to-face interview.
Our ongoing contact with parents and service providers, as well as the qualitative interviews, will alert the research team to any unanticipated harms from the intervention. In addition, unexpected negative effects (e.g. if child and parent symptoms increase following FT) may be detected on our outcome measures which will be carefully reviewed after every assessment.
Auditing
Auditing will not be necessary in this study due to its short duration.
Ethics
The trial has received approval from four ethics committees: the Social Research Ethics Committee in X University (Reference number SRESC-2018-100, the HSE Research Ethics Committee, Tusla Ethics Review Committee, and the Saint John of God’s Research Ethics Committee. Any amendment to the protocol that affects trial implementation and outcomes will require formal approval by each research committee. The trial registry (e.g. ISRCTN) will be notified of any substantive modifications to the protocol.
Consent and assent
Clinicians in each site will verbally inform the service user parent about FT and the PRIMERA research. Once the clinician has secured agreement from the parent that they are interested in participating, they will ask for the parent’s written consent (on the family recruitment leaflet) for their contact details to be passed in confidence to the research team. Parents will then be contacted by the fieldwork coordinator via telephone to discuss the research in more detail, and to arrange for a member of the research team (fieldworker) to visit the family and obtain their written informed consent to participate. Children aged 8-18 years are eligible to participate in the research once their parent has provided prior written informed consent. Parents will be shown a copy of the child’s survey and be given an age-appropriate information sheet to explain to their child. A researcher will also explain the research to the child. Children who decide to participate will then provide their informed written assent. Written informed consent/assent will be obtained at each data collection time point (e.g. baseline, 6- and 12-month follow ups, and also if a parent/child is asked to participate in a qualitative interview).
Service providers (clinicians, management) within each site will also be invited to participate in semi-structured interviews/focus groups and will be asked to provide written informed consent. They will be asked to provide their informed consent too before completing the brief online survey on implementation fidelity.
Confidentiality
All participants in the study (parents, children and service providers) will be assured of confidentiality and anonymity of their data throughout the research process, including their data protection rights of secure storage, processing and deletion of their data. Participants will be informed of limits to confidentiality (where there is a risk to participant or child welfare) in the information sheet and consent form. No identifiable data will be collected using the Qualtrics online platform, and Qualtrics does not share data with third parties [57]. In addition, participants will be informed that they may withdraw from the study and/or withdraw/amend parts of their data if they so wish. They will also be informed that the results will be presented in anonymised form at conferences and published in reports and scientific journals. With their consent, an anonymised version of their data will be archived in IQDA and ISSDA. Researchers who wish to access these data will require separate ethical approval from an approved institution.
Study data files will be encrypted and uploaded onto a central, password protected, secure site at X University that is accessible only to the research team. Data and identifier information will be held separately. The coding key and unarchived data (manual and electronic) will be destroyed by the PI ten years following completion of the study.
Post-trial care
Families recruited to the trial will be under the clinical responsibility of their consultant psychiatrist/MDT/GP and will continue to be under their care following receipt of the Family Talk intervention.
Dissemination
Trial results will be disseminated to participants, funders, collaborating organisations and to a wide range of relevant government departments and other interested organisations (e.g. community- and voluntary-based services). We will also communicate the findings on traditional and social media. To date, we have increased awareness of the research amongst a large number of mental health and child and family services by, for example, hosting several stakeholder events. The study findings will be presented at appropriate academic conferences - both national and international (Covid permitting) - and published in peer-reviewed journals and on relevant websites (e.g. the HSE website, PRIMERA webpage). A number of academic papers are anticipated including: (1) a paper on 6- and 12-month outcomes from the study; and (2) various papers on the experiences of stakeholders in receiving/implementing the intervention. The results will be submitted for publication regardless of the magnitude or direction of the effect. A summary report of the findings with attendant recommendations for policy and practice, will be prepared by the PRIMERA research team for presentation to our funder, the HSE. Anonymised participant level data, along with statistical codes, will be made publicly available in the ISSDA and IQDA, as required by registration with the ISRCTN. This will be available within twelve months of the trial end date.