Setting
We conducted the study in purposively selected PHC facilities in Bui and Kella districts, located in the eat Gurage zone of Central Southern Ethiopia, approximately 100-120km south of Addis Ababa, the capital of Ethiopia. The official language of the region and in both districts is Amharic. In both study areas, the Programme for Improving Mental Health carE (PRIME) (45) study previously worked with local leaders and stakeholders to develop and implement a task-shared mental health care plan delivered in primary and maternal health care settings.
The PHC facilities were staffed by nurses, midwives, and health officers. Each facility was linked to about five health posts: community-based health facilities staffed by health extension workers (HEWs). HEWs are community-based HCWs who provide the first antenatal contact, before referring women for further antenatal care (ANC) at a health center or primary hospital and maintain contact with women during pregnancy.
Study design
We conducted a randomised, controlled feasibility trial with two parallel groups and two time point assessments: at baseline and nine weeks after randomisation (46). We compared adapted PST with enhanced usual care (EUC). A second feasibility trial involving a sub-sample of trial participants who reported past-year exposure to intimate partner violence was nested within the trial; as detailed in the published trial protocol (47, 48).
Participants
Study participants were required to be pregnant women attending ANC services in PHC facilities. Women were eligible to take part if they: (1) endorsed elevated and disabling depression symptoms (scoring 5 or more on the locally validated Patient Health Questionnaire (PHQ-9) (49) and endorsed impaired functioning on the 10th PHQ-9 item about functional impact), (2) were aged 16 years and above, as this is the age at which married adolescent women become legally autonomous in Ethiopia, (3) were between 12 and 34 weeks gestation of pregnancy, (4) spoke Amharic (the official regional language), (5) planned to live in the study area for at least the next six months.
Women were excluded from the study if they: (1) had a condition that impaired their capacity to understand the interview (e.g. were diagnosed with severe intellectual disability or dementia), (2) presented with acute medical illness or evidence of severe mental illness, or (3) had other comorbid medical conditions such as hypertension or renal disease or diabetes, (4) endorsed the 9th item of the PHQ-9 indicating risk of suicide and scored more than 17 on the suicide schedule of the Mini International Neuropsychiatric Interview (MINI) (50), or (5) required emergency treatment.
Participant recruitment and screening
We recruited consecutive women attending PHC-based ANC in two primary care facilities from the beginning June 2021 for 20 working days. Research staff checked the initial eligibility of antenatal attendees based on information available from their clinical records (gestation, age, co-morbid conditions, residence). Eligible women were invited to provide informed consent to an initial screen for depressive symptoms associated with disability using the PHQ-9 and the PHQ-9 tenth item on functional impact. This item asks “Over the last two weeks, how difficult have these problems made it for you to do your work, take care of things at home, or get along with other people?” Options are: “not difficult at all”=0, “somewhat difficult”=1, “very difficult”=2 or “extremely difficult”=3. The suicidality schedule of the Mini International Neuropsychiatric Interview (MINI) was administered to women who endorsed any frequency of suicidality on the ninth PHQ-9 item. Women at risk of suicide (scoring over 17 on the MINI) (50) were excluded from the study and referred for review by a mental health-trained primary care worker (51) who employed the WHO mhGAP intervention guide(52) to assess the risk of suicide and provide an intervention. Research staff were trained to facilitate women’s attendance at services if referred; transportation costs to access care were covered by the study.
Any woman who was eligible to take part following the initial screen received written and verbal information about the study from research staff and thumb printed on the consent sheet; underwent a structured baseline interview after receiving routine clinical care. Participants’ costs incurred to attend research interviews and PST sessions were reimbursed and time spent during research interviews was compensated. Time spent attending PST sessions was not compensated to avoid incentivising engagement with the intervention. Healthcare workers were compensated for attending training, supervision, and delivering sessions.
Sample size
Fifty participants (25 in the intervention and 25 in the EUC group) were recruited for this feasibility trial. A sample size of 24–50 is recommended for feasibility studies (53). The estimated sample size enabled us to detect a dropout rate of 7% with a 95% confidence interval and a 5% margin of error (54).
Randomisation, allocation concealment and masking
Women with disabling antenatal depressive symptoms were randomised to one of two arms (the PST or EUC) using simple randomization in a 1:1 ratio. A random number list was generated by the trial statistician (GM) who was independent of staff working in the field. This list was held centrally at Addis Ababa University. Upon recruitment and completion of baseline assessment, a data manager in the Centre for Innovative Drug Development and Therapeutic Trials for Africa (CDT-Africa), external to the study, was telephoned and allocated each participant to a study arm (PST or EUC). The person contacting the data manager was a member of the research team based in Sodo/Kella and,not involved in assessments. Whenever a new participant was allocated to PST, research staff informed a clinician trained to deliver that arm. Intervention and control groups were anonymously coded so that data analysts remained masked to allocation status during analysis. Participating women and HCWs were not masked to allocation status due to the nature of the intervention; however, outcome assessors were masked to allocation status.
PST Intervention
PST is a commonly used psychotherapy (38, 55) that has comparable efficacy to other psychotherapies such as behavioural activation, cognitive behavioural therapy and to antidepressant medication (56, 57). Assuming circular causality between social adversities and depressive symptoms (58) the PST teaches problem-solving and coping skills (58) in three phases. We adapted PST from the South African evidence base while involving the authors (KS and BM) (34). In the first phase of our adapted PST, women are guided to identify the most important things in their life. In the second phase, they identify a list of problems that challenge attainment of important goals in their life and classify problems into three categories: ‘problems that are upsetting but not relevant to the most important things in one’s life’ (Group A), ‘problems that are important but insoluble’ (Group B) and ‘important and soluble problems’ (Group C). The details of the adaptation procedures and adaptations for this study have been published (35).
The adapted PST consisted of a PST providers’ training manual, training slides, training guides, in-session flip chart resource and session record forms. Participants randomised to the intervention arm received four individual sessions of the locally adapted and manualised PST from a trained, supervised ANC provider, along with EUC. Intervals between sessions ranged from a minimum of two days (for women whose delivery approached) to a maximum of two weeks over a period of eight weeks.
Trained healthcare workers delivered the intervention under the supervision of an Ethiopian clinical psychologist and a psychiatrist trained in psychological therapies. Five days of training in the adapted PST was delivered to the healthcare workers. Training was spread over two blocks of weekdays: one block of two and one block of three days. Care was taken to accommodate Ramadan, orthodox Easter and the Election. Ministry of Health directive on COVID-19 was followed.
Healthcare worker training consisted of: (a) a five-day classroom-based training course which included training on counselling and communication skills as well as PST-specific skills, and (2) accelerated delivery of four sessions of PST, using high-intensity supervision and feedback to build competency (59, 60). Lectures, demonstrations through facilitator role plays and small group activities were employed to make the training interactive.
Competency of providers was established using the Enhancing Assessment of Common Therapeutic factors (ENACT) scale (59, 60) administered by trained clinicians otherwise independent of the study. The healthcare workers were expected to score level 3 (“Done Well”) out of the three levels: (“Done Well”, “Done partially” and “Need improvement”) on each of the competencies. All intervention sessions were audio-recorded. Random selections of sessions were assessed by an expert. A fidelity checklist (61) was adapted and used to assess the random sample of session audio records. Supervisors provided healthcare workers with feedback on audio recorded sessions focused on intervention fidelity and core competencies in PST and communication skills.
Enhanced usual care
Participants randomised to EUC received usual ANC which focuses on advice about reproductive and family health and information about sources of support. In addition, the Federal Ministry of Health in Ethiopia has prepared evidence-aligned guidelines on how to care for mental health problems in PHC and maternal care settings (62). According to the guideline, PHC staff are expected to detect mental health problems and to provide basic mental healthcare (non-specific psychosocial care for all and supervised prescription of antidepressant medication depending on severity) (63). All HCWs participating in the trial had been trained in the World Health Organisation’s mhGAP intervention guide for a minimum of five days, as per the mental health scale-up plans of the Federal Ministry of Health. As the mhGAP-IG had not been implemented at scale in Ethiopia, this represented an enhancement in usual care (64, 65).
Participants allocated to EUC and their HCWs were informed about the results of screening and received a leaflet about well-being in pregnancy and sources of support. These women attended two contacts: the one pre-randomization baseline assessment and the follow-up assessment nine weeks after randomisation.
Baseline assessment
Baseline assessment measured: (1) demographic information, (2) Trial outcome variables (clinical outcome measures and potential hypothesized mediating variables) and (3) trial feasibility parameters (acceptability, fidelity and quality of PST training, participant recruitment and randomisation, data collection procedures and intervention delivery).
Demographic information comprised age, education, marital status, age at marriage, husband’s occupation and educational level, type of residence and pregnancy intention), obstetric history, including parity, pregnancy intention, and gestational age, past psychiatric history and list of traumatic experiences at baseline. We used an item from Ethiopian Demographic Health Survey which we had previously used in our setting (16) to assess pregnancy intention.
Main trial outcomes and hypothesised mediators
Assessments of outcome variables and hypothesised mediators were conducted at two time points: pre-intervention (T0; baseline) and nine weeks after randomisation (T1; follow-up). A third time point assessment had been proposed, at the protocol stage, to take place at 3 months post-partum. This was not carried out due to disruption related to the COVID-19 pandemic and civil conflict.
We piloted the potential primary outcome for a future, fully-powered RCT to assess efficacy of using the locally validated Amharic version of PHQ-9 (66). The PHQ-9 has been widely used as a clinical outcome measure of treatment for depression (67, 68). In Ethiopia, PHQ-9 has been validated in antenatal women (69) and in PHC settings in the neighboring district of the current study. The optimal score cut-off indicating probable depression in this context has been identified as five or more in PHC (49). At that cut-off, PHQ-9 had a sensitivity of 83.3% and specificity of 74.7% for detection of major depressive disorder. In previous studies, a 50% reduction in PHQ-9 depressive symptom scores (68) after 6–8 weeks was defined as treatment response.
We piloted potential secondary clinical outcome measures for a future RCT: Generalised Anxiety Disorder-7 scale (GAD-7 (70)), WHO Disability Assessment Scale (WHODAS (71)), post-traumatic stress disorder (PTSD) checklist for DSM-5 (PCL-5 (72, 73)).
We piloted the following measures of hypothesised mediators of PST’s effects: a five item ‘non-graphic language’ scale for intimate partner violence (IPV) (74) and the WHO multi-country study screen (75) for intimate partner violence exposure, the WHO attitudes towards gender roles scale (76), a translated multicultural mastery scale (77), a an adapted self-efficacy scale (77), the stressful life events scale (78) locally adapted Client Service Receipt Inventory (CSRI) (79) measuring the number of emergency healthcare visits and costs and the Oslo Social Support Scale (OSS-3), previously used in Ethiopia (80).
Feasibility parameters
Feasibility parameters comprised the feasibility of provider training, participant recruitment such as challenges in privacy and ethics of screening and randomisation, data collection procedures (layout, instructions, order of assessment tools), running outcome assessments and intervention delivery and acceptability of the intervention and trial procedures.
We collected both quantitative and qualitative data to examine these parameters. Quantitative data comprised: percentage dropping out of the study, number of HCWs who were competent as assessed by the ENACT scale, independent assessments of session fidelity, rates of recruitment, eligibility and agreement to screening and randomisation. Quantitative data also included the standard deviation of outcome measures and time taken to complete baseline and outcome assessments.
We assessed the acceptability of the intervention and trial procedures using qualitative data obtained from proceedings of the supervision and health worker supervision record notes and embedded supervisor notes in session fidelity and completion checklist. The supervisors were supposed to make face to face supervision after they had completed the HW supervision records and independent fidelity checklists. In four face-to-face supervisions, the supervisors have recorded proceeding notes. The issues included in the notes were related to each of the items in the HW supervision records and independent fidelity checklists. Supervisors were two clinicians who had engagement on PST adaptation workshops, theatre test and in trainer of trainers of the PST. We also employed in-depth interviews with HCW and selected participants post-trial (to be reported in a forthcoming process evaluation). Reports of qualitative data obtained from the supervision and session fidelity and completion checklist notes are reported in this report.
Data quality
We trained research assistants to become familiar with the nature and type of data to be collected. All baseline and outcome assessment tools were entered into the electronic Open Data Kit (ODK) programme at the time of collection.
Data analysis
Trial outcome measures
We calculated descriptive statistics to summarise the main trial outcome assessments at both time points for PST and EUC arms using STATA version 16. For continuous outcomes, we calculated standard deviations to inform future sample size calculations for a fully powered RCT for all participants for whom data were available (complete case analysis). The proportion of each group meeting criteria for treatment success (a 50% reduction of PHQ-9 score at T1) was described for the two arms.
Feasibility parameters such as acceptability, fidelity and preliminary efficacy of: participant recruitment, randomisation, masking, assessment procedures and intervention delivery were summarised using both numerical and text descriptions. We used descriptive tables and graphs to compare the two arms both at baseline and follow up. Finally, we adhered CONSORT Checklist (81) to report the findings of the feasibility trial.
Ethical considerations
Our feasibility trial protocol was registered on the Pan-African clinical trials registry, (PACTR): registration number: PACTR202008712234907 on 18/08/2020;
https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=9578. We received ethical approval from the scientific committee of CDT-Africa and the Institutional Review Board of Addis Ababa University, College of Health Sciences (IRB reference: 049/19/CDT). All participants provided written (thumbprint for non-literates) informed consent. Clinical records and consent forms were stored in a locked research office for confidentiality. Research staff checked for unreported adverse events by using telephone contacts to follow up participants who had withdrawn without reporting to the research office. i