Program Description
The WHO-SCC was introduced in the context of a large-scale QI program being tested within the Ethiopian public health system. This intervention used a district-wide improvement collaborative designed to improve the quality of maternal and newborn health (MNH) care. The collaborative design was based on IHI's Breakthrough Series collaborative model. The goal of the collaborative is to convene a group of facilities around accelerating improvement in a common priority area using improvement methods and an established learning network (25).
The improvement collaborative were aligned to the administrative structure of the district, and had the following basic elements: selection of priority area and target indicators, QI training for QI teams, baseline data collection, and action plans to address key gaps in essential commodities and clinical skills. IHI was requested by the Ethiopian MOH to include WHO-SCC introduction as part of the Maternal and Newborn Health (MNH) QI effort. This checklist was introduced to collaborative health care facilities during the initiation of the program as a reminder for clinical care providers to practice evidenced-based EBPs in real-time. Coaching teams included support for WHO-SCC use with patients and QI support for projects aimed to improve system performance measured by clinical bundles. Adequate orientation for the proper use of the WHO-SCC was given to facility QI teams as part of the QI initiative and implemented in line with similar studies in LMIC(16,26,27).
The program team collaborated with professional associations to support clinical trainings such as Helping Babies Survive (HBS) and Basic Emergency Obstetric Newborn Care (BEmONC) as needed. Subsequently, QI teams from health centers and hospitals within each district convened in a series of “learning sessions”. This is intermittent face-to-face meetings with facility QI teams and leaders to share their progress, challenges, receive targeted QI support and share critical learnings from the testing process.
Between learning sessions, facility teams implemented their QI projects using the Model for Improvement (MFI) as a framework for developing, testing, and implementing changes in a system to improve process reliability and outcomes of interest(28).
Teams tested newly developed change ideas and received on-site integrated clinical/QI coaching support from joint IHI-district leadership coaches. The collaborative was organized in four sessions during a 12-15-month period in the selected districts.
Setting and Site Selection
The first phase of the program was implemented in one district improvement collaborative at Tankua Abergele, Dugna Fango, Lemmu Bilbilo and Fogera districts located in the regions of Tigray, SNNP, Oromia, and Amhara respectively (four of Ethiopia’s most populous regions).
All facilities in each district were included to ensure a district-wide approach, which consisted of three primary hospitals and twenty-seven health centers across the four district improvement collaborative. Districts were selected by regional leadership based on need for improvement, lack of other MNH partner-supported initiatives and the local leadership’s desire for the approach. Leaders from the districts also demonstrated commitment to generate honest data for improvement.
Outcome Measures
In consultation with MOH-MNCH Directorate, we designed three clinical bundles (selected from the WHO-SCC) which were measured using all-or-none bundle adherence (adherence = yes if all bundle elements achieved) to include among the collaborative target indicators. The outcome measures for this study are all-or-none adherence to On Admission, Before Pushing and Soon After Birth bundles.
Table 1. Elements of the clinical bundle extracted from MOH adapted Safe Childbirth Checklist.
Clinical Bundles
|
Safe Childbirth Checklist Bundle Element
|
On Admission Bundle
|
Danger sign assessment
|
Partograph initiated when cervical dilation at least 4 cm
|
Availability of soap, water, alcohol hand rub and gloves
|
Birth companion encouraged to be present during labor and at birth
|
Mothers privacy maintained during labor and delivery
|
Before Pushing Bundle
|
Availability of gloves, soap/savlon and clean water
|
Preparation of 10 IU IV/IM Oxytocin in syringe
|
Availability of two clean, dry, warm towels and suction device
|
Availability of bag and mask (size 0 and 1)
|
Helper/Assistant identified and informed for resuscitation
|
Soon After Birth Bundle (within 1 hour)
|
Newborn assessment
|
Immediate skin to skin and initiate breastfeeding within the 1st hour
|
Baby weighed and recorded
|
Administer Vitamin K1
|
Administer tetracycline eye ointment
|
Data Collection
The data sources included audits of WHO-SCC and medical records. In health facilities where the number of monthly deliveries were greater than 30, a systematic random sampling method was used to retrieve 30 charts to calculate all-or-none bundle adherence using an excel template design as part of the program monitoring tool. In health centers where the number of facility births was less than 30, the total number of monthly deliveries was selected to calculate bundle adherence by regional IHI senior project officers.
Periodic data quality assessments were performed by coaches comparing clinical observation with recorded data. On a monthly basis, the data from respective collaborative health facilities were aggregated to create collaborative wide all- or-none bundle adherence—a dependent variable of our study.
The study period in Oromia, Tigray and SNNP was from November 2016 to December 2018. Unlike other regions, the start date of collaborative in the Amhara region was delayed by 7 months due to political instability in the region. Consequently, the study period was June 2017 to December 2018. No baseline data were collected before the start of the intervention (study period) because the WHO-SCC was introduced for the first time as part of the quality improvement program.
Analysis
The trend of adherence to each clinical bundle over time was analyzed from the collaborative start date to the end of the project. Sustainability was assessed using a follow-up period of twelve months for all districts except Fogera (Amhara region).
For each clinical bundle, a time series analysis using STATA version 13.1 was used to assess the effectiveness of system-level interventions on all-or-none bundle adherence over time for the four districts.
Durbin Watson statics—a test for autocorrelation in the residuals from a statistical regression analysis was used to check if the assumption of independence in observations collected over time was valid. To fit the purpose, monthly collaborative- wide clinical bundle adherence mean was calculated and equally spaced for respective district. Furthermore, Prais-Winsten — a procedure meant to take care of the serial correlation of type Auto -regression (AR (1)) in a linear model — was used to minimize the effect of autocorrelation.