Study Areas
Ethiopia has very diversified culture and more than 86 indigenous languages. Administratively, it has nine regions and two city administrations, and the four regions which the four prototype districts selected house 85% of the country’s population. Health service delivery is provided through three-tier system as primary, secondary and tertiary level health care. The 2016 Ethiopia Demographic and Health Survey has showed coverage of 62% for first antenatal care visit, 32% for four or more ANC visits, 28% for skilled birth attendants and 17% for postnatal care within 2 days after birth. Pregnancy related maternal mortality ratio was 412 per 100,000 live births and neonatal mortality rate was 29 per 1000 live births(10).
To introduce quality improvement (QI) methods through a district-wide improvement collaborative[1] approach (11), four districts were chosen for the prototype phase of the QI project that began in 2016: Limu bilbilu, Tanqua Abergele, Duguna Fango and Fogera in the Oromia, Tigray, Southern Nations, Nationalities and Peoples’ (SNNP) and Amhara regions, respectively. A total of 121 health posts, 27 health centers and 5 hospitals that were providing MNH care for the population in the four Woredas were included in prototype and clustered into four QI collaborative sites, one for each Woreda[2]. The catchment populations of the collaborative sites were 213,032 in Limu Bilbilu, 115,841 in Tanqua Abergele, 122,316 in Duguna Fango, and 296,842 in Fogera Woredas.
The prototype collaborative sites were purposefully selected in consultation with Ministry of Health of Ethiopia and regional health bureaus (RHBs) based on pre-set criteria. The criteria included high maternal and perinatal deaths, high level of leadership commitment to improve the service, reliability of MNH service data, and no other partner organizations working on quality improvement project in the sites to minimize duplication of efforts. All health facilities under the selected woredas were included in the collaborative.
Study Design
A facility based cross-sectional study was deployed to determine the quality of MNH care. Quality of MNH care was measured using input, process and outcome components. The components were developed using input, process and output MNH quality standards of the WHO and HSTQ for health facilities of Ethiopia MoH. Data were collected in 2016 using face to face interviews and data extraction.
Sampling Techniques
The study included 32 health facilities which were part of the facilities for prototyping maternal and neonatal health quality improvement interventions. All health facility heads and maternity care related department heads were included for the interviews. Data from individual folders were extracted through selecting clients’ folders by applying a systematic random sampling method using medical record numbers (MRN) as the sample frame.
Data Collection Technique
The data was collected at the start of the implementation of IHI’s project from Sep 2016 to Nov 2016 at the health facilities that aimed to identify critical gaps that hinder the performance and improve the facilities’ performance. Structured interviews were conducted to assess availability of resources. Direct observation was also done to complement and verify interview results to cross check the available infrastructures, medical equipment’s, supplies, and available services. Before the data collection the data collectors discussed and agreed upon each question. The data collectors were IHI staff and zonal health departments (ZHD)/Woreda health offices (WoHO) MNH and HMIS officers. The collected data were cross-checked for completeness immediately after completion.
Data Collection Tools
The data collection tool had two parts: 1) An interview guide which was used to collect the data from the health facility heads and maternity care related department heads. During the interview, there was cross-checking of records to confirm the reliability of the data they provided. 2) A data abstraction form which was used to collect the data from the MNH registers and clients’ individual folders (medical records). The output data was extracted from the MNH registers, and the process data of clinical bundle and complication management were extracted from the individual folders. During the data extraction data elements were cross-checked among the registers and individual folders; if there is a discrepancy, that element was dropped.
Data Analysis
Data was entered in to an excel database and cleaning was done by running simple frequencies and looking for deviant and incomplete values. The relevant variables for this study were extracted, coded, and exported to STATA version 13 for analysis.
Elements of the input, process, and outcome variable were coded, analyzed and described using average scores.
Further analysis was done based on the operational definition of “satisfactory quality” and “unsatisfactory quality” using the cutoff point of meeting at least 75% of the standards (12). An analysis of the average score of MNH quality of care was done separately for input, process and outcome and then for the overall score.
Input quality components was developed using 29 items related to the infrastructure, supplies and equipment standards. Process quality components was developed using 13 items of the labour, delivery and postnatal care provision and complication management standards. Outcome quality components was measured using four items related to the health seeking behavior standards.
Estimated number of deliveries were used as denominator for calculating the output standards of antenatal care, skilled births and postnatal care. First antenatal care visit was used as the denominator for syphilis test variable.
Ethical approval and consent
The data was collected primary for the improvement purpose in the health facilities, which is part of a broader IHI project evaluation study that was reviewed and approved by Ethiopian Public Health Association (EPHA) Scientific and Ethical Review Committee (Ref: EPHA/OG/5046/17). It was purely program evaluation and was waived by the aforementioned IRB in accordance with Ethiopia ethical guideline (13). Then, a permission was obtained from IHI Ethiopia project office to analyze further the stored data for this manuscript. During the data collection process, informed consent was obtained from all interview subjects and from health facility heads on behalf of mothers for the medical record reviews since not possible to trace them. Confidentiality of the information and their privacy were respected throughout the data collection process and then after. All responses given by the participants have been kept anonymous and confidential using coding system whereby no one has access to the information.
Footnotes:
[1] Collaborative is a short-term (12 to 18 months) learning system that brings together a large number of teams from health facilities to seek improvement in a focused topic area.
[2] Woreda is equivalent to district.