Study design and setting
This was a quasi-experimental study that was carried out by the Department of Pediatrics of the Aga Khan University from April 2009 to Oct 2009 in two provinces of Pakistan. Participants from the province of Sindh belonged to district headquarter hospitals of Sukkur and Khairpur, and participants from Punjab came from civil hospitals of district Rawalpindi and Islamabad. Two IMNCI training sessions were conducted in each province; a standard WHO 11-day training and an abridged 7-day training that was adapted from the standard course.
Study population
Healthcare providers were nominated by the District Health Officers from the public sector facilities. The providers were conveniently divided into two groups to receive either an abridged 7-day training or the standard 11-day training. The two groups were comparable in terms of healthcare worker cadre (physicians or other healthcare providers), the level of health facility they worked at (secondary or tertiary level), the health sector they worked in (public or private), and the years of experience they had in managing infants and children. Physicians that participated in the training had 3 to 4 years of experience in providing clinical care to newborns and children. The other providers included registered nurses (RNs), lady health visitors (LHVs), midwives, and health technicians (HTs).
A total of 104 providers participated in the training. Of these, 57 were from Khairpur/Sukkur (35 and 22 in the 7 and 11-day groups respectively) and 47 were from Rawalpindi/Islamabad (23 and 24 in 7 and 11-day groups respectively). The training was facilitated by faculty members of the Department of Pediatrics, Aga Khan University, who were WHO certified IMNCI master trainers. To ensure uniformity and reduce environmental bias, the training sessions were led by the same team of facilitators for both groups.
IMNCI case-management training
The training sessions were held at two public sector tertiary care hospitals: the Pakistan Institute of Medical Sciences (PIMS) Hospital, Islamabad for the Islamabad and Rawalpindi participants, and the Civil Hospital, Sukkur for the Khairpur and Sukkur participants. The training courses consisted of eight modules that were delivered via classroom activities and hands-on clinical practice sessions as recommended by WHO. The clinical practice sessions were conducted in the outpatient clinics and inpatient wards of the two hospitals. The participants observed and practiced the assessment, classification, and treatment of sick children according to the IMNCI protocol. They were also provided with the IMNCI recording forms to fill their patients’ information.
The same teaching materials, tools, curriculum, and training methodologies were used for both groups. The course was only redesigned and shortened in terms of the time allocated to each classroom activity and clinical practice session.
Pre and post-training assessment
All participants’ knowledge and clinical skills were assessed at the beginning and immediately upon the conclusion of the training. The level of knowledge was measured by administering a written test comprising 25 MCQs. Each correct answer was given a score of two and incorrect answers were marked zero. The questions tested the providers’ knowledge on seven common childhood ailments: possible bacterial infection (PBI), acute respiratory infection (ARI), diarrhea, malaria, ear infection, malnutrition, and anemia, along with breastfeeding problems and counseling.
The clinical skills were assessed in two ways. First, the providers were directly observed in the hospital outpatient and inpatient departments by the facilitators and were evaluated according to the IMNCI standard skills observation checklist. Second, the providers were shown 12 video case studies and asked questions pertaining to the clinical scenarios presented in the videos for a maximum score of 33. These scenarios covered the conditions mentioned above. Participants were expected to appreciate IMNCI signs (for example, sub-costal recessions, stridor, and nasal flaring in respiratory distress, sunken eyes, lethargy, and a slow return to normal after skin pinch in dehydration, edema in malnutrition, and purulent discharge and mastoid swelling in ear infection), count respiratory rate, classify the level of dehydration, nutritional status, ear problem, and respiratory symptoms, and recognize proper attachment and suckling during breastfeeding.
Six months following the IMNCI training, a re-assessment of both the 7-day and 11-day groups was carried out to evaluate and compare the difference in the retention of knowledge and clinical skills between the two groups. This re-assessment was done with the same MCQs and video-based tools that were used at the beginning and conclusion of the training. The facilitators also directly observed the participants’ case-management abilities and their clinical skills.
Data analysis
Data were analyzed using SPSS version 15. Only the scores of the participants who were re-assessed at 6 months were used for the analysis. The scores were reported as mean percentages with standard deviations. The differences in the scores between the standard and the short training groups were evaluated for statistical significance by unpaired t-tests. A p<0.05 was considered statistically significant.
Cost estimation
The total expenses of the training were calculated by including the travel and accommodation costs of the facilitators and the participants, the facilitation fees, the cost of refreshments, stationery, and teaching materials. Because all training sessions were conducted in public sector hospitals, there were no additional expenses for logistic arrangements.
Ethical considerations
The study was approved by the Ethics Review Committee of the Aga Khan University. Verbal informed consent for partaking in the study was obtained from all participants.