Study objectives
To examine the effects of ATM interventions consisting of a package of community-level and health services level interventions implemented in government primary health centres (PHC) in three regions of a south Indian district on:
-
Improvement in availability of quality generic medicines at PHCs
-
Improvement in access and utilisation of medicines among patients with NCDs
-
Reduction in out-of-pocket expenses among patients with NCDs
Study setting
The study was implemented across PHCs of three talukas (administrative sub-divisions of districts): Sira, Koratagere and Turuvekere of Tumkur district in southern Karnataka. Tumkur is the second largest district in the state with an area of 10,598 square kilometres and has a population of 2.67 million of which about 30 % were in urban areas in 2011(28). Tumkur is comparable to many other districts in the country in terms of a mix of government and private (ranging from single doctor clinics to corporate chains of secondary and tertiary level hospitals), formal and informal healthcare providers. In terms of socioeconomic and development indicators, Tumkur could be classified as being one of the average performance district among the 30 districts of Karnataka state(29). The rationale behind selecting Tumkur as the study district, health services structure in Tumkur and characteristics of the government and private health care system in this district are described in detail in the study protocol(30).
Following a rapid assessment of the performance of the local health system at the taluka level using health systems dynamics framework by Olmen et al(31), three talukas (of the 10) were excluded for not having the necessary system preparedness for the intervention. Of the remaining seven talukas, we randomly selected three talukas assuming that PHCs within these talukas will all have comparable levels of readiness for implementing interventions proposed in the ATM study. The selection process is described in detail in the protocol(30). All 39 PHCs across the three selected talukas were randomly allocated to one of three intervention arms of the study in 1:1:1 ratio.
Randomisation, Allocation Concealment and Blinding
PHCs were randomised using simple random sampling method. PHC enrolment and assignment to intervention arms was done based on the random numbers generated using an open source tool (random.org1). The random allocation sequence was initially concealed to the researchers before the intervention was assigned to each of the three study arms. All 39 PHCs were numbered from 1 to 39. Random numbers between 1 to 39 were generated using the open source tool. Each generated random number was kept sequentially inside the three envelopes numbered from 1 to 3. After the allocation was over, intervention was decided for each of the three envelopes as study arm A, B or Control arm. The allocation was concealed to the researchers as well as participants (providers at PHC and patients) before the intervention was assigned. Researcher A generated the random numbers, Researcher B sequentially allocated the random numbers generated to one of the three envelopes and at a later point of time a third researcher (Researcher C) assigned intervention to each of the numbered envelopes. During this process, all three researchers were unaware/blinded of each other’s activity. However, after assignment of intervention happened for the PHCs, all researchers knew the assignment but providers and patients stay blinded to this assignment.
Study design and tools
ATM study was a mixed methods study with a baseline-endline quantitative experimental approach to assess effectiveness and a qualitative theory-driven inquiry to explore implementation process and contextual factors. In this paper, we present results only from the quantitative part of the study. Results from qualitative part has been published elsewhere(27,32).
The quantitative cluster randomised trial is a before-after experimental design and focussed mainly on identifying the determinants of improved (if any) access to medicines for diabetes and hypertension. For this we used a cluster randomised household survey to understand the health seeking behaviour, access and expenditure on anti-diabetic and anti-hypertension medicines. We conducted a before-after survey across PHCs to assess availability of key anti-diabetic and anti-hypertensive medicines in the previous year.
For household and facility level surveys, we used adapted versions of standardised World Health Organisation (WHO) survey tools for household survey and Level II facility survey tool respectively, from the ‘WHO operational Packages for Monitoring and Assessing Country Pharmaceutical Situations’(33). The tools were finalised after two rounds of piloting at PHCs in an adjacent district by trained data collectors. In addition to the household and facility survey, quarterly visits to PHCs were made to collect data on the implementation of the intervention. We prepared narrative reports of each visit; key insights from these reports were compiled and analysed. We also conducted a quality test on two key anti-diabetic and two anti-hypertensive medicines (two). Generic and branded medicines were sampled from both government and private facilities across the study talukas. While the details of such medicines sampling and medicine quality tests could be accessed from study protocol paper(30), results of the quality tests are published elsewhere(32).
Household survey sampling strategy
Houses with a patient self-reporting either diabetes and/or hypertension were selected. We followed a longitudinal cohort approach. However, we measured outcomes for not exactly the same cohort of patients at baseline and endline. We followed a sample replacement strategy at the endline survey. For patients that were lost to follow-up in the endline survey, we replaced with new patients in the across the three study arms. Sampling strategy is described in detail in additional file 1.
Intervention
The intervention commenced in May 2014 and was implemented over 18 months till November 2015. The intervention PHCs were randomly allocated to one of the three intervention arms. The PHCs in arm A received a package of interventions aimed at health service delivery optimization, arm B consisted of package of interventions aimed at strengthening community participation platforms in addition to interventions in arm A and PHCs in arm C received no intervention other than those that are being implemented in all government PHCs.
Arm A package of interventions included training of PHC staff (doctors, pharmacists, laboratory technicians, staff nurses) on standards treatment protocols for diagnosis and management of diabetes and hypertension, technical support for introduction of patient-retained medical records and PHC-based records for registration and follow-up of diabetes and hypertension patients, advocacy and coordination at state, district and taluka level to ensure continuous supply of medicines to the PHCs and regular outreach visits to PHCs by field staff. Arm B package of interventions included development and dissemination of awareness materials, formation of patient groups, and meeting with Arogya Raksha Samiti (ARS) members on matters related to diabetes and hypertension care. Further details of the package of activities for the intervention and how they were developed are available in the study protocol(30).
Hypothesis
Improvement in availability of quality generic medicines at PHCs, access and utilisation among patients with NCDs and reduction in out-of-pocket expenses could be achieved through a package of community-level and health services level interventions.
Measures
The study measures were briefly categorised into dependent variables or outcome indicators and independent socio-demographic variables.
Dependent variables
The primary outcome indicators were measured at both facility and individual levels. Facility level indicators include mean number of days of availability of key generic NCD medicines at PHC and individual level indicators are mean number of patients using PHCs for medicines, OOP expenses among patients with NCDs and mean number of days for which medicines were procured by patients. Secondary outcome indicators are proportion of PHCs compliant to standard treatment guidelines, proportion of PHCs where a trained doctor was available throughout the intervention period, proportion of PHCs where a trained pharmacist was available throughout the intervention period, proportion of PHCs where a functional laboratory was there, proportion of PHCs with NCD registers, proportion of PHCs with an active NCD patient group, proportion of ARS meetings where NCD agenda was discussed and proportion increase in patient awareness on generic drugs.
Independent variables
Socio-demographic variables such as age, sex, marital status, occupation, disease conditions, education and monthly income are the independent variables.
Data management and analysis
Epidata was used for data entry. 10% of the data was randomly verified by the supervisor for quality. In case of systematic errors, the remaining forms were also verified and corrected. Data was then exported from Epidata to Microsoft Excel and final data cleaning was completed. The dataset is available (see data availability statement).
We used SPSS (Statistical Package for Social Science) for data analysis (SPSS version 20). Three datasets were created from the household survey to capture basic household, demographic and patient (NCD) level characteristics. These datasets were joined and the final dataset was validated. Private facility interview data and PHC interview data were appended after cleaning. Exit interview data were analysed separately. Apart from the univariate and bi-variate analysis, we analysed the intervention effect using an intention-to-treat analysis. Independent variables such as socio-demographic characteristics were compared to assess comparability across intervention arms, using t-test and chi-square statistics at baseline and end-line.
The randomisation is at the PHC level for delivery of intervention. We used the intention to treat analysis approach to analyse differences in outcomes across three intervention arms based on assumption of negligible amount of crossover events. Reach to each component of the facility interventions and the community interventions was analysed separately. We also assessed the reach of the intervention in terms health service utilization among NCD patients whom we were able to follow-up from baseline to endline. We analysed efficacy of the intervention for each study outcomes through difference-in-difference analysis using STATA version 12. We compared effectiveness in outcomes for individual patients in Intervention A PHCs, Intervention B PHCs and those from control PHCs. Similarly, we calculated differences in facility level outcome between intervention and control PHCs. Information on drug availability was obtained from the PHC medicine registers. Stock out were assessed for a period of 365 days preceding the date of visit to the PHC. Mean availability days in a year for two key anti-diabetic medicines (Metformin 500 mg tablet and Glibenclamide 5 mg tablet) and two anti-hypertensive medicines (Amlodipine 5 mg tablet and Atenolol 50 mg tablet) was compared across intervention arms. For each PHC, the maximum number of drug availability days was considered for anti-diabetic and anti-hypertensive drugs. Mean and standard errors were estimated by linear regression as part of the difference-in-difference analysis. In addition to calculating the unadjusted difference-in-differences, we used covariates such as: taluka, cluster, age, gender, education, occupation, home to PHC distance, and types of disease (diabetes, hypertension, both these diseases) to calculate adjusted difference-in-differences in outcomes. The research team visited each PHC (including the control PHCs for routine observation) at least thrice during the intervention period. Total number of routine visits made to all PHCs during intervention was 106. We found that few PHCs (six out of total 39) performed better than the others. These PHCs mainly had stable, motivated staff with keen interest towards providing NCD care. Observations from these visits were instrumental in describing role of predictors in reach and effectiveness of the intervention.
Ethical considerations
Ethics clearance was obtained from the WHO ethics review committee and institutional ethics committee of Institute of Public Health, Bangalore (India). We also sought permission from the state department of health and family welfare for implementing the intervention and collecting facility-level data from PHCs. Informed written consent was sought from all participants of the surveys. The participation in the survey was voluntary and no compensation was provided to the participants. All personally identifying information was removed from datasets and manuscript to ensure confidentiality.
1Available at: https://www.random.org