We used an implementation science approach, allowing flexibility to enable close collaboration with policy makers and national TB programmes (27). Our study was based on a convergent mixed methods design, combining quantitative and qualitative findings at the analysis stage (28), to understand how well the strategies encouraged both the vertical (institutionalisation) and horizontal (increased coverage) scale-up of the tobacco cessation intervention.
Learning sites: The selection of the learning sites was determined by NTPs based on local capabilities and interest to implement. In Pakistan, the national programme invited all provinces to participate. Khyber Pakhtunkhwa Province (KPP) volunteered to implement the intervention in 59 facilities out of the 121 in the province, selected to include urban, rural, public and private. In Nepal, one NGO-run community hospital, two NGO-run TB referral centre, 15 public primary care facilities within the Kathmandu district and Lalitpur district were selected. In Bangladesh, 15 facilities – 12 Upazilla health complexes and three district hospitals from three districts were selected to cover both rural and urban settings (see table 2).
Quantitative methods:
As an indication of likelihood of vertical scale-up within the TB programme, we assessed the impact of training on health worker confidence to deliver the intervention. Participants were asked to complete a pre-tested questionnaire (9) to assess capacity, opportunity and motivation for provision of cessation support before and after training. The pre- and post-training questionnaires were collected on paper and recorded in excel. We also recorded the number of trainers trained and any subsequent training provided to TB health workers in the learning sites or beyond.
To assess the implementation of the intervention within the facilities (vertical scale-up), we collected routine data from the revised NTP reporting forms for all drug-sensitive TB patients 15 years and above in the three countries. We collected data for a period of six months from January to June 2019. However, only three months’ data (April- June 2019) were collected in Nepal and two districts in Bangladesh. To aid comparability the total number of patients and the monthly mean number of patients are presented (see table 5). The routine data were captured during our research team’s visits to the learning sites. These included the total number of drug-sensitive TB patients 15 years and above and whether their smoking status was recorded and whether they had received cessation advice. To assess correct usage of the new reporting columns, we estimated the proportion of appropriately completed data entry cells for the columns on tobacco-use and tobacco support for all adult TB patients.
Costs: We used an activity-based cost-analysis approach (29) to estimate the cost of implementation of the intervention per drug-sensitive TB patient (15 years and over) in learning sites. We collected data of: i) personnel salaries, fees, and time-taken in programme-related activities, including intervention delivery and training; ii) printing and disseminating programme/intervention materials; iii) number of intervention sessions delivered. Costs did not include venue utilities (water, electricity, etc.), administrative activities (preparation meetings, organisation contacts, etc.), logistics (stationery, refreshments, etc.) and salary on-costs (contribution to pension, health insurance, etc.) if applicable.
Qualitative methods: TB and Tobacco Consortium researchers, national to each country, with experience in qualitative methods and the health system contexts, observed training delivery and the implementation of the intervention in each facility. They interviewed health workers and managers to understand the facilitators and barriers to both vertical and horizontal scale-up. Training sessions were observed using a structured guide to record the length and content of the training, use of intervention materials and videos, use of interactive methods such as role-play and quality of training provided. These observations focused on patients’ interaction, use of the materials and completion of the reporting forms. To determine the size of the interview sample, we drew on principles of ‘information power’ (30). Given our aim to understand varied perspectives we purposively sampled health workers, managers and policymakers for semi-structured qualitative interviews from public, private and NGO facilities within the learning sites and TB programme managers at municipality, district, provincial and national level (Nepal n=13; Pakistan n=19; Bangladesh: n=12; see table 3). All interviews were audio-recorded and translated into English. The use of the Consolidated Framework for Implementation Research (CFIR) (31) within both the analysis and the interview guide further strengthened the ‘information power’ of the study.
Analysis: The questionnaire data were analysed using descriptive statistics and paired t-test in Stata version 16.1 to identify any significant changes in individual responses before and after the training. The routine facility data were analysed to identify proportions for each indicator. Given the different time periods of data collection, monthly mean patient numbers were calculated. The reported number of smokers identified were compared to the expected number of smokers given the age adjusted prevalence of current tobacco smoking estimates provided by WHO based on 2017 data (11) and 95% confidence intervals around these ratios were calculated.
Costs were collected in respective countries’ currencies: Bangladeshi Taka (BDT), Nepalese rupee (NPR), Pakistani rupee (PKR) and converted to US dollars (May 9, 2019 price: USD1.0 = BDT84.5 = NPR112.1 = PKR142.0). As three months data were collected from some learning sites, for comparison, the number of patients and smokers identified over three months was doubled to match observations over six months. The total costs in the learning sites were calculated and divided by the total TB patients reported in the observation period to derive a per patient cost.
Framework approach (32) was used to structure the analysis against the CFIR constructs, with further codes added to align findings with our four strategies. Transcripts of the first two interviews conducted in each country were double-coded to enable reflection on the interview process and to refine the interview guide to further explore concepts of the CFIR. Consistency of use of the CFIR by the country research teams was enabled through a three-day analysis workshop.
The STARI guidelines have been followed in the reporting of this study (33).
Findings
Our findings are presented against each of the four strategies. The activities used to implement all four strategies are mapped against the ExpandNet 9 steps in Table 4. The table also provides a summary of the lessons learned, drawing on the qualitative findings and reflections of the research team.
Strategy 1: Simple and adaptable intervention
The facility and qualitative data shed light on the extent and nature of implementation of the intervention with TB patients. Table 5 shows the numbers of smokers identified compared to the expected number of smokers according to standardised WHO estimates and the proportion advised to quit.
In Bangladesh and Nepal the health workers identified less smokers than would be expected based on WHO (2017) however these were not statistically significant. In Pakistan the ratio of identified versus observed shows statistically significantly few smokers identified (ratio: 0.43 95% CI 0.33 to 0. 54) than would be expected given WHO estimates of prevalence. The qualitative findings point to a combination of patient, health worker and site factors. Several health workers mentioned the need to build rapport with their patients before asking about tobacco use, often over a number of visits by the patient to collect their TB medicines. This was despite indicating a high level of confidence in asking about tobacco use in the post training questions, with all participants scoring at least 4 out of a potential 5, for totally confident, on the questionnaire Likert scale. This did differ depending on the gender of the provider, with male providers feeling more confident to ask male patients, and female health workers to ask female patients.
Once patients had been identified, the routine reporting forms in all countries indicated that all patients had been given support to quit. The qualitative findings noted use of the flipbook and desk guide. However, the data also shed light on how minimal the advice given often was. Many health workers reported challenges in delivering the behaviour support as per the intervention design with health workers in busy clinics and urban settings rarely able to spend the time required to go through every page of the flipbook:
“I’ve only ever used the flipchart for one patient. My patients cannot spend much time as all of them are workers. They take a short break from work to come, so I cannot explain to them in detail” (NP8 Female TB health worker, public facility, Nepal).
Many health workers felt they had been able to internalise the key messages and could deliver these without using the flipbook, filling in any gaps in subsequent patient consultations. In the busiest learning sites in Pakistan, health workers had adapted the intervention by delivering it to groups of patients.
Where our learning sites included both public and private facilities, the qualitative findings identified similar constraints across both settings, although private providers also mentioned the challenges of balancing implementation of the intervention with the specific requirements of their own organisations:
“It can be difficult because we have our own rules here and we cannot go above a certain limit [of interventions delivered].” (PK19: Male TB health worker, private facility, Pakistan).
Strategy 2: Integration of cessation within routine training:
The national TB programmes identified staff at national and sub-national levels to be trained as trainers in each country. The training of trainers (ToT) workshops took between 3 and 6 hours. During these ToT sessions, participants identified future events, such as district quarterly and monthly meetings to deliver the 1 to 2 hour training session with TB health workers. As shown in table 6, the numbers of trainers trained varied between contexts, depending on the level of engagement of NTPs. The extent to which these trainers then trained TB health workers also varied. In Nepal, while eight NTP and municipal public health officers were trained as trainers, only two provided training to health workers in the subsequent training sessions. In both Bangladesh and Pakistan, trainers expanded their training sessions beyond the initial learning sites to train a further 32 TB health workers in Bangladesh and health workers in all 121 facilities in KP Province by the end of 2020.
Qualitative observations of the training sessions highlighted the value of the videos in helping to maintain consistency in messages delivered and provide relevant demonstrations of rapport building and clear communication. Participants were observed to be more engaged and motivated in sessions where the trainers were able to use interactive methods and relate material to the realities of routine TB services.
Mixing different levels of seniority was practically necessary in several training sessions, however this undermined participation:
“ It should have been a bit more interactive because I did not see any one from lower levels of staff participating. It was mostly one sided, doctors did participate a bit, but it was not adequate” (PK10: Male, senior district manager, Pakistan).
The need to keep the training short, did present challenges in ensuring interactive delivery, but this was seen by senior managers as vital for scale-up of the intervention:
“it would not be possible to include a half-day session within the current training programme. Rather a one-hour interactive session can be introduced” (BD8 Female, senior national TB manager, Bangladesh).
Despite the short duration of training and the challenges in quality, participants’ questionnaire scores before and after the training showed an increase in their confidence to deliver cessation (see table 6). Qualitative interviews highlighted areas of new knowledge for many participants, including increased understanding of the health dangers of smokeless tobacco.
Despite increasing their knowledge and confidence to provide cessation support, health workers in all three countries emphasised their preference for longer sessions and regular refresher training. While this was in part due to the high turnover of staff, training was also perceived as a form of incentive.
Strategy 3) Including tobacco-use in recording, monitoring and supervision:
Following a brief explanation of how to fill the revised recording forms during the training, the TB health workers were asked to use the revised forms version with the three new tobacco columns for a period of six months (January to June 2019). In Pakistan the provincial office mandated health workers to complete the revised forms instead of the existing NTP forms (Forms TB01, 02 and 03). In Bangladesh and Nepal, TB health workers had to complete both the standard TB programme form and the revised form. In Nepal and Bangladesh this process took some time to negotiate and establish, and ultimately the revised forms could only be trialled for three months.
The qualitative findings indicate that TB health workers did not find the additional three columns a burden to fill, and some mentioned that it acted as a reminder to raise tobacco use as an issue with their patients:
“There have been changes in the new register. So, when we need to fill up the form for registration, we need to ask about their smoking status. Even if we forget, since it is there in the register, we have to ask the patients” (NP7: Female TB health worker, public facility, Nepal).
Beyond monitoring tobacco cessation within the TB programme, and reminding health workers to ask about tobacco use, the reporting forms provided the basis for supervision within the facility and from district and provincial level.
“Being an in-charge [facility manager] it is my duty that I go and check if they are actually doing it. I check their data or I observe how they do the counselling of a patient who is a smoker and ask them to do it in front of me and wherever I see a deficiency I should rectify it” (PK1: Male TB manager, public facility, Pakistan).
In Pakistan, the Provincial TB Programme adapted their supervision check-list to note any training on tobacco cessation and to assess the completeness of recording for tobacco status and cessation advice given. However, the qualitative findings highlighted how supervision visits from the district office to the facility level were often infrequent, and focused on checking data in the registers. The influence of supervision was particularly noted, with several facility managers, including those in the private sector revealing that they only changed to the new reporting forms and began using the intervention materials following a visit by the provincial TB focal person.
During the implementation of this study, the transition to a federal system was underway in Nepal and the changes in personnel, systems and roles of different government bodies, particularly between ministry and municipal levels, undermined attempts to include tobacco cessation within supervision and monitoring mechanisms:
“All the staff are in confusion on where we will be and what will we do. We are functioning under both the Health office and the municipality, with instructions coming from both bodies. We are in a dilemma on what we should do because of this...” (NP4: Male TB manager, public facility, Nepal).
Qualitative interviews and observations highlighted the challenges of influencing supervision practices within the context of the public private partnerships in all three countries. In Bangladesh, where TB services are delivered by multiple providers, including the government, NGOs and private providers, challenges were identified in developing and implementing supervision guidelines that would be used by all.
Strategy 4) embedding research within the TB programmes:
The extent to which we were able to embed the research within TB programmes differed across the countries. A key component of this strategy was the use of ‘insider researchers’. In Pakistan, a senior member of the national-level Common Unit for TB (co-author RF) was also a co-investigator in the TB and Tobacco consortium and a senior manager within the KP provincial TB programme (co-author MD) was involved in data collection and analysis for the study. In Bangladesh and Nepal, the TB and Tobacco consortium researchers relied upon their existing relationships at national and district level. The frequent turn-over of key staff in both Bangladesh and Nepal further undermined progress towards ownership of the implementation and scale-up process.
The qualitative interviews highlight how in Bangladesh and Nepal, while staff were positive about the intervention, it was clearly seen as an initiative emanating from the research organisations, rather an initiative of the national TB programmes. In contrast, in Pakistan, the provincial TB programme (KP) felt strong ownership as evidenced by the regular supervision, subsequent role of out training and revised reporting forms to all 121 TB facilities in the province. Gaining national level support for the intervention and revision of policies, guidelines and reporting forms was more challenging, particularly in the context of Pakistan’s federal system whereby each provincial TB programme must agree to any changes. Having a senior member of the national level CU as a co-investigator of the project was invaluable in influencing other provincial TB programmes. By the end of 2019, while not all TB forms have been revised to include the tobacco columns, the TB01, the form held by the patients and brought to each consultation has now been revised to include tobacco status and these revised forms will be rolled out nationally.
In Nepal, the timing of our study coincided with organisational changes due to federalisation making it challenging to embed the research within the NTP. Despite the continual engagement of the research team, policy support and resources for tobacco cessation were minimal within the TB sector plan (34).
“[To-date] the government has not allocated [any financial resources] nor has the international partner, Global Fund, allocated any amount for the TB & Tobacco program” (NP2: Male technical officer, national TB centre, Nepal).
Given the challenges of embedding research when government organisations are undergoing extensive structural change, the team in Nepal used tactics of leveraging support of others e.g. WHO and sub-recipients of Global Fund (GFATM) and seizing opportunities to engage with NTP technical working groups. These efforts were realised when the independent team evaluating NTP recommended greater integration of tobacco cessation within the TB programme, resulting in the inclusion of indicators on tobacco-use and advice within national reporting forms and training for cessation support added to NTP routine training.
In Bangladesh, the team engaged closely with key government stakeholders in the Tobacco Control Cell and the Noncommunicable Diseases Control (NCDC) department as well as the National TB Programme to stimulate engagement with the project. Engaging with, and facilitating communication between, these national government departments was an important strategy for progressing scale-up and helped overcome challenges of relying on the support of one or two champions, particularly given the frequent change of TB programme officials, including NTP directors. There are some indications that these approaches acted as a catalyst for scale-up as the NCDC department used their own resources to print the intervention leaflet and disseminate it nationally. However, the pluralism of providers and the multiple donor-funded vertical programmes within Bangladesh’s health sector were a further barrier to progressing scale-up:
“What is needed is coordinated efforts from everyone. The major obstacle is non-coordination of the operational plans and among DPs [development partners]. We have so many vertical programmes without any coordination. Leadership is another problem. Change in staff within different units every six months to a year slows down the progress of the work” (BD8: Female, senior manager, national TB programme, Bangladesh).
Embedding the research within the three countries required significant flexibility and opportunism to tailor tactics to the complex health systems with multiple providers and donors, frequently changing personnel and organisational structures.
Estimated Costs
The estimated costs over the six-month implementation within the learning sites in each country, including costs per patient are shown in table 7.
Per-patient programme costs were 0.5 USD in Bangladesh, 2.8 USD in Nepal and 1.5 USD in Pakistan. While the costs of intervention delivery would increase with the number of patients treated, the training costs include the costs of training the trainers which can be considered as a one-off cost, hence the average costs per patient could potentially be reduced over time. These costs were shared with TB programme decision-makers in policy-briefs and as part of a series of workshops to facilitate further planning for scale-up.