Our study combines an open-cohort, stepped-wedge, cluster randomised trial (SW-CRT) and interrupted time series (ITS) analysis, together with cross-sectional surveys of water-related practices, an economic and a process evaluation. Our approach is deliberately pragmatic with the different study components designed to mitigate a range of pre-identified risks to this study which relate to the delivery of a complex intervention in a challenging context.
Methods are described in accordance with the SPIRIT guidance [46] and the Consolidated Standards of Reporting Trials (CONSORT) extension for SW-CRT [47] to ensure adequate inclusion and reporting of key design and analysis components during development of this protocol. The SPIRIT check-list is available in Appendix 1.
Aim and objectives
The aim of this study is to evaluate the impacts of improved water services on cholera and other diarrhoeal diseases in the town of Uvira (DRC). Specifically, we seek to assess the following: 1) changes in monthly incidence of suspected and confirmed cholera cases admitted to the main cholera treatment centre (CTC) in Uvira (using SW-CRT and ITS analyses); 2) changes in domestic water-related practices (using cross-sectional surveys, and REGIDESO operational and billing information); 3) cost-effectiveness and cost-benefit of water supply improvements (with an economic evaluation); and, 4) fidelity and compliance of the planned water supply intervention (through a process evaluation). Each of these study components is described below, including all information related to the SW-CRT, followed by the analysis plan, household surveys, economic and process evaluations.
Study setting
Uvira is a town of approximately 280,000 inhabitants on the shore of Lake Tanganyika, in Eastern DRC (South Kivu) [48]. The region is characterized by protracted conflict and ethnic violence [49], with at least 100 active armed groups identified in South and North Kivu as of 2019 [50] and continuing, massive population displacements [51].
Cholera has been endemic in the region since the 1970s and Uvira is located within an internationally designated transmission “hotspot” [14, 52]. The CTC located in the General Hospital in Uvira is the main care structure for acute diarrhoea cases – defined as three or more loose or watery stool per day – for the city and provides free treatment including rehydration and, in some cases, antibiotics [21]. CTC admissions have been recorded by the study team since 2009, with an average of 1,266 patients admitted annually or 3.4 admissions per year per 1,000 inhabitants.
The WHO/UNICEF Joint Monitoring Program estimates that in 2017 approximately 36% of households in DRC relied on unimproved drinking water services and an additional 9% used surface water as their primary source [36]. The existing water supply infrastructure in Uvira was established in the colonial era (1958) [53], was severely damaged during the First Congo War (1996–1997), with parts then repaired and/or modified by NGOs in the early 2000s. In 2018, before the planned intervention began, the water supply system in Uvira provided a partial and intermittent piped water service that reached an estimated 31% of the population [53]. Surveys conducted by the study team in preparation for the trial in 2016 and 2017 indicated that almost half (47%) of the participants (747 respondents from 458 households) reportedly used surface water – lake (13%) or rivers (34%), about a third (34%) used a tap outside their compound, and 18% had a tap in their compound as primary drinking water source (unpublished data).
Rationale for using a cluster design and rationale for using a stepped-wedge design
A SW-CRT design was selected due to the nature and scale of the intervention, which involves the rehabilitation of structural water supply network components as well as the extension of that network. A cluster randomised design was selected because infrastructure improvements (e.g. piped network rehabilitation and extension or installation of community taps) will affect large numbers of water service users simultaneously. The stepped-wedge design overcomes the logistical constraint of not being able to deliver the intervention concurrently to all clusters due to the duration of the construction works. It also addresses ethical concerns by allowing water supply improvements to be delivered to the entire town of Uvira. SW-CRT designs have been used previously for the evaluation of large-scale water treatment, supply and/or management interventions in India [54], Bangladesh [55], and Mexico [56] but never for systems which include new household and community water connections, and never in a cholera-endemic setting.
Intervention
The water supply intervention consists of a package of infrastructure works designed to improve the piped water service in Uvira (Fig. 3).
First, core components of the water supply network will be targeted and these works are expected to affect all clusters. The water treatment plant will be retrofitted with a system including flocculation, settling, sand filtration, and chlorination, and new pumps will be installed to double the water treatment plant production capacity. A new tank (2,000 m3) will be built, increasing the available hydraulic head for water distribution and doubling the overall storage capacity for the town. Structural pipes (diameter ≥ 250 mm) will be installed and those with identified deficiencies will be rehabilitated (7.4 km total).
Second, at the cluster level, the secondary network will be extended to increase coverage and create loops, which are expected to improve the reliability of water distribution locally. The installation of 116 (expected range: 100–120) new community taps is planned within the project, along with works on 3,000 household connections, including approximately 1,000 new taps for households that are currently not connected to the water supply network. While the total number of household connections (new and rehabilitated) included in the project is set to 3,000, the total number of new household connections and the distribution of these connections between clusters will remain flexible for the reasons described in more detail below. Household-level connections and community taps will be installed in each cluster following the randomised allocation sequence (Table 1).
The Uvira water network is, and will continue to be, managed by the national company Régie de Distribution d’Eau de la République Démocratique du Congo (REGIDESO). Three committees will be formed by community members for the management of community taps with the support of a Congolese NGO that has led successful community engagement projects (ADIR). These committees will be responsible for the daily management of water distribution at the community taps and the collection of water consumption fees from users to pay monthly bills sent by REGIDESO to each committee.
REGIDESO will be responsible for the promotion of new household connections in each neighbourhood/cluster via appropriate communication channels. New household connections will be installed on a “first come, first served” basis in each cluster after interested individuals submit an application form to REGIDESO and pay a fee, partially subsidised by the project. The number of new household connections planned in each cluster is based on three parameters as part of the works planning (Table 1): the number of connections per 1,000 inhabitants in each cluster, the proportion of the population with access to a tap within 300 m, and the network capacity in terms of number of total expected connections per meter of pipe within the cluster. However, given the reliance on individual demand for the installation of new household connections, and potential variability thereof, the team supervising construction works will be given discretion to reallocate new household connections to different clusters. Alternatively, in an attempt to facilitate the roll-out of the intervention, they may increase the proportion of household connections to rehabilitate according to identified needs and demands.
The management structure for the construction works is as follows: VF is leading the supervision of the works, including adhesion to the study protocol, with regular visits to the construction site and have contracted an engineering consulting firm for daily follow-up activities. The construction company was hired by REGIDESO, with AFD and VF support, after an international call for tender and is bound by a contract that specifically requires works to be implemented following the cluster randomisation protocol for the SW-CRT described below.
Description and diagram of trial design
The town of Uvira was divided into sixteen clusters stratified into two groups due to the project funding structure and planned works sequence: South (n = 6 service areas considered independent of the new water tank) and North (n = 10 service areas strongly affected by the new tank) (Fig. 1). The primary criteria used to define clusters were the total length of pipes to be rehabilitated or installed and the number of new community taps; the secondary criteria included considerations such as alignment with existing administrative zones and natural features such as rivers. Key characteristics of the study clusters are presented in Table 1.
Table 1
Key cluster characteristics.
Cluster #
|
Estimated population (March 2018)
|
Area [km2]
|
*Mean # suspected cholera cases per month
|
*Mean monthly incidence
per 1,000
|
Existing pipe length [m]
|
Pipe length to rehabilitate [m]
|
Length of new pipes to install [m]
|
# existing household connections
|
# provisionally planned new household connections
|
Number of planned new community taps
|
Allocation sequence
|
1
|
4,291
|
2.02
|
1.9
|
0.4
|
2,152
|
57
|
2,628
|
16
|
66
|
6
|
15
|
2
|
4,990
|
0.76
|
6.0
|
1.2
|
1,578
|
1,658
|
1,792
|
89
|
25
|
3
|
16
|
3
|
11,183
|
0.87
|
6.4
|
0.6
|
5,574
|
1,266
|
1,864
|
171
|
25
|
7
|
10
|
4
|
7,328
|
1.02
|
5.4
|
0.7
|
2,347
|
0
|
3,398
|
25
|
100
|
5
|
12
|
5
|
13,649
|
1.27
|
4.4
|
0.3
|
2,786
|
797
|
4,177
|
19
|
205
|
4
|
9
|
6
|
8,389
|
0.48
|
5.8
|
0.7
|
1,730
|
499
|
2,328
|
43
|
82
|
6
|
13
|
7
|
7,480
|
0.37
|
2.0
|
0.3
|
4,525
|
367
|
1,065
|
152
|
26
|
2
|
8
|
8
|
15,455
|
0.43
|
4.8
|
0.3
|
2,961
|
1,097
|
1,793
|
199
|
25
|
5
|
7
|
9
|
3,994
|
0.36
|
9.4
|
2.4
|
3,848
|
189
|
2,446
|
183
|
25
|
8
|
11
|
10
|
14,175
|
0.59
|
7.1
|
0.5
|
8,901
|
692
|
1,520
|
525
|
25
|
7
|
1
|
11
|
56,106
|
1.70
|
14.5
|
0.3
|
8,775
|
1,599
|
2,401
|
633
|
254
|
16
|
5
|
12
|
12,462
|
0.99
|
3.0
|
0.2
|
2,292
|
1,455
|
1,844
|
22
|
193
|
1
|
14
|
13
|
50,764
|
2.75
|
10.4
|
0.2
|
17,781
|
1,666
|
1,266
|
1,384
|
24
|
11
|
4
|
14
|
16,175
|
0.55
|
6.7
|
0.4
|
907
|
0
|
2,549
|
35
|
220
|
5
|
3
|
15
|
15,183
|
0.81
|
7.2
|
0.4
|
4,091
|
135
|
2,420
|
161
|
62
|
9
|
2
|
16
|
19,338
|
1.98
|
10.6
|
0.6
|
1,788
|
2,061
|
2,874
|
28
|
318
|
20
|
6
|
Mean
|
16,310
|
1.06
|
6.6
|
0.4**
|
72,033
|
13,538
|
36,363
|
3,685
|
1,675
|
7.2
|
-
|
Minimum
|
3,994
|
0.36
|
1.9
|
0.2
|
907
|
0
|
1,065
|
16
|
25
|
1
|
-
|
Maximum
|
56,106
|
2.75
|
14.5
|
2.4
|
17,781
|
2,061
|
4,177
|
1,384
|
318
|
20
|
-
|
*Based on CTC admissions between January 1, 2009 and March 31, 2018, and population in March 2018.
|
**Mean weighted by cluster population size.
|
Within each group (South and North), clusters were randomised to different initiation periods by the research team using a random number generator, with the intervention delivered to the South clusters first. The intervention interval – or “step” – during which time a given cluster receives the intervention was planned to be four weeks; this interval was extended to up to 8 weeks for the installation of new household connections to the water supply network (Fig. 2) – the reasons are discussed below.
Participants
The population of interest is all inhabitants of Uvira, and all patients admitted to the CTC with suspected cholera are eligible for participation in the study and collection of a rectal swab for cholera confirmation. No restriction is placed on patient age. Following approval by the Ministry of Health for DRC, the CTC Coordinator can extract and share anonymised patient information as recorded in the CTC registry, including age, sex, address, dates and length of stay, and antibiotic treatment if any. All information that is extracted and included in this study protocol is anonymised with no personal identifiers included. Aggregated census data provided by municipal authorities will be used to estimate the population size for each cluster.
Outcomes
Two primary outcomes will be used to assess the effectiveness of the intervention: 1) the monthly incidence of suspected cholera cases, as measured by the number of CTC admissions attributed to each cluster; 2) the monthly incidence of confirmed cholera cases, based on rapid detection test (RDT) results for eligible, consenting patients.
Trial data collection
Information will be collected to characterise the water supply intervention as well as to monitor health outcomes.
Monitoring tools were developed to record progress of construction works on the water supply network. For each new community tap and each household connection in this project, a form will be completed that includes information on location (address, cluster number, GPS coordinates), owner (for household connections), type of connection (new or rehabilitated), and date of works completion. For household connections, the date of works completion will correspond to the date of actual service availability for the users. For community taps, the date of service availability may be different from that of works completion and will be recorded by management committee agents in the registers used to monitor water use.
Additionally, in order to further assess the intensity of the intervention we will use the total volume of water distributed (m3/day) as measured at the exit of the pumping station and the total volume of water billed to users (m3/month per cluster), depending on data availability.
In parallel to the intervention, data will be collected at the CTC on an continuous basis, with all admissions and corresponding patient addresses recorded to allow assignment to study clusters, and rectal swabs collected from eligible, consenting patients for cholera confirmation via Crystal VC RDTs (Span Diagnostics, Surat, India) on alkaline peptone water enrichments, as described elsewhere [21]. The sensitivity and specificity of RDTs on enriched rectal swabs was estimated to be 92% and 91%, respectively [57]. Enriched samples testing positive via RDTs may be preserved on filter paper for Vibrio cholerae isolation and characterisation at a partner laboratory.
Blinding
Blinding of participants to the intervention is not possible due to the nature of the intervention: hydraulic construction works are visible and affect water services where they are implemented. However, whether an individual lives in a control or intervention cluster at a given point in time is unlikely to affect care-seeking behaviour for acute diarrhoea and cholera confirmation remains an objective outcome, independent of a patient’s cluster status.
Analysis plan
The SW-CRT and ITS analyses are detailed hereafter.
A generalised estimating equations (GEE) Poisson regression for rates will be used with robust standard errors. An indicator of water service quality will be included. To account for seasonality a harmonic term for time (in months) will be included. This analysis accounts for correlations between individuals within clusters, as well as repeated measures of the same clusters over time. A small sample correction will be considered to adjust for the small number of clusters [58]. Note that data collected during the transition period for each cluster will not contribute to the analysis.
Since the intervention takes place over less than two years, the seasonal pattern of cholera infection may not be estimated correctly using only data from the trial period. A sensitivity analysis will be carried out using historical data from the cholera treatment centre which is available from 2009 to the start of the trial. The model will be re-fitted using the same covariates, with all historical data considered non-intervention time.
An intention-to-treat analysis will be carried out for the main analysis. The above models will be repeated with the other primary outcome: rate of confirmed cholera cases per 1,000 residents.
Randomisation may be particularly challenging to ensure given the nature of the intervention. If the randomisation scheme is not adhered to, balance between arms cannot be assumed. In this case, relevant confounders which may be associated with intervention allocation and outcome will be included in the main analysis, as they would be in non-randomised settings. These may include patient’s age and sex, and factors related to their household location such as water service quality and distance from the cholera treatment centre.
As a complement to the main stepped-wedge analysis, an additional analysis will be carried out which makes fewer assumptions about the structure of the intervention. An interrupted time series analysis will be fitted using historical data, with a fixed starting point for the intervention rather than staggered starting points as assumed in the analysis above. Data collected throughout the intervention until completion of the works in the last cluster will be excluded from the analysis. We intend to continue data collection for at least 12 months after completion of the intervention to allow comparison of suspected and confirmed cholera incidence before and after water services improvements.
Sample size
The ‘steppedwedge’ command was used within Stata 16 (StataCorp LLC, College Station, TX, USA) to calculate the minimum detectable difference (MDD) in the main SW-CRT analysis given known parameters. The pre-intervention cholera rate across all clusters was assumed to be 0.4 per 1000 people per month (Table 1). Power was set at 80% with a 5% significance level. The calculation was carried out with the intraclass correlation coefficient (ICC) set at 0.3 and mean cluster size 16,000. ICC, average cluster size and cholera rates were found using the historical data (Table 1). The MDD was 0.1 per 1000, corresponding to a decrease to 0.3 per 1000 people (or increase to 0.5 per 1000) or a 25% reduction in suspected cholera incidence. In a meta-analysis, availability of piped water on premises compared to unimproved water sources was found to reduce the risk of diarrhoeal disease in children by 23% (confidence interval: 7–36%) [35].
A sample size calculation for the ITS analysis was also carried out. Follow-up periods of 6 and 12 months from an end date of July 2022 were considered. Mean cholera rates per month were estimated using historical data from the CTC in a quasi-Poisson model with a linear term for year and harmonic terms for month. These were used along with estimates of variance and over dispersion parameters to find the minimum detectable difference. The mean monthly rate per 1,000 people was estimated to be 0.25 over a 12 month follow up, 0.29 over 6 months. The minimum detectable reduction in cholera rates was therefore estimated to be 65% with a follow-up time of 12 months, and 75% for 6 months.
Cross-sectional household surveys
During the inception phase of this study, a household survey was conducted in 2016 and repeated in 2017 (unpublished) to assess household water collection, treatment, storage and use practices as well as drinking water quality before the intervention. An additional survey using similar questionnaires will be carried out upon completion of the intervention to assess whether changes in water service modified households’ water-related habits, including the quantity and source of water used for different purposes, water treatment and storage, and personal and household hygiene practices. Drinking water samples will also be collected from participating households to test for bacterial indicators of water quality (E. coli and total coliforms). Five hundred households will be randomly pre-selected across the 16 trial clusters and areas with different levels of access to piped water service post-intervention, using a similar sampling strategy as for the two previous surveys [59].
Economic evaluation
The economic performance of the intervention will be assessed using cost-effectiveness analysis (CEA) and cost-benefit analysis (CBA). Both will use decision analytic modelling to compare costs and outcomes under the intervention scenario as compared to a ‘do nothing’ scenario, over a 20-year time horizon. The CEA will assess the incremental cost per (i) confirmed case of cholera averted, (ii) CTC admission averted, and (iii) disability-adjusted life year (DALY) averted. These measures exclude the value of the broader outcomes of the intervention beyond infectious disease. Therefore, we will also undertake a CBA that will value health and other outcomes (such as time savings) in monetary terms, and calculate a benefit-cost ratio. Cost data for these analyses will come from intervention financial records (capital costs), REGIDESO financial records and interviews (operational costs such as electricity, chemicals and staff), and household surveys (cost-of-illness, travel time to off-plot sources). Outcomes will be estimated from trial records.
Process evaluation
Assumptions on the pathway from intervention to impact (Fig. 3) will be assessed, if possible, by conducting a process evaluation alongside the trial. Information will be gathered from multiple sources: operational data from the water treatment and pumping stations, as well as billing information and community taps registries, in conjunction with household survey data, will allow us to document water service access and quality in each cluster throughout the project – thus helping understand fidelity and compliance of the planned intervention.
Recruitment & consent
Recruitment of participants for cholera confirmation will occur continuously at the Uvira CTC, where trained study staff have offered participation to all admitted patients since April 2016. Written informed consent (Appendix 2) will be sought from all participants prior to collection of a rectal swab by trained CTC study staff. For patients under 15 years old, parental consent will be sought for participation in the study.
Recruitment of participants for household surveys will be done by trained enumerators following the random sampling scheme described above. Written informed consent will be obtained from an adult individual (over 18 years old) accepting to participate in the survey on behalf of each household.
Data management and monitoring
Anonymised data from the CTC registries will be encrypted and sent onto a secure online server via Open Data Kit, with regular data accuracy checks performed by research team members during visits to the study site. Household survey data will also be collected electronically using Open Data Kit, with encryption. All datasets for this trial will be kept on secure servers and password-protected computers accessible only to authorised research team members, separately from identifying information.
No data monitoring board was set up for this trial in view of the nature of the intervention (water supply improvements) and low risk to participants; for the same reason, no interim analyses are planned and stopping guidelines have not been established. Reporting adverse events will be the responsibility of the Principal Investigator. External audits of the trial are currently not planned.
A steering committee was set up with representatives of all study partners, including the Ministry of Health, REGIDESO, funding agencies and cholera response organisations in DRC to advise on research activities. The steering committee will be updated yearly on progress and challenges.