Aims and objectives
The key aim of this research is todetermine whether a standardised and manualised care intervention achieves superior symptomatic outcome compared with usual care for male LUTS, with a primary outcome of overall International Prostate Symptom Score (IPSS) measured 12 months after consent, in a primary care setting.
Secondary objectives are to compare the two trial arms with regard to:
- Disease-specific quality of life
- Symptomatic outcomes
- Cost effectiveness
- Relative harms
- Use of NHS resources
- Overall quality of life and general health
- Acceptability of assessment and provision of care
- Patients’ perception of their LUTS condition
Trial design: This is a pragmatic two-arm cluster randomised controlled trial (RCT) randomising GP practices 1:1 between a care pathway based on a standardised and manualised care intervention (intervention arm) and one based on usual care (comparator arm) for men with LUTS. The study flow diagram is provided in Figure 1 and the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist in Additional file 1. The trial design included an internal pilot recruitment phase of 4 months duration, primarily to verify that recruitment was possible before progression to the main phase of the trial.
Figure 1 Study flow diagram
The study is powered to detect a clinical improvement in overall IPSS score of 2. IPSS is a patient-reported questionnaire and will be completed at baseline, and at 6 and 12 months after consent, with the primary endpoint at 12 months post-consent. Secondary outcomes are collected by questionnaire at 6 and 12 months and extracted from primary care medical records at 12 months. All participants will be provided with study progress updates at 3 and 9 months via a newsletter to maintain engagement with the trial and encourage response rates of follow-up questionnaires. The newsletter does not provide any detail on the TRIUMPH intervention.
Setting: Thirty GP practices were recruited within 12 CCGs across the West of England and Wessex Clinical Research Network (CRN) regions in the UK. Participants are identified and recruited from these practices.
Recruitment of GP practices: The CRNs invited GP practices to express an interest in taking part in the study. In order to achieve a balanced range of practices, the following factors were considered:
- number of potentially eligible patients, on conduct of a preliminary database search
- patient list size
- deprivation score (calculated using the GP practice postcode)
- preference for intervention delivery (practice staff or trial research nurses)
- Treatment room space available for intervention delivery
Selected sites underwent site initiation training. An internal pilot phase was conducted with eight initial sites over a period of four months before the main phase of the trial.
Participants: This is a pragmatic trial, which includes all adult men who consider themselves to have bothersome LUTS, presenting to primary care within the past 5 years, with at least one symptom of LUTS. Only men with prevalent cases of LUTS are included in the trial. Detailed inclusion and exclusion criteria are provided in Table 1.
Patient screening and invitation: The process of patient invitation and screening is detailed below.
- GP practices conduct a single database search to identify potentially eligible patients. The database search was developed specifically for the trial, based on the trial inclusion and exclusion criteria (Table 2) for both EMIS and SystmOne patient administration systems used in primary care sites in both CRN regions.
- The patient list identified by the search is manually screened by GPs at the site against patient’s records using the eligibility criteria listed in Table 2, including criteria which could not be fully included in the search, such as lack of capacity to consent, and referral or review by secondary care.
- A deidentified screening log populated with eligibility codes for all patients identified from the search is sent to the central trial team.
- Invitation letters, with patient information leaflets (PIL) and expression of interest (EOI) forms are mailed out to eligible patients by practices using an approved third party (Docmail—a secure service which automates sending invitation letters to potential participants). A single mail out is conducted for each site.
- Interested patients complete their EOI forms online or return paper copies by post.
- CRN nurses or clinical practitioners trained by the trial team conduct phone calls with interested patients. These calls are conducted whilst blinded to the allocation of the practice and therefore the patient, to avoid any bias. Calls are conducted to confirm eligibility, particularly the subjective criteria of whether the patient’s LUTS is bothersome to them, ensure patient understanding of the study, answer any questions and confirm willingness to participate.
The number of patients manually screened by sites and included in the single mail out varied between the pilot and main phase of the trial:
- Pilot phase: during the pilot phase of the trial sites manually screened up to 325 potentially eligible patients identified from their database search, in order of NHS number. The maximum number of patients for an individual site to include in their invitation mail out was 150, however the screening allowed for the potential of a second mail out. For sites with more than 150 eligible patients, the central study team randomly identified the 150 patients for invitation.
- Main phase: during the main phase of the trial, sites with more than 220 eligible patients screen up to this number, in order of NHS number. The maximum number of patients invited into the trial from a single site is 220.
Cluster randomisation:
GP practices are the units of allocation for the two study arms. Practices are randomised on a 1:1 basis to deliver either the TRIUMPH intervention or continue with usual care (control group) by a statistician blind to the identity of practices. Randomisation is conducted after the practices have completed their screening and invitation to eligible patients. Randomisation is minimised by centre (Bristol and Wessex), practice size (number of patients registered at the practice) and area-level deprivation (Index of Multiple Deprivation score, IMD) of the practice.
Patient consent:
Patients deemed willing and eligible to participate in the study by the CRN are posted a consent form and a questionnaire containing baseline measures specific to trial arm for completion (Figure 2). However, patients are blinded to their allocation until their completed questionnaire and consent form are received.
Withdrawal: Participants remain in the trial unless they choose to withdraw, or if they are unable to continue. Patients may withdraw fully from the study or from specific elements without giving a reason. Any data collected up until the point of withdrawal is retained. Participants are informed of this in the PIL prior to consent.
Blinding: Two statisticians are supporting this trial. The senior statistician co-applicant is blinded throughout the trial. The trial statistician will perform all disaggregated analyses according to a pre-specified statistical analysis plan and attends closed Data Monitoring Committee (DMC) meetings as required. The CRN support team are blinded whilst conducting patient eligibility calls to minimise selection and recruitment bias. Patients are blinded to their allocation until their completed baseline questionnaire and consent form is received. The trial health economist will remain blinded until completion of the cleaning of the resource use data, and will perform all disaggregated analyses according to a pre specified health economics analysis plan. The remaining members of the study team remain blinded to aggregate data only.
Figure 2 Schedule of enrolment, interventions, and assessments
Interventions:
TRIUMPH intervention arm
LUTS presentations are typically a composite of different symptom combinations. The TRIUMPH intervention targets component symptoms with specific educational information and active management. This is provided in a standardised way in the form of a booklet which the patients can read in their own time to encourage take-up of the information. However, the intervention also provides manualised care, with an HCP using basic assessments and discussion with the patient to direct them to the most applicable information in the booklet. The discussion considers their personal circumstances, symptom needs, bothersomeness of these symptoms and impact on quality of life. The TRIUMPH intervention arm therefore offers standardised and manualised care according to the symptomatic presentation of the individual patients.
The TRIUMPH intervention booklet underwent sequential development in multiple iterations and consultations involving patients, HCPs and Health Psychologists.
Details of the TRIUMPH intervention are provided below:
- The intervention is delivered by a trained HCP; either a GP practice clinical nurse, research nurse (RN) or healthcare assistant (HCA), or dedicated trial RN depending on site preference.
- The HCP reviews the patient’s baseline urinary symptoms utilising their completed IPSS, The International Consultation on Incontinence Questionnaire Urinary Incontinence-Short Form (ICIQ-UI-SF) and ICIQ bladder diary.
- The participant attends for a single intervention visit, during which the HCP discusses their individual symptoms and level of bother. The HCPs are provided with a decision tool to assist them in tailoring the treatment for each patient at their intervention visit based on their symptoms.
- The HCP provides the patient with the illustrated booklet of written information “Helping you to take control of your waterworks”. The sections included are:
- Advice on drinks and liquid intake
- Advice on controlling an urgent need to urinate
- Exercising the muscles between the legs (pelvic floor) to help stop bladder leakage
- Advice on emptying the bladder as completely as possible
- Advice on getting rid of the last drops
- Reducing sleep disturbance caused by needing to urinate
- The booklet is water-resistant and able to lie flat when open which is useful when potentially used when in the bathroom. Pictorial representations were used for clarity and avoid the use of potentially embarrassing images.
- The delivery of the booklet is personalised by the HCP who directs the patient to the relevant sections of the booklet and therefore steps to take personally. A maximum of three sections are recommended to each patient and tabbed with discreet stickers. Where more than three relevant sections are identified as relevant to a patient, the three most bothersome are chosen. The choice of a maximum of three sections was guided by PPI consultation on what they considered to be a manageable level of advice to follow.
- To encourage and gauge adherence to the intervention, regular patient contact is provided following the initial face-to-face appointment. Follow-up contacts are conducted by phone at 1 week, and then by phone, email or text at 4 and 12 weeks according to patient preference. Patients retain the intervention booklet at the end of this period.
The TRIUMPH intervention therefore aims to address key limitations in the current provision of care to men with LUTS in primary care through the use of symptom scores and bladder diaries to effectively diagnose specific LUTS symptoms, the provision of effective written materials, and training of RNs/HCAs in the interpretation of symptom scores and use of the Theory of Planned Behaviour to support self-management.15
Patients in the intervention arm continue to receive usual care from their GP for their LUTS where necessary and details of this will be collected at 12 months.
Intervention training
The Chief Investigator developed the training and delivered this to the TRIUMPH study research nurses. Materials were developed to support the training as well as the intervention visits. The TRIUMPH nurses attended GP practices to deliver training to practice nurses or healthcare assistants. Training included examples of bladder diaries and how primary care staff should interpret them for the purpose of the trial. Nurses were trained on the responses to the questionnaires and which sections of the booklet they should direct the participant to. This was supported by a checklist developed specifically for the study. Monthly teleconferences were held between the nurses/HCAs delivering the intervention and the Trial Managers for ongoing support, resolution of queries and sharing of experience.
Usual Care arm
Usual care (the comparator arm for TRIUMPH) in this study requests sites to continue to follow their standard local practice for trial patients. Usual care was chosen as the comparator for the study to reflect the actual care provided by control arm GP practices rather than the NICE guidance which may be variably implemented. The qualitative aspect of this trial will explore what usual care looks like for a sample of comparator and intervention practices.
Post-trial care: Following the end of the trial, patients in the intervention arm will be able to retain the booklet provided, and patients in the control arm will be provided with the booklet alongside a summary of the results of the trial. Their LUTS care will be the responsibility of their GP throughout the trial and after they have completed the TRIUMPH study at 12 months.
Outcome measures: The primary outcome measure is the patient reported IPSS at 12 months after consent. The IPSS is validated, extensively tested in LUTS research, and widely employed in urology services. The ICIQ-UI-SF supplements the IPSS with the inclusion of incontinence.
Secondary outcome measures:
- LUTS specific quality of life at 6 & 12 months (IPSS QoL)
- Symptoms scores at 6 months (IPSS overall score) and 6 & 12 months (ICIQ-UI-SF)
- Cost-effectiveness analyses from an NHS perspective with a 12-month time horizon. The EuroQol Group’s five-dimension health status questionnaire (EQ–5D–5L) will be used to calculate QALYs
- Number of Adverse events (e.g. infection, urinary retention)
- Number of GP consultations
- Number of referrals to secondary care
- Overall quality of life measured by the EQ–5D–5L
- A qualitative element of the research study will evaluate patient experiences of the intervention
- Patient perception of their LUTS using the Brief Illness Perception Questionnaire (B-IPQ)
Assessment and follow-up: The components and timing of follow-up measures are shown in Figure 2.
Clinical and patient reported outcomes:All participants complete self-reported outcome measures in the form of questionnaires (IPSS, ICIQ-UI-SF, EQ–5D–5L and B-IPQ) at baseline (postal), 6- and 12-months (postal, online or telephone) post enrolment. Participants are sent one reminder to return their baseline materials, and up to three reminders to return their 6- and 12-month questionnaires.
Data extraction of GP records at 12 months will be used to collect the secondary outcomes and health care resource measures including GP consultations, adverse events, referrals to secondary care and medications. Study designed CRFs are completed for the intervention arm only, at the intervention visit and during the 12-week treatment phase to collect details of the booklet sections advised to the patient, and feedback on the booklet.
Economic data collection: Data from the EQ–5D–5L will be used to calculate quality adjusted life years (QALYs). Information from the GP record data extraction will provide details of health care resource use for the economic evaluation. The intervention arm CRFs will collect resources related to delivery of the intervention (e.g. HCP time).
Qualitative data collection: A qualitative component is included to evaluate patients’ attitudes to, and experiences of standardised and manualised care interventions for men with LUTS, including patients within the control group and their LUTS experiences. Help-seeking drivers and previous experiences of LUTS management will also be explored. HCP views on the interventions will be explored as well as facets of trial participation. A small group of patients who decline to participate in TRIUMPH will be interviewed to explore their reasons for not participating and identify potential areas of improvement in the trial design.
Interviews will be semi-structured and follow a topic guide which will encourage participants to discuss their perspectives with regard to the aims above. They will be conducted during the pilot phase (control group excluded from this stage to explore acceptability of the intervention) and main phase with study participants. Interviews will focus on LUTS experiences and expectations from treatment at baseline. At 6–12 months following the treatment period follow-up interview will focus on outcomes and the experience of the treatments or interventions received in both groups. Clinicians will be interviewed to explore their perspectives on LUTS management, their perspectives on the intervention and standard care and their experience of being involved in the trial.
Interviews will be audio-recorded, transcribed verbatim and uploaded into a qualitative software package (NVivo10) to aid data management. Thematic content analysis will be undertaken on an ongoing basis in an iterative manner. Interviews will continue until data saturation is achieved in addition to ensuring representation of the different features of the trial and participants, such as age, presenting symptoms, geographical location and usage of different sections of the standardised booklet.
Trial Oversight: The study is supervised by a Trial Management Group (TMG) consisting of grant holders and other relevant trial delivery staff. A Trial Steering Committee (TSC) oversees the progress of the trial, comprising of an independent Chair and three other independent members, including a public and patient involvement (PPI) representative, and the Chief Investigator (CI). A Data Monitoring Committee (DMC) monitors accumulating trial data for quality, completeness and patient safety, and comprises of an independent Chair and two other independent members, and the CI. All serious adverse events are recorded and notified as appropriate to the relevant authorities.
PPI: Extensive PPI was undertaken to develop the TRIUMPH intervention booklet, and also provided input on patient facing materials and questionnaires. Patient representatives on both the TMG and TSC provide ongoing guidance for the trial, and with one patient as a co-applicant on the grant application, PPI input into the study has been ongoing since its conception. A wider Patient Advisory Group (PAG) also provide additional support.
Data management and confidentiality: Study data are collected and managed using REDCap16 hosted at the University of Bristol. The database incorporates data entry and validation rules to reduce data entry errors, and management functions to facilitate auditing and data quality assurance. The database system will protect patient information in line with the data protection legislation. Trial staff will ensure that participants’ anonymity is maintained through protective and secure handling and storage of patient information. The Chief Investigator will have access to and act as custodian of the full dataset.
Dissemination: The results of the study will be published in the academic press and all participants will be offered a lay summary of the main findings of the study. The trial will also be presented at national and international conferences. The results will be disseminated to the primary care and urology communities through the relevant bodies.
Sample size: A scoping search was conducted with local practices within the host CCG to gain a sense of the likely number of patients available on their practice lists based on the trial inclusion and exclusion criteria. This search suggested that an average sized practice (7,500) might identify 100 patients. Assuming that 50% of these patients will be eligible and 70% consent, each practice would consent 35 eligible patients. Our estimates of eligibility rates, consent and loss-to-follow up are conservative and based on our experience running pragmatic trials.
This study is powered to detect a mean change of 2 points in IPSS scores at 12 months. The recognised minimum important difference in IPSS scores is 3.0 in men with LUTS generally17, but a smaller difference was chosen in consultation with patient input when designing the TRIUMPH study, because the study expects to include some men who have only one symptom requiring treatment (e.g. nocturia). We originally estimated that 840 patients are needed from at least 24 practices to detect a difference in IPSS scores of 2 (common standard deviation of 5; in line with the assumptions made in the UPSTREAM study3) with 90% power and significance level 5%. This estimate incorporated a design effect to account for clustering of effects in practices which assumed that practices will be able to recruit 35 patients each and that the intra-class correlation between practices would be 0.05—an estimate in line with results from other primary care studies18. We allowed for up to 30% of men being lost to follow-up.
During the pilot phase of the trial it became clear that the number of patients recruited by practices varied and that many were not recruiting the estimated 35 patients. Exploration of the recruitment data at practices who completed their mailouts and estimates for those to be opened suggested that 30 practices would be required to detect our stated effect size with 90% power assuming a mean practice size of 26 and coefficient of variation in practice size of 0.26.
Statistical analysis: All analyses and reporting will be in line with CONSORT guidelines and its extension for cluster randomised trials. Primary analyses will be conducted on an ITT basis. A full statistical analysis plan will be developed and agreed by the TSC prior to undertaking analyses of the main trial.
Descriptive statistics will be used to summarise characteristics of practices and patients and compare baseline characteristics between groups (age, deprivation based on practice location, height, weight, ethnicity and marital status). Means and standard deviations will be used for continuous and count outcomes or medians and interquartile range if required for skewed data. Categorical variables will be summarised using frequencies and proportions. Patient-reported outcome scores based on standardised questionnaires, including the primary outcome of LUTS score, will be calculated based on the developers’ scoring manuals and missing and erroneous items will be handled according to these manuals.
The primary outcome is IPSS score collected at 12 months post-baseline. It will be described in each treatment group using means and standard deviations. Comparisons between treatment arms will be made using a multilevel linear model to allow for clustering within practices adjusting for baseline IPSS scores and practice-level variables used in the randomisation. We will explore whether there is clustering in our primary outcome by the nurse/healthcare assistant delivering the intervention. If present, we will account for this in sensitivity analyses using a linear mixed model. The underlying assumptions of this model will be checked, and analyses adjusted accordingly.
Secondary outcomes explore LUTS, measures of quality of life, self-management, adverse events, use of LUTS medication and referrals to primary and secondary care. Continuous outcomes will be studied in the same manner as the primary outcome using multilevel linear models to allow for clustering within practices adjusting for baseline measures of the outcome where available. Binary outcomes will be studied using multilevel logistic regression models allowing for clustering within practices. Count variables will be studied using multilevel Poisson regression models - or negative binomial model depending on the distribution of counts - allowing for clustering within practices. All models will adjust for variables used in the randomisation, the underlying assumptions of the models will be checked, and analyses adjusted accordingly.
Economic data analysis: The trial will include a formal economic evaluation comparing the costs and cost-effectiveness of the intervention from an NHS perspective, from baseline to 12 months follow-up. The cost of the intervention and the use of primary and secondary NHS services by the men in relation to their bothersome LUTS, will be estimated through the collection of resource-use data from GP records and study designed proformas, and will be valued using routine data and GP practice information.
The values from EQ–5D–5L, administered at baseline, 6 and 12 months, will be transformed into utility scores and individual QALYs will be calculated using the area under the curve approach.
Resource use (e.g. number of GP consultations) will be calculated for each arm. Differences in costs and QALYs between the arms will be evaluated using appropriate regression techniques. For the primary economic analysis, cost-effectiveness will be assessed using the Net Benefit framework over a range of values for the QALY and will include the UK cost-effectiveness thresholds of £20,000 - £30,000.
A secondary economic analysis will examine the difference in costs and IPSS score. If neither arm is dominant (i.e. both cheaper and more effective), then an incremental cost-effectiveness ratio (ICER) will be calculated in relation to the IPSS score. If appropriate, Seemingly Unrelated Regressions (SUR) will be used when constructing the ICER, to account for the potential correlation between costs and the IPSS score.
Uncertainty for these analyses will be addressed using cost-effectiveness acceptability curves and sensitivity analyses.
Qualitative data analysis: Theoretical purposive (non-probability) sampling will be used to ensure the diverse characteristics of the population are sampled (e.g. participants of differing ages, clinical history, duration of symptoms and at follow-up in the intervention arm, components of the package received and drop-out/adherence). Geographical distribution will also be factored to ensure representation of varied practice populations19. Sampling and analyses will continue in iterative cycles until no new themes are emerging and established themes cease evolving (data saturation)20. It is anticipated approximately 15 participants will be required for the feasibility stage, followed by a maximum of 30 patient interviews for both baseline and follow-up evaluation in the Intervention arm and 15 at both time points in the usual care arm during the main trial. Where possible we will conduct follow-up interviews with the same participants as the baseline interviews to capture reflective perspectives. However, additional participants may be required to ensure representativeness of the spectrum of interventions delivered and those considered compliant/adherent to the interventions.
A convenience sample of a maximum of 20 HCPs will also be interviewed to capture the variability of the practice populations and both usual care and intervention practices involved.
Analyses will be conducted by the qualitative researcher on an ongoing basis in an iterative manner, according to principles of thematic content analysis21. Recordings will be listened to and transcripts read and re-read for familiarisation. Segments of text will be ‘coded’ by assigning descriptive labels. Codes will be grouped on the basis of shared properties to create themes and coded transcripts will then be examined and compared to inductively refine and delineate themes (constant comparison)22, 23.
A subset of interviews will be independently analysed by a second study researcher and coding discrepancies discussed to maximise rigour and reliability. Plausibility of data interpretation will be further discussed within the study team throughout the analyses. Descriptive summary accounts of the audio-recordings and interviews will be prepared.