The MRC recommendation includes completing a mixed method process evaluation based on theory. We will apply two theoretical frameworks: the Theoretical Domains Framework (TDF) (14) and Reach Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) (15), to analyse results and synthesise findings from qualitative and quantitative data collection methods. The study design and timepoints of measurement are in Fig. 1 and Table 1.
Table 1
Schedule of trial follow-up and procedures.
Assessment/ procedure | Baseline | Day 7 | Hospital discharge | 6 weeks | 120 days | 12 months |
Informed consent | X | | | | | |
Demographic information and baseline outcomes | X | | | | | |
Total hospital length of stay | | | X | | | |
mILOA | | X | | | | |
EQ-5D-5L and ICECAP-O | | X | | X | X | X |
FES-I | | X | | X | X | X |
Remain in hospital | | | | X | | |
Return to preadmission mobility | | | | X | X | X |
Current residence | | | | X | X | X |
Reoperation rate | | | | X | X | X |
Discharge destination from the acute ward | | | X | | | |
Adverse events (including readmissions, falls) | | | | X | X | X |
Healthcare utilisation | | | | X | X | X |
Economic evaluation | | | | | | X |
Implementation | | | | | | X |
mILOA = Modified Iowa Level of Assistance Score, EQ-5D-5L = EuroQol 5D-5L, ICECAP-O = ICEpop CAPability measure for Older people, short FES-I = Short Falls Efficacy Scale – International, MBS/PBS = Medicare Benefits Schedule and Pharmaceutical Benefits Scheme.
To determine translation and behaviour change success of HIPSTER, the RE-AIM framework will be applied. This framework effectively evaluates public health interventions by assessing outcomes against five key dimensions; Reach, Effectiveness, Adoption, Implementation and Maintenance (16). We will report on all domains across individual and organisational levels, where appropriate (15, 16). The outcomes assessed (Table 2) include participant characteristics, participation rates, intervention completion, intervention effectiveness and characteristics of staff delivering the intensive physiotherapy. The TDF will be applied to understand individual behaviour change success. The TDF is a framework combining different theories of behaviour change to identify factors affecting healthcare professional behaviour and guide more targeted implementation interventions (17). It will be used as a coding framework to understand clinician survey responses (14, 18).
Table 2
RE-AIM elements and outcomes assessed
RE-AIM element | Outcomes Assessed |
Reach | Percent of eligible individuals who participate Characteristics of participants and non-participants (age, insurance status, postcode, pre-fracture residence, walking ability and cognitive status) |
Effectiveness | Clinical outcomes, healthcare utilization, adverse events Patient and carer experience (semi-structured interviews) |
Adoption | Characteristics of staff delivering intervention, health care professional experience (surveys), clinical partner involvement |
Implementation | Number of intensive physiotherapy sessions delivered, components delivered, adaptations made to intervention, total physiotherapy time |
Maintenance | Individual: patient outcomes at 12 months (e.g. quality of life), factors supporting the participant’s recovery Organisation: intent to continue the intervention at 6 months post-trial completion, local funding models, modifications made, intervention intensity provided to patients |
RE-AIM = Reach, Adoption, Implementation and Maintenance |
Process evaluation design and conduct
A mixed methods study design will be undertaken in parallel to the HIPSTER trial to evaluate the process of HIPSTER at the intervention level, patient and carer level and clinician level.
Intervention level
To determine translation at an intervention level, the RE-AIM framework will be applied. The key components are outlined in Table 2. A site initiation visit will be completed, providing education about current evidence, existing gaps in the literature and aims of the HIPSTER Trial. No additional training will be provided for staff delivering the intervention, as the intervention staff will apply core physiotherapy skills of patient assessment, exercise prescription (including specific strength exercises) and progression during each session. The key difference in management between usual care and the intervention group is the increased frequency of physiotherapy and allied health assistant sessions. We will identify any changes to usual care over the course of the trial, including changes to clinician behaviours. Sites will maintain an intervention log for each participant randomised to the intervention group. Staff delivering the intervention will complete it at the end of each session. The intervention log will contain the number of intervention sessions delivered per resource (Physiotherapist or Allied Health Assistant), the duration of the session (minutes) and a brief description of the intervention provided (e.g. ambulation, exercises). Any missed intervention sessions will be documented, and an explanation provided. These data will track intervention fidelity and be summarised by percentage of planned sessions delivered. Intervention completion will be defined as those that received their designated therapy for at least four days in the acute hospital. The reach of the intervention will be determined by the percentage of eligible participants who participate and their characteristics. Intervention effectiveness will be evaluated by clinical outcomes as specified in our trial protocol (9), adverse events, and patient experience (semi-structured interviews). Adoption of the intervention including health care professional characteristics, experience and perspectives of intensive therapy will be gathered through pre and post clinician surveys. We will record intervention completion, the number and components of the intervention delivered including total physiotherapy and allied health assistant time and adaptations made for implementation. Maintenance at an individual level will be measured by patient outcomes across at 12 months following surgery (e.g quality of life measured using EQ-5D-5L) as well as the participant and carer experience of the intervention and the factors supporting their recovery. Maintenance at an organisational level will be measured by intention to continue delivering the intervention at 6 months following trial completion, including local funding models and modifications made, and the intensity of the intervention delivered.
Participant and carer level
Clinical outcomes and their collection method are explained in detail in our published protocol (9). Baseline data will be collected at hospital admission with key follow-up assessment timepoints occurring at day seven, six weeks, 120 days and 12 months following surgery. At initial study consent, participants or their proxy decision-maker will be invited to participate in semi-structured interviews at six weeks following surgery. At the six-week review with the blinded assessor, participants or their carers will be asked if they consent to be contacted by an experienced qualitative researcher who is independent of the site clinical and research staff. Those who consent and are eligible (have recall of the acute inpatient hospital admission) will be contacted to participate in a semi-structured interview. They will be asked about their experience of intensive therapy, their recovery and discharge from hospital, as well as barriers and facilitators to participation in the intervention, with questions guided by the RE-AIM framework (supplementary material A). Interviews will be conducted via the telephone, at a time of the participant’s preference. A sampling framework will be applied to ensure diversity across hospital, gender and presence of a carer.. Interviews will be transcribed verbatim within 6 weeks of completion of the interview. All participant discussions and responses will be coded to ensure participants cannot be identified from their responses. Two researchers will independently undertake line by line analysis of the coded transcripts, to generate descriptive themes (19). The two researchers will refine the descriptive codes into themes and subthemes through iterative discussion (20). Representative quotes from participants will be used to illustrate the identified themes. Interviews will continue until data saturation is reached, i.e. when no new themes emerge from consecutive interviews.
Clinician Level
Pre implementation and post implementation clinician surveys linked to domains of the TDF will explore behaviours that act as barriers and facilitators to implementation of HIPSTER. Any clinician involved in the care of patients following hip fracture will be invited to anonymously participate in an online survey (Qualtrics®, Utah USA) by their site principal investigator prior to the commencement of recruitment. The pre-implementation online survey will comprise 25 questions each relating to the domains of the TDF (Table 3) as well as an additional five questions relating to the study protocol. Participants will be asked to rate level of agreement to a statement using a six level Likert scale ranging from ‘completely agree’ to ‘completely disagree’. These same questions will be repeated in the post-implementation survey. Free text options will also allow clinicians to list any perceived barriers and facilitators to implementation of intensive therapy following hip fracture. The post-implementation survey will be distributed seven days following completion of participant recruitment to prevent unblinding staff. The survey will include an additional 28 statements and short answer questions relating to barriers and facilitators to implementation, suitability of the site and trial design and likelihood to continue providing high intensity therapy following hip fracture. In both surveys we will collect demographic information about the clinician, their qualifications, years of experience and professional delegation.
Table 3
Survey evaluation of clinician perspective on providing intensive physiotherapy following hip fracture surgery
TDF domain | Number of questions | Representative question |
Knowledge | 3 | I am aware of the findings of the High Intensity Physiotherapy following Hip fracture trial (H4H) published in the MJA in 2016. |
Skills | 2 | I have the ability to deliver high intensity physiotherapy for hip fracture patients (usual care plus two additional daily sessions, one delivered by a physiotherapist and one delivered by an allied health assistant) |
Social/professional role | 2 | There has been sufficient local clinician time allocated for training to deliver high intensity therapy for hip fracture patients. |
Beliefs about capabilities | 4 | I feel confident to discuss the pros and cons of high intensity physiotherapy post hip fracture surgery with patients. |
Optimism | 2 | I don’t think that all patients are capable of participating in high intensity physiotherapy post hip fracture surgery |
Beliefs about consequences | 4 | Whether a patient receives usual care or high intensity physiotherapy after hip fracture doesn’t really matter. |
Reinforcement | 2 | Whenever I look for ways to improve care for patients who have had a hip fracture, I get recognition from professionals who are important to me. |
Intentions | 3 | I intend to support other staff to develop skills to deliver high intensity physiotherapy post hip fracture. |
Goals | 1 | I believe that offering inpatient rehabilitation to patients following hip fracture surgery is important. |
Memory, attention, decision processes | 1 | I am familiar with the mobilisation guidelines for post-operative mobilisation following hip fracture (Australia New Zealand Hip Fracture Registry or NICE Guidelines). |
Environmental context and resources | 5 | Our institution offers mobilisation on the first post-operative day to all patients following hip fracture surgery. |
Social influences | 4 | Most people whose opinion I value would support offering high intensity physiotherapy to our patients. |
Emotion | 2 | I feel nervous about sending patients directly home (rather than to inpatient rehabilitation) after a hip fracture |
Behavioural regulation | 1 | I am confident I could provide high intensity physiotherapy for patients following a hip fracture |
TDF = Theoretical Domains Framework | |
Survey responses will be reported descriptively with the number and proportion of respondents. Themes emerging from free text responses will be mapped to the TDF components (14). The comparison of pre- and post-implementation survey responses will enable differentiation between perceived and experienced barriers and facilitators, which will be used to guide future implementation. These clinician experiences will help with the creation of interventions and an implementation toolkit to target key behaviours of change with the goal of facilitating sustainable implementation.
Logic model
As per best-practice methods for evaluation of complex interventions (10) a logic model was created outlining key factors that may influence implementation, proposed causal mechanisms and target outcomes (Fig. 2).