Study design
In this pragmatic study, the recruiting period will be from April 2019 till March 2020, with follow-ups till December 2020. This study comprises two designs; a prospective cohort study and a stepped-wedge based design.
Two local networks of NPRL1.0 will be enrolled in NPRL2.0. They will receive additional education and information based on the results of the feasibility study of NPRL1.0. In NPRL2.0, they will invite patients to participate in a prospective cohort study.
In the stepped-wedge based design working according to NPRL2.0 will be introduced in three steps in two local primary care networks at the same step (step A, B or C). Local networks that intensively collaborate, due to their geographical location, will be placed together in one step (A, B or C). An independent research assistant will randomly allocate the local networks over the steps. In one local network, at least one therapist, general practitioner (GP), and mental health nurse will participate. Each local network will first recruit patients as controls during a period of care as usual, followed by a 3-month ‘wash-out’ period in which education is given (see Figure 1). After the wash-out period, a local network will then recruit patients during the intervention period in which NPRL2.0 is the standard of care. According to the stepped-wedge based design, length of control and intervention periods vary in each group: Group A will spend three months as control and five months with intervention; for Group B, there will be four months as control and four months with intervention; and Group C will spend five months as control and three months with intervention. Thus, healthcare professionals in all local networks will recruit patients for participation in both control and intervention groups. Patients will contribute data to either the control group or the intervention group, but not both. A stepped-wedge based design is the most feasible design in this pragmatic study as it has the following advantages: 1) it controls for between-local network variation in daily practice; 2) it gives the opportunity to assess intervention effects in a pre/post comparison across local networks, which increases statistical power; 3) it gives an opportunity to assess learning effects by comparing the results of local networks that transit earlier with those that transit later (34).
Intervention
NPRL2.0 is an integrated, transmural healthcare network for patients with CMP, focusing on improving the level of functioning of patients, despite pain. In the primary care of NPRL2.0, the GP is the gatekeeper for assessing the level of complexity of pain complaints, referral, and treatment selection. In the Netherlands, therapists (such as physiotherapists, practice therapists, and occupational therapists) in primary care can be visited by people with CMP directly, without referral. Therefore, therapists will also be able to assess the level of complexity of the pain complaints and to advise these patients to visit a GP if necessary. Depending on the level of complexity involved, the follow-up policy will either include advice without further treatment, monodisciplinary treatment in primary care, interdisciplinary treatment in primary care (collaboration between GPs, primary care therapists, and mental health practice nurses in assessing and treating patients with CMP who need mental support besides physical exercise) or interdisciplinary treatment in secondary or tertiary care (Figure 2). Primary care in NPRL2.0 consists of the following elements:
Integral focus on assessment and referral: assessment tool
To support the healthcare professionals in their decision-making for problem-mapping and treatment selection, an evidence-based objective assessment tool will be used for the assessment of complexity of the pain problem: the STarT MSK Tool (36). The Dutch version of this tool is translated and validated (not published yet). STarT MSK will support decision-making by choosing the right treatment to match the patient’s biopsychosocial profile.
Integral focus on treatment content and duration: treatment protocols
Patients will receive individualized treatments based on their current needs in order to improve their daily functioning. NPRL2.0 protocols are based on the most recent evidence-based treatment methods, such as Graded Activity, Exposure in vivo, and Acceptance and Commitment Therapy, and are adjusted to the primary care setting (22-24, 37, 38). In the feasibility study, healthcare professionals were invited to provide feedback on the NPRL2.0 treatment protocols. Based on this, adjustments were made to the content and duration of NPRL2.0 treatment protocols. The primary care NPRL2.0 protocols are extended with a module focusing on self-management in daily living after treatment by a primary care therapist.
Integral focus on self-management: eHealth application
Healthcare professionals and patients participating in the NPRL2.0 will make use of the eHealth application: SanaCoach Pain Rehabilitation (39). The coach's primary goal is to support self-management. Its main function is to provide module-based pain education. Different eLearning modules are developed for the patients in order to teach them about the biopsychosocial aspects of pain. In addition, diaries are integrated in which patients can provide information on their pain intensity, level of activity, mood, and participation level. Moreover, healthcare professionals can use scores from these diaries to adjust treatment protocols to the needs of individual patients. The application also consists of a chat function between the patient and their healthcare professionals to ensure prompt communications. The functions in the SanaCoach Pain Rehabilitation, such as the number of diaries and the level of education, will be adapted to the patient, based on his/her complexity and level of disability.
Education and collaboration
Healthcare professionals will receive education during the 3-month wash-out period: GPs 2x3 hours and therapists 3x3 hours. Topics in the education program include biopsychosocial theories of CMP, recognition of patients with or at risk of CMP, providing education to patients with CMP, use of the assessment tool and eHealth application, and treatment selection. The first two sessions are organized jointly for all disciplines of healthcare professional in order to promote a common understanding of biopsychosocial treatment. Separately, therapists will also receive information about the treatment protocols. To encourage collaboration in the local networks, three additional peer-review meetings of one hour (every 6-8 weeks) are organized by the project team in each local network after the wash-out period. During these meetings, healthcare professionals apply the theories and treatment protocols learned during the education program in daily practice, with room for extra education by the teachers if necessary. After these three peer-review meetings, the local networks are encouraged to organize further such meetings in order to align the working procedures and treatment plans of the patients.
Control
All networks start with a control period, in which local networks will invite patients who are attending consultations for CMP complaints to participate in the study. The healthcare professionals will refer and treat the patients, following the usual way of working in pain rehabilitation care in the Netherlands.
Recruitment of primary healthcare professionals
Primary healthcare professionals (therapists, GPs and mental health nurses) working in the Parkstad region (Limburg, the Netherlands) who have no prior experience with NPRL1.0 will be recruited for participation in the study. Social media and the network of healthcare professionals of NPRL1.0 will be used to recruit new healthcare professionals. Healthcare professionals must be willing to recruit patients for the control and intervention periods, to attend the education days, and to make use of the assessment tool and treatment protocol of NPRL2.0.
Recruitment of patients
Patients with CMP complaints, who visit the participating GPs and therapists via direct access, will be informed about the study and asked for consent to transfer their contact details to the research team. The research team will contact these patients by phone to inform them about the study and ask for oral consent for participation. Subsequently, the patients will receive the first questionnaire (T1) electronically or by post, in which they can give electronic/written informed consent for participation in the study.
Patients will be eligible if they are ≥ 18 years at the start of the study, have CMP or musculoskeletal pain with a high risk of becoming chronic, are willing to improve their functioning despite the pain, and have adequate Dutch literacy to complete the questionnaires. Exclusion criteria are pregnancy or any medical (orthopedic, rheumatic or neurological) or psychiatric disease which could be treated by a more appropriate therapy, according to the expert opinion of the GP.
Sample size
In the prospective cohort, all patients with CMP who visit the two local networks of NPRL1.0 will be invited to participate in the study. Based on the recruitment results of the feasibility study of NPRL1.0, and the number of patients visiting a GP practice, we expect that each local network will also recruit about six patients per month. Therefore, the two local networks from NPRL1.0 together should recruit approximately 132 patients in 11 months. Assuming a dropout rate of 20%, we expect to include approximately 105 patients in this study.
To calculate the desired sample size for the stepped-wedge based design, we used the method described by Woertman et al. (40). The calculations of the number of patients needed are based on the primary outcome of the cost-utility analysis, the health-related quality of life measured with the 5-level EQ-5D version (EQ-5D-5L). Based on McClure et al., we consider an increase of 0.063 points (SD = 0.013) in one year as clinically relevant (41). In addition, an alpha of 0.05, a power of 80%, a 1:1 ratio between control and intervention groups, and a dropout rate of 30% were assumed. Based on these values and the stepped-wedge based design, a design effect (DEsw) of 0.416 exists, which leads to a required sample size of 184 patients (92 control and 92 intervention). Based on the recruitment results of the feasibility study of NPRL1.0, and the number of patients visiting a GP practice, we expect that each local network will recruit 6 patients per month (32). Therefore, with a dropout rate of 30% of local networks, six local networks will need to participate.
Data collection
An overview of the content of the different data collection methods can be found in Figure 3.
Patients participating in NPRL2.0 are asked to fill in four questionnaires electronically or on paper: T1 after initial contact with healthcare professionals about their CMP complaints (50 minutes completion time); T2 three months after T1 (30 minutes completion time); T3 six months after T1 (30 minutes completion time); and T4 nine months after T1 (50 minutes completion time).
Additionally, assessment tool 1 will be used for research purposes, as well as for decision-making in primary care. Therefore, patients in the control group will complete assessment tool 1 as part of the questionnaire at T1. Patients in the intervention group will complete it during their consultations in primary care. Assessment tool 1 will assess the level of complexity of the pain complaints and consists of one Visual Analogue Scale (VAS) for pain intensity and nine dichotomous questions on biopsychosocial factors.
At the end of the study, records of the treatment characteristics of each patient will be collected from the participating practices and rehabilitation centers.
In order to encourage completion of the questionnaires, patients will be reminded up to three times by phone if they have not responded within one week. If incomplete questionnaires are returned, patients will be contacted by phone to answer the remaining questions. The researcher who performs the analyses will be blinded as to patient allocation.
Outcome measures
Baseline characteristics
Baseline characteristics will be collected at T1 and they will include questions about: birth date, gender, nationality, marital status, family composition, level of education, and co-morbidities.
Health assessment
The Pain Disability Index (PDI) will be used as the primary outcome for pain-related disability. It measures the influence of pain on a patient’s life and on the performance of daily activities. The questionnaire consists of seven items that measure the complexity of the disabilities experienced in different situations such as work, leisure time, activities in daily life, and sport. Each item is scored on a scale from 0 (no disability) to 10 (severe disability). Scores from the individual items are summed to a total (0-70). The minimal important change is 13 points for patients with CMP (42). The Dutch version of the PDI has proven internal consistency and test-retest reliability (43).
The Dutch language version of the Short Form Health Survey (SF-12) will be used as the primary outcome for cost-effectiveness, measuring quality of life on specific domains. The SF-12 has proven to be a practical, reliable, and valid instrument for use in both general population surveys and in studies of chronic disease populations in the Netherlands (44, 45). Total scores range from 0 to 100 (a higher score indicates a better quality of life) with a minimal clinically important difference of 8.9 for low back pain (46). The physical health component scale (SF-12 PCS) comprises the domains of physical functioning, physical role limitation, bodily pain, and general health perceptions. The mental health component scale (SF-12 MCS) comprises the domains of vitality, social functioning, emotional role limitations, and general mental health. These sub-scales will be used in the effectiveness analysis.
The EQ-5D-5L will be used for the cost-utility analysis: it provides a single health index based on self-reported mobility, self-care, usual activities, pain/discomfort, and anxiety/depression (47). There are five levels in each dimension from which respondents select that which most closely matches their health state. The levels are no, slight, moderate, severe, and extreme problems, coded 1 to 5. A health state index score, ranging from -0.446 to 1 (worst to best imaginable health status), will be calculated from individual health profiles, using the Dutch utility tariff. The accompanying visual analogue scale (VAS: 0-100) rates the current health state, with higher scores indicative of better experienced health. The minimal clinically important difference for low back pain is 22.5 (46). The Dutch version of the EQ-5D-5L was found valid and reliable (48, 49).
The Numeric Rating Scale (NRS) will be used to measure pain intensity on an 11-point scale varying from 0 (no pain) to 10 (worst pain imaginable). At each measurement point (T1-4), the patient will complete the NRS three times: current pain intensity; lowest pain intensity in the last week; highest pain intensity in the last week. The NRS has shown high test-retest reliability and validity (50). A reduction of 2 points, or 30%, on the pain NRS scores can be seen as clinically important (51).
The Hospital Anxiety and Depression Scale (HADS) consists of 14 items of which seven are related to anxiety and seven to depression. The patient is asked to rate the items on a 4-point scale ranging from 0 (not at all) to 3 (most of the time). Total scores range from 0 to 21 on each subscale: a higher score reflects higher distress. The HADS has a sensitivity and specificity of about 80% and a predictive validity for identification of about 70% (52). The reliability ranges from 0.84 to 0.96 (53).
The six-item short form Pain Catastrophizing Scale (PCS-6) comprises six definitions of thoughts and feelings when experiencing pain (54). The patient is asked to rate the definitions on a 5-point scale, ranging from 0 (not at all) to 4 (all the time), with total scores ranging from 0 to 24 (54). The six-item version is used because it places a lower burden on patients than the original PCS. This form is adequate for detecting pre- to post-treatment changes in pain catastrophizing (55). The PCS-6 is highly comparable to the original PCS and meets the construct validity criteria. Internal consistency and test-retest reliability of the original PCS appears to be adequate (54-56).
The Pain Self-Efficacy Questionnaire (PSEQ) is used to measure pain self-efficacy (57). In patients with CMP, it shows satisfactory internal consistency and construct validity (58). The four-item short form PSEQ-4 (items 4, 6, 8 and 9) will be used because it places a lower burden on patients than the original PSEQ (54). Items are rated on a 7-point Likert scale ranging from 0 (not at all confident) to 6 (completely confident). The scores are summed, ranging from 0 to 24: the minimal important change is 1.5 points (59). The PSEQ-4 is a good alternative for the PSEQ as the sensitivity and specificity of the PSEQ-4 are 0.803 and 0.687 respectively, compared with 0.648 and 0.875 respectively for the PSEQ (59).
Cost assessment
To evaluate the economic consequences of NPRL2.0 from a societal perspective, as recommended by the Dutch guidelines for costing studies in healthcare, the intervention costs, other healthcare costs, patient and family costs, and productivity losses will be assessed (60).
The intervention costs include costs of education meetings for healthcare professionals and peer review meetings for the intervention group, and consulting and/or treatment hours for the intervention and control groups. The education costs are for 2x3 hours of education and 1x3 hours of additional education for therapists. For each education session, the costs of two teachers and one meeting room will be taken into account. These costs will be charged at 10% per patient as it is assumed that healthcare professionals need education only once. Multidisciplinary consultations are organized with all healthcare professionals of the local networks in the absence of patients. For the multidisciplinary consultations per patient, the costs of the healthcare professionals will be divided by six, assuming that during one hour the status of six patients will be discussed. Moreover, it will be assumed that on average each patient is discussed during three multidisciplinary consultations. The number of consultations and/or treatment hours will be collected by the research team from the records of the patients in both the intervention and control groups. To calculate costs for healthcare professionals, standardized cost-prices as prescribed in the Dutch manual for cost-analysis in healthcare research will be used (60).
Healthcare usage will be measured with the iMTA Medical Consumption Questionnaire (iMCQ). It contains questions about healthcare consumption related to frequently-occurring contacts with healthcare professionals (www.imta.nl). The iMCQ will be combined with the iMTA Productivity Cost Questionnaire (iPCQ), a standardized instrument suitable for self-completion by patients for measuring and valuing all relevant productivity losses of paid and unpaid work for use in economic evaluations (61, 62). The manual for the iMCQ and iPCQ will be used for evaluating healthcare usage and productivity losses with the friction cost approach. The costs of prescribed medication will be calculated by multiplying the number of tablets that participants used during three months with the cost price as described at the Dutch webpage http://www.medicijnkosten.nl; the pharmacist costs will also be included. For over-the-counter medication, the lowest prices of Dutch drugstores and pharmacies will be used. All costs will be given in euros and, when necessary, indexed using the general Dutch Consumer Price Index rates (63).
Besides the iPCQ and iMCQ, the patients will be asked about their current care status and the treatment program for their CMP complaints. Moreover, at the end of the study, participating practices and rehabilitation centers will use the records of the patients to collect data about the length, content, and duration of the program.
Learning curve
Data regarding the background experience and knowledge of healthcare professionals will be assessed at the start of the study to judge whether there is a learning curve when participating in NPRL2.0. Whether patient outcomes regarding health and costs are improved when healthcare professionals have more experience of and knowledge about treating patients with CMP will be assessed.
The Pain Attitudes and Beliefs Scale (PABS) will be used to measure clinicians’ biomedical and biopsychosocial treatment orientations with respect to back pain (64). It consists of 36 statements about treatment preferences, scored on a six-point Likert scale (from 1 = ‘totally disagree’ to 6 = ‘totally agree’). The sum score ranges from 6 to 60 for the biomedical factor and 6 to 54 for the biopsychosocial factor (65). The PABS shows a consistent factor structure and good test-retest reliability and construct validity (66).
Data analysis
Demographic data (e.g. gender, age, home situation, level of education, nationality, and co-morbidities) will be described overall and separately for the intervention and control groups. Frequencies are to be presented for categorical variables, means and standard deviations (SDs) for normally-distributed continuous variables, and medians and ranges for non-normally-distributed continuous data. The two groups will be tested on differences between characteristics, using the t-test for continuous variables and the chi-squared test for categorical variables. If variables differ between the two groups, with p ≤ 0.10, they are considered to be potential confounders in further analyses.
Outcomes on questionnaires will be compared using linear mixed-model analysis, to take into account repeated measurements in patients as well as the effects of the clustering of patients within local networks. The fixed part of the model contains treatment group (intervention/control), time, treatment group*time, and cluster (local network). To assess the learning effect in local practices, the time (months) that a local network participates in NPRL2.0 will also be taken into account as a fixed variable. Variables known to be related to the outcome and differing between treatment groups at T1 (p ≤ 0.10) will be added to the model. An unstructured covariance structure will be used for repeated measures. Missing values for items in the questionnaires will be handled according to the scoring algorithms of the questionnaires. Missing variables in the follow-up data will not be imputed because linear mixed-model analysis is a flexible method for handling missing data for stepped-wedge and repeated-measures designs (likelihood-based approach). Linear mixed-model analyses will be performed using IBM SPSS Statistics for Windows (version 24.0 or higher, Armonk, NY: IBM Corp.) according to the intention-to-treat principle. Other missing values for non-repeated measures will be handled by multiple imputation, which means that missing values will be predicted using existing values for other variables (67).
Costs will be compared using bootstraps (1,000 replications) with Microsoft Excel 2016 with mean differences and 95% confidence intervals. Subsequently, sample uncertainties around the incremental cost-effectiveness ratio (ICER) and incremental cost-utility ratio (ICUR) will be explored using bootstrapping with a minimum of 5,000 replications. The ICER and ICUR will be defined by the difference in costs between NPRL2.0 and the control group, divided by the difference in their effect. Cost-effectiveness analyses will be performed with the mean total costs and the mean SF-12 scores. The cost-utility analysis will be performed by relating the mean total costs to the mean QALY scores of both groups, and the bootstrapped ICURs will be plotted in cost-effectiveness planes. Moreover, uncertainties of the ICERs and ICURs will be graphically presented in cost-effectiveness planes (CE plane), as well as cost-effectiveness acceptability curves (CEAC). A CEAC will be calculated to describe the probability of NPRL2.0 being a cost-effective alternative to the control group (68). This CEAC includes the amount of money the society is willing to pay (WTP) in order to gain one unit of effect (one QALY here). The WTP threshold in the Netherlands for one QALY is based on the health burden and varies between €20,000 (health burden 0.1 to 0.4), €50,000 (health burden 0.41 to 0.7) and €80,000 (health burden 0.71 to 1) (2015) (69).
Three sets of sensitivity analyses will be performed to measure the robustness of the economic evaluation. These analyses will explore the impact of an assumption on the results when changing one value of one parameter while keeping all the other parameter values unchanged (70). One sensitivity analysis will be performed to measure the influence of taking the educational costs included the intervention costs. Because healthcare professionals will only need training once, the intervention costs may be overestimated. The secondary sensitivity analysis will be performed to assess the influence of the multidisciplinary consultation costs. No standard cost price exists for multidisciplinary consultations in primary care in the Netherlands and it is not known how many patients will be discussed in order to be able to split the costs over these patients. The tertiary sensitivity analysis will be performed to see if there is over- or under-reporting of healthcare consumption in the iMCQ. The data from the records regarding GP and therapist sessions will be compared with the patient data from the iMCQ. When over- or under-reporting is found, a secondary cost analysis will be performed with corrections on all healthcare consumption data, assuming that the same amount of over- or under-reporting is present in the iMCQ.