Evaluating Methodological Quality of Prognostic Prediction Models on Patient Reported Outcome Measurements after Total Hip Replacement and Total Knee Replacement Surgery: a systematic review protocol

doi:10.21203/rs.3.rs-903247/v1

Download PDF

Protocol

Evaluating Methodological Quality of Prognostic Prediction Models on Patient Reported Outcome Measurements after Total Hip Replacement and Total Knee Replacement Surgery: a systematic review protocol

https://doi.org/10.21203/rs.3.rs-903247/v1

This work is licensed under a CC BY 4.0 License

You are reading this latest preprint version

Background

Prediction models for poor patient-reported surgical outcomes after total hip replacement (THR) and total knee replacement (TKR) may provide a method for improving appropriate surgical care for hip and knee osteoarthritis. There are concerns about methodological issues and the risk of bias of studies producing prediction models. A critical evaluation of the methodological quality of prediction modelling studies in THR and TKR is needed to ensure their clinical usefulness. This systematic review aims to: 1) evaluate and report the quality of risk stratification and prediction modelling studies that predict patient-reported outcomes after THR and TKR; 2) identify areas of methodological deficit and provide recommendations for future research; and 3) synthesise the evidence on prediction models associated with post-operative patient-reported outcomes after THR and TKR surgeries.

Methods

MEDLINE, EMBASE and CINAHL electronic databases will be searched to identify relevant studies. Title and abstract and full-text screening will be performed by two independent reviewers. We will include: 1) prediction model development studies without external validation; 2) prediction model development studies with external validation of independent data; 3) external model validation studies; and 4) studies updating a previously developed prediction model. Data extraction spreadsheets will be developed based on the CHARMS checklist and TRIPOD statement and piloted on two relevant studies. Study quality and risk of bias will be assessed using the PROBAST tool. Prediction models will be summarised qualitatively. Meta-analyses on the predictive performance of included models will be conducted if appropriate.

Discussion

This systematic review will evaluate the methodological quality and usefulness of prediction models for poor outcomes after THR or TKR. This information is essential to provide evidence-based healthcare for end-stage hip and knee osteoarthritis. Findings of this review will contribute to the identification of key areas for improvement in conducting prognostic research in this field and facilitate the progress in evidence-based tailored treatments for hip and knee osteoarthritis.

Systematic review registration:

Submitted to PROSPERO on 30 August 2021.

Health Economics & Outcomes Research

Health Policy

total hip replacement

total knee replacement

prediction model

systematic review

meta-analysis

Osteoarthritis affects 9% of the population and over 30% of those aged > 65 years in Australia, cost the health care system an estimated $3.5 billion in 2015-16 (1). Total hip and knee replacement (THR and TKR) surgeries are effective for treating end-stage hip and knee osteoarthritis (2). However, some patients report unsatisfactory outcomes persistent pain or poor function following THR (~ 5–10%) and TKR (~ 15–35%) (3–5). Unsatisfactory surgical outcomes may lead to revision and a further increase in healthcare burdens (6, 7). Identifying individuals who may not respond to THR or TKR can assist the development of new non-operative treatment strategies for this subgroup, ensuring surgery is only provided to those most likely to benefit. Well-constructed prediction models that can predict poor patient-reported surgical outcomes are crucial to provide the required information.

The reporting quality of research aimed to develop or validate prediction models is considered suboptimal in medicine and significant efforts have been made to improve methodological rigor and research transparency in this field (8). Guidelines and instruments such as the TRIPOD Statement (9) and CHARMS checklist (10) have been developed to provide guidance for reporting prognostic studies. Indeed, systematic reviews on the methodological quality of prognostic models have been performed in conditions such as hypertension (11), chronic kidney disease (12, 13) and cancer (14), but are absent in joint replacement, despite much attention directed at the patient selection and optimisation of joint replacement (15). Thus, little is known about the quantity, validity and methodological quality of studies that have generated prediction models for specific outcomes after THR and TKR.

Published prognostic models in total joint replacement range from predicting perioperative complications (16–18) and discharge destination (19), to long-term postoperative outcomes including pain (20, 21), infection (22–25), readmission (26), revision (27), patient-reported function (28, 29), range of motion (30), and satisfaction (31). Although studies have identified risk factors (e.g. psychological distress, diabetes and severe obesity) (32–36) and prediction models for poor patient-reported outcome after joint replacement (20, 21, 28, 29), there are concerns about methodological issues and the risk of bias (37, 38). The lack of methodological and analytic rigour of these studies indicates the risk that incorrect models could be used to guide clinical practice. Thus, a critical evaluation of the methodological quality of prediction modelling studies in THR and TKR is needed to ensure their clinical usefulness.

This systematic review aims to: 1) evaluate and report the quality of risk stratification and prediction modelling studies that predict patient-reported outcomes after THR and TKR; 2) identify areas of methodological deficit and provide recommendations for future research; and 3) synthesise the evidence on prediction models associated with post-operative patient-reported outcomes after THR and TKR surgery.

This systematic review protocol is prepared according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols (PRISMA-P) Guidelines (39, 40). The PRISMA-P checklist is provided in the Supplementary Files (Table S1). Registration of this systematic has been submitted and is currently assessed by the International Prospective Register of Systematic Reviews (PROSPERO).

Eligibility criteria

The PICOTS (Population, Intervention, Comparison, Outcome, Timing, Setting) approach is used to develop the eligibility criteria that will be used to select relevant studies (9, 41). This information is provided in the Supplementary Files (Table S2).

Types of participants

Studies including adults aged 18 or older receiving elective THR or TKR will be included. The surgeries can be either primary or revision for persistent pain after previous THR/TKR, and either unilateral or bilateral joint replacement. No restriction will be placed on sex or race. Studies including participants receiving partial/hemi-replacements, or THR/TKR indicated for acute fracture, will be excluded.

Types of studies

We will evaluate prospective studies using multivariate predictive statistical models that assess preoperative risk factors for predicting patient-reported outcome after THR or TKR. We will include the following studies:

Prediction model development studies without external validation of independent data.

Prediction model development studies with external validation of independent data.

External model validation studies.

Studies updating a previously developed prediction model.

Eligible studies should present at least one formal prediction model or regression equation in such a way that it allows calculation of the risk of poor post-operative outcome.

Included studies must have patient-reported outcome measures (PROMs) as the primary prediction outcome. As there is no single validated, reliable and responsive PROM specifically for TKR or THR, we will include prediction models using instruments to measure minimally clinically important difference in any patient-reported outcomes (42). These instruments include generic (quality of life) questionnaires such as the Short Form health surveys (SF-36 or SF-12) and the EuroQol 5-dimension questionnaire, or joint-specific questionnaires such as the Knee Society Score, the Western Ontario and McMaster Universities Arthritis Index, Oxford Knee/Hip Score or Hip disability and Osteoarthritis Outcome Score (43). Studies should report a final prediction model(s) that only includes pre-operative predictor variables.

The following types of study will be excluded:

Univariate prediction studies reporting bivariate associations between specific baseline clinical risk factors and postoperative PROMs, without multivariate adjustment for other sociodemographic or clinical parameters.

Studies only identifying predictors associated with a PROM without an attempt to develop a prediction model.

Studies that only predict non-PROM postoperative outcomes such as adverse events, complication rates, revision, falls or clinician assessed/reported outcomes.

Literature reviews and grey literature such as reports, conference abstracts, opinions, editorials, commentaries, letters.

Search strategy

To identify relevant studies, an electronic literature search of MEDLINE, EMBASE and CINAHL will be conducted. Available published search filters will be adapted and combined with medical subject headings (MeSH) and related free-text words for a sensitive yet specific search strategy. A combination of different keywords for THR or TKR and prediction model will be used to identify relevant literature. The search strategies will be tailored to each database. The full search terms and search strategy are included in the Supplementary Files (Table S3). No restriction will be placed on the publication period. Only articles in the English language will be included. The reference lists of included studies and existing relevant reviews, will also be screened for potentially relevant studies. References will be searched for the original prediction model development study in cases of external model updating and recalibration. While the review is in progress, citation searching for forward citation of recent studies and citation alerts (e.g. Google Scholar) will be used to identify potentially relevant studies as they appear. The searches will be re-run prior to the final analysis and new relevant studies will be retrieved.

Study selection

The complete references of the studies retrieved from the above search strategy will be exported into Endnote X9 and duplicates removed. Two reviewers will independently assess the title and abstract of all studies identified through the search against the eligibility criteria. The full text of all eligible studies will then be retrieved. Disagreements on study eligibility will be resolved by consensus and if necessary, a third reviewer will be consulted for arbitration. Search results and reasons for excluded articles at each stage of study selection will be documented and reported in a PRISMA flowchart (44).

Data extraction

Two reviewers will independently conduct the data extraction from the final list of eligible studies. Any disagreements in the extracted data will be resolved through discussion with an additional reviewer. A piloting phase will be introduced before the formal data extraction. During the piloting phase, two randomly chosen articles from the eligible articles will be used by two independent reviewers to test a piloted data extraction spreadsheet and the definitions of the items to be collected. Disagreements will be discussed to achieve consensus and modifications to the piloted spreadsheet will be made. This customised data extraction spreadsheet will be reviewed and agreed by all the reviewers before its use in the formal data extraction.

We will collect information in the domains related to prediction modelling adapted from the CHARMS (CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies) and TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) statements (10, 45). The following information will be extracted from the eligible studies:

Study characteristics- first author, publication year, data source (cohort, case-control, randomised trial participants, registry data or separate development dataset), study dates (start and end of accrual, end of follow-up), recruitment method.

Participants- age, sex, type of surgery, the number of participants enrolled in the study.

Outcome measures- defined outcome of interest (PROMs such as pain, function, mobility, composite outcome), method of outcome measurement, where the same definition and method used for all participants (Y/N), type of outcome (single, combined endpoints), blinding of outcomes assessors (Y/N), candidate predictors part of outcome in panel or consensus diagnosis (Y/N), time duration of outcome occurrence.

Predictor variables- type of predictors, number of predictors included in final model, defined method for measurement of candidate predictors (Y/N), timing of predictor measurement, blinding of predictor assessment including blind for outcome and blind for each other (Y/N), handling of predictors in modelling.

Model sample size- number of participants, number of outcome events reported, events per variable, number of outcomes in relation to number of predictor variables.

Missing Data- number of participants with missing data in each predictor variables and outcome measures, handling of missing data.

Model development- modelling method, modelling assumptions satisfied (Y/N), predictor pre-selection for inclusion in multivariate modelling, predictor selection method during multivariate modelling, criteria for predictor selection.

Model performance- calibration, discrimination, whether performance measures with confidence intervals (Y/N). Prediction model performance including discrimination using a c-statistic such as area under the receiver operating characteristic (ROC) curve (AUC), calibration using a calibration plot and slope or goodness-of-fit statistic (e.g. Hosmer-Lemeshow test), or overall model fit (e.g. Brier score, explained variation/R² statistic) will be extracted.

Model performance evaluation- internal and/or external validation methods, was there poor validation with model testing (Y/N) including model adjusted/updated (Y/N), adjustment such as intercept recalibrated, predictor effects adjusted, or new predictors added (Y/N).

Result- final multivariable models, alternative presentation of final prediction models (Y/N), comparison of predictors distribution (including missing data) for development and validation datasets (Y/N).

When data are missing, authors of the studies will be contacted a maximum of three times in order to obtain the data.

Quantitative data extraction and pre-processing

Discrimination is the ability of a prediction model to differentiate between participants who develop poor outcome and those who do not, assessed using c-statistics (such as AUC). C-statistics with 95% confidence intervals will be extracted. As the discrimination of prediction models is heavily influenced by the distribution of participant characteristics, or case mix variation, the standard deviation of participant characteristics (e.g. age) and of the linear predictor for the outcome of interest will be extracted (41). The linear predictor is defined as the weighted sum of the values of predictors in the validation study, where the weights are the regression coefficients of the prediction model (41, 46). When the standard deviation is unavailable, reported ranges will be used to obtain such information (41).

Calibration is the agreement between outcome predicted by the model and the observed outcome (47). The calibration slope of the calibration plot, if reported, will be extracted and summarised. However, as calibration is often reported using different summary statistics or unreported, the total number of observed (O) and expected (E) events will be extracted and the total O:E ratio will be calculated to estimate the overall model calibration (47). Where the O:E ratio is available in subgroups, such information will be extracted.

Study quality and risk of bias

The methodological quality of the included studies will be assessed by two reviewers independently with disagreements resolved by consensus. The risk of bias and applicability concerns will be assessed using the PROBAST (Prediction model Risk Of Bias ASsessment Tool) (48) in four domains of participants, predictors, outcome, and analysis (a total of 20 signalling questions) for the development and validation of prediction models. These criteria are summarised in the Supplementary Files. Signalling questions will be rated (yes, probably yes, probably no, no or no information) to help make judgement for risk of bias as “high,” “low” or “unclear” for each domain. Applicability concerns of three domains of participants, predictors and outcome will also be rated (high/low/unclear). Overall risk of bias for each prediction model will be assessed across all four domains based on the following criteria:

Low- all domains rated as low risk of bias; a prediction development model without external validation based on a very large data set and included internal validation.

High- at least one domain rated as high risk of bias; a prediction development model without internal or external validation rated as low risk of bias.

Unclear- at least one domain rated as unclear risk of bias and rest of the other domains as low risk of bias.

Overall applicability concerns for each model will be assessed across three domains according to the following criteria:

Low- all domains rated as low concerns about applicability.

High- at least one domain rated as high concerns about applicability.

Unclear- at least one domain rated as unclear concerns about applicability.

If studies assessed multiple prediction models, only models meeting the eligibility criteria will be assessed for their risk of bias and applicability concerns.

Data synthesis

Narrative review

A narrative review will be conducted to synthesise the evidence for the risk of bias and applicability concerns of the prediction modelling studies. Data of the selected studies will be tabulated or categorised in the following domains:

Study characteristics- first author, publication year, study country, recruitment period, type of surgery, outcome measures, data source, age/sex of participants, number of participants included in derivation cohort/analysis for model development.

Outcomes- type of PROMs, incidence of poor outcome (number and percentage).

Predictors for each outcome- demographic, biological, psychological predictors.

Methodological findings- model type, predictor selection procedure, predictor variables included in the model, missing data handling.

Model performance for each outcome- predictive performance of development model (discrimination and calibration), type of validation, predictive performance of validation model.

Methodological quality- risk of bias, applicability concerns.

All issues related to methodological quality will be reported and discussed. Specifically, the usefulness and overall applicability of the prediction models will be described. Findings will be presented based on the type of surgeries (THR vs. TKR) and type of outcome predicted in the studies (e.g. pain, function, quality of life, composite measure). The risk of bias and applicability concerns will be reported as counts and percentages to underline the most critically affected domains of bias and applicability.

Meta-analysis

Quantitative analysis of this review will be conducted using R (RStudio-1.2.5033; The R Foundation for Statistical Computing, a statistical software) (49) and relevant packages (e.g. ‘metafor’). Meta-analysis for measures of model performance will be conducted separately for the intervention (first THR and TKR, then primary and revision surgery if there are sufficient studies) and PROMs. When there are at least two included studies that assessed the prediction performance (discrimination and calibration) of the models on the same PROM with sufficient information available, meta-analysis will be performed to estimate the average model performance using a random effects model where the weights are based on the within-study error variance (41). Estimates of discrimination and calibration will be first summarised separately. A joint synthesis of discrimination and calibration will then be performed using multivariate meta-analysis to avoid excluding studies that only assessed one of the measures of prediction performance (50). Forest plots and hierarchical summary receiver operating characteristic (HSROC) curves will be produced to visualise model performance.

To assess the heterogeneity of the study population, Cochran’s Q and the I² statistic will be calculated (51). The heterogeneity is considered significant when p < 0.1 and I² ≥ 50%. Difference between the 95% confidence intervals and prediction region in the HSROC curve will be used to visualise the heterogeneity, with a large difference indicating the presence of heterogeneity (52). If more than 10 studies are included in the meta-analysis, sources of heterogeneity will be examined using meta-regression, where the dependent variable is the measure of model performance and the study level or summarised participant level characteristics (e.g. age) are the independent variables (41).

Subgroup and sensitivity analysis

Where heterogeneity is identified (p < 0.1), subgroup analysis will be performed based on type of model validation (internal and external validation), predictor variable selection method (forward or backward stepwise approaches, least absolute shrinkage and selection operator [LASSO] technique) and type of predictor variables selected in the models (clinical measures and laboratory-based measures) and other study characteristics according to the data extracted. A sensitivity analysis will be conducted to assess the impact of excluding studies with high risk of bias determined using the PROBAST tool.

Meta-biases

Publication biases will be assessed using a funnel plot to evaluate publication bias if more than 10 studies are included in meta-analysis (53). Egger’s test will be used to assess the publication bias (p value > 0.10 indicating low publication bias), and a funnel plot asymmetry test will be conducted to examine the risk of publication bias (p value > 0.10 indicated low publication bias) (54). A trim and fill method, a non-parametric data augmentation approach, will be used to estimate the number of missing studies and to generate an adjusted estimate by imputing suspected missing studies (55). The adjusted estimates reveal whether the estimates based on meta-analysis are biased resulted from funnel plot asymmetry. If the difference between unadjusted and adjusted estimates is a positive value, the estimate in meta-analysis is considered overestimated due to missing studies (56).

Reporting and dissemination

Findings from this review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) 2020 statement (57) and the confidence of evidence will be assessed using the Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) system (58). Any deviation from the protocol will be recorded and explained in the final report. We will disseminate our findings in published in peer-reviewed journals and presented at national/international conferences related to orthopaedic medicine.

This protocol describes a systematic review to evaluate the methodological quality and the usefulness of prediction models for poor patient-reported outcomes after THR or TKR. This information is essential to provide evidence-based recommendations for clinical decision making in healthcare for individuals with end-stage hip and knee osteoarthritis. Well-conducted prediction modelling studies have great potential to inform research and clinical practice in stratified treatments based on accurate risk estimates. Findings of this review will contribute to the identification of key areas for improvement in conducting prognostic research in this field and facilitate the progress in evidence-based tailored treatments for hip and knee osteoarthritis.

AUC: area under the receiver operating characteristics curve; CHARMS: CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies; GRADE: Grades of Recommendation, Assessment, Development, and Evaluation; HSROC: hierarchical summary receiver operating characteristic; LASSO: least absolute shrinkage and selection operator; MeSH: medical subject headings; PICOTS: Population, Intervention, Comparison, Outcome, Timing, Setting; PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis; PRISMA-P: Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols; PROBAST: Prediction model Risk Of Bias ASsessment Tool; PROM: patient-reported outcome measure; PROSPERO: International Prospective Register of Systematic Reviews; ROC: receiver operating characteristic; THR: total hip replacement; TKR: total knee replacement; TRIPOD: Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis.

Ethics approval and consent to participate

Not applicable

Consent for publication

Not applicable

Availability of data and materials

Not applicable

Competing interests

The authors declare that they have no competing interests.

Funding

Not applicable

Authors’ contributions

WJC, JN and SA conceptualised the study. WJC, JN and SA developed the methodology of the review. WJC drafted the manuscript. All the authors reviewed and approved the final version of the manuscript.

Acknowledgements

None

Health, AIo. Welfare. Osteoarthritis. Canberra: AIHW; 2020.
Goodman SM, Mehta B, Mirza SZ, Figgie MP, Alexiades M, Rodriguez J, et al. Patients’ perspectives of outcomes after total knee and total hip arthroplasty: a nominal group study. BMC Rheumatology. 2020;4(1):3.
Gandhi R, Davey JR, Mahomed NN. Predicting patient dissatisfaction following joint replacement surgery. J Rheumatol. 2008;35(12):2415–8.
Dowsey MM, Spelman T, Choong PF. Development of a Prognostic Nomogram for Predicting the Probability of Nonresponse to Total Knee Arthroplasty 1 Year After Surgery. J Arthroplasty. 2016;31(8):1654–60.
Singh JA, Lewallen DG. Predictors of activity limitation and dependence on walking aids after primary total hip arthroplasty. J Am Geriatr Soc. 2010;58(12):2387–93.
Maradit Kremers H, Kremers WK, Berry DJ, Lewallen DG. Patient-Reported Outcomes Can Be Used to Identify Patients at Risk for Total Knee Arthroplasty Revision and Potentially Individualize Postsurgery Follow-Up. J Arthroplasty. 2017;32(11):3304–7.
Dalury DF, Pomeroy DL, Gorab RS, Adams MJ. Why are total knee arthroplasties being revised? J Arthroplasty. 2013;28(8 Suppl):120–1.
Collins GS, Reitsma JB, Altman DG, Moons KGM. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD StatementThe TRIPOD Statement. Ann Intern Med. 2015;162(1):55–63.
Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and ElaborationThe TRIPOD Statement: Explanation and Elaboration. Ann Intern Med. 2015;162(1):W1–73.
Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS medicine. 2014;11(10).
Echouffo-Tcheugui JB, Batty GD, Kivimäki M, Kengne AP. Risk models to predict hypertension: a systematic review. PloS one. 2013;8(7).
Echouffo-Tcheugui JB, Kengne AP. Risk models to predict chronic kidney disease and its progression: a systematic review. PLoS medicine. 2012;9(11).
Souwer ET, Bastiaannet E, Steyerberg EW, Dekker J-WT, van den Bos F, Portielje JE. Risk prediction models for postoperative outcomes of colorectal cancer surgery in the older population-a systematic review. Journal of Geriatric Oncology. 2020.
Deliu N, Cottone F, Collins GS, Anota A, Efficace F. Evaluating methodological quality of Prognostic models Including Patient-reported HeAlth outcomes iN oncologY (EPIPHANY): a systematic review protocol. BMJ open. 2018;8(10):e025054.
Adie S, Harris I, Chuan A, Lewis P, Naylor JM. Selecting and optimising patients for total knee arthroplasty. Med J Aust. 2019;210(3):135–41.
Romine LB, May RG, Taylor HD, Chimento GF. Accuracy and clinical utility of a peri-operative risk calculator for total knee arthroplasty. J Arthroplasty. 2013;28(3):445–8.
Wuerz TH, Kent DM, Malchau H, Rubash HE. A nomogram to predict major complications after hip and knee arthroplasty. J Arthroplasty. 2014;29(7):1457–62.
Harris AH, Kuo AC, Bowe T, Gupta S, Nordin D, Giori NJ. Prediction Models for 30-Day Mortality and Complications After Total Knee and Hip Arthroplasties for Veteran Health Administration Patients With Osteoarthritis. J Arthroplasty. 2018;33(5):1539–45.
Oldmeadow LB, McBurney H, Robertson VJ. Predicting risk of extended inpatient rehabilitation after hip or knee arthroplasty. J Arthroplasty. 2003;18(6):775–9.
Shim J, Mclernon DJ, Hamilton D, Simpson HA, Beasley M, Macfarlane GJ. Development of a clinical risk score for pain and function following total knee arthroplasty: results from the TRIO study. Rheumatology advances in practice. 2018;2(2):rky021.
Sanchez-Santos M, Garriga C, Judge A, Batra R, Price A, Liddle A, et al. Development and validation of a clinical prediction model for patient-reported pain and function after primary total knee replacement surgery. Scientific reports. 2018;8(1):1–9.
Mu Y, Edwards JR, Horan TC, Berrios-Torres SI, Fridkin SK. Improving risk-adjusted measures of surgical site infection for the National Healthcare Safely Network. Infection Control Hospital Epidemiology. 2011;32(10):970–86.
Berbari EF, Osmon DR, Lahr B, Eckel-Passow JE, Tsaras G, Hanssen AD, et al. The Mayo prosthetic joint infection risk score: implication for surgical site infection reporting and risk stratification. Infection Control Hospital Epidemiology. 2012;33(8):774–81.
Bozic KJ, Ong K, Lau E, Berry DJ, Vail TP, Kurtz SM, et al. Estimating risk in Medicare patients with THA: an electronic risk calculator for periprosthetic joint infection and mortality. Clinical Orthopaedics Related Research®. 2013;471(2):574–83.
Kunutsor S, Whitehouse M, Blom A, Beswick A. Systematic review of risk prediction scores for surgical site infection or periprosthetic joint infection following joint arthroplasty. Epidemiology Infection. 2017;145(9):1738–49.
Mesko NW, Bachmann KR, Kovacevic D, LoGrasso ME, O’Rourke C, Froimson MI. Thirty-day readmission following total hip and knee arthroplasty–a preliminary single institution predictive model. J Arthroplast. 2014;29(8):1532–8.
Paxton EW, Inacio MC, Khatod M, Yue E, Funahashi T, Barber T. Risk calculators predict failures of knee and hip arthroplasties: findings from a large health maintenance organization. Clinical Orthopaedics Related Research®. 2015;473(12):3965–73.
Lungu E, Desmeules F, Dionne CE, Belzile ÉL, Vendittoli P-A. Prediction of poor outcomes six months following total knee arthroplasty in patients awaiting surgery. BMC Musculoskelet Disord. 2014;15(1):299.
Huber M, Kurz C, Leidl R. Predicting patient-reported outcomes following hip and knee replacement surgery using supervised machine learning. BMC Med Inform Decis Mak. 2019;19(1):3.
Pua Y-H, Poon CL-L, Seah FJ-T, Thumboo J, Clark RA, Tan M-H, et al. Predicting individual knee range of motion, knee pain, and walking limitation outcomes following total knee arthroplasty. Acta Orthop. 2019;90(2):179–86.
Van Onsem S, Van Der Straeten C, Arnout N, Deprez P, Van Damme G, Victor J. A new prediction model for patient satisfaction after total knee arthroplasty. J Arthroplast. 2016;31(12):2660–7. e1.
Khatib Y, Madan A, Naylor JM, Harris IA. Do psychological factors predict poor outcome in patients undergoing TKA? A systematic review. Clinical Orthopaedics Related Research®. 2015;473(8):2630–8.
Vincent HK, Horodyski M, Gearen P, Vlasak R, Seay AN, Conrad BP, et al. Obesity and long term functional outcomes following elective total hip replacement. J Orthop Surg Res. 2012;7(1):16.
Nanjayan SK, Swamy GN, Yellu S, Yallappa S, Abuzakuk T, Straw R. In-hospital complications following primary total hip and knee arthroplasty in octogenarian and nonagenarian patients. Journal of Orthopaedics Traumatology. 2014;15(1):29–33.
Manning DW, Edelstein AI, Alvi HM. Risk prediction tools for hip and knee arthroplasty. JAAOS-Journal of the American Academy of Orthopaedic Surgeons. 2016;24(1):19–27.
Schwartz FH, Lange J. Factors that affect outcome following total joint arthroplasty: a review of the recent literature. Curr Rev Musculoskelet Med. 2017;10(3):346–55.
Thuraisingam S, Dowsey M, Manski-Nankervis J-A, Spelman T, Choong P, Gunn J, et al. Developing prediction models for total knee replacement surgery in patients with osteoarthritis: Statistical analysis plan. Osteoarthritis Cartilage Open. 2020;2(4):100126.
Buirs LD, Van Beers LWAH, Scholtes VAB, Pastoors T, Sprague S, Poolman RW. Predictors of physical functioning after total hip arthroplasty: a systematic review. BMJ open. 2016;6(9):e010725.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews. 2015;4(1):1.
Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.
Debray TPA, Damen JAAG, Snell KIE, Ensor J, Hooft L, Reitsma JB, et al. A guide to systematic review and meta-analysis of prediction model performance. BMJ. 2017;356:i6460.
Harris K, Dawson J, Gibbons E, Lim CR, Beard DJ, Fitzpatrick R, et al. Systematic review of measurement properties of patient-reported outcome measures used in patients undergoing hip and knee arthroplasty. Patient related outcome measures. 2016;7:101.
Rolfson O, Bohm E, Franklin P, Lyman S, Denissen G, Dawson J, et al. Patient-reported outcome measures in arthroplasty registries: report of the patient-reported outcome measures working group of the International Society of Arthroplasty Registries Part II. Recommendations for selection, administration, and analysis. Acta Orthop. 2016;87(sup1):9–23.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS med. 2009;6(7):e1000097.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. Br J Surg. 2015;102(3):148–58.
Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration. Ann Intern Med. 2015;162(1):W1–73.
Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, et al. Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures. Epidemiology. 2010;21(1).
Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann Intern Med. 2019;170(1):W1–33.
Core Team R. R: A language and environment for statistical computing. Vienna: R Foundation for statistical computing; 2013.
Snell KI, Hua H, Debray TP, Ensor J, Look MP, Moons KG, et al. Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model. J Clin Epidemiol. 2016;69:40–50.
Huedo-Medina TB, Sánchez-Meca J, Marín-Martínez F, Botella J. Assessing heterogeneity in meta-analysis: Q statistic or I². index? Psychol Methods. 2006;11(2):193–206.
Macaskill P. Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. J Clin Epidemiol. 2004;57(9):925–32.
Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol. 2005;58(9):882–93.
Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34.
Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.
Song F, Khan KS, Dinnes J, Sutton AJ. Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002;31(1):88–95.
Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.
Iorio A, Spencer FA, Falavigna M, Alba C, Lang E, Burnand B, et al. Use of GRADE for assessment of evidence about prognosis: rating confidence in estimates of event rates in broad categories of patients. BMJ: British Medical Journal. 2015;350:h870.

SupplementaryFiles.docx

Download PDF

Editorial decision: Minor revision
12 May, 2022
Reviews received at journal
25 Apr, 2022
Reviewers invited by journal
09 Apr, 2022
Editor assigned by journal
04 Apr, 2022
Submission checks completed at journal
17 Sep, 2021
First submitted to journal
13 Sep, 2021

You are reading this latest preprint version

Evaluating Methodological Quality of Prognostic Prediction Models on Patient Reported Outcome Measurements after Total Hip Replacement and Total Knee Replacement Surgery: a systematic review protocol

Status:

Version 1

Abstract

Background

Methods

Discussion

Systematic review registration:

Background

Methods/design

Eligibility criteria

Types of participants

Types of studies

Search strategy

Study selection

Data extraction

Quantitative data extraction and pre-processing

Study quality and risk of bias

Data synthesis

Narrative review

Meta-analysis

Subgroup and sensitivity analysis

Meta-biases

Reporting and dissemination

Discussion

Abbreviations

Declarations

References

Supplementary Files

Status:

Version 1