Study Design
The study aimed to systematically review and analyze the cost-utility and budget impact of telehealth compared to traditional in-person healthcare. This systematic review and meta-analysis were registered with the International Prospective Register of Systematic Reviews (PROSPERO). The methodology adhered strictly to the guidelines outlined by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA-2020) checklist, ensuring a rigorous and standardized approach.
Search Strategy
A comprehensive search strategy was meticulously designed to cover a wide range of studies focused on the economic aspects of telehealth. The search encompassed several key databases including PubMed, Scopus, CINAHL, and the OVID Library, spanning from their inception to the current date. The search terms used were a combination of keywords and Medical Subject Headings (MeSH) terms related to "telehealth," "cost-utility," "economic outcomes," "QALY" (Quality-Adjusted Life Year), "Incremental Cost-Effectiveness Ratio" (ICER), "cost-effectiveness," "cost-benefit," "cost-analysis," and "economic evaluation."
In addition to the database search, the reference lists of included studies and relevant systematic reviews were manually examined to identify further studies. Grey literature sources, such as conference proceedings, thesis repositories, and relevant organizational websites, were explored to capture unpublished studies and reports. To ensure no significant studies were missed, manual searches of reference lists from included studies and relevant reviews were conducted. Moreover, search alerts were set up in the databases to capture any new publications throughout the review process, ensuring that the review remained current.
Study Selection
The selection of studies was conducted in two rigorous phases to enforce eligibility criteria. Initially, two independent reviewers screened the titles and abstracts of the identified records for relevance based on predefined inclusion and exclusion criteria. Records deemed potentially relevant were then moved to the next phase. In the second phase, the full texts of these potentially relevant studies were independently assessed by the same reviewers to determine their final inclusion in the review. Any disagreements that arose during the screening process were resolved by a third reviewer, ensuring a consensus on the studies selected for inclusion. The study selection process was documented using a PRISMA flow diagram, which detailed the number of records identified, screened, assessed for eligibility, and included in the review, along with reasons for exclusions at the full-text stage.
Eligibility Criteria
The eligibility criteria focused on studies that directly compared telehealth to traditional in-person healthcare methods and reported on economic outcomes such as cost savings, cost-utility ratio, ICER, and QALY. The review included only studies published in English in peer-reviewed journals, excluding those that lacked specific economic data or detailed economic evaluations, and those focusing on telemedicine outside the scope of healthcare services. Only original articles on economic analysis were considered, ensuring the inclusion of high-quality, relevant studies.
Data Extraction
The data extraction process was meticulously executed using a detailed and standardized form to ensure the comprehensive collection of pertinent information from each included study. The form was structured to capture various key elements crucial for the review's objectives. Study identifiers were recorded, encompassing the title, DOI, author(s), publication year, and geographical location, facilitating easy reference and categorization of studies. Detailed information on the study design, study population demographics, clinical conditions, and sample size was documented to provide insight into the context and generalizability of the findings.
Economic evaluation metrics were meticulously logged, including the currency reported in the study, conversion to USD (2023) for standardization, types of costs measured (direct and indirect), utility outcomes such as QALYs, cost-utility ratios, and cost-effectiveness outcomes like ICERs, essential for assessing the economic impact of telehealth interventions. Intervention details were comprehensively described, outlining the telehealth intervention and the comparison group, including modality, duration, and intensity, facilitating an understanding of the specific aspects evaluated. Outcome measures were meticulously recorded, encompassing primary and secondary outcomes, types of costs, utilities, and cost-effectiveness outcomes, along with any additional outcomes relevant to the review's objectives.
Economic data were meticulously extracted, including Incremental Cost-Effectiveness Ratios (ICER) with standard deviation (SD), mean, and median; incremental cost-utility ratio (ICUR) with mean and median; interquartile range; total cost for intervention and control groups; average costs for both groups with SD, mean, and median; and a breakdown of direct and indirect costs with SD, mean, and median. This facilitated a comprehensive economic analysis. Health outcome data, including QALYs and Disability-Adjusted Life Years (DALYs) for both intervention and control groups were documented to evaluate the health impact of the interventions.
Quality Assessment
The quality of the included studies was assessed using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist, which is specifically designed for evaluating the reporting quality of economic evaluations in healthcare. Each study was evaluated against the CHEERS checklist items to ensure comprehensive coverage of essential aspects such as study objectives, economic importance, choice of comparators, time horizon, choice of health outcomes, measurement of effectiveness, estimation of resources and costs, currency valuation, choice of model for data analysis, analytical methods, and characterizing uncertainty.
Two independent reviewers conducted the quality assessment to minimize bias and ensure reliability in the evaluation process. Any discrepancies in the quality assessment between the reviewers were resolved through discussion or consultation with a third reviewer. The findings from the quality assessment were synthesized to provide an overview of the reporting quality of economic evaluations in the included studies, highlighting strengths and potential areas for improvement.
Statistical Analysis
The statistical analysis plan was designed to synthesize the data extracted from the included studies and assess the cost-utility of telehealth interventions. The analysis was conducted using the ggplot2 library within the R software to create a visually intuitive scatter plot.
For the Cost-Utility Scatter Plot, data spanning from 2010 to 2023 regarding Incremental Cost-Effectiveness Ratios (ICERs) and Quality-Adjusted Life Years (QALYs) from various healthcare interventions were compiled and processed. The 'Year' of each intervention was categorized to facilitate temporal analysis, and ICER values were standardized. A scatter plot was then generated using ggplot2 in R, plotting ICER values against QALY gains, with data points color-coded by year. This visual representation allowed for the analysis of trends and patterns in the cost-effectiveness of telehealth interventions over time.
In the Probability Sensitivity Analysis (PSA), a Monte Carlo simulation was employed to address uncertainties in cost and QALY estimates. Triangular distributions, defined by minimum, most likely, and maximum values, were used for both costs and QALYs. For each of 10,000 iterations, a simulated ICER value was calculated by sampling from these distributions. The resulting ICER values were summarized to produce a density plot, illustrating the distribution of potential cost-effectiveness outcomes and highlighting the most probable ICER values alongside the range and skewness indicative of less cost-effective scenarios.
The Budget Impact Analysis involved comparing the average and total costs between the control and intervention groups. Bar charts were created to graphically represent these comparisons, providing a clear visual indication of the economic impact of telehealth interventions.