Survey Questionnaire Development and Pretesting
We consulted the existing literature on the application of CDSS for VTE risk assessment and prevention(VTE-CDSS), and integrate it with the current practical application situation in China. Collaborate with domestic experts in medical informatics (particularly those with research and practical experience in CDSS and AI), clinical specialists, healthcare management personnel, and information professionals to collectively develop the initial questionnaire.
Select ten representative hospitals from central, eastern, western, and northeastern regions of China that include large tertiary hospitals, medium-sized tertiary hospitals, as well as grassroots secondary hospitals. After conducting a pilot survey on a small scale, revise and enhance the survey questionnaire based on feedback received to finalize the questionnaire.
Contents of Survey Questionnaire
The contents of the questionnaire are mainly application status and future implementation suggestions for VTE-CDSS, which are composed of the following five parts (see supplemental table for details):
1. Covering letter;
2. Basic information of the surveyed hospitals: including the name, level, category, form of ownership, location, etc.;
3. Application and implementation of VTE-CDSS: including the development of VTE risk assessment and prevention work in hospitals, the specific application and implementation details of VTE-CDSS, utilization effectiveness, implementation barriers, and areas for optimization and resolution;
4. Scale of the surveyed hospitals: including the number of beds, the number of doctors and the number of nurses;
5. Admission capacity of the surveyed hospitals: annual outpatient volume, annual discharge number, annual operation volume;
6. Basic information of the respondents: including age, gender, title, education, work department, etc.
Survey Deployment
From September to December 2023, a network survey (electronic questionnaire) was adopted and forwarded by the National VTE Prevention Program Office of China to each provincial VTE prevention regional alliance, and the investigation purpose, survey objects and survey time period were explained in detail. Then, the provincial VTE prevention regional alliance forwarded the local hospitals, and each hospital assigned a responsible person who was familiar with the VTE-CDSS of the hospital to fill in the questionnaire.
Additionally, the National VTE Prevention Program Office of China, in collaboration with provincial VTE prevention regional alliances, sent at least 5 reminders through WeChat group announcements, emails, mobile phone text messages, and other communication channels to enhance the response rate of questionnaires.
Survey Sample Size
According to《Statistical Bulletin on the Development of Health Undertakings in China in 2022》[17]issued by the National Health Commission of the People's Republic of China, as of October 2023, there are a total of 14,668 hospitals in China, including 3,523 tertiary hospitals and 11,145 secondary hospitals. That is, the total N is 14,668.
Based on the sample size calculation formula: n=u2α/2π(1-π)/δ2, with a 95% confidence interval and α set at 0.05, u=1.96; According to previous literature, the proportion of hospitals in China implementing CDSS is approximately 15%, with an overall rate of π=0.15. If the allowable error is set at 0.03, then δ=0.03. The calculated sample size n is 544.
The n/N ratio is below 0.05, which indicates that no correction to the sample size is necessary; therefore, the survey should include a minimum of 544 hospitals.
Survey Quality Control Measures
In the electronic questionnaire, we preseted a logical correlation between the questions and the specified mandatory responses. Prior to formal submission of the questionnaire, an automatic check for logical coherence and comprehensiveness was conducted. Before submission, respondents had the opportunity to review or modify their completed content.
We cleaned and organized the collected survey questionnaires, and removed 13 test questionnaires. Considering the IP address and hospital name, 11 hospitals were screened for duplicate questionnaires, and after cleaning, only the most authoritative one was retained as a valid questionnaire for each hospital. The cleaning rules are as follows:
1. Delete those with shorter filling times, such as deleting those that are completed within 30 seconds and retaining those that are completed within 500 seconds;
2. Completely identical, only keep one copy;
3. If there is a significant difference in the contents of the duplicate answer sheet, confirm to retain one copy after contacting the respondents.
Finally, a total of 611 questionnaires were collected in this survey. After excluding 13 test questionnaires and 11 repeated questionnaires, 587 effective questionnaires were obtained, with an effective rate of 96.07%.
Calculations and Statistical Analysis
Based on the survey results, we have summarized and statistically analyzed the demographic characteristics of the respondents (age, gender, professional title, education level, work department) and the basic information of the responding hospitals (economic region, grade, category and ownership); we calculated the proportion of responding hospitals performing VTE risk assessment and prevention, and the proportion of VTE-CDSS deployed in responding hospitals; we analyzed the functions and implementation details of VTE-CDSS in clinical practice; we also described the achievements, existing problems and obstacles of VTE-CDSS, and what needs to be further optimized.
We used a Chi-square test to compare whether there were differences in hospital background variables (economic region, hospital grade and category, hospital scale, admission capacity, etc.) between the two groups of VTE-CDSS with or without AI capabilities. Wilcoxon rank sum test was used to compare whether the two groups of VTE-CDSS with or without AI function had differences in implementation details and system effectiveness. Statistical significance was determined as p <0.05. Statistical calculation was performed by SPSS20.0 (IBM Corp. Released 2011, IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.).