The results of this study can be summarized as follows. First, significant differences between physicians and nurses in hand hygiene compliance were found by direct observation (both overall and for all WHO-5 indications except “after patient contact”) and were in favor of nurses, while no such differences were found for self-reported compliance (except for “after body fluid exposure” in favor of physicians). Second, overestimation in terms of the numerical difference between self-reported and observed compliance correlated negatively with observed compliance levels across the WHO-5 indications. Third, and regarding the main hypothesis of this paper, self-reported overall compliance was higher when compliance was assessed using a single item than when it was assessed using the relative frequency-weighted index of the WHO-5 items among physicians. This was not the case among nurses. In explorative analysis among physicians, this effect was confined to surgeons (vs. anesthesiologists) and specifically to orthopedic or trauma surgeons (vs. physicians who perform general/visceral surgery).
Before the results are discussed further, the limitations of this study must be considered. First, the questionnaire survey response rate was 30% overall. This is lower than the global average response rate of 53% reported for surgical doctors [34] (while the rate for Germany is depicted only graphically in that review, it is reported as close to the global mean). However, neither (a) indirect approaches such as that used in the present survey (i.e., distributing a written questionnaire from the WACH team to the survey respondents via the in-house IPC-teams) nor (b) anesthesiologists or nurses were reviewed by Meyer et al. (who distinguished in-person, postal, e-mail, and web-based surveys, and focused on surgeons). It is probable that the lack of monetary or similar incentives, lack of personalization of the questionnaire, and the considerable length of the questionnaire [35] affected the response rate in the WACH-survey. Additionally, the response rate of 73% among surgical doctors in orthopedics in the WACH questionnaire pretest [36] was achieved in a university hospital clinic – a context in which individual health care workers may have a higher affinity for research, and in which there was extraordinary support for the survey by the clinic’s medical director. However, while efforts should be made to increase response rates in future studies of self-overestimation of compliance, Meyer et al. also reported a decreasing trend of response rates for surgical doctors [34], and the response rate in the present survey at least falls within one standard deviation of the average rate reported in 2019.
Second, while all self-reported compliance rates were assessed prior to the start of the COVID-19 pandemic, 21% of the hand hygiene opportunities were observed after its onset in March to July 2020. This is relevant because hand hygiene compliance has been reported to have increased among both physicians and nurses during the COVID-19 pandemic [37]. Indeed, when opportunities observed after the onset of the pandemic are omitted, the compliance rates observed in this study decrease to 58.6% (95%-CI: 56.4–60.7%) and 61.1% (57.1–64.9%) for physicians and nurses, respectively. However, this in fact increases the difference between the self-reported and the observed compliance rates, while at the same time, the correlations of the WHO-5-specific differences did not change (r = .86, p = 0.001 overall, and .86, p = 0.064, and .87, p = 0.058 for physicians and nurses, respectively). Thus, the key hypothesis of this study is largely unaffected by the effects of the COVID-19 pandemic. Results when observed compliance is restricted to opportunities from the trial’s baseline assessments also speaks for this assertion (for preliminary trial results, see [38]).
Third, the magnitude of most of the significant differences and associations was small. For instance, the eta-squared statistic for the focal paired samples t-test of the two self-reported overall compliance assessments among physicians was 0.049, a value that falls within the range that is considered small [39] (in the explorative analysis of orthopedic/trauma surgeons, it was considerably larger, with an eta² of 0.208). At the same time, the comparisons between the self-reported and the observed compliance rates were quite restricted in methodical terms due to the differences in the data sources, i.e., with individuals as the unit of observations in the former case and with hand hygiene opportunities as the unit of observations in the latter case. Aside from some early studies in which there was obviously an opportunity to link questionnaires with hand hygiene observations at the level of individuals [40–42], the absence of self-reports and observational data from the same sample of health care workers has become a common problem (probably due to data and/or employment protection considerations and regulations). In any case, effect size measures are not readily available in such cases, despite the existence of numerically large differences. All told, analyses in which more determinants of hand hygiene compliance (both in terms of self-reported and observed assessments) are used are warranted to increase explained variability.
Fourth, the relative frequencies of the WHO-5 indications used to calculate the WHO-5-based overall self-reported compliance rate were determined based on the information not of a systematic, but a systematized review (see “Supplementary Material” document). This type of review, while compatible with the PRISMA statement [31], includes some but not all elements of a systematic review (e.g. comprehensive searching and tabular synthesis), and uses only one reviewer within, e.g., a doctoral student assignment [28]. Additionally, it remains an issue whether even valid average relative frequencies determined from a state-of-the-art review are the best estimate for the WHO-5 distribution in a given context and/or in a given sample of health care workers. While it can be noted that the present results did not change considerably when the WHO-5 proportions biased by study size were utilized (see Table A1, Row “Total” in the “Supplementary Material” document), future research should also assess self-reported relative frequencies of the WHO-5 indications, i.e., individually perceived distributions in an attempt to further clarify the psychology of hand hygiene overestimation.
Fifth, for practical and managerial reasons within the WACH project, the directly observed compliance rates used for comparison purposes were determined only during ward rounds. This may to some extent compromise comparisons with the self-reports because the latter were elicited without any confinement to particular workflows or settings. Additionally, this was also the reason we used the relative frequencies of the WHO-5 indications from the systematized review rather than from the observed compliance data collected in WACH, i.e., so that the distribution of the opportunities across the indications would be based on a broader and more representative database (it can be noted that the present results did not change considerably when the WACH-data were utilized). However, as the test of our main hypothesis was not dependent on the directly observed data, we opted to use the relative frequencies from the systematized review as the basis for obtaining the compliance estimates.
Finally, this study analyzed overestimation but not overplacement (i.e., exaggerated beliefs that one is better than others) or overprecision (i.e., excessive certainty that one’s beliefs are accurate) as the other two “faces of overconfidence” [1]. These three forms of overconfidence are interrelated but manifest under different conditions, are caused by different factors, and have different consequences. Thus, no claim is made that rationales analogous to those pursued in the present study apply to overplacement (the association of overplacement with task difficulty is, in any case, opposite to that of overestimation) and overprecision. In contrast, it is maintained that for each of the three overconfidence facets in-depth analysis is worthwhile, and at the same time advocates that studies in which all three facets are considered simultaneously are desirable.
With these limitations in mind, it seems safe to say that the present study is the first to analyze the role of item difficulty in the overestimation of hand hygiene compliance among health care professionals, in this case physicians and nurses in the surgical context. Besides comparably larger overestimation, higher self-reported overall compliance based on the single-item measure as opposed to the WHO-5 items (this being our main hypothesis derived from overconfidence theory) was found in physicians. While this is consistent with the commonly lower compliance of physicians compared with that of nurses [16, 20–23], it is psychologically even more intriguing that this finding fits with evidence that physicians judge their hand hygiene guideline knowledge less favorably than do nurses [43]. Specifically, “…as participants less skilled in a task can show even greater overestimation than their peers, perhaps due to a lack of awareness regarding what they do and do not know…” [1, p. 3), it is plausible at least that not only motivational, but also cognitive factors play a role in this context. In fact, a recent study showed that (over)confidence did not correlate with social desirability, but rather represented a knowledge factor [44]. While that study involved university students in different disciplines rather than health care workers, it does support the importance of further research to elucidate whether physicians’ overestimation of their hand hygiene is truly a question of motivated social desirability and impression management, or not, more simply, an indication that they may not be aware of what they do in this regard. The fact that explorative analyses revealed that the contrast between the single-item-based results and the WHO-5-based results was confined to orthopedic/trauma surgeons is consistent with earlier research [33], but further scrutiny regarding differences related to physicians’ specialties is needed.
At the same time, as found in our comparison of self-reported and observed compliance, overestimation of hand hygiene also occurs among nurses. Even the negative correlation between observed compliance levels (as a proxy for task difficulty) and the degree of overestimation across the WHO-5 among nurse was comparable to that among physicians. However, the contrast between the single-item and the WHO-5-based self-reported overall compliance measurements did not show here. In fact, the contrast was reversed: for nurses, the results show numerically higher self-reported compliance based on the WHO-5 index, a finding which is intriguing. It is possible that nurses use their higher awareness of hand hygiene guidelines to (implicitly) calibrate their response to the single item by a “discount” based on a notion of some kind of “empirical realism” regarding their compliance.