A reliable and up-to-date source of health information is essential, as it can significantly influence the health of users and their ability to make informed decisions about their treatment and medication. YouTube was originally introduced as a platform for entertainment and not education. Since then, it has become an indispensable educational resource for both the general public and specialists alike. As an example, different studies suggest that surgical videos on YouTube are currently the preferred source of education among trainees as they are free, portable, reusable, and accessible via mobile phones 6,49. Accordingly, researchers expressed early concerns about the quality of health-related content on YouTube and began investigating the issue as early as 2007 50. Since then, the number of publications that evaluate the quality of health-related content has steadily increased.
As shown in Fig. 2, our study included papers that evaluated YouTube's health-related information in almost all specialties. It is important to keep in mind that within each of the topics in Fig. 2, the videos covered a wide range of pathological conditions and health information (e.g., the orthopedics category may contain information on inflammatory conditions, cancer, or surgical procedures). Some specialties were covered more than others potentially because of their frequency, the difficulty of understanding the disease's nature, or because researchers in those specialties are more engaged in research on the subject. In general, searches for health information about chronic diseases tend to be higher 25.
Different scores were applied to the assessment of video quality (Fig. 3). The scores ranged from standardized scores, such as JAMA and GQS, to customized scores based on specialty guidelines and recommendations of boards, societies, and organizations. Because it was difficult to consider specific scores as they are specialty-dependent and are not unified or standardized, we focused on general scores. Even so, it has been reported that the use of both general and specific scores together to assess video quality led to consistent results 51. All of the scores indicated that YouTube's health information videos were of average quality (Fig. 4). However, the use of the word "average" implies a serious problem, since it means obtaining information that is likely to have a substantial impact on health even if it is equally correct or incorrect.
We developed a quality clustering for the video based on the terms used in various papers to describe the quality categories. According to our analysis, YouTube has poor to average quality as a source of health information. In approximately 19% of papers searching for "excellent" quality videos, only 16% found videos of excellent quality. In Generally, vidoes relating to complementary and alternative medicine (CAM) were of poor quality 52,53, while papers addressing specific or specialized audiences, such as trainees and residents, were of higher quality 54,55.
The authors of several papers also assessed whether any bias existed in the making of the content (Fig. 6). Over half of them found a commercial bias in the content, mainly in information related to plastic surgery or unapproved therapies. As an example, Adeeb and colleagues (2019) study of 13 YouTube videos on "Facelift" found that 12 were created by individuals having a private practice, which is mentioned in video 49. In our analysis, more than a quarter of the videos appeared to be against a particular treatment, health procedure, or health information. Only 32% of the videos were neutral, showing that YouTube videos are significantly influenced by maker bias.
Most of the studies that assessed the relationship between quality and YouTube metrics (e.g., views, likes, dislikes, shares) found no or negative correlations, indicating that YouTube metrics can be misleading indicators when it comes to healthcare video quality. Furthermore, this also demonstrates that adding more videos produced by professionals and health institutions will not have a significant effect without taking other measures.
As a result of our analysis, we discovered that the most frequent recommendations to improve the quality included encouraging experts and professional institutions to guide users or upload videos to YouTube. Nevertheless, YouTube is an informal educational resource which is based on different factors, such as self-motivation and general learning. In this sense, making video content will not be easy for institutions because of the limited time available to physicians and professionals. Furthermore, studies have revealed that videos uploaded by professional institutions are not necessarily more popular. According to Desai and colleague (2013), the public does not engage with videos uploaded by credible health organizations because they tend to have extensive educational content, making them overly appropriate for the public 56.
Only 13% of papers recommended that YouTube not be used for health-related purposes. As an impractical recommendation, this recommendation ignores the present and potential benefits of YouTube in health education 6,57,58 as well as the economic implications of this recommendation. A recommendation of this kind also ignores the fact that > 3.02 billion people are expected to use social media platforms such as YouTube to seek health information by 2021 59, making it nearly impossible to ignore the educational importance of these platforms.
Nearly 85% recommended improving the content – through peer review for example - but did not advise caution when using YouTube as a source of information. However, these recommendations are not specific enough, as the authors did not provide any specific steps to perform this. Moreover, this will be a complex task due to the large number of videos and the financial and technical requirements. On the other hand, about 15% of papers urged users to use caution when seeking information on YouTube. Similarly, this was unclear because no specific criteria were described for selecting and obtaining the correct information.
Collectively, we believe that the most practical step would be to create a ranking and filtering algorithm for YouTube health education videos that takes into consideration all recommendations, such as peer review and expert endorsement. The filter system should include additional parameters associated with quality. Aside from the uploading source, these criteria may also include the video duration 60, presence of medical terminology (e.g., arthrocentesis versus aspiration) 54, and presence of links to specialized resources in the title.. Using this filtering system, endorsed videos will be brought up and most of the recommendations made by reviewers (Fig. 8) will be taken into consideration. While a system of this type may take some time to develop, other measures can be taken, such as:
-
Watching videos from more than one resource on the same topic;
-
Keep in mind the bias of the author when viewing their videos;
-
The presence or absence of the resources on which the videos are based;
-
To encourage healthcare institutions to periodically review YouTube for the most popular videos on health-related topics and make public announcements that specifically address misinformation.