Distribution pattern of retrieved articles
A total of 13,529 articles on ‘medical education’, published between 1989 and 2018 by 43,733 authors, were retrieved from WosCC. Figure 1 indicates that during this period the number of annual publications steadily increased, and have done so dramatically since 2014. Since 2000, the average citation rate has demonstrated a reverse trend because of the cumulative citation effect, that articles published earlier might have a higher citation throughtout the following years. Table 1 details several summary statistical indices for these publications during the study period, including citations, authors, keywords, and collaboration status.
Table 1. Summary of bibliometric data on medical education (1989–2018)
Description
|
Results
|
Documents
|
13,529
|
Sources (Journals, Books, etc.)
|
1,885
|
Keywords Plus (ID)
|
8,795
|
Author's Keywords (DE)
|
13,979
|
Period
|
1989–2018
|
Average citations per documents
|
13.87
|
Authors
|
43,733
|
Author Appearances
|
62,015
|
Authors of single-authored documents
|
762
|
Authors of multi-authored documents
|
42,971
|
Single-authored documents
|
823
|
Documents per Author
|
0.309
|
Authors per Document
|
3.23
|
Co-Authors per Documents
|
4.58
|
Collaboration Index
|
3.38
|
Geomap visualization of medical education research
Figure 2 presents a geomap visualization of the distribution of publications by country. As the legend indicates, the more literature published in a particular count, the more intense the colour red on the map. Notably, this map makes clear that field publications mainly in the US, the UK, Canada, Australia, Germany, Netherlands, Iran, China, and India. Figure 3 displays the ten countries with the most publications during last 30 years along with the average citation curve of each article. Notably, the US published the most articles (14,737; 50.21% of publications by the top ten) and the UK has the highest article citation rate (21.74), followed by the Netherlands (19.71), Canada (18.64), and the US (16.99). Iran (3.25) and India (3.20), ranked 7th and 9th in publication frequency respectively and demonstrated relatively lower citation rates.
The distribution of research institutions and their collaboration
Figure 4 reveals that the University of Toronto published most frequently (529 papers, accounting for 3.91% of all publications in the field), followed by the University of California San Francisco (402, 2.97%), the University of Michigan (364, 2.69%), Maastricht University( 342, 2.52%), and Harvard University (329, 2.43%).
Co-authorship analysis reveals scientific communications between institutions and helps identify influential institutions. To analyse co-authorship among our academic institutions, we selected for collaborative organizations with at least five publications in the field: 943 out of 7854 institutions qualified. Figure 5 details that this global scientific collaboration network includes twenty clusters (in different colours) that centre around the top five most prolific institutions shown in Figure 4 as follows: light green for the University of Toronto, light grey for the University of California San Francisco, green for the University of Michigan, light pink for Maastricht University, and light blue for Harvard University. Link strengths were 111, 147, 126, 110, and 168, respectively. The highest link strengths are between Harvard University and Beth Israel Deaconess Medical Center, Brigham and Women’s Hospital, and Massachusetts General Hospital at 36, 33, and 31, respectively. These are thus most active collaborating pairs. Meanwhile, the most active collaborator with the University of Toronto is McMaster University (link strength=29). The University of California San Francisco collaborated the most with Stanford University (link strength=17). Maastricht University most significantly collaborated with Vrije Universiteit Amsterdam (link strength=18). Each of these prolific centres engaged in co-authorship except Maastricht University and Harvard University. Figure 6 indicates that the worldwide collaboration evidenced in Figure 5 was common over the last three decades.
In this illustration, each node represents a research institution, and the size of each node indicates the number of its scientific publications on medical education between 1989 and 2018. The closer two nodes, the stronger their relation. Meanwhile, the larger a node, the more active the institution. Next, we turn to the total strength of co-authorship links.
Top twenty journals related to medical education
All of the 13,529 publications published across 1,885 journals, 1,547 journals (or 81%) did not publish more than five papers related to medical education during the past 30 years (2754 publications in total). Meanwhile, approximately 1550 (or 82.07%) of journals published only 2,753 papers (or 20.35%). We extracted the top twenty prolific journals, which had published 5,764 papers or 42.6% of publications in our sample. To be sure, most of our journals did not specialize in medical education. We focused on the top twenty journals and analysed their scientific outputs and citation rate. Table 2 reveals that these journals specialize in medical education, and that the top three journals are Medical Education (1240, 21.51%), BMC Medical Education (897, 15.56%), and Medical Teacher (812,14.09%). The papers published in these three journals made up 51.16% of all of the publications in the top 20 journals, which situates them as main source for medical education research.
Table 2. Top twenty most prolific journals with medical education-related papers (1989–2018)
Rank
|
Journals
|
Publication
number (n)
|
Percentage
of sample
|
Cumulative
percentage
|
1
|
MEDICAL EDUCATION
|
1,240
|
21.51
|
21.51
|
2
|
BMC MEDICAL EDUCATION
|
897
|
15.56
|
37.07
|
3
|
MEDICAL TEACHER
|
812
|
14.09
|
51.16
|
4
|
ACADEMIC MEDICINE
|
716
|
12.42
|
63.58
|
5
|
TEACHING AND LEARNING IN MEDICINE
|
235
|
4.08
|
67.66
|
6
|
FAMILY MEDICINE
|
178
|
3.09
|
70.75
|
7
|
AMERICAN JOURNAL OF SURGERY
|
163
|
2.83
|
73.58
|
8
|
JOURNAL OF SURGICAL EDUCATION
|
155
|
2.69
|
76.27
|
9
|
ACADEMIC PSYCHIATRY
|
151
|
2.62
|
78.89
|
10
|
PATIENT EDUCATION AND COUNSELING
|
137
|
2.38
|
81.26
|
11
|
ANATOMICAL SCIENCES EDUCATION
|
133
|
2.31
|
83.57
|
12
|
MEDICAL EDUCATION ONLINE
|
131
|
2.27
|
85.84
|
13
|
ACADEMIC RADIOLOGY
|
116
|
2.01
|
87.86
|
14
|
ADVANCES IN MEDICAL EDUCATION AND PRACTICE
|
110
|
1.91
|
89.76
|
15
|
NURSE EDUCATION TODAY
|
110
|
1.91
|
91.67
|
16
|
PLOS ONE
|
102
|
1.77
|
93.44
|
17
|
ADVANCES IN HEALTH SCIENCES EDUCATION
|
98
|
1.70
|
95.14
|
18
|
EUROPEAN JOURNAL OF DENTAL EDUCATION
|
97
|
1.68
|
96.83
|
19
|
JOURNAL OF SURGICAL RESEARCH
|
94
|
1.63
|
98.46
|
20
|
ACADEMIC EMERGENCY MEDICINE
|
89
|
1.54
|
100.00
|
The H index, which stands for ‘high citations’, is defined as the max value of h: each of the h publications of a journal or an author been cited at least h times to measure both the productivity and citation rate of journals or scientists. Figure 7 details the H indices of the top twenty journals.
Top ten most cited papers on medical education
To identify the most influential papers on medical education, we analysed the top ten most frequently cited publications: nine were published during the sub-period of 1999–2008, and only one was published between 2009–2018; no highly-cited papers were published between 1989–1998. Three of the top ten most cited papers were published in Academic Medicine and Medical Education, two in JAMA, one in Lancet, and one in the New England Journal of Medicine. The article with the highest total citation (TC) is Parker’s 1999 piece ‘Health literacy: report of the council on scientific affairs’, which has been cited 793 times, an average of 39.65 times per year. This article argues for the improvement of the physician-patient communications skills of medical students and clinicians to bridge the inadequate medical literacy of patients to facilitate, better medical outcomes. The runner up is Ruiz’s 2006 article, ‘The impact of e-learning in medical education’, which has been cited 733 times and boasts the highest average citation rate at 56.36 per year. In the article, Ruiz concludes that e-learning technologies can revolutionize the field, in part by situating the educator as a facilitator of learning processes24. Third is Charon’s 2001 ‘Narrative medicine – a model for empathy, reflection, profession, and trust’, which emphasizes the importance of medical narrative competence for effective medical practice25. Other notable papers argue that: assessments of medical education must be based on solid scientific evidence (Downing SM26), future clinicians must learn empathy (Hojat M27), problem-based learning curricula is effective (Colliver JA28), students should be assessed for clinical confidence (Wass V29), professionalism should play a central role in medical education and practice (Papadakis MA30), and clinicians should possess strong reasoning skills (Norman G31 and Eva KW32). Table 3 details these results.
Table 3. The top ten most cited papers in the field of medical education
Rank
|
DOI
|
First author
|
Title
|
Journal
|
Institution
|
Year
|
Total Citations(TC)
|
TC per Year
|
1
|
10.1001/jama.281.6.552
|
PARKER RM
|
HEALTH LITERACY - REPORT OF THE COUNCIL ON SCIENTIFIC AFFAIRS
|
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION
|
COUNCIL SCI AFFAIRS
|
1999
|
793
|
39.65
|
2
|
10.1097/00001888-200603000-00002
|
RUIZ JG
|
THE IMPACT OF E-LEARNING IN MEDICAL EDUCATION
|
ACADEMIC MEDICINE
|
VA MED CTR
|
2006
|
733
|
56.3846
|
3
|
10.1001/JAMA.286.15.1897
|
CHARON R
|
NARRATIVE MEDICINE - A MODEL FOR EMPATHY, REFLECTION, PROFESSION, AND TRUST
|
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION
|
COLUMBIA UNIV
|
2001
|
678
|
37.6667
|
4
|
10.1046/J.1365-2923.2003.01594.X
|
DOWNING SM
|
VALIDITY: ON THE MEANINGFUL INTERPRETATION OF ASSESSMENT DATA
|
MEDICAL EDUCATION
|
UNIV ILLINOIS
|
2003
|
583
|
36.4375
|
5
|
10.1097/ACM.0B013E3181B17E55
|
HOJAT M
|
THE DEVIL IS IN THE THIRD YEAR: A LONGITUDINAL STUDY OF EROSION OF EMPATHY IN MEDICAL SCHOOL
|
ACADEMIC MEDICINE
|
THOMAS JEFFERSON UNIV
|
2009
|
519
|
51.9
|
6
|
10.1097/00001888-200003000-00017
|
COLLIVER JA
|
EFFECTIVENESS OF PROBLEM-BASED LEARNING CURRICULA: RESEARCH AND THEORY
|
ACADEMIC MEDICINE
|
SO ILLINOIS UNIV
|
2000
|
511
|
26.8947
|
7
|
10.1016/S0140-6736(00)04221-5
|
WASS V
|
ASSESSMENT OF CLINICAL COMPETENCE
|
LANCET
|
GUYS KINGS AND ST THOMAS SCH MED
|
2001
|
479
|
26.6111
|
8
|
10.1056/NEJMSA052596
|
PAPADAKIS MA
|
DISCIPLINARY ACTION BY MEDICAL BOARDS AND PRIOR BEHAVIOR IN MEDICAL SCHOOL
|
NEW ENGLAND JOURNAL OF MEDICINE
|
UNIV CALIF SAN FRANCISCO
|
2005
|
407
|
29.0714
|
9
|
10.1111/J.1365-2929.2005.02127.X
|
NORMAN G
|
RESEARCH IN CLINICAL REASONING: PAST HISTORY AND CURRENT TRENDS
|
MEDICAL EDUCATION
|
MCMASTER UNIV
|
2005
|
406
|
29
|
10
|
10.1111/J.1365-2929.2004.01972.X
|
EVA KW
|
WHAT EVERY TEACHER NEEDS TO KNOW ABOUT CLINICAL REASONING
|
MEDICAL EDUCATION
|
MCMASTER UNIV
|
2005
|
361
|
25.7857
|
Keywords and trends
We visualized the top ten keywords (Figure 8) and strategic diagrams for each sub-period (Figure 9).
Figure 8 reveals the top keywords across the sub-periods. The top three are ‘education’, ‘students’, and ‘medical students’. In addition to these three words, five high-frequency keywords appear on all three sub-period lists—‘medical education’, ‘care’, ‘curriculum’, ‘school’, and ‘skills’—but differ in rank across sub-periods. Meanwhile, ‘competence’ and ‘physicians’ appear only in the first sub-period, while ‘performance’ and ‘attitude’ appear in both the other two sub-periods.
A strategic diagram was used to analyse the major themes in the field of medical education during each sub-period. The diagram was generated by SciMAT involves four quadrants: the right-upper quadrant represents motor themes, the right-lower basic and transversal topics, the left-upper well-developed but isolated themes, left-lower emerging or declining themes33. The size of each labelled circle is proportional to the number of publications on a given theme.
Figure 9a illustrates that keyword co-occurrences between 1989–1998 emerge in 10 clusters. Notably, COMPETENCE (Density(D)=2.46, Centrality(C)=1.5, H index(Hi)=11) and TEACHING-METHODS (D=1.48, C=1.24, Hi=10) are the two motor themes, which suggests that teaching methods and student competence were the two main research topics during this period. Research on medical education increased over the next two sub-periods. 42 clusters were present between 1999–2008 (Figure 9b), and COMPETENCE (D=0.36, C=1.99, Hi=10) and EDUCATION,-MEDICAL,-UNDERGRADUATE,-METHODS (D=0.14, C=1.72, Hi=10) were present in the right-lower quadrant, indicating that these were the key themes of this period. ADULTS (D=1.56, C=2.46, Hi=27), SIMULATION (D=0.56, C=2.31, Hi=9), ATTITUDES (D=1.57, C=2.12, Hi=9), PATIENT-SIMULATION (D=0.72, C=1.97, Hi=11) and OPERATING-ROOM (D=2.47, C=1.56, Hi=13) were some of the motor topics during this time frame; this suggests that research mainly pivoted to themes such as adult expectations, simulation education, and student attitudes. SKILLS (D=0.25, C=0.99, Hi=10) and COMMUNICATION (D=0.28, C=1.29, Hi=20) are emerging themes here, indicating that researchers were staring to focus on skills in clinical practice and patient-physician communication. Figure 9c shows a dramatic increase in the number of research topics with a total number of 100. COMPETENCE (D=0.06, C=0.49, Hi=6), a basic theme during 1999–2008, became a declining theme in the third sub-period and BEHAVIOR and WOMEN demonstrated trends similar to that of COMPETENCE, suggesting that during this time span, scholars explored medical education across a variety of topics and benefitted from the rapid development of mobile communication technology. To be sure, teaching and learning with apps was a hot topic during this period: the theme APPS (D=2.63, C=1.53, Hi=5) as a motor theme lays in the right-upper quadrant, and CLINICAL SKILLS (D=0.35, C=0.69, Hi=6) and PATIENT SIMULATION (D=0.42, C=0.61, Hi=6) remain motor topics in this study period.
As Figure 9d details, in chronological order, the three sub-periods involve 259, 674, and 1092 keywords, respectively. As we have split our study time into only three periods, we can only see from the second period that the number of new keywords is 447, compared to 15 transient ones during the same time span. Furthermore, 674 keywords are evident in the second period, with 227 hanging over from the first period and a similarity index of 0.88. Six hundred and fifty-nine out of 674 keywords from the second period passed directly to the third period (the similarity index was 0.98) and 433 new keywords emerged in the third period. Ultimately, over 88% of or 960 keywords remained relatively constant between periods, implying that research on medical education is worth long-term study.
Each circle in this chart represents a given sub-period. The numbers inside each circle indicate the number of total keywords during that time span, the arrows on top of them indicate the flow of new (downward arrows) or transient (upward arrows) keywords during that period, the numbers above arrows that connect two circles indicate the number of keywords these two sub-periods share, and the numbers in parentheses refer to the similarity index.