Of 268 students (134 in each class) invited to participate in the survey, a total of 104 responded (38.8%). Respondents consisted of 72 first year students (53.7%) and 32 second year students (23.9%).
Effects of remote learning on curricular components
For all curricular components besides lectures, most students felt the quality of instruction had been somewhat or very negatively affected by the remote learning transition (Table 2). Curricular components where the highest proportions of students felt that remote learning had very negatively affected the quality of instruction were anatomy (49/74, 66.2%), ultrasound (39/47, 83.0%), and the ambulatory care preceptorship (51/53, 96.2%). Students felt that remote learning had somewhat or very positively affected other curricular components, such as lecture-based learning (23/93, 24.73%) and problem-based learning (14/101, 13.9%). However, for the remaining curricular components, <10% of students felt that the remote learning transition had any positive effects.
Pre-clinical students’ perceptions of how remote learning affected their ability to participate in the curriculum followed similar patterns. Besides lectures and problem-based learning, where students generally felt neutral about their ability to participate remotely, the majority (>60%) of students felt remote learning had somewhat or very negatively affected their ability to participate in all other curricular components (Table 2).
Table 2. Perceptions of the effects of remote learning on quality of instruction and on ability to participate among pre-clinical medical students at the University of California San Diego, March-April 2020. The number of respondents is indicated for each specific curricular component.
|
Very negatively affected
|
Somewhat negatively affected
|
Neutral
|
Somewhat positively affected
|
Very positively affected
|
Effect of Remote Learning on Quality of Instruction
|
|
|
|
|
|
|
|
|
|
|
Lecture-based learning (n=93)
|
8
|
(8.6%)
|
23
|
(24.7%)
|
39
|
(41.9%)
|
12
|
(12.9%)
|
11
|
(11.8%)
|
Problem-based learning (n=101)
|
11
|
(10.9%)
|
41
|
(40.6%)
|
35
|
(34.7%)
|
10
|
(9.9%)
|
4
|
(4.0%)
|
Practice of Medicine (n=77)
|
38
|
(49.4%)
|
32
|
(41.6%)
|
7
|
(9.1%)
|
0
|
(0.0%)
|
0
|
(0.0%)
|
Anatomy (n=74)
|
49
|
(66.2%)
|
20
|
(27.0%)
|
4
|
(5.4%)
|
1
|
(1.4%)
|
0
|
(0.0%)
|
Histology (n=74)
|
26
|
(35.1%)
|
27
|
(36.5%)
|
15
|
(20.3%)
|
4
|
5.41%
|
2
|
(2.7%)
|
Ultrasound (n=47)
|
39
|
(83.0%)
|
7
|
(14.9%)
|
1
|
(2.1%)
|
0
|
(0.0%)
|
0
|
(0.0%)
|
Ambulatory Care Preceptorship (n=53)
|
51
|
(96.2%)
|
0
|
(0.0%)
|
2
|
(3.8%)
|
0
|
(0.0%)
|
0
|
(0.0%)
|
Pre-clinical Electives (n=69)
|
30
|
(43.5%)
|
17
|
(24.6%)
|
19
|
(27.5%)
|
3
|
4.35%
|
0
|
(0.0%)
|
|
|
|
|
|
|
|
|
|
|
|
Effect of Remote Learning on Ability to Participate
|
|
|
|
|
|
|
|
|
|
|
Lecture-based learning (n=95)
|
14
|
(14.7%)
|
17
|
(17.9%)
|
42
|
(44.2%)
|
11
|
(11.6%)
|
11
|
(11.6%)
|
Problem-based learning (n=101)
|
8
|
(7.9%)
|
32
|
(31.7%)
|
46
|
(45.5%)
|
12
|
(11.9%)
|
3
|
(3.0%)
|
Practice of Medicine (n=78)
|
17
|
(21.8%)
|
30
|
(38.5%)
|
26
|
(33.3%)
|
3
|
(3.9%)
|
2
|
(2.6%)
|
Anatomy (n=73)
|
38
|
(52.1%)
|
20
|
(27.4%)
|
13
|
(17.8%)
|
1
|
(1.4%)
|
1
|
(1.4%)
|
Histology (n=73)
|
33
|
(45.2%)
|
24
|
(32.9%)
|
14
|
(19.2%)
|
1
|
(1.4%)
|
1
|
(1.4%)
|
Ultrasound (n=46)
|
37
|
(80.4%)
|
6
|
(13.0%)
|
2
|
(4.4%)
|
0
|
(0.0%)
|
1
|
(2.2%)
|
Ambulatory Care Preceptorship (n=53)
|
45
|
(84.9%)
|
4
|
(7.6%)
|
3
|
(5.7%)
|
0
|
(0.0%)
|
1
|
(1.9%)
|
Pre-clinical Electives (n=68)
|
25
|
(36.8%)
|
17
|
(25.0%)
|
22
|
(32.4%)
|
2
|
(2.9%)
|
2
|
(2.9%)
|
Remote learning resources and curricular structure
Utilization of remote learning resources by pre-clinical students was variable (Figure 1). Resources regarded as valuable by half or more of respondents included a laptop, tablet, online question bank subscription, recorded didactic lectures, videoconferencing software (Zoom Pro), digital anatomy education app (Complete Anatomy), and online office hours and review sessions (Figure 1). Resources of relatively lesser value included Online MedEd, online textbooks, JOVE Science Education, and Aquifer.
Almost two-thirds (66/103, 64.1%) of students preferred having the flexibility of learning material at their own pace rather than having required modules and set due dates. When asked about the ideal frequency of due dates, most (55/103, 53.4%) preferred weekly due dates. Fewer students preferred due dates to occur daily (4/103, 3.9%), every few days (15/103, 14.6%), biweekly (16/103, 15.5%), or monthly (13/103, 12.6%).
Costs, living arrangements, and connectedness
For most (72/103, 69.9%) students, transitioning to remote learning incurred less than $100 of additional out-of-pocket expenses for educational resources. However, almost a quarter (24/103, 23.3%) spent $101-$500, and there were 7 students (6.8%) who spent over $500 during the remote learning transition.
With the transition to remote learning, approximately one-fifth of the students (20/98, 20.4%) moved outside the greater metropolitan area surrounding the institution. The remaining students stayed locally, whether in their current housing arrangements (72/98, 73.5%) or moving to different housing nearby (6/98, 6.1%). About one-fifth of students (21/98, 21.4%) felt their living arrangements were not conducive to remote learning (Table 3). This was primarily attributed to lack of quiet study space, a barrier identified by a quarter of students (24/98, 24.5%). Very few students (5/98, 5.1%) indicated lack of sufficient internet or technology.
Overall, students felt less connected during remote learning. Over half of respondents felt disconnected to the medical school or to their classmates (Table 3). Only about a quarter of students still felt connected to the medical school or to their classmates.
Table 3. Living arrangements and feelings of connectedness among pre-clinical (first- and second-year medical students) at the University of California San Diego, March-April 2020.
Statements
(N=98 students)
|
Scale of Agreement
|
|
Strongly Disagree
|
Disagree
|
Neutral
|
Agree
|
Strongly Agree
|
Overall, my current living arrangements are conducive to remote learning.
|
6
(6.1%)
|
15 (15.3%)
|
17 (17.4%)
|
40 (40.8%)
|
20 (20.4%)
|
I have access to sufficient internet to meet the demands of remote learning.
|
1
(1.0%)
|
8
(8.2%)
|
7 (7.1%)
|
40 (40.8%)
|
42 (42.9%)
|
I have access to sufficient technology (i.e. a computer with a webcam, iPad, etc) to meet the demands of remote learning.
|
0
(0%)
|
5
(5.1%)
|
2
(2.0%)
|
43 (43.9%)
|
48 (50.0%)
|
Given my living arrangements, I have sufficient access to quiet study space to meet the demands of remote learning.
|
7
(7.1%)
|
17 (17.4%)
|
16 (16.3%)
|
38 (38.8%)
|
20 (20.4%)
|
Given the transition to remote learning, I still feel connected to UCSD School of Medicine.
|
14
(14.2%)
|
38 (38.8%)
|
21 (21.4%)
|
20 (20.4%)
|
5
(5.1%)
|
Given the transitions to remote learning, I still feel connected to my classmates.
|
20
(20.4%)
|
31 (31.6%)
|
20 (20.4%)
|
26 (26.5%)
|
1
(1.0%)
|
Preparation for subsequent stages of training
Second-year students also felt that preparation for subsequent stages of training were negatively affected. Over half (17/30, 56.7%) felt that their preparation for the United States Medical Licensing Examination (USMLE) Step 1 examination was somewhat or very negatively affected. About a quarter (7/30, 23.3%) felt that preparation was somewhat or very positively affected, and the remainder felt their preparation for Step 1 had not changed. Similarly, in terms of feeling of prepared to begin clinical clerkships, 13 (43.3%) felt somewhat or very unprepared, 9 (30.0%) felt somewhat or very prepared, and the remainder were neutral.
Narrative results
Four dominant themes emerged from 254 unique narrative responses to open-ended survey questions:
I. Structure – flexibility and efficiency
Many students praised the increased flexibility afforded by remote learning. Almost two-thirds (38/59, 64.4%) cited increased flexibility as the best part of the remote learning curriculum (Table 4), noting the benefits of self-pacing and indicating that a traditional 50-minute lecture format is not ideal. Students reflected that self-pacing the lecture schedule permitted them to pause and work out difficult concepts, or to speed up recordings to enhance efficiency. Many appreciated the opportunity to get ahead of the lecture schedule via pre-recorded lectures (Table 5, a, b). Several students noted they were able to coordinate studies with their circadian rhythms to optimize periods of productivity, efficiency, and learning (Table 5, c, d). Students also valued the flexibility to engage in activities such as research, Step 1 studying, self-care, and volunteering with COVID-19 relief efforts (Table 5, e). Several students praised remote learning for the time and financial gains from eliminating commutes, either from home to school or from one building on campus to another (Table 5, f).
By contrast, some students struggled with decreased structure, citing that without a regular schedule, it was easy to fall behind (Table 5, g). When asked specifically about gaps in the remote learning curriculum, 7/61 respondents (11.5%) noted lack of a structured schedule and disorganization (Table 4). Others conveyed that productivity and motivation were hindered by home environments that were not conducive to studying (Table 5, h).
II. Remote learning format – digital fatigue and participation
Prolonged engagement in remote learning formats proved problematic for many students. Numerous respondents (11/61, 18.0%) specifically reported digital fatigue as a significant drawback of the remote curriculum. Interestingly, some students noted the greatest digital fatigue with synchronous, small group sessions which were designed to be interactive, but instead led to disengagement, exhaustion, and inability to focus (Table 5, i, j). Some respondents felt remote formats hampered participation due to technical issues and inability to study in groups or effectively use office hours (Table 5, k, l). In contrast, some students felt the remote format enhanced small group interactions, and 9/54 respondents (16.7%) desired that virtual PBL be continued beyond the pandemic period (Table 4).
III. Content gaps – lab classes and clinical skills learning
Unsurprisingly, when asked specifically about the biggest gaps in the remote learning curriculum, 31/61 respondents (50.8%) cited clinical skills learning (Table 4). Many students noted deficiencies with history-taking and physical exam training. The overall dearth of clinical skills training left students feeling unprepared for clinical assessments and encounters (Table 5, m, n). Students also felt a loss of motivation when opportunities to participate in the clinical realm disappeared (Table 5, o). Most students also felt that digital substitutes were inadequate for lab classes like anatomy, histology, and ultrasound (Table 5, p).
While many students missed out on opportunities within the curriculum to learn clinical skill, a handful of students who were able to participate in telehealth found the experience quite valuable. Fourteen students reported participating in some form of telehealth since transitioning to remote learning, the majority of whom (78.6%) obtained the experience via a student-run Free Clinic elective in which students help provide healthcare to uninsured members of the San Diego community. While students had mixed feelings regarding the effectiveness and efficiency of telehealth patient visits, students highly valued opportunities to participate in patient care and stated that telehealth patient visits were a source of motivation (Table 5, q-s).
IV. Mental health – anxiety and isolation
Pre-clinical students typically spend the majority of each day learning together in-person in the standard curriculum, thus developing close-knit relationships with each other. The transition to remote learning and the accompanying isolation took a noticeable toll on students’ mental health (Table 5, t-v). A notable proportion of students (11/66 respondents, 16.7%) mentioned isolation, feelings of disconnectedness, or declining mental health in their responses. Anxiety and uncertainty made it difficult for many to focus on academics. Disruption of normal routines and additional stresses from stay-at-home orders made remote learning particularly trying for some students (Table 5, w). An incessant barrage of mixed and sometimes contradictory information was also difficult to navigate, and several students noted that effective communication from medical school administration was necessary to assuage feelings of uncertainty and maintain a positive educational environment (Table 5, x).
Table 4. Free responses among pre-clinical (first- and second-year medical students) at the University of California San Diego, March-April 2020. Best and worst components of the remote learning curriculum and aspects that should be continued in future, hybrid curricula.
What are the best components of the remote curriculum?
(N=59)
|
N (%)
|
Which components of the remote curriculum should be continued in the standard curriculum in the future?
(N=54)
|
N (%)
|
What gaps remain in the remote curriculum?
(N=61)
|
N (%)
|
Increased flexibility
|
38 (64%)
|
Videocasted lectures, uploaded in advance for the block
|
27 (50%)
|
Clinical skills learning (POM, ACA)
|
31 (51%)
|
Videocasted lectures, uploaded in advance for the block
|
18 (31%)
|
Virtual PBL
|
9 (17%)
|
Lab classes (Anatomy, Histology, Ultrasound)
|
15 (25%)
|
Increased efficiency
|
10 (17%)
|
Increased office hours/review sessions
|
7 (13%)
|
Zoom/Digital Fatigue
|
11 (18%)
|
Increased office hours/review sessions
|
4 (7%)
|
Extra resources/practice questions
|
6 (11%)
|
Difficult to participate/ask questions
|
8 (13%)
|
Virtual PBL
|
4 (7%)
|
|
|
Disorganization/ Lacking structured schedule
|
7 (11%)
|
|
|
|
|
Poor communication/ Transparency
|
5 (8%)
|
Table 5. Student quotations illustrating thematic content of free response questions.
I. Structure: Flexibility and Efficiency
|
a. "I do not learn well in the physical lecture session bc I cannot pause and address confusion right away."
|
b. " I appreciate having all the block's lectures at the beginning so I can watch them at my own pace and get ahead if I choose."
|
c. "I am an early riser so I do like being able to wake up early and start on lectures by six AM."
|
d. "The ability to learn more or less depending on the energy level of the day is absolutely massive. And has been the STRONGEST addition to my education, regardless of the circumstance."
|
e. "More freedom to productively use my time (research/STEP studying)."
|
f. "I also commute to school so remote learning is saving me a lot of money and time, which I am very happy about."
|
g. "The biggest killer in remote learning is time self management... I sleep in more than I should and do less work than I should. I would like help keeping myself accountable by having more assignments with more set due dates. If the assignments are there, I will do them."
|
h. "At grad housing, my neighbors above have children who are persistently loud and while at home my large family are all working and always on calls. Many students feel that it’s difficult to focus, be engaged, and be placed in an environment conducive to learning. As such, a student like myself who used to never struggle with having motivation to get to work is having more difficulties now than ever to simply be a student."
|
II. Remote Learning Format: Digital Fatigue and Participation
|
i. "Zoom classes feel much longer online than in person."
|
j. "POM [Practice of Medicine] for 4 hours straight is impossible. Many of the activities are difficult to do over Zoom. Honestly, the past few weeks after logging off the 4 hour POM zoom call, I have been so discouraged that I couldn't focus for the rest of the evening. Four hours on a Zoom call is physically and emotionally draining."
|
k. "Interaction with faculty and students is simply not the same. It's a bit hard to describe, but as someone who is very much an "in person" and "tangible" learner, going to lecture and seeing the faculty, speaking with peers, and interacting with everyone in person is more conducive to my learning style."
|
l. "It's very hard to do any sort of group studying. It's very hard to find a quiet place to study. It's very hard to learn doctoring skills… There is no way to practice your skills/ask questions."
|
III. Content: Lab Classes and Clinical Skills Learning
|
m. "As someone who learns best through hands on methods, I’m struggling with anatomy and POM and really missing the opportunity to practice patient interviewing/physical exams during ACA. I do not feel prepared for an OSCE at the end of the year."
|
n. "As of now I do not feel prepared for step style questions, or comfortable trying to apply my knowledge in relevant clinical settings."
|
o. "It has also been hard not having clinical experiences, since that was my favorite part of medical school."
|
p. "Anatomy is extremely difficult to learn remotely - and I know a lot of students who have just resigned to not learning pelvic anatomy given the circumstances."
|
q. "(Telehealth participation) has been very valuable and a great learning experience and is helping me stay grounded and connected to my role as a med student."
|
r. "Telehealth... Was a great learning experience, practiced taking a hx, presenting to attending, writing a note."
|
s. "(Telehealth participation) has been hugely helpful for my motivation and keeping up with my interviewing skills."
|
IV. Mental Health: Anxiety and Isolation
|
t. " Being more or less alone for the past ~2 months has showed me the importance of connection and social interaction in my own mental well-being and the role that our in-person classes served in meeting that need for me. I miss in-person class for that reason the most. And I would be worried that if the SOM switched to more remote learning permanently after COVID-19, a lot of student's mental health would decline due to isolation and lack of relationships with classmates. "
|
u. " It's an incredibly isolating experience... mental health is more so a challenge than ever with all of this, and it is impacting all facets of our student life: academic performance, extracurricular commitments, socializing, etc. "
|
v. " Some of us are being hit more by the complete psychological lack of interaction, that can't really be remedied by looking at boxes on a computer with friends and mentors faces in them."
|
w. " In addition to family issues and regular coursework, it's more difficult to go about daily activities, such as grocery shopping or exercising; some of us do not have access to a quiet study space with reliable internet; some of us are managing free clinic responsibilities, where more administrative duties are falling on students. Some of us have had a known exposure to COVID-19 ourselves or have responsibilities to our communities outside of school. "
|
x. "I also wish I knew what was going on—I get so many emails from the school and UC San Diego Health that I don’t know what to open for actual information about my own curriculum, etc."
|