A total of 1,378 faculty evaluations were collected. Inter-rater reliability testing resulted in a Cohen’s Kappa of 0.85, indicating an excellent level of reliability. Twenty-three codes were consistently present throughout the data within six clear themes representing educator qualities and teaching techniques that resonated with medical students during their surgical clerkships: Enabling Student Involvement, Investment in Student Learners, Positive Team Environment, High Yield Teaching, Clinical Role Models, and Personal Connection (Table 1). These themes are organized based on the frequency of the codes they represent, with the themes containing more frequent codes discussed first and with the least frequent codes last. An overview of the relative code frequencies can be found in Fig. 1. Quotes included in the results are transcribed as written in the student evaluations. Given the anonymization of the data, student responses are not credited to specific student evaluations.
Table 1
Data Themes, Codes, and Corresponding Definitions
Theme
|
Codes
|
Definition
|
Enabling Student Involvement
|
Independence
|
Students appreciate when the educator gives them the autonomy to act and think independently, and do not appreciate when educators do not provide this opportunity.
|
Engagement
|
Educator invites student to participate in skills practice, direct patient care, hands on learning experiences, and the OR.
|
Advocate
|
Advocates for student to be involved in patient care.
|
Preparation
|
Aids the student in preparing for their rotation (ie. OR cases, patient care, clinic, etc).
|
Investment in Student Learners
|
Feedback
|
Educator provides frequent, constructive, actionable feedback.
|
Expectation Setting
|
Strong educators set clear expectations for the rotation and the student's role on the team.
|
Challenging
|
Challenges the student to improve within a supportive environment.
|
Prioritization of Education
|
Carves out time or adds time to the work day for teaching regardless of the busyness or stress of the service.
|
Positive Team Environment
|
Team Inclusion
|
The educator facilitates integration of the student into the surgical team and makes them feel welcome in the surgical environment.
|
Psychological Safety
|
The educator creates a safe environment where the student feels comfortable approaching them, making mistakes, and asking questions.
|
Clear Communication
|
Communicates clearly with the student and whole team regarding daily tasks and expectations.
|
Positive Attitude
|
Educator is described as enthusiastic and having a positive attitude towards teaching, as well as toward their job in general. Also includes when the student describes a negative attitude as a detriment.
|
Value Acknowledgement
|
Recognizes the value the student adds to the team, and expresses gratitude.
|
High Yield Teaching
|
Meaningful Teaching
|
Educator provides teaching on high yield topics or skills to prepare students for the surgery clerkship. Avoids non-educational tasks.
|
Personalized Teaching
|
Elicits goals from the students and tailors educational experiences toward student's goals and/or interests.
|
Multi-modal Teaching
|
Utilizes different forms of teaching, including formal didactics/lectures, in-the-moment instruction or discussion, literature investigation, etc.
|
Questions
|
Uses questions to probe fund of knowledge and prompt further learning.
|
Clinical Role Models
|
Clinical Excellence
|
Student describes the educator as modeling excellence for patient care and in the OR.
|
Professionalism
|
Students appreciate when educators model professionalism toward the team and their patients, and are disappointed when unprofessional behaviors are modeled.
|
Thought Process
|
Provides insight and explanations to the decision-making and critical thinking that is needed when providing patient care.
|
Personal Connection
|
Personal Investment
|
Sees the student as a whole person, takes the time to get to know them personally.
|
Mentorship
|
Student describes the educator as providing career advice or guidance.
|
Theme #1: Enabling Student Involvement
Students most frequently commented on how effective educators encouraged and enabled them to be hands-on in their learning. To set the student up for success, the best resident and attending educators would help them prepare for their operative experiences (See Appendix 1:1a for specific quote). Most importantly, for some students, the unique environment of the operating room (OR) can be particularly intimidating. With the educator’s guidance, students can feel more confident and comfortable in the OR, therefore maximizing their educational experience.
Resident educators in particular also acted as advocates to encourage student involvement in patient care. Their position as leaders of the inpatient team can be used to empower student engagement (see Appendix 1:1b). Excellent educators advocated for their student by encouraging them to be involved in the operation, guiding them as to the right time to scrub in, and checking in to make sure they were comfortable. This kind of investment in the student’s educational experience is very impactful to students’ perception of learning and acceptance on the surgical clerkship.
Additionally, the best educators allowed the students an appropriate level of autonomy. These experiences included independently seeing patients, presenting histories, working on notes, or assisting with procedures (see Appendix 1:1c). When educators trusted students to act independently, the students eagerly rose to the occasion and the opportunities to practice the skills they had observed were valued as great educational experiences.
Correspondingly, students were especially discouraged by residents or attendings who did not make an effort to engage them. As mentioned previously, students sought opportunities to help the team and act independently, but to do so often required the encouragement from their educator. Unfortunately, not all students had educators who welcomed their involvement (see Appendix 1:1d). When students described neglect, it was consistently a similar experience of feeling like an outsider, not encouraged to participate in the day-to-day activities of the team. Therefore, when residents or attendings showed disinterest, students similarly became disinterested and disheartened.
Theme #2: Investment in Student Learners
By taking small steps to ensure their students were set up for success, faculty left students with the impression that they were genuinely invested in their educational experience. The strongest educators would start the student’s rotation by delineating expectations for their role on the team (see Appendix 1:2a). Often, these students did not have previous exposure to surgery, so setting these guidelines helped them feel better prepared to take on their surgical rotations. Additionally, eliciting the student’s personal goals helped align their interests with the educator’s objectives.
As the student continued on the service, these expectations were best maintained by providing regular feedback. Students often commented on how honest, actionable feedback would inspire them to improve (see Appendix 1:2b). Students sought feedback from their educators, however, not all faculty provided appropriate feedback. As noted in the previous quote, good feedback was constructive, specific, and gave the student the opportunity to improve and build upon what they had learned. Students often noted when faculty would either not provide feedback or provided ineffective feedback: (see Appendix 1:2c). Students saw feedback as an opportunity for growth, so being deprived of that opportunity was particularly disheartening. When educators gave clear expectations and feedback on their progress, students were motivated to push themselves as learners (see Appendix 1:2d). By challenging their students to succeed, educators showed investment in their students’ growth, which in turn led the students to believe in their own potential.
In addition, one of the most impactful ways educators demonstrated investment in the students was by prioritizing their education. Students recognized that the clinical day was often busy, which made the moments faculty took time to teach particularly meaningful (see Appendix 1:2e). Therefore, teaching does not always have to be structured, but rather small teaching moments throughout the day maximized the student’s educational experience. On the other hand, the most common complaint was when educators would not make this effort (see Appendix 1:2f). Similar comments were common throughout the evaluations, and highlight how much students valued when teaching is prioritized. It is important to note that students often recognize that busy days are not always conducive to teaching, and therefore the strongest educators were those who found a way to incorporate student learning into those demanding clinical schedules.
Theme #3: Positive Team Environment
The team dynamic is one of the most unique aspects of surgical culture, and students viewed surgical educators as responsible for setting the tone of that environment. There were several ways students mentioned their faculty would positively contribute to the environment. First, and most commonly noted, was establishing a psychologically safe environment. The strongest educators allowed the students to feel comfortable and confident asking questions and sharing their curiosity. This was important of both resident and attending physicians. Residents often would set the tone outside of the OR. (see Appendix 1:3a). On the other hand, students saw the role of the attending as directing the atmosphere inside of the OR during cases (see Appendix 1:3b). In both instances, students appreciated being able to learn in an environment where they were encouraged to ask questions, and could be wrong without repercussions. The safe space allowed their curiosity and interest in surgery to grow.
Similarly, students greatly valued when their resident physicians would make them feel “like a welcome part of the team”. Resident educators would do so by involving them in tasks, and by acknowledging them as a valuable addition to the team’s productivity. Additionally, attending educators would welcome students into the operating room, and interact with them during cases. Actively involving students as team members inspired them to be more engaged and proactive when contributing to patient care but likely requires dedicated pre-clinical instruction to maximize each student’s knowledge and effectiveness.
Another important aspect of the team dynamic is effective communication. Students often noted that strong educators were able to lead their team by clearly delegating roles and tasks to each member (see Appendix 1:3c). For students, this effective communication helped define their role within the team and therefore allowed them to maximally contribute and learn.
In general, the team environment was significantly impacted by the overall attitude of the surgical educator. Residents and attending educators with positive attitudes towards teaching inspired similar excitement in the students they taught (see Appendix 1:3d). However, the opposite was also true; negative attitudes were toxic to the team dynamic (see Appendix 1:3e). Students reflected the attitudes put forth by their educators in that positive leaders similarly led to enthusiastic students, while negative outlooks would cloud the student’s surgical experience.
Theme #4: High Yield Teaching
There were several different teaching strategies that students noted effective educators employed. First was providing what felt like meaningful teaching. Students would commend when educators provided practical or “high yield” teaching points on topics relevant to the cases they would see that day or would need to know for their exams (see Appendix 1:4a). In doing so, students felt that the educator’s time and their time were being used effectively to focus on only the most pertinent surgical knowledge to understand.
Similarly, students appreciated when teaching was personalized to their interests or needs. Educators effectively elicited those interests by asking students if there were any particular topics they were hoping to learn or experience early in the rotation (see Appendix 1:4b). By tailoring teaching to the student’s preferences, the educator showed interest in the student as an individual. This approach has the benefit of helping students feel engaged and personally connected to them as individuals.
Within the OR, students felt the best educators would teach using focused questions. This use of teaching scripts was the most common way students noted they would have the opportunity to interact with attendings. Questioning in the OR would help keep students engaged, focus their learning, and clarify areas where they could continue to grow (see Appendix 1:4c). Since the OR was the most common environment where students interacted with attendings, active Socratic questioning sessions were also one of a students’ few opportunities to highlight their medical knowledge and technical skills. Therefore, the use of standardized questioning scripts by attending surgeons also allowed fair student assessments and constructive feedback opportunities.
Another often commented-on technique was using multi-modal teachings strategies. In other words, rather than only relying on chalk talks or intra-operative teaching alone, strong educators would use a variety of teaching strategies and techniques (see Appendix 1:4e). These teaching strategies helped keep student learners engaged and interested in varying settings. This method was a particularly effective way that educators could incorporate teaching moments within a busy clinical schedule.
Theme #5: Clinical Role Models
This theme highlights how medical students turn to faculty to exemplify clinical acumen and skill. Students frequently noted when educators personified clinical excellence, both inside and outside of the OR. Intra-operatively, students were attuned to the technical skills attendings and resident physicians demonstrated (see Appendix 1: 5a). Specifically, students often appreciated when educators would share their thought process around different clinical situations, and many saw this as significantly contributing to their learning. In particular, students noted when educators would not explain the “why” when making clinical decisions, and frequently gave this as constructive feedback for educator improvement (see Appendix 1:5b). Students valued when educators provide glimpses into their surgical decision-making so they could similarly begin to develop those skills themselves.
The medical students noted that a surgical educator displayed clinical excellence not only through technical skills and knowledge, but also through their interactions with peers, patients, and the students themselves (see Appendix 1:5c). Teacher behaviors such as showing respect, kindness, and professionalism towards everyone, truly distinguished a role model in the eyes of medical students. Such a view emphasizes how these students look to surgical educators to learn not only technical skills and medical knowledge, but also how to behave as a surgeon.
Theme #6: Personal Connection
Residents and attendings that made an effort to establish personal connections with the students were greatly valued. Educators showed interest in the student as a person by eliciting their goals within medicine, discussing their hobbies outside of the hospital, and assuaging their fears or anxieties about surgery (see Appendix 1:6a). In getting to know the students personally, educators could also tailor their teaching towards the student’s interests and goals to maximize their learning. On the other hand, although infrequent, students were particularly offput when their resident or attending made no effort to connect with them (see Appendix 1:6b). This indifference from the faculty not only led to the student’s diminished interest in that particular rotation, but also in the field of surgery as a whole.
At times, residents and attendings would go beyond their roles as teachers to become mentors (see Appendix 1:6c). Students who found mentors among their educators often cited this connection as leading to their own decisions to pursue a career in surgery (see Appendix 1:6d). Excellent educators passed on their knowledge freely, inspiring medical students to follow in a similar path.