Settings:
Jichi Medical University
Jichi Medical University (JMU) in Japan was founded to educate medical students to become rural physicians. JMU graduates are appointed to a clinic or hospital in medically underserved or geographically-isolated areas during postgraduate years (PGY) 3 to 9, where consultation with specialists and educational instruction from teachers is difficult [10, 18]. Accordingly, they have fewer chances to train their clinical knowledge and skills under systematic instructional programs between PGY 3 and 9. While JMU graduates are supposed to improve medical knowledge and skills in a self-directed manner, JMU undergraduates are not sufficiently ready with SRL for postgraduate settings [10, 11, 20]. Therefore, the university educational board introduced a new program aimed at independent learning at Year 6 [11], and now the attempt has been expanding across school years. PIF-rCBCC is another attempt to promote better SRL.
The original rCBCC
The original rCBCC was introduced in 1998 [19]. It takes place for 2 weeks from late August to early September just after the long summer holidays between the first and second trimester in Year 5. During rCBCC, Year 5 students stay in their home prefecture community hospital or clinic where JMU graduates work. Every year, two to five JMU graduates per prefecture are appointed to be attending doctors for rCBCC based on reputation and motivation for teaching among their prefectural communities. Although JMU faculty organize and manage the program and assure instructional quality, attending JMU graduates determine the program’s process. In 2001, standards for learning activities were proposed, which include ambulatory care, home care, hospital care, placement in mobile clinics, on-call work, rehabilitation, health education, health check-ups, vaccination, day services, and placement in welfare facilities (welfare institutions or nursing homes for the aged) [19].
Before the rCBCCs, students had few chances for sufficient communication with their attending doctors. Following the rCBCC, students were asked to submit a report but did not receive reflective feedback from their mentors. There was no platform to communicate what JMU alumni expected undergraduates to learn, and what undergraduates hoped to learn to become medical professionals in their future setting. Therefore, although the original rCBCC provided an advantageous setting for PIF from learners’ future role models (Figure 1), we were concerned the lack of communication might interfere with establishing professional identity as rural physicians.
PIF-rCBCC
In order to make learning contexts of rCBCC more PIF-oriented, we introduced a PIF-oriented communication platform designed in accordance with two other core elements in Figure 1: articulating future ‘self’ images as ‘professional’ to form professional identity, and having in-depth communication pertaining to values and norms of professionalism with mentors.
We used an online communication platform or Google Forms because we expected students and mentors to post opinions and feelings frequently with each other. The structure of Google Forms for PIF-rCBCC is described in Add. File 1.
In Google Forms, participants were asked to post essays to verbalize their future self-image and receive feedback from mentors. Also, they were asked to fulfill the professional identity essay (PIE) invented by Kalet, et al. [21]. PIE is useful for helping learners articulate their values and norms about medical professionalism from their own point of view and to help teachers provide feedback by referring to rubrics based on Kegan’s constructive developmental theory [21, 22]. This study used a Japanese version of Kalet et al.’s PIE form originally in English. Back translation between English and Japanese was conducted by the main author (YM, Japanese) and an American professor living in Japan literate in both English and Japanese (AJL).
Prior to PIF-rCBCC, mentors received an instruction manual explaining in detail the aim of PIF-rCBCC and the program from receiving the first student submission on Google Forms in July to the final provision of reflective feedback to students in September (Figure 2). The outline of the manual was shown in Add. File 2.
Aside from iterative message exchanges in Google Forms before and after the clinical clerkship, students in PIF-rCBCC were asked to create one or more learning themes during rCBCC based on verbalized future self-images and values and norms of medical professionalism. In response to learners’ themes, alumni mentors observed their learning and gave just-in-time feedback during the two weeks of rCBCC. Also, mentors showed students how to overcome future workplace challenges through self-study. Aside from these directives, mentors were basically allowed to educate students in their own ways.
After the two-week clerkship, students were asked to re-articulate their own future images as medical professionals re-writing Kalet’s PIE and receiving comments from JMU graduates’ feedback on them by Google Forms.
Subjects
Participants and design
As figure 2 shows, we first selected attending rural physicians for PIF-rCBCC. In 2018 and 2019, ninety-four JMU graduates registered as attending graduates for the original rCBCC. Among them, we randomly selected 20 candidates for PIF-rCBCC mentors in 2018 and 2019 and attempted to obtain informed consent for the contribution to PIF-rCBCC in this study. Eventually, 17 and 13 JMU alumni agreed on participation in 2018 and 2019, respectively. Eight alumni participated in both years.
Independent from this study, the JMU Center for Community Medicine matched one alumni with one to three students for the original rCBCC. The thirty PIF-rCBCC alumni were paired with one to three students before informed consent was obtained. In this study, we used students paired with the thirty PIF-rCBCC alumni as candidates for PIF-rCBCC group subjects. There were twenty-two and twenty candidates in 2018 and 2019, respectively. One candidate in 2019 declined the participation. Eventually 41 students were registered as subjects in PIF-rCBCC group (PIF-rCBCCs). Simultaneously, 41 original rCBCC participants (original rCBCCs) control subjects were chosen and provided informed. Participants in both groups were paired by gender and academic ranking from the previous year (Year 4), because previous studies have showed gender [23, 24] and academic performance [25] might independently influence SRL development.
Procedures
We chose a convergent mixed method for the first research question ‘Does PIF-rCBCC improve SRL better than the original-rCBCC?’. A rationale for this method is ‘one data collection form supplies strengths to offset the weaknesses of the other form to achieve a more complete understanding of a research problem’ [26]. We used an explanatory mixed method to address the second research question ‘How does the PIF-oriented rCBCC improve SRL?’. A rational for this method is that following qualitative approaches can explain quantitative results [26]. We used this method because we believed qualitative analysis would explain how the PIF-oriented rCBCC improved SRL in quantitative data in detail.
1) Quantitative Approach
We measured learners’ SRL levels by a Japanese-language version of the Motivated Strategies for Learning Questionnaire (MSLQ-J) [27] before and after subjects participated in PIF-rCBCC or original rCBCC. MSLQ is reported useful measuring SRL in medical undergraduate education [28-30], and is composed of 81 items with seven-point Likert scales quantifying levels of nine types of SRL strategies (rehearsal, elaboration, organization, critical thinking, metacognitive self-regulation, time and study environment, effort regulation, peer learning, and help seeking), and six variables of motivation states (intrinsic goal orientation, extrinsic goal orientation, task value, control of learning beliefs, self-efficacy for learning and performance, and test anxiety). We used 81 items of MSLQ used in a medical school context [29]. All were translated into Japanese and back translations were made between the main author (YM) and an American professor living in Japan literate in both English and Japanese (AJL).
2) Qualitative Approach
To explore change of perception regarding motivation, strategies and reflective behaviors in daily self-study before and after the PIF-rCBCC, we created a questionnaire composed of seven questions (shown in Add. File 3). In 2019, we also conducted one-on-one interviews after analyzing qualitative data from the questionnaire from 41 participants in 2018 and 2019 to achieve data saturation [31]. We employed three interviewers who are familiar with the original rCBCC but not engaged in Year 5 students’ assessment in order for interviewees to openly articulate their own perceptions. We asked all PIF-rCBCCs in 2019 to join the interviews and twelve students agreed to have interviews. Interviews were conducted in a semi-structured manner using an interview form with similar questions to those in the questionnaire (shown in Add. File 3). The interviewers were told by the main author (YM) beforehand to obtain data about change of perception regarding motivation, strategies and reflective behaviors. After collecting interview data from 10 students, the two main authors (YM and HO) found no additional meaningful codes emerging and concluded data reached saturation [31] and stopped interview data collection.
Analysis
1) Quantitative Approach
We compared the 15 MSLQ-J pre-course subcategory scores of PIF-rCBCCs and original rCBCCs subjects using Kruskal-Wallis one-way analysis of variance (ANOVA). After confirming there were no statistically significant differences between the two group, we compared subtracted (post-pre) scores in the 15 MSLQ-J subcategories between PIF-rCBCCs and original rCBCCs using Kruskal-Wallis one-way ANOVA. A p-value < 0.05 was considered statistically significant. The effect sizes for comparisons were also calculated using ε2 values where small effect sizes ranged from 0.01 to <0.08, medium effect sizes ranged from 0.08 to <0.26 and large effect sizes from ≥0.26. We used JAMOVI version 1.0.7.0 [32] for the statistical analysis.
2) Qualitative Approach
From a constructivist paradigm in which 'reality' is subjective and context-specific, and multiple truths are constructed by and between people [33], qualitative data from the questionnaire and interviews were analyzed using constructivist thematic analysis. We coded anonymized transcripts of the Japanese scripts in accordance with the six phases proposed by Braun and Clarke [34]. Initial coding was conducted by the two Japanese researchers (YM and HO). YM was the lead author, who engages in the development of PIF-rCBCC and had experienced qualitative studies relevant to SRL. HO was chosen to conduct initial coding because he is not directly engaged in the rCBCC program but had experienced qualitative studies relevant to SRL. The transcripts were thoroughly read and analyzed using an inductive coding approach until agreement on coding was achieved through repetitive face-to-face meetings between the pair.
We specifically focused on changes of SRL (motivation, learning strategies, and reflective behaviors) and PIF (individual identities as a medical professional), and attempted to explore how they think changes occurred or what they feel the changes are attributed to. Representative codes and statements were translated into English by an American professor living in Japan literate both English and Japanese (AJL). In the final phase, two other authors (JL and CV; education psychologists being familiar to SRL) joined the discussion, and a higher-level synthesis of the codes were made.