Quantitative Survey Results
The feedback form was completed by 2,754 participants (response rate = 71.3%). The participants had a mean (SD) age of 21.2 ± 2.1, with 27.5% males and 71.9% females. Additional demographic data for the participants can be found in Table 1.
Table 1
Demographic and enrollment characteristics of study participants
Variable
|
Feedback Form Participants
|
FGD Participants
|
No. of Respondents
|
2754
|
40
|
No. of Cities
|
37
|
9
|
No. of Universities
|
113
|
25
|
Age, in years; (Mean ± SD)
|
21.1 ± 2.1
|
20.9 ± 2.0
|
Gender
Male; n (%)
Female; n (%)
Prefer not to answer; n (%)
|
761 (27.6%)
1979 (71.9%)
14 (0.5%)
|
13 (32.5%)
27 (67.5%)
0 (0.0%)
|
Year of Study
Pre-Clinical Years; n (%)
Clinical Years; n (%)
|
1321 (48.0%)
1433 (52.0%)
|
18 (45.0%)
22 (55.0%)
|
Type of institution
Public; n (%)
Private; n (%)
|
1201 (43.6%)
1553 (56.4%)
|
22 (55.0%)
18 (45.0%)
|
Table 1 highlights the demographic features of participants who completed the feedback forms and participated in Focused Group Discussions (FGDs).
Figure 2 comprehensively shows the level of agreement and/or disagreement that participants felt when evaluating specific qualitative feedback sub-themes. 2,311 (84.0%) participants stated that the course helped them in improving their overall research knowledge and 2,333 (84.7%) reported feeling confident that the skillset learnt through the series would help them in future research projects. The findings also revealed a high interest in 2,498 (90.8%) participants for a future advanced research series.
Participants were also asked to nominate the area of the workshop that they felt was the strongest feature and the area that needed the most improvement. The two key areas that were identified by the highest number of participants as the main strength were course content (n=853, 31.0%) and delivery method and approach (n=693, 25.2%). Likewise, the two key areas that were identified to be the major limitation were course duration (n=636, 23.1%) and course video and sound quality (n=478, 17.4%). Majority of the students (n=978, 35.5%) rated the overall series as ‘Excellent’, followed by ‘Very Good’ (n=879, 31.9%) on the grading rubric.
Thematic analysis of Focused Group Discussions (FGDs):
A total of 40 participants took part in the FGDs, consisting of 13 (32.5%) males and 27 (67.5%) females, with a mean age of 20.9 ± 2.0 (Table 1). Thematic analysis (Table 2) exhibited the following noteworthy findings, extrapolated from the opinions shared by the FGD participants (Table 3).
Table 2
Thematic analysis of the ISGMs – themes, subthemes, codes and frequencies
Themes
|
Subthemes
|
Codes
|
Frequency; n (%)
|
1. Motivating Factors for Participation
|
1.1 Baseline Knowledge
|
A. Had no prior knowledge
B. Had existing knowledge
C. No Response
|
24 (60.0%)
12 (30.0%)
4 (10.0%)
|
1.2 Inspirations
|
A. First of its kind workshop in Pakistan
B. Learn about research
C. Career advancement
D. E-Certificate
E. Learn from leading experts from AKUH
F. Productive and efficient use of time
G. Ease of access of a free online workshop
H. Recommendation
I. No Response
|
4 (10.0%)
36 (90.0%)
21 (52.5%)
21 (52.5%)
13 (32.5%)
11 (27.5%)
3 (7.5%)
4 (10.0%)
1 (2.5%)
|
2. Workshop Strategy
|
2.1 Teaching Pedagogy
|
A. Presentations
B. Live demonstration (screen share)
C. Small classroom format
D. Use of examples
E. Use of audio-visual media
F. No Response
|
9 (22.5%)
23 (57.5%)
5 (12.5%)
9 (22.5%)
2 (5.0%)
8 (20.0%)
|
2.2 Logistics
|
A. Internet connectivity
B. Video playback
C. Clash with preexisting commitments
D. No challenges faced
E. No Response
|
10 (25.0%)
3 (7.5%)
2 (5.0%)
24 (60.0%)
3 (7.5%)
|
3. Workshop Feedback and Evaluation
|
3.1 Strengths
|
A. All session objectives covered
B. Time duration per session
C. Appropriate for beginners
D. Utility of pre and post tests
E. Ease of supplemental documentation
F. Q&A Session
G. No weakness
H. No Response
|
27 (67.5%)
5 (12.5%)
16 (40.0%)
14 (35.0%)
7 (17.5%)
2 (5.0%)
5 (12.5%)
2 (5.0%)
|
3.2 Limitations
|
A. Did not cover all objectives
B. Time duration per session
C. Too complex
D. Too basic
E. Insufficient time for Q&A
F. No Response
|
4 (10.0%)
22 (55.5%)
9 (22.5%)
13 (32.5%)
8 (20.0%)
2 (5.0%)
|
3.3 Recommendations for Improvement
|
A. Lecture recordings
B. Fewer participants
C. Greater interaction
D. Homework and follow up assignments
E. Answer key and scores for pre and post tests
F. Utilization of real time “chat-box” platform
G. Increased number of sessions
H. No Response
|
13 (32.5%)
10 (25.0%)
20 (50.0%)
5 (12.5%)
4 (10.0%)
8 (20.0%)
14 (35.0%)
2 (5.0%)
|
4. Impact Assessment
|
4.1 Ability to Implement
|
A. Ability to Undertake Independent Projects
B. Expansion in own Institutions
C. No Response
|
23 (57.5%)
22 (55.0%)
10 (25.0%)
|
4.2 Interest in Advanced Workshops
|
A. Need to conduct an advanced series
B. Interest in attending an advanced series
C. No Response
|
24 (60.0%)
29 (72.5%)
11 (27.5%)
|
Table 3
Representative Quotations from Qualitative Focused Group Discussions
Themes
|
Subthemes
|
Participant Quotations
|
Motivating Factors for Participation
|
Baseline Knowledge
|
Fifth Year, 24 y Male: “I learnt many things from this course. A few topics were completely new for me…”
Fourth Year, 20 y Male: “I brushed up on a lot of things I knew before, and I learned many new things too…”
Third Year, 22 y Female: “My knowledge improved a lot since I didn’t even know the ABC of research but now, I know how to do referencing, write an abstract etc.”
|
Inspirations
|
Third Year, 21 y Female: “Develop basic skills as a beginner…convenience of online sessions. Helps with residency acceptance by giving you an edge over those who might have similar STEP scores…”
Third Year, 22 y Male: “To improve my CV, get a certificate and to improve my knowledge.”
First Year, 18 y Male: “Curiosity for attending an online workshop and learn more about research; E-certificate was a minor inspiration.”
|
Teaching Format
|
Teaching Pedagogy
|
Fifth Year, 25 y Female: “Giving us examples of research, screensharing and showing us how to use the softwares really allowed us to learn.”
First Year, 18 y Male: “ …Examples and demonstration was used to make the audience understand content.”
|
Workshop Feedback and Evaluation
|
Strengths
|
Fifth Year, 23 y Female: “The basic things were covered by all the speakers and everything was explained…”
Second Year, 21 y Female: “I gained adequate knowledge considering I'm a beginner and the management was really good…”
First Year, 18 y Female: “Teachers taught right from the basics so even a beginner could understand what was being taught.”
|
Limitations
|
Fifth Year, 22 y Female: “Final year to first year, all students were dealt with the same way even though everyone has different levels of introduction to research.”
Second Year, 19 y Female: “If the sessions were over a longer period of time with less duration, might have been more beneficial because as a beginner it was difficult to take in everything.”
|
Recommendations for Improvement
|
Fifth Year, 23 y Female: “Recorded lectures would be better for next time…”
Second Year, 21 y Male: “Small group sessions could have been conducted to increase interactions…”
First Year, 18 y Female: “Smaller groups. Better interaction. Content should be according to comprehension level.”
|
Impact Assessment
|
Ability to Implement
|
Fifth Year, 23 y Female: “I would love to do research myself and will be able to conduct a similar workshop at my institution.”
First Year, 18 y Female: “I believe I can do research independently to some extent and will be able to teach and conduct similar workshops, but with the help of colleagues.”
|
Interest in Advanced Workshops
|
Fifth Year, 25 y Female: “Will be interested in an advanced workshop series. Should include how to assess journals for article submission and publication.”
Second Year, 19 y Male: “I would be interested in attending a future series, especially if it incorporates SPSS analysis.”
First Year, 18 y Male: “Yes, will definitely think on participating in it. Should include more advanced information on these sessions and include steps on how to start off with research since we know what to do but not sure about the platforms where we can proceed with our research.”
|
Theme 1: Motivating Factors for Participation
24 (60.0%) participants reported no baseline knowledge regarding research, which motivated them to register for the series and particularly learn basic research skills (n=36, 90.0%). For example, a second-year medical student commented, “We didn’t have any orientation related to the concept of research; neither in first-year, nor in the second-year - so we wanted to learn about research.” Similarly, another first-year medical student was quoted as saying “…Wanted to start from scratch so really needed a basic course and a platform where people could tell me how research is done…”
Other factors that inspired registrations included the provision of certificates on the completion of the course (n=21, 52.5%), the possibility of developing an academically sound career (n=21, 52.5%) and the opportunity to learn from research experts affiliated with a leading research institute in the country (n=13, 32.5%).
Theme 2: Teaching Format
A hybrid teaching style, combining a presentation format and real-time practicing of problems, demonstrated through screen-sharing on Zoom was considered one of the best teaching methodologies employed by the workshop by 23 (57.5%) participants, followed by the use of presentation and examples within the sessions by 9 (22.5%) attendees each. For example, a fifth-year medical student stated that, “Screensharing, showing videos, relating content with real life and giving examples really helped in understanding the topic…”
When participants were asked about any logistical issues encountered during the workshop, most of the students (60.0%) did not face any challenges. However, 10 (25.0%) respondents experienced internet connectivity issues and 3 (7.5%) students reported interrupted livestreaming.
Theme 3: Workshop Feedback and Evaluation
27 (67.5%) participants stated that the major strength of the workshop was the fulfillment of all stated objectives, while 16 (40.0%) students felt that the course content was appropriate for beginners. One second-year medical student appreciated the “synchronization of content with objectives,” and another stated: “I am satisfied with the content and objectives and how they were covered. It was pretty good and comprehensive for beginners.”
Similar to the limitations highlighted in the feedback form, the duration of the sessions was considered a major shortcoming by 22 (55.5%) participants. Furthermore, a significant variability was seen in the comprehension of the course content by students, which led some to find the course too basic (n=13, 32.5%), while others found it to be too complicated (n=9, 22.5%).
Theme 4: Impact Assessment
23 (57.5%) participants stated their confidence in leading a research project after the course, along with 22 (55.0%) students who showed interest in expanding a research platform within their institutions through dissemination of the learnt knowledge, as stated by a first-year medical student, “…. I can teach and deliver the skills to students in my institution, at least the ones I learnt”.
The possibility of an advanced workshop series was exciting for many participants, with 29 (72.5%) attendees showing an interest in attending a future workshop series.