A population of 305 students were eligible to participate. Eighty-two students (27%) completed the SEC and 68 (22%) completed the online survey.
Online Survey
Table 1 displays the means and standard deviations (SD) for the TBL Student Assessment Instrument. These results show moderately positive outcomes for all three subscales, resulting in a moderately favourable overall experience with TBL compared to lectures. Scale reliability was satisfactory for the accountability (.737) and TBL preferences (.774) scales, and excellent for the TBL satisfaction scale (.921).
Table 1
The Team-Based Learning Student Assessment Instrument descriptive statistics.
Subscale
|
N
|
Mean (SD)
|
Accountability
|
68
|
22.2 (2.8)
|
Preference
|
68
|
52.7 (6.3)
|
Satisfaction
|
67
|
33.5 (5.1)
|
Overall
|
67*
|
108.5 (12.2)
|
*One participant did not answer the questions relating to the satisfaction subscale and thus could not be included |
Table 2 displays the means and standard deviations for the remaining questions. These were rated on a scale from 1 to 10. Higher scores indicated students favoured TBL. The results show modest positive results for all questions.
Table 2
Descriptive statistics for the additional questions.
Question (descriptive answer range)
|
N
|
Mean (SD)
|
How would you rate your experiences of the Team Based Learning approach overall? (poor to excellent)
|
68
|
6.8 (1.6)
|
How difficult/easy was it to adjust to learning via the TBL process? (very difficult to very easy)
|
67
|
6.2 (1.6)
|
How would you rate…? (poor to excellent)
|
…the engagement or interaction experienced in TBL classes?
|
68
|
6.7 (1.5)
|
…your own level of learning from the TBL process?
|
68
|
6.6 (1.3)
|
Please rate the following TBL steps in terms of how useful each was to your learning. (not useful to highly useful)
|
The (self) preparation readiness
assurance phase
|
69
|
6.3 (1.7)
|
The individual (iRAT) and team test (tRAT) processes
|
70
|
6.4 (1.5)
|
The IF AT test resources (Scratch card process)
|
69
|
6.5 (1.7)
|
How enjoyable were the individual (iRAT) and team test (tRAT) processes? (not at all to very enjoyable)
|
70
|
6.8 (1.7)
|
Student Evaluation of Course (SEC)
The SEC asks student to agree or disagree with the following statements on a 5-point Likert scale: Q1 ‘This course was well-organised’; Q2 ‘The assessment was clear and fair’; Q3 ‘I received helpful feedback on my assessment work’; Q4 ‘This course engaged me in learning’; Q5 ‘The teaching (lecturers, tutors, online etc) on this course was effective in helping me to learn’; Q6 ‘Overall, I am satisfied with the quality of this course’. These scored a median 4/5 on the Likert scale in each item.
Performance
Table 3 displays the grade distribution achieved by the whole cohort in the course delivered using TBL. The overall mean score in this course was 72.89% (SD = 12.63) compared to a mean of 63.96% (SD 2.42) across the other four courses delivered in the program during the previous 18 months.
Table 3
Students’ course score performance comparisons across the programme.
Comparison of course mean scores
|
Course 1
|
Course 2
|
Course 3
|
Course 4
|
Overall Mean
|
SD
|
Other Course mean scores
|
59.84
|
64.7
|
66.01
|
65.32
|
63.9675
|
2.43
|
TBL Course
|
|
|
|
|
72.89
|
12.63
|
Qualitative Data
Qualitative data were obtained from the SEC qualitative statements, and from the qualitative element of the online survey tool. These were analysed via NVivo 12.
Four themes were developed following 245 original code references, and 17 theme revisions highlighted within the qualitative texts. These themes were Engagement, Learning, Process, and Challenges. Overall, the responses were positive about the experience of TBL, although some students did express some concern about the approach. This can be seen in Fig. 1 below:
Theme 1: Engagement
This theme drawn from 40 reference statements, encapsulated aspects related to activity, engaging and sharing with others, and team working as a result of the TBL process. Students appeared to enjoy the opportunity for working in teams and interacting with others:
Team based learning approach was very engaging and beneficial in understanding the course better.
Team based learning used in teaching is a good approach. It engages students more than traditional teaching methods.
Theme 2: Learning
This theme was drawn from 24 reference statements. These were related to the students demonstrating positive attitudes towards the learning experience and the learning/understanding gained in the process. Participants highlighted the value of the TBL approach in relation to their learning:
Team based learning is good to aid in learning process.
‘It’s basically putting my knowledge to a test to see what I have learned has retained.’ (SIC)
Especially at the end of IF-AT & tRAT where we get to challenge the lecturer with our own answers. This promotes critical thinking and allows students to learn in a unique way.
Theme 3: Process
This theme was drawn from 47 reference statements. It refers to the TBL aspects that the students experienced and their perceptions of them. The students seemed to enjoy the team-based learning process:
It is a fun and engaging way of learning and it has certainly benefitted me in my learning journey.
Team-based learning is really effective, as followed by feedback session where students can clarify the answers with the lecturer for any doubt or confusion.
Theme 4: Challenges
This theme was drawn from 43 reference statements and relates to aspects students reported as challenging or negative from their perspective. There were some aspects that students found impacted on their engagement:
‘I recalled the first trial was quite difficult because sometimes we hardly to express our opinions with others whom we don't know, and we weren't sure about the flow of TBL and how it worked.’ (SIC).
The members who are non-enthusiastic in contributing to the team's efforts.
Some challenges were identified in relation to learning:
Did MCQ for whole class without explanation, I didn’t feel I’m learning.
The process was also not without its challenges:
It is challenging and mentally draining to work on 100 MCQ and 1–2 scenario(s).
I prefer combination of traditional lecture with team-based
Environmental factors such as classroom layout were noted as the factors most affecting the approach including the noise when groups were working and discussing in their teams
‘Round table will be the best, sitting in a row can be difficult to do discussion’
TBL can be a bit noisy. Hard to focus.
The students also found the peer review aspect to be challenging as some were reluctant to criticise their colleagues:
‘No peer evaluations, it’s not true evaluation due to the Asian culture. Nobody will write honestly; majority are positive feedbacks.’ (SIC)
However, some students recognised the value of the peer review:
I like it. If they just say you're not good or you're good it doesn't help, but if it's constructive feedback, they tell you your improvement area it really helps.