Analysis of questionnaire responses: Mean responses and their standard deviations were calculated for each statement (n = 35) on a scale from of 1 to 5 and are presented in Table 1. Mean male and female responses were also compared for each statement and the average response to each statement taken over all students was compared with the mean CIT response. The mean nursing student response for each statement was statistically significantly greater than 3.0 (mean response) at the 95% confidence level (p < 0.05). The exceptions occurred in items S11 and S20, namely “My understanding is improved compared to similar courses I studied before” and “Compared to face-to-face course settings, I am less satisfied with this learning experience”. In each case the mean score was below neutral (3.0) but not significantly so in the case of the former, but very significantly so for female students in the case of the latter (p < 0.001).
Table 1
Title: Male and female questionnaire responses and comparative statistics.
The statements comprising the questionnaire together with mean, standard deviations and gender comparisons of the nursing student responses and their CIT comparators. T-tests comparisons of mean responses are between columns 2 and 3 (Nursing and CIT students) and between columns 4 and 5 (male and female nursing students).
| Nurse sample (n = 283) | CIT 2012 (n = 108) | | Nurse Male (n = 84) | Nurse Female (n = 199) | Male/female Nurse comparison |
Questions | Mean (SD) | Mean (SD) | | Mean (SD) | Mean (SD) | p-value |
Interaction Domain (S1-S9) | | | | | | |
S1. A blended learning session keeps me always alert and focused. | 3.43 (1.08) | 2.60*** (1.25) | | 3.55 (1.07) | 3.38 (1.08) | 0.236 |
S2. Interaction is adequately maintained with the lecturer when he/she is on the other side of the blended learning classroom. | 3.63 (1.02) | 3.00*** (1.27) | | 3.67 (1.08) | 3.62 (1.00) | 0.724 |
S3. Having students from the opposite gender on the other side of the blended learning classroom listening to what I say might restrict my participation. | 3.21 (1.23) | 3.45 (1.35) | | 3.27 (1.26) | 3.18 (1.22) | 0.568 |
S4. A blended learning course makes it more important for students to visit the lecturer during office-hours. | 3.30 (1.08) | 3.45 (1.26) | | 3.11 (1.05) | 3.30 (1.10) | 0.954 |
S5. I cannot interrupt the lecturer to ask a question when he/she is on the other side of the blended learning classroom. | 3.55 (1.16) | 3.30 (1.52) | | 3.80 (1.17) | 3.45** (1.15) | 0.021 |
S6. I am satisfied with the quality of interaction between all involved parties. | 3.68 (1.00) | 3.10*** (1.17) | | 3.61 (1.12) | 3.71 (0.94) | 0.466 |
S7. I am dissatisfied with the process of collaboration activities during the course. | 3.33 (1.15) | 3.40 (1.31) | | 3.42 (1.19) | 3.29 (1.13) | 0.395 |
S8. I am satisfied with the way I interact with other students. | 3.77 (0.99) | 3.60 (1.13) | | 3.69 (1.09) | 3.81 (0.95) | 0.385 |
S9. I am satisfied with my participation in the class. | 3.93 (0.96) | 3.35*** (1.28) | | 4.05 (0.94) | 3.88 (0.96) | 0.186 |
Instruction Domain (S10-S21) | | | | | | |
S10. Use of blended learning technology in this course encourages me to learn independently. | 3.77 (1.12) | 3.15*** (1.16) | | 3.80 (1.19) | 3.75 (1.09) | 0.772 |
S11. My understanding is improved compared to similar courses I studied before | 2.89 (1.27) | 2.70 (1.14) | | 2.93 (1.27) | 2.87 (1.28) | 0.743 |
S12. My performance in exams is improved compared to similar courses I studied before | 3.49 (1.22) | 2.75*** (1.18) | | 3.65 (1.21) | 3.43 (1.22) | 0.149 |
S13. I am satisfied with the level of effort this course required. | 3.62 (1.06) | 3.20** (1.15) | | 3.79 (1.07) | 3.55 (1.06) | 0.085 |
S14. I am dissatisfied with my performance in this course. | 3.34 (1.20) | 3.00* (1.31) | | 3.42 (1.33) | 3.31 (1.14) | 0.507 |
S15. I believe I will be satisfied with my final grade in the course. | 3.59 (1.05) | 3.40 (1.08) | | 3.74 (1.12) | 3.53 (1.02) | 0.138 |
S16. I am satisfied with how I am able to apply what I have learned in this course. | 3.45 (1.04) | 3.40 (1.18) | | 3.37 (1.21) | 3.48 (0.97) | 0.467 |
S17. Had I known this was a blended learning class, I would not have taken it. | 3.91 (1.07) | 3.00*** (1.33) | | 3.82 (1.18) | 3.95 (1.02) | 0.386 |
S18. I am willing to take another course using the blended learning delivery mode | 3.80 (1.02) | 2.55*** (1.29) | | 3.86 (1.04) | 3.78 (1.01) | 0.561 |
S19. I am satisfied enough with this course to recommend it to others. | 3.62 (1.11) | 2.90*** (1.26) | | 3.71 (1.20) | 3.58 (1.07) | 0.385 |
S20. Compared to face-to-face course settings, I am less satisfied with this learning experience. | 2.65 (1.23) | 2.50 (1.37) | | 3.01 (1.28) | 2.50** (1.18) | 0.002 |
S21. I enjoy working on assignments by myself. | 3.76 (1.01) | 3.55 (1.29) | | 3.75 (1.11) | 3.77 (0.96) | 0.892 |
Instructor Domain (S22-S26) | | | | | | |
S22. The instructor makes me feel that I am a true member of the class | 3.61 (1.01) | 3.70 (1.29) | | 3.54 (1.10) | 3.64 (0.97) | 0.438 |
S23. I am dissatisfied with the accessibility and availability of the instructor | 3.31 (1.17) | 3.00* (1.36) | | 3.36 (1.20) | 3.30 (1.16) | 0.694 |
S24. The instructor uses blended learning technology appropriately. | 3.89 (0.95) | 4.00 (0.94) | | 4.12 (0.94) | 3.80** (0.94) | 0.009 |
S25. Class assignments were clearly communicated to me. | 3.60 (1.16) | 3.70 (1.22) | | 3.46 (1.24) | 3.66 (1.12) | 0.204 |
S26. Feedback on evaluation of tests and other assignments was given in a timely manner | 3.30 (1.20) | 3.70** (1.27) | | 3.54 (1.20) | 3.20* (1.19) | 0.031 |
Management Domain (S27-S29) | | | | | | |
S27. Discipline is highly observed when the lecturer is on the other side of the blended learning | 3.78 (1.01) | 2.95*** (1.32) | | 3.82 (1.04) | 3.77 (1.00) | 0.695 |
S28. The lecturer/supervisor always takes attendance. | 3.54 (1.02) | 4.00** (1.39) | | 3.55 (1.09) | 3.54 (0.99) | 0.943 |
S29. I attend discussion board classes the same way I attend face-to-face classes | 3.62 (1.27) | 3.85 (1.39) | | 3.46 (1.32) | 3.69 (1.25) | 0.185 |
Technology Domain (S30-S35) | | | | | | |
S30. The instructor’s voice is audible. | 3.66 (1.04) | 3.75 (1.28) | | 3.93 (0.93) | 3.55** (1.07) | 0.003 |
S31. Course content shown or displayed on the smart board is clear. | 4.10 (0.86) | 4.50*** (0.80) | | 4.10 (0.94) | 4.10 (0.83) | 0.998 |
S32. The microphone is in good working condition. | 3.78 (1.06) | 3.60 (1.31) | | 4.14 (0.89) | 3.62*** (1.09) | < 0.001 |
S33. The image is clear and comprehensive when the lecturer is on the other side of the blended learning classroom. | 3.94 (0.90) | 3.90 (1.27) | | 4.04 (0.86) | 3.89 (0.92) | 0.215 |
S34. Technical problems are not frequent and they do not adversely affect my understanding of the course. | 3.13 (1.30) | 3.65*** (1.21) | | 3.54 (1.19) | 2.97*** (1.31) | < 0.001 |
S35. The technology used for blended teaching is reliable | 3.88 (0.91) | 3.60* (1.11) | | 4.00 (0.93) | 3.83 (0.90) | 0.167 |
* p < 0.050, **p < 0.010, ***p < 0.001 |
Interaction domain: The main finding from Table 1 is that male and female nursing students report similar levels of satisfaction in the Interaction domain with the exception that male students are significantly more reluctant to interrupt an instructor during a blended learning session than female students. Mean levels of satisfaction significantly exceeded their CIT comparator in four aspects of instructor-student and student-student interactions and in so doing maintained good continuity of attention throughout remote e-learning sessions leading to the reinforcement of personal feelings of class participation. Otherwise nursing and CIT students had similar attitudes towards potential inhibitions when participating in a mixed gender environment, the importance of consulting instructors during office hours when undertaking blended learning courses and their willingness to interrupt instructors during e-learning sessions. In conclusion, satisfaction in the interaction domain was significantly above average for nursing students, and also significantly better than that of their CIT counterparts (p < 0.001).
Instruction domain: Nursing students most highly rated not being ‘put off’ before undertaking the blended learning course nor for participating in future courses, and also enjoyed undertaking assignments using this method. Male and female responses were similar in all the statements of this domain with the exception that female responses were significantly lower than those for males when comparing blended e-learning and face-to-face instruction. Male students took a neutral position whereas female students had a significant preference for the blended learning environment. Interestingly, male students were largely neutral in their comparison of blended e-learning and face-to-face instruction whereas female students mildly preferred blended e-learning over face-to-face instruction (p = 0.002).
By comparison with their CIT counterparts, nursing students showed significantly increased levels of satisfaction in 7 of the 12 facets of the instruction domain including their willingness to recommend their blended learning course to others and to participate in future courses involving blended learning, their belief that blended learning improves their motivation to learn independently and that the level of effort required of such a course will be reflect in improved examination performance by comparison with similar courses taken previously. In the remaining facets of the Instruction domain both cohorts of students had similar levels of satisfaction and beliefs. For example, each cohort positively enjoyed working independently on assignments, held positive beliefs that they will be satisfied with their final grades and with their ability to apply what has been learned. Interestingly, both cohorts refuted the notion that blended learning was inferior to face-to-face instruction. In overview, satisfaction in the instruction domain was significantly above average for nursing students, and also significantly better than that for their CIT counterparts (p < 0.001).
Instructor domain: Nursing students expressed good satisfaction with the way that course instructors created a class atmosphere, made appropriate use of technology, clearly communicated assignments and provided timely feedback. Male and female students responded similarly but the latter were significantly less satisfied than their male counterparts with the appropriateness with which instructors used blended learning technology and their timeliness of feedback. Nevertheless, female students were still moderately satisfied with instructors’ performance.
While the nursing and CIT students reported similar levels of satisfaction with the clarity of the communication of class assignments, use of blended learning and inclusiveness generated by instructors, it is clear that CIT students rated the timeliness of feedback and instructor availability significantly higher that their nursing counterparts who thought that instructors could have provided greater accessibility and availability than the current provision. Consequently, CIT students satisfaction with their instructors was significantly higher than that of nursing students (p = 0.030), although satisfaction was significantly better than average for the latter.
Management: Male and female nursing students were similarly well satisfied with the administrative aspects of blended learning courses, and in particular the positive acceptance of the need for discipline in the remote e-learning environment. Overall there was no significant difference between the nursing and CIT students in this domain (p = 0.717), although the latter viewed discipline as significantly less important than the former, but this facet was counterbalanced by CIT instructors being significantly more rigorous than their nursing faculty counterparts in recording attendance at e-learning sessions.
Technology: While nursing students were, on average, positively satisfied with all aspects of the Technology domain, the most notable feature of the responses in this domain was that female satisfaction was lower than that of males in 5 of the 6 facets of the domain, and demonstrated significantly less satisfaction with respect to the audibility of instructors’ voices, the operability of instructors’ microphones and the impact of adverse technical issues on the effectiveness of the remote e-learning session. Nevertheless, female students never rated these issues lower than neutral indicating an overall level of mild satisfaction.
On average, nursing students were less satisfied than their CIT counterparts in respect of the disruption caused by technical issues and the use of the smart notice board, but were better satisfied with how technology was used in their blended e-learning program. In overview, however, levels of satisfaction in the Technology domain for nursing and CIT student were similar (p = 0.717).
Analysis of domain responses
Questionnaire responses were further collated according to the five domains of satisfaction. The frequencies of responses are illustrated in Fig. 2.
Almost two-thirds (60%-65%) of respondents agreed or strongly agreed that they were satisfied with all five components of education being investigated by the questionnaire topics, approximately (15–20%) had a neutral response and less that one fifth (15–20%) disagreed or strongly disagreed. These responses demonstrate consistency in the students’ levels of satisfaction within each domain of the education context and across each of the domain. The mean domain responses are reported and compared in Table 2 by year of undergraduate study.
Title: Mean domain satisfaction responses are presented by undergraduate year of study.
Table 2
Mean and standard deviations of domain satisfaction responses are reported for nursing students by undergraduate year of study. Satisfaction levels between year groups are compared.
Domain | Undergraduate year of study | Inter-year comparisons of mean scores |
Year 2 N = 90 mean (SD) | Year 3 N = 103 mean (SD) | Year 4 N = 90 mean (SD) | Years 2 & 3 p-value | Years 2 & 4 p-value | Years 3 & 4 p-value |
Interaction | 3.56 (1.12) | 3.48 (1.05) | 3.58 (1.14) | 0.174 | 0.660 | 0.069 |
Instruction | 3.40 (1.25) | 3.44 (1.14) | 3.65 (1.13) | 0.370 | < 0.001 | < 0.001 |
Instructor | 3.42 (1.20) | 3.52 (1.10) | 3.69 (1.04) | 0.189 | < 0.001 | 0.015 |
Management | 3.64 (1.13) | 3.63 (1.10) | 3.68 (1.11) | 0.889 | 0.672 | 0.560 |
Technology | 3.67 (1.07) | 3.67 (1.04) | 3.92 (1.07) | 0.905 | < 0.001 | < 0.001 |
The most significant finding in Table 2 is that 4th year undergraduate students have the highest mean scores in all five domains. Despite this result, the mean satisfaction scores in the domains of Interaction and Management are similar for years 2, 3 and 4. Second, the mean domain scores between 2nd and 3rd year students are similar in the remaining domains, and consequently students in their 2nd and 3rd years of study report similar levels of satisfaction across all the domains of enquiry. However, satisfaction levels of 4th year students in the domains of Instruction, Instructor and Technology are significantly higher than those of 2nd and 3rd year students (p ≤ 0.015).
A similar investigation of satisfaction ratings within individual year groups was conducted. Pairs of mean domain scores (n = 10 per year group) were compared within each year group. Rather that report detailed comparisons, we summarise the findings. Students in their 2nd year of study provided similar overall satisfaction ratings for the Interaction and Management domains (p = 0.281), the Instruction and Instructor domains (p = 0.670) and the Management and Technology domains (p = 0.686). All other comparisons of mean domain satisfaction scores were significantly different.
Students in their 3rd year of study assigned similar levels of satisfaction to the Interaction, Instruction and Instructor domains with p-values ranging from p = 0.159 to p = 0.523, but these scores were statistically significantly lower than satisfaction scores for the Management and Technology domains which were similarly rated (p = 0.606). Again, all other comparisons of mean domain satisfaction scores were significantly different.
Finally, students in their 4th year of study assigned similar satisfaction ratings to the Interaction, Instruction, Instructor and Course Management domains with p-values ranging from p = 0.080 to p = 0.908, but these domains all received satisfaction scores significantly lower than that for the Technology domain.
Reliability of data
The reliabilities of the five domains of the student questionnaire were tested using Cronbach’s alpha measure. The results of these calculations are shown in Table 3.
Table 3
Mean nursing and CIT domain satisfaction responses are compared. Cronbach α measures and their 95% confidence bounds are shown for each domain of the nursing and CIT (brackets) survey questionnaires.
Domains of enquiry | Comparison of Nurse and CIT mean domain scores and associated p-value | Cronbach α Nurse (CIT) | 95% confidence bounds for Cronbach α reliability |
Nurse mean (SD) | CIT mean (SD) | p-value | Lower Nurse/(CIT) | Upper Nurse/(CIT) |
Interaction (9 items) | 3.54 (1.10) | 3.10 (1.24) | < 0.001 | 0.682 (0.750) | 0.617 (0.650) | 0.725 (0.800) |
Instruction (12 items) | 3.49 (1.18) | 3.00 (1.23) | < 0.001 | 0.864 (0.840) | 0.834 (0.770) | 0.886 (0.914) |
Instructor (5 items) | 3.54 (1.12) | 3.80 (1.23) | 0.030 | 0.720 (0.700) | 0.656 (0.590) | 0.763 (0.780) |
Management (3 items) | 3.65 (1.11) | 3.60 (1.35) | 0.717 | 0.534 (0.570) | 0.415 (0.400) | 0.633 (0.694) |
Technology (6 items) | 3.75 (1.07) | 3.70 (1.18) | 0.677 | 0.772 (0.800) | 0.724 (0.710) | 0.809 (0.840) |
All domains (35 items) | 3.37 (1.24) | 3.31 (1.23) | 0.667 | 0.906 | 0.888 | 0.918 |
The overall reliability of the questionnaire was rated in excess of 90%, which is excellent. Reliabilities of 86.4%, 77.2% and 72.0% in the Instruction, Technology and Instructor domains respectively are rated as good whereas a reliability rating of 68.2% in the Interaction domain is rated as acceptable (Cronbach alpha reliability descriptor https://stats.stackexchange.com/questions/70274/where-do-the-descriptors-for-cronbachs-alpha-values-come-from-e-g-poor-exce). Only the domain of Management falls below 60.0%, the minimum reliability rating of acceptability. All nursing indices fall within the 95% confidence intervals of the equivalent CIT index (in brackets) which suggests that the nursing and CIT questionnaires have similar (and good) levels of reliability.