Development of the EVIBEC Learning Outcomes Framework to support the delivery of evidence-based practice curricula in health care professional programmes: a Codesign Approach

doi:10.21203/rs.3.rs-3310504/v1

Download PDF

Research Article

Development of the EVIBEC Learning Outcomes Framework to support the delivery of evidence-based practice curricula in health care professional programmes: a Codesign Approach

https://doi.org/10.21203/rs.3.rs-3310504/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 03 Jan, 2024

Read the published version in BMC Medical Education →

You are reading this latest preprint version

Background

All healthcare professional education programmes must adopt a systematic approach towards ensuring graduates achieve the competencies required to be an evidence-based practitioner. While a list of competencies for evidence-based practice exist, health care educators continue to struggle with effectively integrating these competencies into existing curriculum. The purpose of this project was to develop an open access cross-discipline, learning outcomes framework to support educators in integrating the teaching, learning and assessment required to ensure all graduates of health care professional programmes can achieve the necessary evidence-based practice competencies.

Methods

An interdisciplinary project team of 7 health care professions educators and a librarian completed a review of the health professions literature on the teaching and assessment of evidence-based practice. The literature coupled with the teams’ collective experiences in health professions evidence-based education and research were used to identify relevant teaching, learning and research frameworks to inform the project design. The guide and toolkit for experience-based co-design developed by the NHS Institute for Innovation and Improvement was adopted for this study. A four-step approach involving three online interactive and participatory co-design workshops and a national stakeholder validation workshop was designed. Students (n = 33), faculty (n = 12), and clinical educators (n = 15) contributed to the development and validation of the EVIBEC learning outcomes framework through this co-design approach.

Results

Through a rigorous, systematic co-design process the EVIBEC Learning Outcomes Framework was developed. This framework consists of a series of student-centred learning outcomes, aligned to EBP competencies, classified according to the 5 As of EBP and mapped to the cognitive levels of Bloom’s taxonomy. Associated learning activities for each step of EBP are suggested.

Conclusions

Co-design was an effective method to develop a learning outcomes framework and associated learning activities to support integration and delivery of evidence-based practice across health care professions education programmes. Furthermore, outcomes from the co-design workshops supported the use of a spiral curriculum design where knowledge and skills are introduced and revisited at increasing levels of complexity over time coupled with the use of active learning and assessment activities to deliver evidence-based practice curriculum.

Evidence based practice (EBP) is defined as the integration of best research evidence with clinical expertise and patient values [1]. It is recognised as fundamental for safe, high-quality healthcare and therefore should be an essential component of all healthcare professional (HCP) education programmes [2–5]. HCPs are mandated by professional and regulatory bodies, WHO guidelines and national policies to work within an EBP context. Despite the recommendation that HCP educators incorporate the necessary competencies in their programmes [6], one of the long-recognised barriers to EBP education is lack of consistency in EBP curricular content [7–9]. Recent reports also highlight that effectively embedding EBP throughout HCP curricula remains a particular challenge [10–13]. While academics are generally supportive of teaching EBP, barriers such as competing job demands, lack of faculty skills, knowledge, and confidence, or supporting curricula frameworks impede progress [13–18]. These academic barriers impact HCP student EBP competency and contribute to deficits that continue to undermine healthcare quality, safety, and patient outcomes [16, 19].

The Institute of Medicine (IOM) first recommended core EBP competencies for their profession in 2003 [2]. In 2005, the Board on Health Care Services Health Professions Education Summit defined core competencies for all HCPs, one of which included EBP [20]. In Europe, following a conference of EBP health care educators and developers, an international working group published the Sicily consensus statement on EBP [21], comprising a five-step, 5As model (Ask, Acquire, Appraise, Apply, Assess) for teaching and conducting EBP, and a description of core competency requirements. Since then, various EBP competency frameworks or statements have been developed independently by most HCP disciplines and their regulatory bodies [13, 22] with the overall aim of assisting educators in developing curricula and promoting alignment of competencies with appropriate learning activities and assessment strategies [11].

Despite this more recent availability of EBP competency guidelines, the lack of uptake by healthcare educators suggests they may not meet the needs of all disciplines or educators [15, 23]. Additionally, where EBP has been integrated, inconsistencies in curricular content and the quality of teaching have been noted [9, 24]. Aiming to standardise and further enhance teaching, Albarquoni and colleagues [24] developed an international, consensus-based, set of core EBP competencies for entry-level HCP programmes. This approach offers a universal shared language with clear benchmarks to inform EBP curricular development.

Whilst defining a set of core competencies for EBP education was a necessary first step for the implementation of effective EBP education, such competency frameworks and statements provide a broad overview only. They do not identify in any detail the knowledge, skills, and attitudes (KSAs) required to be an effective evidence-based practitioner or articulate these as actionable learning outcomes. Since the Bologna agreement [27], outcomes-based curriculum design has increasingly been recognised as the appropriate approach for all third level institutions [26–27]. Learning outcomes are defined as: “statements of what a learner is expected to know, understand and/or be able to do at the end of a period of learning” [28], and place the emphasis on student achievement of learning rather than content delivery [29]. The overall result is a curriculum design that focuses on the desired student impact and facilitates planning of how this may be achieved [30]. Constructive alignment of appropriate learning activities and assessment strategies in turn allows clarity in achievement of learning outcomes [31].

In view of the complexity of the pan-European competency statements provided by Alberqouni et al. [24] the next logical step towards supporting EBP educators is to disaggregate these competencies into a series of transparent and explicit achievable learning outcomes. These learning outcomes should encompass multiple cognitive learning levels allowing scope for progression and vertical integration of EBP learning from early to late programme stages. In addition, they should also be expressed from a student perspective in a way that students can clearly relate to, requiring a development process that is most effectively achieved using a co-design process [31–34]. Given that EBP competencies are required by multiple HCP disciplines, there is huge potential gain from an interdisciplinary approach to curriculum design, with the collaboration of an interprofessional team of HCPs offering additional benefits [35].

The aim of this study was to develop the first cross-discipline, vertically integrated, open access, learning outcomes framework to support EBP curriculum development and delivery across entry-level HCP programmes.

Objectives:

To articulate student-centred learning outcomes required to achieve core evidence-based competencies through a co-design process involving collaboration with an interdisciplinary group of HCP students.

To map the developed outcomes to both the 5 As of EBP and the cognitive levels within Blooms' taxonomy to create a learning outcomes framework.

To identify student-friendly learning activities to attain the EBP learning outcomes.

An interdisciplinary (ID) group of academics (7 educators from 7 HCP programmes and 1 librarian), from a leading Irish University, involved in the design and delivery of Evidence Based Practice in their respective HCP programmes established the Evidenced-based Education collaborative (EVIBEC) project management team. Ethical approval for the project was obtained from University College Dublin, Human Research Ethics Committee (LS-E-20-166-Redmond). Access and support for the recruitment and involvement of registered students was obtained from the Heads of Schools/Disciplines in each of the participating healthcare programmes.

Co-design approach

A co-design approach was deemed most suitable for the development of this learning outcomes framework. Co-design, within the context of health services research, is the process of bringing together service users, clinical and non-clinical staff, and at times, relevant support, and advocacy groups to work collaboratively to improve or refine elements of the care system, services, or processes [36]. This overall approach lends itself well to application in a healthcare education setting although reports of its use in this context are limited. Theobald et al [32] brought together hospital and academic service providers to co-design a postgraduate specialist course and concluded that this strengthened the nexus between both entities thus advancing relevant learning and employability. Hardie et al., [33] utilised a co-design process that included undergraduate student nurses, to develop an innovative educational nursing preceptorship programme. The case study of Dederichs et al., [37] indicated the feasibility and acceptance of a participatory design workshop for medical students. What is clear is that co-design in health professional education has great potential to provide a structured approach to collaborative working in creating and refining curriculum which is responsive to the needs and interests of students, educators, practitioners, practice development personnel and patients.

Co-design Team

The co-design team comprised the interdisciplinary EVIBEC project management team and 33 undergraduate and postgraduate students, registered to the participating HCP programmes in the University, (see Table 1).

HCP students in the later stages of their programmes, who had undertaken a module in EBP within the last year, were sent an email outlining the study. Students responding to the initial call for expressions of interest were given an information leaflet and consent form for participation in the co-design team.

Supporting Meaningful Involvement

Open, reciprocal, and democratic dialogue where all participants contribute equally is core to meaningful involvement in co-design [38]. When developing the co-design approach, the development team were mindful of the contextual, environmental, and social enablers to effective and meaningful participation [38, 39]. The team recognised the importance of fostering a positive team atmosphere which is receptive to the contribution of students. A faculty co-design team member was identified as an ‘involvement champion’. This champion was a point of contact for the students and provided pre-workshop information sessions to ensure students felt confident when joining the wider co-design team. A critical mass of students from each of the 7 HCP disciplines was recruited (min. 4 students from each discipline). This ensured amplification of the student voice relative to the faculty voice as well as balancing the representation across disciplines.

The co-design team made an explicit commitment to avoid use of jargon and to explain any technical language as and when it arose in discussions. The collective aim was for a relaxed and informal atmosphere with all team members identified by first name only. Because COVID-19 public health guidance was in operation at the time of the co-design sessions, all workshops were conducted via Zoom™ (Zoom Inc, CA USA). Students were provided with an ‘icebreaker’ session in advance of the first workshop which ensured access, familiarity and confidence with virtual platforms being used. To accommodate the varying schedules of students across programmes all workshops were conducted in the evening. This facilitated attendance of students who were undertaking clinical practicums with resulting stable participation (bar one student who missed one workshop due to family commitments) throughout the workshops. All students received an honorarium (one-for-all voucher for €30) at the end of the project in recognition of their contribution to the co-design work.

Research Design

This study followed the guide and toolkit for experience-based co-design developed by the NHS Institute for Innovation and Improvement (2005). A four-step approach was designed that comprised three online interactive and participatory co-design workshops and one key national stakeholder validation of the emerging framework event (See Fig. 1). The online workshops were conducted using Zoom™ web conferencing platform and interactive collaboration was facilitated using Mural™ (Tactivos Inc. Buenos Aires, Argentina), a digital whiteboard and innovative platform for creative collaboration.

Step One: Capture the experience.

Capturing key stakeholder (here educators and students) experiences is identified by the NHS Toolkit as a critical first step in this co-design approach. This guide notes that the approach should start by helping people to tell the story of their experiences.

a) Educator experience of EBP:

The EVIBEC project management team began by performing a review of the relevant literature exploring learning frameworks for EBP. Following a series of brainstorming sessions, the Albarquouni et al [24] set of core EBP competencies for health professionals was deemed the most suitable for this project. These had been recently adopted by the Clinical Effectiveness Unit, Department of Health, Ireland, and were identified as relevant for all entry level health professional programmes [40]. The team discussed, reflected on, and debated how these competencies related to the existing EBP curricula of each team member. This scoping exercise also assisted the team in identifying Bruner’s spiral curriculum design as appropriate to underpin the draft learning outcomes framework, where knowledge and skills are introduced and applied at increasing levels of complexity [41]. This type of spiral curriculum design supports student-centred outcomes-based education and provides flexibility in implementation. In addition, it was proposed that Bloom’s taxonomy would provide the cognitive levels necessary to scaffold the progression of learning outcomes throughout all stages of a programme [42].

b) Student experience of EBP

The focus of this step was to assist students in telling the story of their own experiences of learning EBP. In the first co-design workshop, students were grouped by discipline in virtual break out rooms. Each room had a member of the project team with experience in facilitating group discussions. The Mural platform contained instructions on each task set, the 5 As and the core competencies. It also displayed a clock, so tasks were completed on time.

The tasks were designed to return students to their EBP educational experience (to be situated) facilitating them in processing how they thought it connected with their HCP practice. Task 1 required students, individually and then in their group, to reflect on what they considered to be the key characteristics of an evidence-based practitioner. This helped them to link back to their experience and facilitated them in discussing and exploring their individual and shared experiences and understandings with colleagues. Task 2 asked participants to outline the knowledge and skills they considered necessary to become this effective evidence-based practitioner. Finally, the group was asked to reflect on their experiences of EBP education and if, how and why they thought their educational experience had facilitated their acquisition of the knowledge, skills, and attributes that they had identified.

Following the small discipline group discussions, everyone returned to the main virtual room and shared their discipline group’s perspectives with the larger group.

At the end of this workshop all participants had:

· Developed discipline specific conceptualisation of competencies for EBP

· Experienced sharing of perspectives and commonalities across disciplines

Step Two: Understand the experience.

The overall focus of this step was to facilitate co-design participants in integrating their experiences of EBP learning with conceptual frameworks for the five steps of evidence-based practice.

Workshop two aligned with the principles of the world cafe method (https://theworldcafe.com/key-concepts-resources/design-principles/). This method has been used extensively in education to facilitate large group dialogue and has, more recently, been used in co-design health education projects [43]. It is characterised by targeted small group rotating discussions, with each conversation building on the last. Mural proved an ideal platform for virtual hosting this method (see Fig. 2). Participants were randomly assigned to 1 of 5 mixed-discipline groups and directed to a virtual breakout room. Each of these 5 break out rooms was hosted by a facilitator and represented one of the 5 As. The participants were asked to reflect on, discuss, and develop a list of knowledge and skills relevant to the 'A' assigned to that room. Each group then rotated to the next room, read, reflected on, discussed, and built on the previous group(s) work before moving on again. The facilitator in each room prompted contribution, listened for patterns and insights, and harvested an overview of the conversations to share with the whole group during the concluding session of the workshop. This overall process ensured the integration of interdisciplinary perspectives and experiences.

Step Three: Improve the experience.

The step focuses on the facilitation of co-design participants in the creation of ideas for learning activities that support the development of the knowledge and skills identified in workshop 2.

Following principles from the participatory research method of deliberative dialogue, where the best course of action is determined through discussion [44, 45], students were placed in interdisciplinary groups within breakout rooms. In these groups they discussed learning activities that they had previously found useful for learning EBP and proposed additional novel exercises that they thought might aid learning within each of the EBP A domains. They then framed these activities in terms of their position and progression within their programmes (early, middle or late-stages). At the end of the process, students were asked to reach a consensus, identifying one key Interdisciplinary learning activity for each ‘A’ and prepare a ‘sales pitch’ to present to the whole group explaining their choice. Each facilitator`s role was to absorb information, promote reflection, and provide feedback, encouraging prioritising with the intention of identifying and reaching consensus on the intervention components.

Step Four: Assess the experience with a ‘critical friend’

In this final step of the co-design process the emergent co-designed framework was presented to an audience of stakeholders and disciplinary experts to allow open discussion and feedback. This workshop was delivered at the Irish Network of Healthcare Educators (INHED) national conference in Dublin in 2021. Ethical permission was obtained from the hosting institution and informed consent gained from all conference participants who attended the workshop (n = 15).

During this interactive workshop, participants undertook some of the same exercises that had been performed by students in their workshops. The aim of this was to provide context for the participants and to explore their perceptions of the knowledge, skills and learning strategies necessary to attain the 5 A EBP competencies. In break out rooms participants then explored the developing EVIBEC learning outcomes framework and its related learning activities and were asked to validate or contest its content. All discussions were fed back to the whole group at the end of the session to derive a consensus.

Finally, the participants in this 4th workshop brainstormed immediate and long-term suggestions for implementation and dissemination of the EVIBEC framework under the following headings: clinical practice; module/ course level; programme level - positioning, embedding, acceptability, feasibility, training, evaluation; Institution level - policy and procedures; National level - regulatory bodies, dissemination mechanisms and international level.

Participants

The demographic profile of the student and educator participants is presented in Table 1. A minimum of 4 students participated from each of the disciplines involved, with some registered to late stages of an undergraduate degree and some registered at postgraduate level. Each discipline had an educator team member participating.

Table 1

Co-design participant demographics
Group	Profession	Degree type	Year level within degree	Participants (n)
Students	Human Nutrition	Undergraduate	Year 4	4
	Dietetics	Masters	Year 2	4
	Physiotherapy	Undergraduate	Year 4	3
		Masters	Year 2	1
	Medicine	Undergraduate		2
		Graduate degree		2
	Nursing and midwifery	Undergraduate	Year 4	3
		Graduate degree		2
	Veterinary medicine	Postgraduate	-	2
		Undergraduate	Year 4	2
	Veterinary nursing	Postgraduate	-	2
		Undergraduate	Year 4	2
	Radiography	Undergraduate	Year 4	4
Academic members	Dietetics and human nutrition			3
	Nursing and midwifery			2
	Veterinary medicine			1
	Veterinary nursing			1
	Radiography			1
	Physiotherapy			2
	Library and information services			1
	Medicine			1

The EVIBEC Learning Outcomes Framework

Data in this framework is the result of a collation of the work of the educators, students, and participants from the INHED conference. Data from the students and conference participants were collected in the format of virtual sticky notes from their mural board and summary documents created by each of the room facilitators. At the end of each co-design workshop, data were collated and presented to students prior to the next workshop. Due to time constraints and lack of student familiarity with learning outcome development, student data was not written in the form of learning outcomes. Instead, sticky notes consisted mainly of short terms or single words, indicating the knowledge and skills students perceived essential for an effective evidence-based practitioner. For example, in workshop 2, short statements such as “know how to perform a search” or “use Boolean operators' ' or “which CASP tool?” were received (see Fig. 2). Students also struggled to allocate their identified knowledge and skills to the appropriate ‘A’ domains of the 5 As of EBP. Hence, following this workshop, the project management team examined and discussed the data. Duplications were removed, data was placed under the correct ‘A’ domain and the content was converted to measurable learning outcomes, framed using an action verb followed by an appropriate object for that verb. The project team also ensured that each learning outcome was appropriately assigned and scaffolded to each cognitive learning level of Bloom's Taxonomy: knowledge, comprehension, application, analysis, synthesis, and evaluation.

The outputs from workshop 3 comprised a list of innovative non-traditional learning activities designed to meet the learning outcomes. Overall, students actively favoured contextual and situated learning activities as might be expected of adult learners [51–53]. Gamification of learning activities were proposed such as “Who`s who: what source are you” and “navigating virtual cases with graduated information release”. In the discussions students voiced their opinion that inclusion of a gaming component improves motivation. They also added that incorporating conceptual levels of difficulty or “cognitive scaffolds” into activities, similar to performance levels found in gaming, promote learning and keep learners engaged. Students favoured peer-learning and interactive teaching strategies such as “final years presenting to 1st years” and “group case discussions using online forums”. They were also explicit about beginning to learn EBP early in their programmes with the incorporation of EBP throughout different modules and all stages. However, notably only one group identified teaching strategies that incorporated EBP in clinical placements: “be provided with a tricky clinical dilemma - what's the evidence to guide practice - can be in clinical or classroom setting”.

The final workshop, WS4, occurred during the INHED conference. In this workshop participants were mainly clinical HCP educators. They also suggested EBP learning activities, however these tended to focus predominately on learning in clinical practice. They advocated for active learning strategies, problem-based learning, and work-based learning approaches. Suggested activities included: the practical use of audit tools; sharing examples; having a repository of “real” examples and having patients involved. They also agreed that the purposeful teaching of EBP should be positioned throughout healthcare curricula, within practice placements in addition to multiple academic modules. To aid this it was suggested that stronger links be made between academia and clinicians, with a two-way sharing of resources. The project team later reviewed suggested activities from workshops 3 and 4 and assigned them to the appropriate ‘A’ domains of the evolving learning outcomes framework.

Workshops 1–4 resulted in the generation of the EVIBEC Learning Outcomes Framework (see Fig. 3). This framework is hosted on Padlet (San Francisco, California, U.S.), a cloud-based collaborative platform designed to act like a virtual notice board, allowing real-time interaction and sharing of materials. This approach was selected as it allows what would have been a very large and unwieldy table to become easy to navigate and find the relevant sections. It also offers huge potential for open access sharing of materials and ideas, and it is hoped that it would form the basis to establish a community of practice approach to support EBP and drive further refinement of the framework.

Figure 3 shows the initial basic starting structure of the framework with the 5 As presented as columns from left to right across the screen and the colour coded cognitive levels of Bloom’s taxonomy as rows. A few examples of learning outcomes have been added to the ‘Ask’ column to show how the learning outcomes framework was built from here. This image allows readers to gain an overview of the final framework structure which is hard to appreciate in one image when it is fully populated.

More information about the EVIBEC project and a link to the live learning outcomes framework within Padlet can be accessed via our project website [58]. Additional Padlet screens can be accessed from the main page, with a link at the top of each column providing access to a Padlet page for each ‘A’ and one at the bottom of each column providing a link to suggested activities for each A, derived from the workshop participants.

Through a rigorous, systematic co-design process, involving an interdisciplinary group of HCP educators and relevant student groups, the EVIBEC framework is presented for the first time. This framework consists of a series of learning outcomes, aligned to EBP competencies, classified according to the 5 As of EBP and mapped to the cognitive levels of Bloom’s taxonomy. The framework is designed to support the integration of teaching and learning related to evidence-based practice throughout all entry level HCP programmes. There is clear value in designing an interdisciplinary syllabus for EBP. Firstly, it has core relevance across health professional programmes with very similar approaches relevant to each and hence significant potential gains from the sharing of resources [9, 21]. EBP competencies transect the healthcare disciplines regardless of the scope of practice and additionally feature heavily in the learning outcomes and pedagogical approaches within individual disciplines, with a common overall goal of effective EBP. Secondly, and of significant importance, as many professionals practise as a team, a trans-curricular approach will equip students with shared EBP language, knowledge, and skills. This will facilitate their future engagement in multi-disciplinary teams, debates, and practice development, all progressing an effective, constructive EBP agenda and future alignment of the professions.

The EVIBEC learning outcomes framework was developed with recognition of the requirement for progressive of learning from early to late programme stages, a requirement articulated strongly by both students and educators. A programmatic approach with deliberate progression of learning using scaffolded delivery approaches should enhance student EBP skill development, allowing students to build on learning gained during previous and parallel modules [31]. The explicit detailing of the knowledge, skills and attitudes required for competency in each of the 5 As should enable HCP educators to recognise and appreciate critical elements of EBP and should in turn afford greater consistency and transparency in curricular content. This framework is one that will support both entry level HCP education and continuous professional development for HCPs in clinical practice, especially important where HCPs undertook their professional education at a time where less emphasis may have been placed on EBP. Now hosted on the freely accessible website this framework will support educators in adopting a more systematic and explicit approach to the implementation of EBP learning in HCP programmes. It is also designed as a mechanism to promote the sharing of resources and the development of a community of practice aligned to the common aim of enhanced interprofessional EBP teaching and learning.

The underpinning beliefs of the interdisciplinary project team led to the choice of a co-design approach to this framework. In agreement with Moriña [46] and O`Connor [47] the team were of the belief that students have a valuable contribution to make and represent a valuable source of knowledge and insight for the effective development of T&L resources. Participatory co-design effectively fosters negotiation, participation, and inclusion of the voice of the students [48]. As end users of teaching pedagogies, it is recommended that students should be co-collaborators in the development and evaluation of T&L approaches to ensure an effective user-centred design [49]. In this study students appreciated being invited to contribute to enhancing curriculum and felt valued and empowered by this process. As one student voiced: “workshops were very useful and the dialogue beneficial to give a voice to and feel heard”. The student perspective provided unique insights - students were comfortable outlining the knowledge and skills required for the early EBP steps of Ask, Acquire and Appraise. However, in line with findings from other studies [24, 50], they struggled to express the components of Apply and Assess. They also required facilitator prompting to consider the connection between shared decision making, patient preferences and EBP. This difficulty of expressing progression has been described as the novice-expert divide where experts in a domain have attained and organised a large amount of information and may not appreciate the step-by-step learning needs of novice or advanced beginner students [51]. Co-creating a scaffolded learning outcomes framework with students moving from lower-level learning outcomes before progression to higher level learning was very instructive for both parties. It facilitated the incorporation of important learning outcomes that may have otherwise been overlooked by the project team. It also provided clear insight to educators about areas students find more challenging and in turn how best they can scaffold the curriculum to meet the student needs.

An important element of this study`s co-design process concerns the general features of student suggested learning activities. The students emphasised their preference for a wide range of contextual activities and emphasised that these had to involve active contextual interactions as this met a broader range of student learning preferences. They also suggested activities that would trigger their curiosity and enhance their motivation to learn. This is in line with other studies showing that students value access to different kinds of resources to support, motivate and enhance their learning with an adult learner preference for 'real life' learning [52, 53]. The diversity of the student group and their disciplinary differences enriched these discussions exposing participants, both educator and student alike, to a rich variety of learning experiences and activities. As voiced by one student “the interdisciplinary approach allowed us to get out of our own profession’s ‘bubble’ and think in new /alternative ways". The awareness of ideas and approaches from different disciplines also widens the variety over a single disciplinary approach.

The voice of clinical educators is equally valuable as their experiential knowledge is important in helping academics acknowledge the “multiple realities and meanings” of EBP in action [33, 54]. HCP educators in workshop 4 provided important insight into how learning outcomes and suggested aligned learning activities might support the learning and application of EBP knowledge in different learning spaces. There was a stark contrast between the focus of HCPs on learning in the clinical context, while students focused predominantly on learning in the HEI. Lewin et al [55] argue collaboration and co-design opens new ways to connect and combine different learning sites in higher education in which both universities and clinical institutions are equal partners in influencing learning and competence development in students. This certainly appeared evident in the findings of this study. This type of collaboration also fosters seamless learning processes thus enabling students to navigate between different spaces and different roles promoting and developing transferability between learning contexts in HCP education and decreasing the theory-practice gap [56, 57]. It is important that HEIs focus on EBP learning as part of clinical/professional work placement education and future developments and implementation should occur in close collaboration with students, the university, and the clinical setting thus maximising the overall integration of EBP education.

Limitations

The framework was developed within a single university in Ireland, a situation counterbalanced by external stakeholder feedback from the INHED conference and several validation exercises by way of conference presentations, an Irish National Forum seminar, and the seeking of expert opinion from EBP Ireland. Participating students in this study were self-selected and might not necessarily represent the full diversity of the university’s student population. This university does have a wide range of HCP educational programmes mapping to the One Health agenda so there was good representation, but obviously multiple other HCP disciplines were not represented (e.g., Dentistry, Pharmacy, Occupational therapy etc) which may limit the generalisability of the study in the first instance. However, it is the hope of EVIBEC team that the hosting of the framework on the Padlet platform will establish a community of practice and ongoing iterations of the framework. Further external validation is warranted, and the patient voice could also be sought to further progress this collaborative approach.

Combining experiential knowledge from students and clinical educators with scientific knowledge gained from a literature search and the expert knowledge of our team of EBP educators, facilitated the development of a shared understanding of EBP and the development of this consensus framework. This freely accessible EVIBEC framework will support entry level HCP education regarding EBP, offering clear potential for the development of interdisciplinary approaches and the sharing of valuable resources. The overall goal is the support of evidence-based healthcare with a view to enhancing healthcare efficiency and effectiveness. A co-design process involving HCP educators and students proved highly successful in development of a learning outcome framework.

Data Statement

The datasets generated and/or analysed during the current study are available from the corresponding author on reasonable request.

Consent for publication statement

Consent to publish data in an online, open-access journal was obtained from the study participants. All raw data has been de-identified.

Sackett DL, Rosenberg WM, Gray JM, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996;312(7023):71.
Institute of Medicine. Leadership Commitments to Improve Value in Health Care: Finding Common Ground: Workshop Summary. Washington, D.C.: National Academies Press; 2009.
Young T, Rohwer A, Volmink J, Clarke M. What are the effects of teaching evidence-based health care (EBHC)? Overview of systematic reviews. PLoS ONE. 2014;9(1):e86706–6.
Larsen CM, Terkelsen AS, Carlsen A-MF, Kristensen HK. Methods for teaching evidence-based practice: A scoping review. BMC Med Educ. 2019;19(1):259–9.
World Health Organization. European strategic directions for strengthening nursing and midwifery towards Health 2020 goals. In. Copenhagen: WHO Regional Office for Europe; 2015.
Thomas A, Saroyan A, Dauphinee WD. Evidence-based practice: a review of theoretical assumptions and effectiveness of teaching and assessment interventions in health professions. Adv Health Sci Educ. 2011;16:253–76.
Lehane E, Leahy Warren P, O’Riordan C, Savage E, Drennan J, ‘Tuathaigh O, O’Connor C, Corrigan M, Burke M, Hayes F. M et al: Research on Teaching of Evidence Based Practice in Ireland - to Health Care Professionals and Healthcare Students. Clinical Effectiveness Unit. In. Dublin: Department of Health;: Report prepared for Department of Health; 2017.
Lehane E, Leahy-Warren P, O'Riordan C, Savage E, Drennan J, O'Tuathaigh C, O'Connor M, Corrigan M, Burke F, Hayes M. Evidence-based practice education for healthcare professions: An expert view. BMJ Evidence-Based Medicine. 2019;24(3):103–8.
Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):1–8.
Skela-Savič B, Gotlib J, Panczyk M, Patelarou AE, Bole U, Ramos-Morcillo AJ, Finotto S, Mecugni D, Jarosova D, Patelarou E, et al. Teaching evidence-based practice (EBP) in nursing curricula in six European countries—A descriptive study. Nurse Educ Today. 2020;94(Journal Article):104561–1.
Lehane E, Agreli H, O’ Connor S, Hegarty J, Leahy-Warren P, Bennet D, Blake C, Burke F, Corrigan M, Drennan J et al. Development of a Competency Framework for Clinical Effectiveness Education. Report prepared for Department of Health, Clinical Effectiveness Unit, National Patient Safety Office, Ireland. In. Dublin: Department of Health; 2018.
Daly MM, DeAngelis TM. Teaching Evidence-Based Practice across Curricula-An Overview of a Professional Development Course for Occupational Therapy Educators. Occup Ther Health Care. 2017;31(1):102–9.
Janicke H, Johnson MA, Baillie S, Warman S, Stone D, Paparo S, Debnath NC. Creating the Next Generation of Evidence-Based Veterinary Practitioners and Researchers: What are the Options for Globally Diverse Veterinary Curricula? J Vet Med Educ. 2020;47(5):647–58.
Stichler JF, Fields W, Kim SC, Brown CE. Faculty Knowledge, Attitudes, and Perceived Barriers to Teaching Evidence-Based Nursing. J Prof Nurs. 2011;27(2):92–100.
Melnyk BM. The Current Research to Evidence-Based Practice Time Gap Is Now 15 Instead of 17 Years: Urgent Action Is Needed. Worldviews Evid Based Nurs. 2021;18(6):318–9.
Melnyk BM, Gallagher-Ford L, Zellefrow C, Tucker S, Thomas B, Sinnott LT, Tan A. The First U.S. Study on Nurses’ Evidence-Based Practice Competencies Indicates Major Deficits That Threaten Healthcare Quality, Safety, and Patient Outcomes: U.S. Study on Nurses’ Evidence-Based Practice Competencies. Worldviews Evid Based Nurs. 2018;15(1):16–25.
Saunders H, Vehviläinen-Julkunen K. The state of readiness for evidence-based practice among nurses: An integrative review. Int J Nurs Stud. 2016;56(Journal Article):126.
Patelarou E, Vlasiadis K, Panczyk M, Dolezel J, Jarosova D, Gotlib J, Skela-Savič B, Mecugni D, Finotto S, Ruzafa-Martinez M, et al. Providing a teaching and learning open and innovative toolkit for evidence-based practice to nursing European curriculum (EBP e-Toolkit): Project rationale and design. Popul Med. 2020;2(November):1–7.
Ruzafa-Martínez M. EBP e-toolkit project: Providing a teaching and learning open and innovative toolkit for evidence-based practice to nursing european curriculum. Cent Eur J Nurs Midwifery. 2019;10(2):1017–8.
Fineout-Overholt E, Johnston L. Teaching EBP: A Challenge for Educators in the 21st Century. Worldviews Evid Based Nurs. 2005;2(1):37–9.
Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, Porzsolt F, Burls A, Osborne J et al. Second International Conference of Evidence-Based Health Care T : Sicily statement on evidence-based practice. BMC Med Educ 2005, 5(1):1–1.
Melnyk BM, Gallagher-Ford L, Long LE, Fineout-Overholt E. The Establishment of Evidence-Based Practice Competencies for Practicing Registered Nurses and Advanced Practice Nurses in Real-World Clinical Settings: Proficiencies to Improve Healthcare Quality, Reliability, Patient Outcomes, and Costs. Worldviews Evid Based Nurs. 2014;11(1):5–15.
Hitch D, Nicola-Richmond K. Instructional practices for evidence-based practice with pre-registration allied health students: a review of recent research and developments. Adv Health Sci Educ 2017, 22:1031–45.
Albarqouni L, Hoffmann T, Straus S, Olsen NR, Young T, Ilic D, Shaneyfelt T, Haynes RB, Guyatt G, Glasziou P. Core Competencies in Evidence-Based Practice for Health Professionals: Consensus Statement Based on a Systematic Review and Delphi Survey. JAMA Netw Open vol. 2018;1:e180281–1.
Cedefop. The future of vocational education and training in Europe: volume 2: delivering IVET: institutional diversification and/or expansion? Cedefop Research Paper. Luxembourg: Publications Office of the European Union; 2022: 120.
Pérez-Montoro M, Tammaro AM. Outcomes of the Bologna Process in LIS higher education: Comparing two programs in Europe. Int Inf Libr Rev. 2012;44(4):233–42.
The European higher education area. Joint Declaration of the European Ministers of Education [https://www.ehea.info/media.ehea.info/file/Ministerial_conferences/02/8/1999_Bologna_Declaration_English_553028.pdf].
Directive. 2005/36/EC of the European Parliament and of the Council of 7 September 2005 on the recognition of professional qualifications. In: Official Journal vol. L255; 2005: 22–142.
Allan J. Learning outcomes in higher education. Stud High Educ. 1996;21(1):93–108.
Prideaux D. ABC of learning and teaching in medicine. BMJ. 2003;326(1):268–70.
Biggs J. Enhancing Teaching through Constructive Alignment. High Educ. 1996;32(3):347–64.
Theobald KA, Coyer FM, Henderson AJ, Fox R, Thomson BF, McCarthy AL. Developing a postgraduate professional education framework for emergency nursing: a co-design approach. BMC Nurs. 2021;20(1):43.
Hardie P, Murray A, Jarvis S, Redmond C, Co Design T. Experienced based co design: nursing preceptorship educational programme. Res Involv Engagem. 2022;8(1):1–53.
Adams S. Using learning outcomes: A consideration of the nature, role, application and implications for European education of employing ‘learning outcomes’ at the local, national and international levels. In. Edinburgh: Heriot-Watt University; 2004.
Thistlethwaite JE, Forman D, Matthews LR, Rogers GD, Steketee C, Yassine T. Competencies and Frameworks in Interprofessional Education: A Comparative Analysis. Acad Med. 2014;89(6):869–75.
Slattery P, Saeri AK, Bragge P. Research co-design in health: a rapid overview of reviews. Health Res Policy Syst. 2020;18(1):17.
Dederichs M, Nitsch FJ, Apolinário-Hagen J. Piloting an Innovative Concept of e–Mental Health and mHealth Workshops With Medical Students Using a Participatory Co-design Approach and App Prototyping: Case Study. JMIR Med Educ. 2022;8(1):e32017.
O’Donnell D, Ní Shé É, McCarthy M, Thornton S, Doran T, Smith F, O’Brien B, Milton J, Savin B, Donnellan A, et al. Enabling public, patient and practitioner involvement in co-designing frailty pathways in the acute care setting. BMC Health Serv Res. 2019;19(1):797.
Black A, Strain K, Wallsworth C, Charlton S-G, Chang W, McNamee K, Hamilton C. What constitutes meaningful engagement for patients and families as partners on research teams? J Health Serv Res Policy. 2018;23(3):158–67.
Lehane E, Agreli H, O' Connor S, Hegarty J, Leahy Warren P, Bennett D, Blake C, Burke F, Corrigan M, Drennan J, et al. Building capacity: getting evidence-based practice into healthcare professional curricula. BMJ Evid Based Med. 2020;26(5):246–6.
Harden RM. What is a spiral curriculum? Med Teach. 1999;21(2):141–3.
Kennedy D. Writing and using learning outcomes: a practical guide. Cork: University College Cork; 2006.
Kuluski K, Ho JW, Cadel L, Shearkhani S, Levy C, Marcinow M, Peckham A, Sandercock J, Willison DJ, Guilcher SJT. An alternate level of care plan: Co-designing components of an intervention with patients, caregivers and providers to address delayed hospital discharge challenges. Health Expect. 2020;23(5):1155–65.
Boyko JA, Kothari A, Wathen CN. Moving knowledge about family violence into public health policy and practice: A mixed method study of a deliberative dialogue. Health Res policy Syst. 2016;14(1):31–1.
Boyko JA, Lavis JN, Abelson J, Dobbins M, Carter N. Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making. Soc Sci Med. 2012;75(11):1938–45.
Moriña A. Approaches to inclusive pedagogy: A systematic literature review. Pedagog. 2021;140(4):134–54.
O'Connor S, Zhang M, Trout KK, Snibsoer AK. Co-production in nursing and midwifery education: A systematic review of the literature. Nurse Educ Today. 2021;102:104900.
Carballo R, Cotán A, Spinola-Elias Y. An inclusive pedagogy in Arts and Humanities university classrooms: What faculty members do. Arts Humanit High Ed. 2021;20(1):21–41.
Ösp Egilsdottir H, Heyn LG, Brembo EA, Byermoen KR, Moen A, Eide H. Configuration of mobile learning tools to support basic physical assessment in nursing education: Longitudinal participatory design approach. JMIR Mhealth Uhealth. 2021;9(1):e22633–3.
Hoffmann TC, Montori VM, Del Mar C. The connection between evidence-based medicine and shared decision making. JAMA. 2014;312(13):1295–6.
Persky AM, Robinson JD. Moving from novice to expertise and its implications for instruction. Am J Pharm Educ 2017, 81(9).
Lall P, Rees R, Law GCY, Dunleavy G, Cotič Ž, Car J. Influences on the implementation of mobile learning for medical and nursing education: qualitative systematic review by the digital health education collaboration. J Med Internet Res. 2019;21(2):e12895.
Koivisto J-M, Haavisto E, Niemi H, Katajisto J, Multisilta J. Elements Explaining Learning Clinical Reasoning Using Simulation Games. Int J Serious Games 2016, 3(4).
Green T, Bonner A, Teleni L, Bradford N, Purtell L, Douglas C, Yates P, MacAndrew M, Dao HY, Chan RJ. Use and reporting of experience-based codesign studies in the healthcare setting: a systematic review. BMJ Qual Saf. 2020;29(1):64–76.
Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, Bohren MA, Tunçalp Ö, Colvin CJ, Garside R, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. 2018;13(suppl 1):1–10.
Verkuyl M, Djafarova N, Mastrilli P, Atack L. Virtual Gaming Simulation: Evaluating Players’ Experiences. Clin Simul Nurs. 2022;63(Journal Article):16–22.
Zieber M, Wojtowicz B. To dwell within: Bridging the theory–practice gap. Nurs Philos. 2020;21(2):e12296. -n/a.
Redmond C, Farrell R, Cunningham C, Dineen A, Foley S, O`Donnell D, O`Reilly S, Stokes D, O`Neill E. The Evidenced-Based Education Collaborative (EVIBEC) Learning Outcomes Framework. https://www.ucd.ie/chas/research/evibec/. Accessed 30th August 2023.

No competing interests reported.

Download PDF

Journal Publication

published 03 Jan, 2024

Read the published version in BMC Medical Education →

Editorial decision: Revision requested
30 Nov, 2023
Reviews received at journal
16 Nov, 2023
Reviewers agreed at journal
06 Nov, 2023
Reviewers invited by journal
05 Nov, 2023
Editor assigned by journal
05 Nov, 2023
Editor invited by journal
19 Sep, 2023
Submission checks completed at journal
19 Sep, 2023
First submitted to journal
30 Aug, 2023

You are reading this latest preprint version

Development of the EVIBEC Learning Outcomes Framework to support the delivery of evidence-based practice curricula in health care professional programmes: a Codesign Approach

Status:

Journal Publication

Version 1

Abstract

Background

Methods

Results

Conclusions

Figures

Background

Methods

Co-design approach

Co-design Team

Supporting Meaningful Involvement

Research Design

Step Four: Assess the experience with a ‘critical friend’

Results

Participants

The EVIBEC Learning Outcomes Framework

Discussion

Limitations

Conclusions: brief summary and potential implications

Declarations

References

Additional Declarations

Status:

Journal Publication

Version 1