The IEMH Care Pathways Initiative leverages community strengths through collaborative organizational and regional partnerships to develop Pathways, using a 2 to 3-year process. The process encompasses 5 phases: 1) Community Engagement, 2) Service Mapping and Inventory Assessment, 3) Aspirational Pathway Building, 4) Ages and Stages Questionnaire and Developmental Support Plan Training and Implementation, and 5) Aspirational Pathway Implementation and Evaluation.
The Consolidated Framework for Implementation Research (CFIR) guides the evaluation during each phase, including the interpretation of survey and focus group data. The CFIR was chosen due to its applicability in health system research [40], and its relevant constructs of inner setting (e.g., relational connections and available resources) and outer setting (e.g., partnerships and connections and systemic conditions). Informed consent is obtained from all participants involved in the evaluation pieces (e.g., prior to survey and focus group participation).
Each phase is discussed in detail below.
Phase 1: Community Engagement
The Community Engagement phase is characterized by relationship-building and collaborative groundwork. The first phase begins with an initial meeting with organizational and regional leaders who will act as local change agents. During the initial meeting, leaders begin curating a contact list encompassing diverse regionally based potential change agents across sectors vested in supporting children under six years old. This inclusive approach fosters a broad representation of perspectives crucial for the initiative's success. Following this meeting, comprehensive follow-up actions are undertaken: a project overview is disseminated through a recorded video presentation, invitations to learn about and join the initiative are sent to all newly identified potential partners, and the IEMH Care Pathways Initiative Brief is circulated. The IEMH Care Pathways Initiative Brief includes the background and rationale for the work, the phases, roles and responsibilities, the evaluation plan, and expected outcomes. The Brief provides a unified understanding of the project's process and objectives. Shared knowledge and language are essential in implementation work to reduce confusion and increase agreement between partners [9].
Subsequently, a meeting is held with all key change agents, wherein project specifics are elucidated, including further outlining and agreeing to roles and responsibilities, sharing an initial draft of the Memorandum of Understanding (MOU) and Terms of Reference (TOR), and sharing the project protocol that has been approved by an appropriate institutional or regional research ethics board.(Of note, protocols and research ethics board considerations may differ across organizations, institutions, and regions; it is pertinent to include discussions regarding different institutional and organizational planning needs and regulatory requirements such that all can be adequately met at this stage.) The current body of literature indicates that creating shared agreements can improve communication and collaboration across sectors [41]. A MOU and TOR were developed by IEMHP and reviewed by leadership from each partnering agency. These documents help to clearly define expectations and responsibilities amongst partners [42, 43]. Following partner review, feedback is incorporated as needed, thus ensuring alignment with partner expectations, organizational protocols, and policies.
With attention to collaboration and consensus-building, Phase 1 culminates with community partners approving and signing the MOU and TOR, underscoring a shared commitment to achieving the initiative’s objectives through collaborative partnerships.
Phase 2: Service Mapping and Inventory Assessment
The Service Mapping and Inventory Assessment phase involves hosting a series of focused meetings (at least one, and typically three) to understand the landscape of existing services supporting IEMH within the community.
Through guided discussions, partners identify the existing services and the current tools for recognizing and responding to IEMH used in the community, evaluate their efficacy and challenges, examine current referral mechanisms, and explore opportunities for improvement. See Table 1 for a template of the questions asked during the first service mapping meeting.
Table 1
Service Mapping Question Guide for Guiding Discussions of Existing Services
Guiding Prompt/Question | Follow-Up Questions |
A developmental, behavioural, or social-emotional concern has been raised for a child. | a. Who raises concern about the child? b. Why did the child come to your organization? c. What is the organization’s role in supporting young children in the community? d. What supports and services can your organization offer (e.g. parental education, developmental screening, etc.) |
What happens next? | e. Does your organization need families to have a referral to access services? f. What happens during your first point of contact with the child (e.g. intake process, screenings, questionnaires, meetings, etc.)? g. What kind of support do you know of in the community that you can send this family to, or provide them? h. How do you support the family in accessing those services/agencies? |
What does the referral process look like? | i. Who decides whether a referral is needed? How is it decided? j. How is a referral made? k. Is there follow-up with the family and the agency receiving the referral? l. What does follow-up look like after the referral (from both the referring agency and the agency receiving the referral)? |
Is there anything else you would like to share, or want us to know about the current pathway? | |
Subsequent meetings include questions such as “what are the strengths and challenges of the current pathway?”, “which sectors should be involved in developmental screening and triaging children who need additional services?”, and “where do you see your sector/agency fitting into a system of care pathway?”
Following these meetings and subsequent deliberations, IEMHP amalgamates insights to develop an initial draft of the community's current Pathway, providing the first overview of existing services and processes. This preliminary outline serves as a focal point for collaborative refinement in subsequent sessions, where partners reconvene to scrutinize, amend, and ultimately agree on the components and process outlined in the Pathway.
At the end of Phase 2, findings are consolidated into a comprehensive "Project Summary Report.” This report includes milestones achieved, emergent insights, and next steps. Ensuring information is accessible to relevant change agents, such as through data sharing and reporting, is key to driving feedback cycles and promoting successful implementation [12, 13].
Phase 3: Aspirational Pathway Building
Of note: Phase 3 and Phase 4 occur concurrently, as different collaborators are involved in each phase.
The Aspirational Pathway Building phase begins with an invitation for organization leaders/supervisors to complete the “Infant and Early Mental Health (IEMH) Core Components Evaluation Tool”, which is a self-evaluation survey tool that includes questions related to the organization (e.g. number of employees, number of families with children under the age of 6 served in the last year, sector(s) of activity involved in the work, etc.), and questions related to the five core components identified as being important and relevant to serving IEMH needs (i.e. a system of care pathways, resources and tools for strengthening IEMH practice, leadership specific to IEMH, knowledge and skill building, and research and reporting). Answering this survey helps identify how “IEMH friendly” the organization’s current practices and services are. This survey is re-sent to each respondent 180 days (approximately six months) after Phase 5 begins, to allow for comparing pre- and post-aspirational pathway implementation.
Following initial surveying of IEMH service readiness, partnering agencies are brought together for an in-person meeting to develop the first draft of the aspirational Pathway(s). The meeting begins with IEMHP presenting the draft of the community's current Pathway, allowing community partners to review and provide feedback for any necessary changes to better reflect the service processes. Once the draft has been thoroughly reviewed, IEMHP makes the proposed modifications before re-presenting the draft through e-mail correspondence to the partners.
After the first round of pathway revisions, a Local Pathways Implementation Team (LPIT) is established in the community. The LPIT consists of individuals from the agencies who drive pathway development and implementation in their communities (generally, individuals in supervisory or leadership roles). The LPIT identifies, using the draft of the aspirational Pathway(s), which agencies take priority for developmental screening and early intervention training. The draft of the aspirational Pathway(s) is then revised, as needed, by the LPIT and IEMHP in iterative cycles, until approval of the final aspirational Pathway(s) draft is confirmed by the LPIT and partnering agencies.
In partnership with the LPIT, dissemination materials for the aspirational Pathway are created. Dissemination materials may include pamphlets (i.e. that outline the purpose and process of the pathway) and ‘map’ magnets (i.e. that can be placed throughout organizations for ease of use, and in family homes). Focus groups are then held with parents/caregivers and frontline practitioners to make any changes to the materials based on feedback. Supplemental materials for families to complement the aspirational Pathway(s) are also developed, and a focus group is held with parents/caregivers to receive feedback on whether the materials are appropriate for use. Supplemental materials may include such items as a ‘Frequently Asked Question’s’ brochure and/or a ‘legend’ for understanding the terminology and process on the aspirational Pathway.
Following focus group feedback and material revision, the LPIT reviews and approves revised dissemination materials. Together, they develop a communication plan that outlines how to share updates, approved materials, and resources with broader partners.
Phase 4: Ages and Stages Questionnaire and Developmental Support Plan Training and Implementation
In Phase 3, staff members that require developmental screening and early intervention training are identified. In Phase 4, frontline practitioners and supervisors begin training on the Ages and Stages® Questionnaires (ASQ®s) and Developmental Support Plan (DSP) administration.
The first part of ASQ-DSP training is an initial survey to gain a baseline understanding of a participant’s current practice, standard of care, collaboration, and organizational policies. If staff have already been trained on ASQ®s and DSPs prior to beginning a partnership, then they fill out a survey to assess their “baseline” of inter-sectoral and inter-organizational collaboration, personal practice, the standard of care, and systems of care prior to aspirational pathway creation. The response options are offered in a Likert scale from ‘Strongly Agree’ to ‘Strongly Disagree.’ Depending on the participant’s response, they will be prompted with a follow-up question to garner deeper insight into their response. See Table 2 for an example of a survey question.
Table 2
Example of Pre- and Post- Training and Pre- and Post-Implementation Survey Questions.
Survey Question | Follow-up Question if Respondent Chooses ‘Strongly Agree’ or ‘Agree’: | Follow-Up Response Options if Respondent Chooses ‘Strongly Agree’ or ‘Agree’: | Follow-up Question if Respondent Chooses ‘Strongly Disagree’ or ‘Disagree’: | Follow-up Response Options if Respondent Chooses ‘Strongly Disagree’ or ‘Disagree’: |
“Rate your level of agreement with the following statement: My organization collaborates well with other organizations in my community.” | “In which ways is your organization collaborating with other organizations? Select all that apply.” | 1, Referrals to/from other organizations 2, Resource sharing between organizations 3, Data sharing between organizations 4, Frequent communication between organizations 5, Good coordination between organizations (e.g., joint advocacy efforts) 6, Other (please describe) | “Why is your organization not collaborating well with other organizations? Select all that apply.” | 1, Lack of capacity 2, Lack of time 3, Lack of resources 4, Lack of confidence 5, Unsure of who to reach out to 6, Other (please describe) |
Participants receive the survey again 90 days (approximately three months) and 270 days (approximately nine months) after initial survey completion to allow for a comparative analysis of pre-ASQ®-DSP training and post-ASQ®-DSP training. Focus groups are held with direct service providers, leadership (e.g. supervisors and managers), and parents/caregivers 180 days (approximately six months) after initial survey completion. Member checking is conducted after initial focus group data analysis and interpretation. Member checking is a method of maintaining validity and ensuring an accurate account of participants experience by re-meeting with participants to discuss insights such that feedback can confirm or modify the initial interpretations [44]. Following completion of ASQ®-DSP training, surveys, and focus groups, IEMHP develops and shares a summary report of the findings with the community partners.
Phase 5: Aspirational Pathway Implementation and Evaluation
Phase 5 begins when the LPIT disseminates the final aspirational Pathway(s) to all agencies. LPIT works with partner agencies to implement the pathway into practice.
Similar to the evaluation plan laid out in Phase 4, inter-sectoral and inter-organizational collaboration, personal practice, standard of care, and systems of care are evaluated through surveys at 90 days (approximately three months) and 270 days (approximately nine months) following Pathway distribution, and through focus groups with leadership/supervisors/managers, frontline practitioners, and parents/caregivers at 180 days (approximately six months) following Pathway distribution. Again, member checking is conducted after initial focus group data analysis and interpretation.
Supervisors/organization leaders who completed the IEMH Core Components Evaluation Tool in Phase 3 are invited to complete the survey again now that the Pathway has been implemented in their community.
Results are analyzed and a summary report of surveys, focus groups, and IEMH Core Components results are shared with the community as outlined in the communication plan developed in Phase 2.