Of the 17 funded studies, participants from 7 studies agreed to take part with a total of 10 interviews. Interviews took place in July and August 2019, lasting on average 49 minutes in duration (range 29 to 66 minutes). Of the 10 interviewees, one was a patient partner, three were research staff, and six were investigators. All studies involved conducting a clinical trial.
Interviewees varied with respect to their experience with patient engagement; for some, this was their first project engaging patients or other stakeholders, while others had developed long-standing relationships with patients and/or stakeholder groups.
There was variation in the methods used to engage patients and other stakeholders, and the roles that patients and stakeholders occupied and where they had input. Theory informed approaches were rare with respect to the ways in which the theory informed patient engagement within the study. For example, one participant referred to a framework set out by the Ontario SPOR Support Unit (OSSU) that informed their engagement approach, while others indicated that their work was not grounded in any particular theory. Other interviewees discussed frameworks that informed their overall research program, but were not specific to patient engagement, for example, the Access Framework developed by Levesque et al. (14), the McCain Model of Youth Engagement (15), or the Knowledge-to-Action process (16).
We present our thematic findings below. Specifically, we present these within descriptive accounts of three key areas of focus within the interviews: (1) approaches to patient engagement; (2) areas of impact, noting the impact that patient engagement had on the specific study in question but also on future research, and; (3) the identified challenges and noted approaches to ameliorate these. Illustrative quotes are provided within the text, with additional quotes provided in Table 1.
Table 1
Topic
|
Quote
|
3.1 Methods & roles
|
3.1.1 “There were eight participants in our focus groups that we've engaged specifically around the pilot - the parent pilot study. The first focus groups have been eight participants, and we also alongside have what we call the parent panel, where we have anywhere between 10 and 14 parents that participate in the advisory panel. These are the two ways we have engaged families directly around how this works.” P1, Principal Investigator
3.1.2 “we've committed to hiring people who have lived experience onto our team, so that on a daily basis they're involved in all decisions, and they weigh in on every decision.” P7, Principal Investigator
3.1.3 “[…] as far as the advising part of the development - so that's where we were asking about the different questionnaire - the different questions and the different items. That was done via email, sending it to participants that expressed interest in developing it, and that was simply sent to individuals who would then - and then it was and Excel sheet where they could write in all their comments and then send that back to us.” P2, Research Staff
3.1.4 “I think one of the things we found out early on was that these families were very engaged via Facebook, and so we decided to try to meet them there […] We created a Facebook page. […] We're seeing some success there as far as making Facebook the go-to area for connecting with these families. I think that in and of itself, people have been very responsive, and it's really great to be able to interact with the families in, I think, a mode that they're on anyways. We're not asking them to get out of their usual-ish schedule, which is really nice.” P2, Research Staff
|
3.2 Impact of patient engagement
|
|
3.2a Impact on the study
|
3.2a.1 “A primary outcome measure is functioning, which as a youth contribution, one - the psychiatrist sitting out around a table, and healthcare providers were automatically defaulting to symptoms. Then, they went and talked to youth, and they're, no, it's not symptoms I'm interested in. I want to know how I'm doing on a daily basis. How's it going at school? How's it going with my friends? How's it going among my family? Primary outcome measures, that's a pretty serious decision. That was youth led.” P8, Research Staff
3.2a.2 “Our quality of life measures have come from some medical world of you had a heart attack, and now we're - can you go up and down the stairs? These are things that are - that often are completely irrelevant to young people who are, ‘I feel like killing myself because my boyfriend broke up with me, and my parents are telling me it's no big deal, and now I'm going to fail my math course, because I didn't study for the exam’.” P7, Principal Investigator
3.2a.3 “Yes [it has made a difference to the outcomes], because it's actually what youth wanted. It's actually relevant to our experience, because yeah maybe you might not necessarily, you can still be depressed, but if you're not going to school or something, is that helpful, or - do you know what I mean?” P6, Patient partner
3.2a.4 “Some of the feedback we've received around time of day, location, their interest in using technology, as opposed to coming in person. Some of those implementation questions have been - it's been very useful having parents provide us feedback there.” P1 Principal Investigator
3.2a.5 “Patients were involved on the LIP in terms of developing - okay, for example, what does a navigator do? What are their qualifications? If we're actually going to get the referral form to the patient, the patients told us, these are things that we'd like to see on it. These are the issues you need to be aware of with respect to health literacy and so on. They were involved in the consultation phase, in the development of the intervention, at every LIP meeting during the implementation, and so it began to tweak things as it rolled out.” P4, Research Staff
3.2a.6 “I think in terms of this case, they have been involved right from the start of the production of the knowledge translation tools which were used in this study, and then parents are investigators on the study, and have been at the meetings, and have been interviewed with me.” P5, Principal Investigator
|
3.2b Impact on the researcher
|
3.2b.1 “I think part of that success was really just being open to the idea of doing research differently, and for good reason, to push ourselves as researchers who have been involved in lots of projects over the years, but perhaps not with this level of emphasis and intentional design around engaging patients. I think having been through it, I can never go back. I think it just makes the research so meaningful.” P9, Principal Investigator
3.2b.2 “I certainly think that this population and interacting with them has opened my eyes to so many things, both in research and just in life […] it really can change your lens on how you view research, how you view your life, and may certainly -- those participants have really opened my eyes to the reality of what it's like to have a child with medical complexity. Of course, I'll never have the understanding of it, because I've not lived it. But I certainly have a very deep appreciation for those parents, and that was through the patient engagement. I think it's one thing to read it on paper, but when you're interacting with people, it just - there's a difference - a significance, and it really makes you understand so much more what we're dealing with.” P2, Research Staff
3.2b.3 “This is something that we've developed far more for other initiatives since them, so essentially you can say that SPOR helped us understand the value and benefit of engaging with patients, and so with the other projects we've done things much better.” P3, Principal Investigator
3.2b.4 “And that's one thing actually, we did tell people like I always say to them, like, we're learning. I mean, if do things that are wrong, you tell me. Don't assume that, you know, there would that there's, like, I don't necessarily know how to do this. Well, so we're both learning. You're learning research and learning this partnership.” P10, Principal Investigator
|
3.3 Challenges
|
|
3.3a Identifying and reaching patient advisors and patient partners
|
3.3a.1 “For example, if the study was on a chronic disease, and there were community organizations around that chronic disease, then I could see that our involvement in engagement of their patients, and I could see how that community organization would be really directly key to the patient engagement. If we're talking about healthy children, a little bit more of that, community organisations that represent healthy children is a little bit, struggling to think about those.” P1, Principal Investigator
3.3a.2 “Then, it's like ensuring that you're not just looking for young people to say what you want to hear, but you're actually - you should be almost more interested in the things if they don't fit with what you already thought. That represents a different point of view.” P7, Principal Investigator
3.3a.3 “Yeah, and so again, there's more work coming out about how we should pay patient partners, because when we get funding, we don't pay out Co-I’s. It's our job, but then again, it is our job, whereas their family. Certainly, we always pay gas, and childcare, and I don't - coffee carts, meal carts. To pay them money? I've never put that in a grant yet, and what should that be? What should an honorarium for a patient partner be? […] Yeah, so we're still working that out, and that's - I don't know. I don't have the answer.” P5, Principal Investigator
3.3a.4 “I don't know if this has come up in your process to date, but even - I know there's a lot of discussion out in the patient engagement world just around sort of how do we properly recognize these essential partners in research? Is it - what are we doing to do that? Does compensation need to come into it, and how do we make sure that people are being compensated and recognized in a way that is most appropriate for their oftentimes very involved contribution?” P9, Principal Investigator
|
3.3b Time-related challenge
|
3.3b.1 “You've got to move a little bit slower sometimes.[…]We knew that we were going to be doing this from the get go, so it was worked into our timeline. I don't think that was a as big a deal as much as getting REB approval, some of the other stuff. This is a slow process anyways. It wasn't such a major barrier. Sometimes you just have to relax a little bit and take your time on making decisions, but do it anyway, because of institutional mistakes.” P8, Research Staff
3.3b.2 “I think for us particularly with the population that we are trying to engage with, like I mentioned, they just don't have a lot of time, which is absolutely fair, since they are - they're very busy managing their child's health, managing their family, managing their own life. It's - the challenge is trying to engage them, even though they don’t have a lot of time, […].” P1, Principal Investigator
3.3b.3 “I think it's true for everyone, but my area's youth based, see as being especially important to youth, because the demands on their time, their developmental context, the tasks with which they are confronted over time, and so they may really want to be involved, but if they're in the middle of their grade 12 year where they're really focused on trying to get good grades to get into university, it's not appropriate to ask them to make a big commitment.” P7, Principal Investigator
3.3b.4 “[Interviewer: Yeah. Yeah, and how do you build that rapport?] Being open, a little bit, giving a little bit of time out to chat with them about what matters to them. Inviting conversation, not being the ivory tower dry scientist that they can come down to a real person's level.” P8, Research Staff
3.3b.5 “Sometimes it was a matter of meeting with them individually and talking about what's coming up at the meeting, but also providing really practical supports, like ensuring transportation, taxi, if they needed it. Made sure that all of our meeting rooms were physically assessable…” P4, Research Staff
3.3b.6 “I can't say that this [relationship] is something that was built for that project. This is something that we built over time that previously existed and we just continued to nourish so to speak.” P3, Principal Investigator
|
3.3.c Maintaining engagement
|
3.3c.1 “We really from the very beginning were sitting together, and the youth changed over time, […] our youth became not youth. At some point, you're, oh right, you are now 10 years older…and the youth were trying to understand that you're actually no longer youth.” P7, Principal Investigator
3.3.c.2 “I think some of the challenges we've had, it's a long project and with the randomized control trial nature of it, there's a lot of protection and oversite with the data to ensure the credibility of the trial. I think for me, maybe that it's something that we would want to consider moving forward is just sort of the lulls in time in that data collection phase where there's passion and energy from patients to be engaged, and then it's just trying to think collectively between all of us on the project, including the family partners and family leaders. What are those components that this kind of data collection where we can all continue to be excited and engaged along the way.” P9, Principal Investigator
|
3.1 Approaches to patient engagement
The populations engaged as partners within the individual studies varied, with studies engaging children and youth, young adults, parents of young children, adult patients, community members, and healthcare professionals and community organisations. The breadth of stakeholder groups engaged was reflected in the myriad ways in which interviewees discussed the roles of the patients and stakeholders. Interviewees discussed varied approaches to engaging their patient partners, with these approaches tailored to the populations engaged. Some reflected on how their study had been co-created, and thus involvement had been throughout. In other instances, roles or engagement opportunities focused upon certain aspects of the study, such as helping identify the appropriate outcome, or reviewing study material.
Examples of these patient engagement methods included: the creation of advisory panels or committees that fed back on the study design or intervention; focus groups to elicit ideas or feedback (Quote 3.1.1); and even hiring individuals who were patients or who represented the target population for the study and embedding them within the research team (Quote 3.1.2). Engagement mechanisms included in-person meetings, email (Quote 3.1.3), or sometimes via social media (e.g. utilising existing Facebook groups to engage networks of patients) (Quote 3.1.4).
3.2 Impact of patient engagement on the research
Figures 1 and 2 provide an overview of the ways in which interviewees described the impact of patient engagement on their study. Notably, interviewees discussed two major areas of impact: (a) impact on the study about which they were being interviewed, and (b) impact on researchers and research teams which led to changes in practice or approaches in future research.
3.2.a Impact on the research study: improved relevancy
Figure 1 provides examples of study phases and how patients had been involved, and examples of the impact that patient engagement was reported to have had on the study. Specific changes or influence varied. Examples included influence on the outcome measured (Quotes 3.2a.1-3.2a.3), better understanding of the burdens patients face and adapting the recruitment process (Quote 3.2a.4), or even through the co-creation of the intervention itself (Quote 3.2a.5-3.2a.6).
When asked how patient engagement had affected the quality of their research, interviewees agreed it had improved the research. Yet a number of interviewees highlighted a lack of clarity in regard to measurements available to assess the benefits of patient engagement to research activities. As one participant put it:
“I think one of the issues that is not resolved for me are what are the - how can we measure that question? How are we to understand the quality - the impact on quality from patient engagement?” P1, Principal Investigator
For others, the improvement in quality was captured by impact. Responses from these interviewees included phrases such as “that your intent matches your effect” and keeping research “real and anchored in [the] real world”. Indeed, while distinct impacts such as those above were noted by individual interviewees in relation to their project, the cross-case analysis indicated a common underlying theme; that engagement with patient partners improved the relevancy of the study to participants. As one interviewee put it:
“Certainly, the relevancy of the project itself [improved], I think - if you measure that in a qualitative way […] how the project changed and morphed based on patient input.” P3, Principal Investigator
However, higher levels of engagement or co-creation of research could, paradoxically, make it more challenging to demonstrate the specific impact or effect that the patient engagement had on the study. For example, when asked to share how patient engagement had changed their study, one participant challenged the framing of the question, instead arguing that because the study had been co-created it was impossible to parse out the influence of the patient partners from those of the researchers and other team members.
3.2.b Impact on the researcher and research team
In addition to the influence that patient engagement had on the specific design or conduct of the study, the researchers among the pool of participants noted how patient engagement had changed the way that they did research (Quote 3.2b.1). Figure 2 provides examples of how patients had been involved and examples of the impact on the researchers. Comments such as increased awareness of the issues faced by patients, or about the power dynamics that are in play in meetings, were common (Quote 3.2b.2). Indeed, a noted impact was the long-term effect that experiences with patient engagement had (Quote 3.2b.3) and which was taken into subsequent projects:
“Even for me, I've had a few other grants that I've applied for and been successful with since then where we've done exactly that, and right from the get go, right from writing the grant I've had youth on that grant helping me write that grant, and tear it up, and help create the product that happens with that. As a result, I've been successful, and I think that wouldn't have happened. I don't think I would have built that into my process in the same way without this experience through the IMPACT Awards, certainly.” P9, Principal Investigator
Yet it was also understood that this impact of engagement was a process of ongoing learning and may have varied effects in future work (Quote 3.2b.4).
3.3 Challenges
Participants identified challenges to patient engagement. These included: (a) identifying and reaching patient advisors and patient partners, (b) time-related challenges and, (c) maintaining engagement.
3.3.a Identifying and reaching patient advisors and patient partners
For several of the interviewees, an initial challenge was identifying who would have relevant expertise to serve as a patient partner or advisor. Common factors that were raised as relevant to the decision included experience with the health condition under study, or experience with the health system in question.
For example, interviewees noted that when the research question centred around a particular health condition, then it may be more straightforward to identify a patient population from whom they could seek patient partners or advisors. However, in areas such as public health or other areas that were not condition-specific, the identification of relevant expertise or characteristics could be more challenging (Quote 3.3a.1). In other instances, there were more practical issues, such as a short period of ill health or contact with the health system, that meant that there was potentially limited engagement with the issue at hand and thus less saliency with the research:
That's a bit of a challenge…to identify very motivated folk if you're studying a condition that did not impact or affect them long term. Again, we're going back to challenges of studying a population that is not a chronic - suffering from a chronic disease, and for which the impact is temporary and not life altering. That continues to be a bit of a challenge.
P3, Principal Investigator
Others reflected on the input of individuals without experience of the issue being studied, with one participant noting:
“ I think a lot of when we were planning this out, we thought the feedback we should be getting from families or people who have experienced [health condition], or are passionate about [health condition] - and I think what I've learned is maybe that doesn't have to be the case, and maybe you just need to go to venues where you have really passionate people who want to help and sort of change the world in their own way. I think we benefit from that.” P9, Principal Investigator
A sub-theme related to the groups represented by the patient partners (Quote 3.3a.2). Specifically, interviewees reflected on the diversity and inclusiveness of the patients who were engaged and the degree to which they reflected the patient population served by the study. For example, some interviewees reflected on how financial barriers may mean only those who were financially stable could participate as a patient partner with the resulting input on study design potentially not acknowledging challenges faced by those who are less financially secure. Reflecting on this perceived need for diversity within the patient partners engaged, one interviewee stated:
“I think that having representation of [a] diverse perspective - diverse in terms of background, patient experience, so having mental health is really great, because that ended up being one of our prime - the primary referral, but I think having diverse in terms of age, and perhaps medical condition, as a caregiver, as a family member, as a patient themselves, and having more patients at the table, so that when people aren't able to come because of health reasons, having one patient, and 15 others around the table, there's an imbalance here.” P4, Research Staff
As part of this discussion about reach and representation, the issue of compensation was raised. In some instances, this was raised as a challenge; some projects may not have funding available to support financial compensation, or there may be a lack of clarity regarding levels of support or how payments would be managed (Quotes 3.3a.3–3.3a.4). However, it was also raised as a way in which researchers could break down some of the barriers to engagement and reach a more diverse group:
“It's unlikely that […] parents feel that they're going to achieve direct benefit from participation. In that context, we really - I think it's important to add that we have distribution of different voices and perspectives, and I think unless you provide incentives for people to participate in such a thing, and I still feel like the people, that the people who are participating are likely not necessarily representative of the entirety of our cohort. When I've reviewed the literature on how to improve participation in marginalised communities, it is, cash or direct compensation is one of the most effective strategies. To be able to provide that compensation is really important, and we did not include budget for that in our grant, so I think that we are doing [that] now [going] forward.” P1, Principal Investigator
3.3.b Time-related challenges
A second set of challenges identified were time related. This included awareness of, and accounting for, existing time commitments that patient partners have, understanding that patient engagement may mean that additional time is needed for research, and that engagement with age-bound groups may affect ongoing engagement (Quotes 3.3b.1-3.3b.3).
Discussion about recognising the existing time commitments of patients and family members was commonly raised in the context of how the team had attempted to facilitate patient involvement: participants noted the need for researchers to move out of their own domain, or ‘ivory tower’ (Quote 3.3b.4) and provide supports to facilitate patient engagement (Quote 3.3b.5). For example, one participant noted how parents would use social media groups to interact with each other. The research team, therefore, used social media and these groups to engage parents. This allowed parents to respond in their own time, which may be outside office hours, rather than having to fit around the research teams’ schedule:
“I think the next piece is to be thoughtful that there are many different ways that a patient can contribute to research, and we need to meet - we need to consider how do we meet patients where they are, and where they want to be, and how they want - and really tailor those opportunities to how they want to contribute, because it's all going to be meaningful, but I don't think we should expect all patient leaders to be the same, and to contribute in the same way.” P9, Principal Investigator
Indeed, when asked to suggest advice for other researchers, building in extra time for research was a key theme. Not only in terms of allowing longer for individual research to be conducted but acknowledging that the relationships between researchers and patient partners or advisors themselves require an investment of time (Quote 3.3b.6).
3.3.c Maintaining engagement
A further time-related challenge was of maintaining engagement in the context of studies where inclusion or relevance was perceived to be time-limited. For example, interviewees whose projects involved children, youth, or young adults reflected on how their patient partners may “age out” or that the study would become less relevant to them as the patient partners grew and where the study was not as immediately relevant to them (Quote 3.3c.1). The challenge of maintaining engagement with patient partners also arose when conditions were transient in nature. For example, a condition would resolve, and the study would again become less relevant to the patient partner.
Maintaining engagement was also a challenge for research-related reasons. Specifically, it was noted that research involved periods of more or less intense activity (Quote 3.3c.2). Maintaining engagement during those lulls in activity was identified as a key challenge for patient engagement.
“[P]art of the challenge of maintaining the engagement with our patient partner so to speak was that there was very little reason to stay engaged with that patient during the one-year duration of the study itself. They participated in steering committee meetings, and they were made aware of the progress of the study, but we had little to ask of them, and they have little to comment upon” P3, Principal Investigator
Some researchers did note that they had taken steps to maintain communication, such as maintaining mailing lists, in order to try and keep engagement going during lulls in activity.