Implementation of Peer Specialist Services in VA Primary Care: A Cluster Randomized Trial on the Impact of External Facilitation

doi:10.21203/rs.3.rs-76127/v1

Download PDF

Research

Implementation of Peer Specialist Services in VA Primary Care: A Cluster Randomized Trial on the Impact of External Facilitation

https://doi.org/10.21203/rs.3.rs-76127/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 07 Jun, 2021

Read the published version in Implementation Science →

You are reading this latest preprint version

Background. Over 1100 Veterans work in the Veteran’s Health Administration (VHA) as Peer Specialists (PSs)—those with formal training who support other Veterans with similar diagnoses. A White House Executive Action mandated the pilot reassignment of VHA PSs from their usual placement in mental health to 25 primary care Patient Aligned Care Teams (PACT) in order to broaden the provision of wellness services that can address many chronic illnesses. An evaluation of this initiative was undertaken to assess the impact of outside assistance on the deployment of PS in PACT, as implementation support is often needed to prevent challenges commonly experienced when first deploying PSs in VHA settings.

Methods. This study was a cluster-randomized Hybrid II trial to test the impact of minimal implementation support vs. facilitated implementation on the deployment of VHA PSs in PACT over two years. Twenty-five Veteran’s Affairs Medical Centers (VAMCs) were recruited to reassign a mental health PSs to provide wellness-oriented care in PACT. Sites in three successive cohorts (n=7, 10, 8) over six-month blocks were matched and randomized to each study condition. In facilitated implementation, an outside expert worked with site stakeholders through a site visit and regular calls, and provided performance data to guide the planning and address challenges. Minimal implementation sites received a webinar and access the Office of Mental Health Services work group. The two conditions were compared on PS workload data and Veteran measures of activation, satisfaction and functioning. Qualitative interviews collected information on perceived usefulness of the PS services.

Results. In the first year, sites that received facilitation had higher numbers of unique Veterans served and a higher number of PS visits, although the groups did not differ after the second year. Also, sites receiving external facilitation started delivering PS services more quickly than minimal support sites. All sites in the external facilitation condition continued in the pilot into the second year, whereas two of the sites in the minimal assistance condition dropped out after the first year. There were no differences between groups on Veterans’ outcomes—activation, satisfaction and functioning. Most Veterans were very positive about the help they received as evidenced in the qualitative interviews.

Discussion. These findings demonstrate that external facilitation can be effective in supporting the implementation of PSs in primary care settings. The lack of significant differences across conditions after the second year highlights the positive outcomes associated with active facilitation, while also raising the important question of whether longer-term success may require some level of ongoing facilitation and implementation support.

Trial Registration. This project is registered at ClinicalTrials.gov with number NCT02732600 (URL:https://clinicaltrials.gov/ct2/show/NCT02732600).

Health Economics & Outcomes Research

Health Policy

Peer Specialist

implementation

facilitation

primary care

The model of facilitation used in the study can be a model of deploying Peer Specialists into Primary Care in other sites
The model of facilitation used in the study can also be a model of deploying new workers (not just Peer Specialists) into a variety of health care settings
Given there were no funds to hire new Peer Specialists, the study shows some level of ongoing facilitation may be needed to support Peer Specialist implementation

Over 1100 Veterans work in the Veterans Health Administration (VHA) as Peer Specialists (PSs). PSs are Veterans with lived mental health experience and formal training who provide support to other Veterans with similar diagnoses. Drawing on their own recovery experience, PSs provide a range of services including facilitating groups, role modeling, providing outreach and support, teaching coping skills, and helping Veterans navigate and coordinate care. PSs have traditionally supported recovery from mental illness and substance use disorders in mental health settings. While not conclusive, randomized and quasi-experimental trials have shown that individuals with mental illnesses who receive PS services benefit across a range of outcomes (1).

PSs are increasingly being deployed beyond mental health treatment settings to support holistic physical health and wellness in other medical settings such as primary care. In 2014 the White House issued an Executive Action mandating the pilot reassignment of VHA PSs from mental health to 25 primary care Patient Aligned Care Teams (PACT) in order to extend delivery of peer support to Veterans in primary care settings. VHA PACTs, first established in 2010, are medical homes that provide coordinated, comprehensive patient-centered outpatient primary care using a multidisciplinary team-based approach (2). Importantly, to maximize the effectiveness of this type of coordinated, team-based, complementary support, “patient activation” is often needed (3–5), which is the knowledge, skills, and motivation to be involved in one’s own care (6, 7). One such intervention which can increase patient activation is health coaching, a patient-centered approach that includes assessing needs, developing concrete goals, and skill building (3, 8–12). Research also indicates that such supportive, complementary coaching interventions delivered by peers, or individuals who share a common characteristic with a target population, can make primary care services more effective by activating patients to engage in more health behaviors such as illness self-management, disease prevention, and health information seeking (13, 14).

Although PSs services are expanding from mental health to other medical settings, there has been no research to examine how best to implement PS services in primary care settings. However, within mental health settings, there have been many documented challenges to the implementation of PS services, especially when these services were just starting. For example, lack of understanding regarding the PS role, inadequate supervision, lack of training opportunities, stigma and discrimination against PSs have been common implementation challenges (15–24), all of which can lead to poor uptake of PS services. One strategy that has been examined to implement PS services in mental health settings is external facilitation (16). External facilitation is an evidence-based implementation strategy specified within the Integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework (25–29), in which outside individuals activate and support implementation by assessing and responding to characteristics of recipients of the innovation, taking into consideration additional factors within their inner organizational and outer contextual settings (25). It is a multifaceted strategy involving interactive problem-solving and support that occurs in a context of a recognized need for improvement and supportive interpersonal relationships (30). Several studies have shown external facilitation to be an effective strategy for improving implementation of complex evidence-based practices and other clinical innovations (31–35). As detailed below, the purpose of this study is to evaluate the impact of external facilitation on implementing PS services in VA primary care settings.

The present study evaluates a pilot project to deploy PSs in 25 VA primary care settings. It is a Hybrid II, cluster randomized trial comparing 12 VA medical centers (VAMCs) deploying PSs in primary care teams while receiving external facilitation to 13 VAMCs deploying PSs in primary care while receiving minimal assistance. Including PSs in PACT teams was intended to extend the provision of VA PS services beyond mental health settings and might include some form of brief health coaching. Sites agreed to participate in the pilot for two years. To facilitate health coaching, VA Central Office (VACO) made whole health coach training available for most PSs engaged in this pilot. As is common in Hybrid Type II designs (36), the project has a dual emphasis on the assessment of both Veteran-level outcomes and uptake of PS services. Key outcomes for this evaluation were specified according to the RE-AIM model (37), an evaluation model that specifies five domains needed for successful impact of a new intervention (i.e., Reach, Effectiveness, Adoption, Implementation, and Maintenance). The present manuscript presents findings relating to Reach and Adoption as measured using administrative services data. We also report on the Effectiveness of PS-delivered services on Veteran satisfaction, activation, and functioning. Qualitative interviews with 10 Veterans in receipt of PS services (6 in the external facilitation sites and 4 in sites receiving minimal implementation assistance) were also conducted to characterize and describe participant experiences regarding the PSs’ Effectiveness. Finally, we also report on the Maintenance (sustainment) of PS-delivered services beyond the first and second years specified in the pilot.

In collaboration with our VA national operational partners, the project was determined to be quality improvement by the VA, thus individual informed consent for the Peer Specialists, non-peer providers and supervisors, and Veterans was not required or sought. However, Veterans are always free to decline PS and participation in the evaluation. Full details of this process are available elsewhere (38). Facilitators, research staff watched for harms of PSs while they were active. None were reported.

Site Recruitment and Randomization

A convenience sample of 25 PACT sites were recruited by a workgroup of national VA leaders led by the VA’s National Director of Peer Support and National Director of Integrated Services and the project team. To participate, sites demonstrated endorsement from facility leadership and had to agree to dedicate one or more already-hired PSs to PACT for a total of 10 or more hours per week, for one year. No additional funds were made available, thus sites had to reassign their current PSs deployed in mental health settings, in part or in full, to work in PACT. The actual amount of PS time dedicated to PACT across sites ranged from 4 hours per week (in one site) up to 80 hours per week covered by two or more PSs (in 3 sites). Most PSs worked 10 hours a week (in 8 sites) or 20–50 hours a week (in 13 sites).

From January 2016 to March 2019, recruited sites were divided into three cohorts (n = 7, 10, 8). A new cohort was introduced over three successive six-month blocks. The sites in each cohort were pair-matched based on the number of PSs deployed at a site, number of hours each PS would provide in PACT, and the status of PS assignment to PACT (currently deployed or anticipating deployment to PACT as part of the pilot). A statistician with no other direct involvement in the project used a computerized random number generator to assign sites within each pair to one year of either minimal implementation support (n = 13) or external facilitation (n = 12). Blinding to condition assignment was not possible because it was well known who received the external facilitation. Across sites there was a total of 43 PSs and 44 supervisors. The average age of the PSs was 52, 81% were male, 52% Caucasian and 48% African-American or other race, and the mean number of years spent working in the VA was 3.9 (s.d.=2.3). There were no differences among PSs in age, gender and race across conditions. There was, however, a significant difference on the mean number of years PSs had spent working in the VA between external facilitation (3.0 ± 1.5) and minimal implementation support sites (5.1 ± 2.7), p = 0.007.

External Facilitation versus Minimal Implementation Support

External facilitation, provided for one year at each site by one of three doctorate level psychologists, was tailored to site needs and adapted to incorporate lessons learned about the implementation challenges experienced when first deploying Peer Specialists (39). As is typical for external facilitation, facilitators engaged in multiple proactive strategies, tailored to each location (40), including (1) identifying and engaging key stakeholders, opinion leaders and clinical champions at all organizational levels, (2) identifying implementation problems and finding solutions, (3) providing assistance with technical issues such as establishing clinic titles for electronic chart data, (4) facilitating site participation in a learning collaborative with other sites, (5) providing evidence of the effectiveness of PSs, (6) marketing the use of PSs to PACT staff, (7) training staff on how to work with PSs, and (8) ongoing monitoring and feedback of PS services delivered to inform quality improvement efforts (26, 36, 40–42).

Facilitators began this process by conducting telephone conference calls with local site team members to assess a range of domains related to the local context—e.g., available resources for PS implementation—using a standardized semi-structured interview guide. These site assessment calls were followed by an in-person, two-day site visit to connect with key staff and complete a PS implementation checklist to develop a specific implementation plan tailored to each site. These site visits also provided opportunities for the external facilitators to further develop relationships with site stakeholders, provide staff and leadership with an overview of the project and the PS role, and build consensus. Once the local implementation plan had been finalized, the facilitators then engaged the local implementation team, including PSs and supervisors, in bi-weekly phone or Skype meetings to monitor and support implementation of the plan and encourage accountability. These meetings frequently involved feedback of PS administrative services data extracted from the VA electronic record. The average number of hours of external facilitation (operationalized as direct contact between facilitator and sites) ranged from 5.98 to 37.25 hours with an average of 23.26 (sd = 9.77) hours across the 12 sites receiving this implementation support. Each site received about one hour per month of faciliation, although the external facilitators also spent time helping sites outside of site meetings (e.g., reviewing data, preparing documents, etc.). More details about the external facilitation strategy applied in this project are available elsewhere (38).

The assistance offered to the minimal support sites included written guidance (a toolkit on how to hire and integrate PSs into a clinical setting), a 1-hour webinar on integrating mental health and primary care, and the option to call VHA Central Office staff overseeing the pilot for ad hoc consultation.

Further, two separate monthly Learning Collaborative calls were held for sites within each of the two study conditions; one for PSs and one for PSs supervisors. Facilitated by a consultant expert in PS services, these calls afforded staff from all sites the opportunity to meet together to review implementaion progress, share ideas and lessons learned, and provide support.

Peer Specialist Services Delivered

PSs provided a variety of services across the sites, through a mix of phone and in-person visits. Approximately 30 of the 43 PSs across sites received training in Whole Health Coaching (WHC) from the VA Office of Patient-Centered Care and Cultural Transformation, and incorporated aspects of the training into their activities with Veterans, including the completion of personalized health plans and individual or group-based WHC. An overarching goal for PSs utilizing WHC was to help Veterans identify realistic goals, and then provide or connect Veterans with the support needed to achieve those goals. Identifying and connecting Veterans with VA and community resources was another important service provided. PSs also facilitated groups, independently or with another co-leader from PACT, on topics ranging from dental education and smoking cessation to PTSD support and chronic disease self-management.

Measures and Analytic Methods

Reach and Adoption

Two years of biweekly administrative data pulls from the VA Corporate Data Warehouse were used to assess measures of Reach and Adoption of PS services from the RE-AIM framework. Reach was operationalized as: (1) the number of unique Veterans who received services from PSs, and (2) the average number of visits per Veteran. Adoption was operationalized as: (1) the total number of services provided by each PS; and (2) each site’s time to first PS service delivered from the start of the cohort, as an indirect measure of the site’s ability to get their program operational.

These variables were calculated as both “raw” scores – the total number of unique Veterans and services in the two-year period for each PS regardless of the PS employment period and hours worked and as “adjusted” scores. The adjusted workload variables took into consideration both the employment period (many PSs did not start immediately or may have left prior to the end of the 2 years) and weekly hours worked (varying from one hour to 40 hours per week). Visits during each PS’s employment period were divided by the total number of hours worked, then multiplied by 40 to calculate adjusted values for both operationalizations of Reach (as defined above) and total number of services (Adoption) provided per a 40-hour work week. Because these variables were significantly skewed, we used a log transformation to improve their distributional properties. Differences between intervention conditions were then compared with a series of Analyses of Covariance models with age, gender and race as covariates. Since these variables are measured at the PS level, the covariates were the average across the Veterans seen by each PS (mean age, percent White and percent male). The average number of visits per Veteran was also compared across conditions. This is a Veteran level variable, thus a General Linear Mixed Model (GLMM) was used with PS specified as a random effect and Veteran age, race and gender included as covariates.

Before comparing conditions, we removed two sites that were matched with each other, both of which already had PSs working in PACT (one in each condition) at the time of joining the pilot. These sites had substantially more PS services provided than all other sites and their inclusion initially obscured the results for the rest of the sites. Thus, we present raw totals from the 25 sites, but focused on the remaining 23 sites in this pilot that were newly implementing PS services in primary care in the adjusted comparisons (as defined above).

Effectiveness

PSs asked Veterans to complete a brief survey during their first interaction with the Veteran. Project evaluation staff collected follow-up assessments at 6-months (Timepoint 2, TP2) and 1-year (Timepoint 3, TP3) by phone or mail. A total of 415 baseline surveys were completed across the 25 participating sites; a greater proportion of Veterans from facilitation sites completed baseline surveys than did Veterans from minimal assistance sites (chi-square = 49.20; p < .001). Of this number, 250 (60%) completed TP2 and 213 (51%) completed TP3 assessments. There were no differences in response rates across study conditions (p = 0.406 at TP2, p = 0.933 at TP3).

Three measures were included in the Veteran level assessment completed at each timepoint: (1) a single item regarding general health functioning taken from the VR-12, a Veteran version of the SF-36 Health Inventory (43–45); (2) the Patient Activation Measure (PAM), a 13-item survey that measures an individual’s perceived ability to manage his or her illness and health behaviors and act as an effective patient (7); and, (3) a modified version of the 12-item Satisfaction Index-Mental Health Survey (46). A General Linear Mixed Model (SAS v 9.4 Proc MIXED) was used to compare conditions over time (baseline, 6 months, 12 months) with Veteran age, race and gender as covariates and site as a random effect. ICCs ranged from .001 to .07. All available data were used at each timepoint.

As a measure of Effectiveness, semi-structured, qualitative interviews were also completed via telephone with a total of 10 Veterans (3 female and 7 male) across the three cohorts to characterize and describe participant experiences working with PSs in PACT settings. These Veterans were identified as having had a high number of documented contacts with the PS (range = 8–34). Interviews were professionally transcribed. A senior member of the evaluation team read the interview transcripts and summarized Veterans’ experiences with and reactions to working with PSs. A second member of the team who had also read the transcripts then reviewed the summary for accuracy.

Sample Demographics

Across all 25 participating sites, the demographics of the full sample are presented in rows one through three in Table 1 below; for the 23 sites that newly implemented PSs in PACT (used in the adjusted Reach and Adoption analyses), demographics are presented in rows four through six. Finally, demographics across all 23 sites for participants who completed surveys for our Effectiveness measures are presented in rows seven through nine.

Table 1

Demographics
								Comparison
Label		Total		External Facilitation		Minimal Implementation Support		Test	df	Test Value	p
Full sample, unadjusted¹		n	(N = 5,616)	n	(N = 2,091)	n	(N = 3,525)
Mean Age		5,554	61.5 ± 13.9	2,062	60.6 ± 13.3	3,492	62.0 ± 14.2	t	4,545	-3.78	< 0.0001
Gender, %	Female	5,554	649(11.7%)	2,062	338(16.4%)	3,492	311(8.9%)	Chi-sq	1	70.40	< 0.0001
	Male		4,905(88.3%)		1,724(83.6%)		3,181(91.1%)		.	.	.
Race/Ethnicity, %	1 = Non-His. White	5,228	4,042(77.3%)	1,930	1,158(60.0%)	3,298	2,884(87.4%)	Chi-sq	2	530.51	< 0.0001
	2 = African American		978(18.7%)		654(33.9%)		324(9.8%)		.	.	.
	3 = Other		208(4.0%)		118(6.1%)		90(2.7%)		.	.	.
Sample adjusted Reach and Adoption data²		n	(N = 2,383)	n	(N = 1,484)	n	(N = 899)
Mean Age		2,353	57.9 ± 14.3	1,464	58.6 ± 14.1	889	56.8 ± 14.7	t	2,351	3.04	0.002
Gender, %	Female	2,353	426(18.1%)	1,464	272(18.6%)	889	154(17.3%)	Chi-sq	1	0.59	0.443
	Male		1,927(81.9%)		1,192(81.4%)		735(82.7%)		.	.	.
Race/Ethnicity, %	1 = Non-His. White	2,118	1,291(61.0%)	1,336	821(61.5%)	782	470(60.1%)	Chi-sq	2	4.64	0.098
	2 = African American		670(31.6%)		406(30.4%)		264(33.8%)		.	.	.
	3 = Other		157(7.4%)		109(8.2%)		48(6.1%)		.	.	.
Veteran survey/effectiveness data³		n	(N = 263)	n	(N = 145)	n	(N = 118)
Mean Age		225	58.6 ± 13.6	135	57.4 ± 14.8	90	60.5 ± 11.3	t	219	-1.78	0.076
Gender, %	Female	226	35(15.5%)	135	15(11.1%)	91	20(22.0%)	Chi-sq	1	4.90	0.027
	Male		191(84.5%)		120(88.9%)		71(78.0%)		.	.	.
Race/Ethnicity, %	1 = Non-His. White	210	133(63.3%)	124	85(68.5%)	86	48(55.8%)	Chi-sq	2	4.22	0.121
	2 = African American		62(29.5%)		30(24.2%)		32(37.2%)		.	.	.
	3 = Other		15(7.1%)		9(7.3%)		6(7.0%)		.	.	.
¹Demographics of all those who received services at the 25 participating sites
²Demographics of all those who received services the 23 sites that newly implemented PSs in PACT (used in the adjusted Reach and Adoption analyses)
³Demographics across all 23 sites for participants who completed surveys for the Effectiveness measures

Reach

Using raw numbers, 3,841 unique Veterans were reached across all 25 sites during the first year (during which external facilitation was provided to the experimental condition sites) and 5,616 unique Veterans were reached across both years. The average number of visits per Veteran across all 25 sites was 1.9 during the first year and 2.3 across both years.

As noted above, before looking at comparisons across conditions, we removed two matched sites who already had PSs working in PACT (one in each condition) and used adjusted comparisons (as defined above) to focus more specifically on sites that were newly implementing PSs in primary care. Compared to minimal assistance sites, sites receiving external facilitation saw a significantly larger average number of unique Veterans (p = 0.045) at the end of the first year; though across both years there was no significant difference between conditions (p = 0.428). Though the average number of PS visits per Veteran trended higher for sites receiving external facilitation, these differences were not significant for the first year (p = 0.419) nor across both years (p = 0.266). Reach data are presented in Table 2.

Table 2

Adjusted measures of Reach and Adoption among 23 sites newly implementing Peer Support in primary care
		Per Service Week in Actual Date Range, Means ± SD¹			Comparison
REACH		Total	External Facilitation	Minimal Implementation Support	Test	df	Test Value	p
	Unique Veterans
	First Year Only	3.2 ± 4.9	4.8 ± 6.1	1.3 ± 1.3	t	31	2.10	0.046
	Across Both Years	5.9 ± 7.0	6.0 ± 5.8	5.8 ± 8.5	t	34	0.80	0.428
	Visits Per Veteran Per PS
	First Year Only	2.4 ± 3.1	2.6 ± 3.6	2.0 ± 2.1	t	1,053	0.81	0.419
	Across Both Years	2.8 ± 4.8	3.2 ± 5.6	2.2 ± 3.0	t	2,058	1.11	0.267
ADOPTION
	Total Visits
	First Year Only	5.9 ± 7.2	8.4 ± 8.7	2.7 ± 2.7	t	31	2.64	0.014
	Across Both Years	11.2 ± 8.7	12.4 ± 8.7	9.8 ± 8.7	t	34	0.98	0.336
	Time to Service
	# of days from cohort start date to first PS visit date	140.6 ± 110.1	88.7 ± 65.0	188.2 ± 123.4	t	21	-2.38	0.027
¹Workload variables adjusted for the employment period and weekly hours worked (1–40). Visits during each PS’s employment period were divided by the total number of hours worked, then multiplied by 40 to calculate adjusted values for both operationalizations of Reach and total number of services (Adoption) provided per a 40-hour work week

Adoption

Using raw unadjusted numbers, a total of 7,153 visits were held across all 25 sites during the first year, and 12,771 were held across both years. Within the 23 sites where PSs were newly added to PACT and using adjusted data (as defined above), external facilitation sites had a significantly greater average number of total visits in the first year than did minimal support sites (p = 0.014); though across both years there was no significant difference between conditions (p = 0.336) (see Table 2). Also, within the 23 sites newly implementing PSs, time to first service was significantly shorter in sites receiving external facilitation (89 days) than in sites receiving minimal implementation support (188 days), p = 0.027.

Effectiveness

Quantitative measures

There were no significant group by time effects at between baseline and 6 months or baseline and 1 year on any of the veteran outcome measures across the 23 sites (see Table 3).

Table 3

Effectiveness outcomes for Veterans served by Peer Specialists
	Baseline, M ± SD		Month 6 Follow-Up, M ± SD		Baseline-6 Month Comparison				Year 1 Follow-Up, M ± SD		Baseline-1 Year Comparison
	External Facilitation	Minimal Support	External Facilitation	Minimal Support					External Facilitation	Minimal Support
Effectiveness measure	(N = 221)	(N = 194)	(N = 129)	(N = 121)	ES	t	df	p	(N = 113)	(N = 100)	ES	t	df	p
In general, would you say your health (0-100)¹	48.9 ± 26.5	45.4 ± 25.6	48.0 ± 27.9	46.2 ± 25.8	-0.02	-0.17	340	0.867	46.7 ± 27.0	45.1 ± 24.9	-0.07	-0.51	340	0.613
Patient Satisfaction Total Score (12–72)	51.3 ± 11.5	47.7 ± 12.1	52.3 ± 12.6	49.7 ± 12.7	-0.06	-0.51	370	0.611	51.2 ± 13.6	50.6 ± 13.0	-0.22	-1.48	370	0.139
PAM Total Score (13–52)	41.6 ± 6.2	41.0 ± 5.9	40.6 ± 5.7	39.9 ± 5.6	0.03	0.23	366	0.821	40.8 ± 5.5	39.8 ± 6.2	0.06	0.38	366	0.704
PAM Patient Activation Level (0-100)	64.2 ± 16.1	62.7 ± 16.2	61.7 ± 15.3	59.8 ± 15.9	0.03	0.17	366	0.864	62.2 ± 15.6	59.5 ± 16.0	0.04	0.32	366	0.752
Note: Raw means and Proc Mixed repeated measurement analyses are presented for continuous data with condition and time interaction.
¹General health rating has five levels: 100 = Excellent; 99 − 85 = Very Good; 84 − 60 = Good; 59 − 35 = Fair; 34 − 0 = Poor.

Qualitative findings

Most Veterans who were interviewed (n = 10) were very positive about their experiences working with a PS. They described PSs as being “terrific,” “professional,” “easy to talk to,” and “knowledgeable.” Veterans noted that the PS helped them in meeting their personal goals (e.g., diabetes management and weight loss) with a positive attitude and nonjudgmental accountability. Some Veterans said that the PS also helped them get connected with other services and programs, both within the VA and in the community. PSs functioned not only as a sounding board (“he’s the only one that listens to me”) but also as a liaison between Veterans and their PACT teams and other providers (“he knew how to get things done”). PSs’ Veteran status was “the key thing” for many Veterans because it helped establish an immediate comradery: “it’s different if you’ve been there and done that or if you just learned it off a book.” Notably, several Veterans said that working with a PS gave them a better view of the VA overall, with one Veteran saying that the experience “restored my faith and relationship with the VA.” A few of the Veterans also expressed negative sentiments about working with a PS; these complaints centered on aspects of program delivery (e.g., the focus on a particular model of Whole Health coaching rather than open-ended peer support, difficulty getting appointments with the PS). Still, even the least-satisfied Veteran said that the program was “better than nothing” and that he found it helpful “knowing somebody out there was interested in helping you get better.”

Maintenance

We also tracked the number of sites across study conditions that continued using PSs in PACT after the first and second years. After the first year, all external facilitation sites (12 out of 12) continued into the second year; two of the minimal support sites discontinued (11 out of 13 continued). Regarding continuation beyond two years, there was not a difference in rates of continuation by condition; fourteen (56%) of the twenty-five sites were able to sustain the PS’ presence (6 external facilitation, 8 minimal support) and 11 discontinued (6 external facilitation, 5 minimal support) after the project period (Chi-square = 0.561, p = 0.34).

In the first year, sites that received external facilitation had higher numbers of unique Veterans served (operationalized as Reach according to the RE-AIM framework) and a higher number of visits (operationalized as Adoption). Also, sites receiving external facilitation were able to start delivering PS services more quickly than comparison sites receiving minimal implementation support. Finally, all sites in the external facilitation condition continued in the pilot into the second year, whereas two of the sites in the minimal assistance condition dropped out after the first year. These findings demonstrate that external facilitation can be effective in supporting the implementation of PSs in primary care settings, as it has been in mental health settings (16). The lack of significant differences across conditions after the second year—in terms of service delivery and sustainability (Maintenance in RE-AIM)—highlights the positive outcomes associated with active facilitation, while also raising the important question of whether longer-term success may require some level of ongoing facilitation and implementation support. For example, in another study focused on integrating new providers (mental health providers) into primary care settings, a more intensive external plus internal facilitation strategy was applied for up to 28 months at participating sites to produce and sustain significant improvements in RE-AIM measures of Reach and Adoption (27, 47). Thus, it is possible that efforts to incorporate new types of providers into primary care involving significant provider engagement and education, new roles for clinical staff, and new clinical processes and referral patterns may require the use of more intensive, enduring facilitation strategies to produce sustained improvements in service delivery.

Regarding Effectiveness, the qualitative interviews did show that Veterans generally reported positive experiences and outcomes in working with PSs. However, there were no group differences in Veteran level outcomes of satisfaction, activation, or functioning. Research on other PS initiatives has involved much more intensive interventions than what was delivered here (average of 2.3 services to each Veteran). It is likely, for example, that a total of two or three visits—which is not atypical for health coaching in primary care—may be inadequate to meaningfully impact these particular outcomes. Additionally, the lack of significant effects may also be due to timing of assessments which may have been months after the Veteran had contact with PSs. There was also great variability in the PS services delivered and the target of those services, and the limited outcome measures that were collected may not have been sensitive enough to detect that wide variety of outcomes. Other unmeasured outcomes such as recovery, hope, and resiliency—measures that have shown improvement in other PS studies (e.g., 48, 49)—may have been more impacted by working with a PS. As such, future studies that more narrowly specify the content of the PS intervention and conduct appropriately timed and more targeted assessments are needed to better understand the impact of PS services in this setting.

Given the recent passage of the Mission Act (50), which in part mandates the hiring and integration of PSs in 30 primary care settings across the VHA, the results of this study have several implications for how to improve the effectiveness of external facilitation designed to support PSs in primary care. First, the number and types of people charged to work with external facilitators should be considered; e.g., perhaps an internal facilitator might be added at the local level to supplement and extend the external facilitator’s efforts, and the duration of active facilitation may need to be extended. Second, perceived need for assistance, or other site-level idiosyncrasies (including available money and resources to invest) may also impact which types of implementation support are required (or feasible) to help sites adopt and sustain new models of care delivery. Future studies might consider adding assessments to characterize these elements including measures that look at the extent to which program goals and objectives have been written into policies and standard operating procedures (SOPs, including job descriptions), the allocation/assignment of permanent staff positions and protected space as additional metrics of adoption and institutionalization of care delivery models (51). Third, the external facilitators in the present study are individuals who are very familiar with PSs’ training, and role, which may be an important requirement for facilitators in future PS implementation efforts. Fourth, our study only used one specific type of implementation support (i.e. external facilitation). It may be that impacts on service delivery and patient outcomes may be enhanced by using alternative or multiple types of implementation support. For example, as noted above, external facilitation could be used to train internal facilitators and site champions to take a longer-term lead in integrating new providers into the primary care and institutionalizing the programmatic change (27). Finally, PSs are increasingly being used not only in mental health settings, but also to help address a range of health behaviors such as weight management, management of chronic health conditions (52), and addictions (53). Given the challenges faced by sites when PSs are first introduced, including lack of role clarity and inadequate supervision, it would be advantageous to adopt a similar set of implementation strategies that were used in this effort in future PS deployment efforts.

Limitations

The present study had some limitations that should be noted. PSs typically had limited time in primary care, some as few as four hours a week. Further, the PSs were ‘on loan’ from each site’s mental health service, which likely impacted their ability to deliver services during the pilot, and perhaps influenced their sustainability. In addition, there was a lack of standardization of what interventions PSs provided (PSs tailored their services to their individual settings); more information is needed on what PS interventions are effective in primary care and in what dose. In addition, the target Veteran group differed by site, and sites also differed in terms of how and where they received referrals. Baseline Veteran level data was collected by the Peer Specialists themselves, which may have biased responses. Some Peer Specialists were reluctant or uncomfortable asking Veterans to complete the survey, and this reduced the available Veteran data. The present study also did not examine the impact of PS services on service use outcomes outside of primary care; future studies could examine whether PS support helps to improve use of health care services (as has been done in other studies, (e.g., 54, 55, 56) and reduce use of high-cost services. Also, the study relied on self-reported measures of effectiveness. Lastly, the extraction and analysis of administrative data may not have accurately captured all the services delivered by PSs. Utilizing the reporting structure within each local sites’ electronic health record was challenging because PSs occasionally did not record their visits and coding of the visits would change without our knowledge.

It is notable that external facilitation had success given that implementing PS services in a new setting like primary care requires in-depth education of providers and leadership regarding an entirely new discipline. With only a modest investment of external facilitation resources, sites that received implementation support were able to deploy PSs more quickly and deliver more services than sites without such support. This approach could be a model to other PS initiatives such as the MISSION Act.

i-PARIHS, Integrated Promoting Action Research on Implementation in Health Services

PACT, Patient Aligned Care Teams

PSs, Peer Specialists

VAMC, Veteran’s Affairs Medical Centers

VHA, Veteran’s Health Administration

Ethics approval and consent to participate.

The project was deemed a Quality Improvement project on 2/24/2016. Because of this determination, individual consent will not be sought from individual staff or Veterans. However, all staff and Veterans will have the opportunity to decline participation without penalty after reviewing information provided to them about the study. This determination was made after two actions. First, on 12/3/2015, the PIs (MC,RG) completed a non-research determination checklist that asked several questions about the nature of the project (e.g., yield generalizable knowledge, expanding knowledge base, double-blind or placebo design). All answers indicated the project was not a research study. We sent the completed checklist to the VA’s Chief Consultant of Mental Health Services to obtain final approval. In addition, we obtained approval on 3/10/2016 from Organizational Assessment Sub-Committee (OASC) of the Office of Research Development, which governs the surveying of VA staff (Peer Specialists are VA staff).

Consent for publication.

Not applicable

Availability of data and materials.

Readers can request data and materials from the lead author.

Competing interests.

The authors declare that they have no competing interests.

Funding.

All the authors are funded by a grant from the Department of Veterans Affairs (QUERI): QUERI for Team-Based Behavioral Health (1IP1HX001979-01): Evaluation of Peer Specialists on VA PACTs.

Authors’ contributions.

RG helped conceptualized the study and developed the evaluation plan and edited the manuscript. MC conceptualized the study, developed the facilitation plan, and wrote significant portions of the manuscript. KD helped to develop the facilitation plan and wrote and edited significant portions of the text. AM helped with the literature for the introduction. JS contributed to both the evaluation and facilitation plans and edited the manuscript. SM edited the manuscript and developed significant portions of the facilitation plan. DM developed the statistical analyses for the evaluation plan and wrote that portion of the manuscript. AP developed the qualitative analyses for the evaluation plan and wrote that portion of the manuscript. LK and NV collected and managed the survey data. LL conducted all the statistical analyses. All authors read and approved the final manuscript.

Acknowledgements.

The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs or other affiliated institutions. We would like to acknowledge the contributions of Daniel O’Brian-Mazza and Andrew Pomerantz for their assistance with this project.

Trial Registration.

This project is registered at ClinicalTrials.gov with number NCT02732600 URL: https://clinicaltrials.gov/ct2/show/NCT02732600.

Chinman M, George P, Dougherty RH, Daniels AS, Ghose SS, Swift A, et al. Peer support services for individuals with serious mental illnesses: assessing the evidence. Psychiatr Serv. 2014;65(4):429–41.
Rosland AM, Nelson K, Sun H, Dolan ED, Maynard C, Bryson C, et al. The patient-centered medical home in the Veterans Health Administration. Am J ManagCare. 2013;19(7):e263-e72.
Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA: The Journal of the American Medical Association. 2002;288:1909–14.
Coleman K, Austin BT, Brach C, Wagner EH. Evidence on the Chronic Care Model in the new millennium. Health Aff(Millwood). 2009;28(1):75–85.
Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78.
Hibbard JH, Mahoney ER, Stock R, Tusler M. Do increases in patient activation result in improved self-management behaviors? Health ServRes. 2007;42(4):1443–63.
Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res. 2004;39(4 Pt 1):1005–26.
Jonk Y, Lawson K, O'Connor H, Riise KS, Eisenberg D, Dowd B, et al. How effective is health coaching in reducing health services expenditures? Med Care. 2015;53(2):133–40.
Kivela K, Elo S, Kyngas H, Kaariainen M. The effects of health coaching on adult patients with chronic diseases: a systematic review. Patient Educ Couns. 2014;97(2):147–57.
Linden A, Butterworth SW, Prochaska JO. Motivational interviewing-based health coaching as a chronic care intervention. J Eval Clin Pract. 2010;16(1):166–74.
Lorig KR, Holman H. Self-management education: history, definition, outcomes, and mechanisms. Ann Behav Med. 2003;26(1):1–7.
Olsen JM, Nesbitt BJ. Health coaching to improve healthy lifestyle behaviors: an integrative review. Am J Health Promot. 2010;25(1):e1–12.
Brady TJ, Murphy L, O'Colmain BJ, Beauchesne D, Daniels B, Greenberg M, et al. A meta-analysis of health status, health behaviors, and health care utilization outcomes of the Chronic Disease Self-Management Program. Prev Chronic Dis. 2013;10:120112.
Webel AR, Okonsky J, Trompeta J, Holzemer WL. A systematic review of the effectiveness of peer-based interventions on health-related behaviors in adults. Am J Public Health. 2010;100(2):247–53.
Carlson LS, Rapp CA, McDiarmid D. Hiring consumer-providers: barriers and alternative solutions. Community Ment Health J. 2001;37(3):199–213.
Chinman M, Shoai R, Cohen A. Using organizational change strategies to guide peer support technician implementation in the Veterans Administration. Psychiatr Rehabil J. 2010;33(4):269–77.
Dixon L, Krauss N, Lehman A. Consumers as service providers: the promise and challenge. Community Ment Health J. 1994;30(6):615–25.
Fisk D, Rowe M, Brooks R, Gildersleeve D. Integrating consumer staff members into a homeless outreach project: Critical issues and strategies. Psychiatric Rehab J. 2000;23(3):244–52.
Gates LB, Akabas SH. Developing strategies to integrate peer providers into the staff of mental health agencies. Adm Policy MentHealth. 2007;34(3):293–306.
Hamilton AB, Chinman M, Cohen AN, Oberman RS, Young AS. Implementation of consumer providers into mental health intensive case management teams. J Behav Health Serv Res. 2015;42(1):100–8.
Manning SS, Suire B. Consumers as employees in mental health: bridges and roadblocks. PsychiatrServ. 1996;47(9):939 – 40, 43.
Miya K, Wilbur S, Corcker B, Compton F. Addressing and resolving role issues between professionals and consumer employees. In: Mowbray CT, Moxley DP, Jasper CA, Howell J, editors. Consumers as providers in psychiatric rehabilitation. Columbia: International Association of Psychosocial Rehabilitation Services; 1997. pp. 334–6.
Mowbray CT, Moxley DP, Thrasher S, Bybee D, McCrohan N, Harris S, et al. Consumers as community support providers: issues created by role innovation. Community MentHealth J. 1996;32(1):47–67.
Solomon P, Draine J. Perspectives concerning consumers as case managers. Community Ment Health J. 1996;32(1):41–6.
Harvey G, Kitson A, editors. Implementing evidence-based practice in healthcare: A facilitation guide. London: Routledge; 2015 2015.
Harvey G, Loftus-Hills A, Rycroft-Malone J, Titchen A, Kitson A, McCormack B, et al. Getting evidence into practice: The role and function of facilitation. J Adv Nurs. 2002;37(6):577–88.
Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care-mental health. J Gen Intern Med. 2014;29(Suppl 4):904–12.
Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: A conceptual framework. Qual Health Care. 1998;7(3):149–58.
Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: Theoretical and practical challenges. Implement Sci. 2008;3(1):1–12.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10:21.
Heidenreich PA, Sahay A, Mittman BS, Oliva N, Gholami P, Rumsfeld JS, et al. Facilitation of a Multihospital Community of Practice to Increase Enrollment in the Hospital to Home National Quality Improvement Initiative. Jt Comm J Qual Patient Saf. 2015;41(8):361–9.
Kilbourne AM, Almirall D, Eisenberg D, Waxmonsky J, Goodrich DE, Fortney JC, et al. Protocol: Adaptive Implementation of Effective Programs Trial (ADEPT): cluster randomized SMART trial comparing a standard versus enhanced implementation strategy to improve outcomes of a mood disorders program. Implement Sci. 2014;9:132.
Kirchner JE, Ritchie MJ, Pitcock JA, Parker LE, Curran GM, Fortney JC. Outcomes of a partnered facilitation strategy to implement primary care-mental health. J Gen Intern Med. 2014;29(Suppl 4):904–12.
Kirchner JE, Woodward EN, Smith JL, Curran GM, Kilbourne AM, Owen RR, et al. Implementation Science Supports Core Clinical Competencies: An Overview and Clinical Example. Prim Care Companion CNS Disord. 2016;18(6).
Mignogna J, Hundt NE, Kauth MR, Kunik ME, Sorocco KH, Naik AD, et al. Implementing brief cognitive behavioral therapy in primary care: A pilot study. Transl Behav Med. 2014;4(2):175–83.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217 – 26`.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM Framework. Am J Public Health. 1999;89(9):1322–7.
Chinman M, Daniels K, Smith J, McCarthy S, Medoff D, Peeples A, et al. Provision of peer specialist services in VA patient aligned care teams: protocol for testing a cluster randomized implementation trial. Implement Sci. 2017;12(1):57.
Chinman M, Oberman RS, Hanusa BH, Cohen AN, Salyers MP, Twamley EW, et al. A cluster randomized trial of adding peer specialists to intensive case management teams in the Veterans Health Administration. J Behav Health Serv Res. 2015;42(1):109–21.
Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, et al. Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science: IS. 2006;1:23.
Hayden P, Frederick L, Smith BJ, Broudy A. Developmental, Facilitation. Helping Teams Promote Systems Change. Collaborative Planning Project for Planning Comprehensive Early Childhood Systems. 2001 4/2001.
Nagykaldi Z, Mold JW, Aspy CB. Practice facilitators: A review of the literature. Fam Med. 2005;37(8):581–8.
Kazis LE, Skinner K, Rogers W. Health status of veterans: physical and mental component summary scores (SF-12V). Washington D.C.: Department of Veterans Affairs; 1998.
Kazis LE, Skinner KM, Ren XS. Health status and outcomes of veterans: physical and mental component summary scores (SF-36). Washington D.C.: Department of Veterans Affairs; 2000.
Tunis SL, Croghan TW, Heilman DK, Johnstone BM, Obenchain RL. Reliability, validity, and application of the medical outcomes study 36-item short-form health survey (SF-36) in schizophrenic patients treated with olanzapine versus haloperidol. Med Care. 1999;37(7):678–91.
Nabati L, Shea N, McBride L, Gavin C, Bauer MS. Adaptation of a simple patient satisfaction instrument to mental health: psychometric properties. Psychiatry Res. 1998;77(1):51–6.
Ritchie MJ, Kirchner JE, Townsend JC, Pitcock JA, Dollar KM, Liu CF. Time and Organizational Cost for Facilitating Implementation of Primary Care Mental Health Integration. J Gen Intern Med. 2020;35(4):1001–10.
Barbic S, Krupa T, Armstrong I. A randomized controlled trial of the effectiveness of a modified recovery workbook program: preliminary findings. Psychiatr Serv. 2009;60(4):491–7.
Cook JA, Jonikas JA, Hamilton MM, Goldrick V, Steigman PJ, Grey DD, et al. Impact of Wellness Recovery Action Planning on service utilization and need in a randomized controlled trial. Psychiatr Rehabil J. 2013;36(4):250–7.
Aggarwal NK. Ramifications of the VA MISSION Act of 2018 on Mental Health: Potential Implementation Challenges and Solutions. JAMA Psychiatry. 2019.
Goodman RM, McLeroy KR, Steckler AB, Hoyle RH. Development of level of institutionalization scales for health promotion programs. Health Educ Q. 1993;20(2):161–78.
Young AS, Cohen AN, Goldberg R, Hellemann G, Kreyenbuhl J, Niv N, et al. Improving Weight in People with Serious Mental Illness: The Effectiveness of Computerized Services with Peer Coaches. J Gen Intern Med. 2017;32(Suppl 1):48–55.
Bassuk EL, Hanson J, Greene RN, Richard M, Laudet A. Peer-Delivered Recovery Support Services for Addictions in the United States: A Systematic Review. J Subst Abuse Treat. 2016;63:1–9.
Boevink W, Kroon H, van Vugt M, Delespaul P, van Os J. A user-developed, user run recovery programme for people with severe mental illness: A randomised control trial. Psychosis. 2016;8(4):287–300.
Cook JA, Copeland ME, Jonikas JA, Hamilton MM, Razzano LA, Grey DD, et al. Results of a randomized controlled trial of mental illness self-management using Wellness Recovery Action Planning. Schizophr Bull. 2012;38(4):881–91.
Craig T, Doherty I, Jamieson-Craig R, Boocock A, Attafua G. The consumer-employee as a member of a Mental Health Assertive Outreach Team. I. Clinical and social outcomes. Journal of Mental Health. 2004;13(1):59–69.

CONSORTandSTARI.pdf

Download PDF

Journal Publication

published 07 Jun, 2021

Read the published version in Implementation Science →

Editorial decision: Major revision
31 Dec, 2020
Review #2 received at journal
05 Nov, 2020
Review #1 received at journal
05 Nov, 2020
Reviewer #2 agreed at journal
14 Oct, 2020
Reviewer #1 agreed at journal
30 Sep, 2020
Reviewers invited by journal
26 Sep, 2020
Editor assigned by journal
14 Sep, 2020
Submission checks completed at journal
13 Sep, 2020
Editor invited by journal
13 Sep, 2020
First submitted to journal
11 Sep, 2020

You are reading this latest preprint version

Implementation of Peer Specialist Services in VA Primary Care: A Cluster Randomized Trial on the Impact of External Facilitation

Status:

Journal Publication

Version 1

Abstract

Contributions To The Literature

Background

Methods

Site Recruitment and Randomization

External Facilitation versus Minimal Implementation Support

Peer Specialist Services Delivered

Measures and Analytic Methods

Reach and Adoption

Effectiveness

Results

Sample Demographics

Reach

Adoption

Effectiveness

Quantitative measures

Qualitative findings

Maintenance

Discussion

Limitations

Conclusions

Abbreviations

Declarations

Ethics approval and consent to participate.

Consent for publication.

Availability of data and materials.

Competing interests.

Funding.

Authors’ contributions.

Acknowledgements.

Trial Registration.

References

Supplementary Files

Status:

Journal Publication

Version 1