Participants
Quantitative data was collected from women incarcerated in one of five jails in Kentucky (N = 600) as part of a larger parent project under the NIH/NIDA funded JCOIN initiative30,46 between December 2020 and January 2024. To be eligible for the study, women must have endorsed criteria consistent with OUD during a screening session and be planning for jail release within 7–60 days.46
Qualitative and quantitative data was also collected from MOUD providers (n = 4), who conducted psychosocial assessment sessions via telehealth with women in jail. All MOUD providers were women, had master’s or doctoral-level training in behavioral health services, and worked for agencies that provided comprehensive substance use disorder services (including MOUD) and mental health treatment. MOUD providers were selected based on their agency’s location in proximity to the jail, their agency’s offering of community MOUD treatment and other SUD services, and willingness to designate one provider for the JCOIN PreTreatment Telehealth protocol.
In addition, qualitative data was collected from recovery staff (N = 5), including peer navigators (n = 3; all female) and their supervisors (n = 2; all male), all of whom were employed by a local recovery community organization. Peer navigators met with women before release for re-entry planning and linkage to MOUD treatment in the community and had many key factors in common with study participants -- all peers were women, identified as a person in recovery from OUD, had a history of OUD treatment, and had a history of involvement with the CLS47.
Measures
General telehealth perceptions. To address the first study objective, general telehealth perceptions were assessed through a series of semi-structured qualitative interviews with MOUD providers and recovery staff. Research staff (all women) interviewed both providers and recovery staff approximately halfway through study data collection (50% of experimental enrollment) to assess general perceptions of the use of telehealth for the study. Using a Likert-type scale, MOUD providers and recovery staff responded to validated scale measures assessing the acceptability, appropriateness, feasibility, and desirability of telehealth as a means to conduct OUD assessments and pre-release planning with incarcerated women.48After each set of subscale items, providers and recovery staff were asked "can you tell me a little more about why you chose those responses?" to collect additional qualitative data about their ratings. Analyses for the present paper focus on these qualitative responses related to the acceptability, appropriateness, feasibility, and desirability of telehealth.
JCOIN participant characteristics. To address the second study objective, quantitative measures were collected from JCOIN participants to better understand individual-level factors which may influence telehealth session acceptability and feasibility. JCOIN participant characteristics included demographic information such as age, race/ethnicity (non-White = 0, White = 1), sexuality (sexual minority = 0, heterosexual = 1), and whether they were married or living as married prior to incarceration (PTI; not married/living as married = 0, married/living as married = 1). Women also reported their highest level of education (less than high school/GED = 0, at least high school/GED = 1), employment status PTI (unemployed = 0, employed = 1), area where they lived PTI (urban county = 0, rural county = 1, classified based on rural-urban continuum codes49), and specifically whether they lived in a designated Appalachian county PTI (non-Appalachian = 0, Appalachian = 1).50
Other characteristics included severity of opioid use prior to incarceration as measured by the DSM-5 OUD Checklist (range 0–11)51 and NM-ASSIST (range 0–39).52 The DSM-5 OUD Checklist screened participants for severity of symptoms consistent with OUD in the 30-day PTI and 12-month PTI. The NM-ASSIST was split into two sections asking about the severity of opioid use in the 90 days before incarceration including both street opioids (e.g., heroin, fentanyl) and prescription opioids (e.g., oxycodone).
Mental health and past victimization experiences were also assessed as JCOIN participant characteristics. Questions were derived from the Global Appraisal of Individual Needs—Initial (GAIN-I)53 mental and emotional health section and asked participants to report on past 12-month depressive symptoms (range 0–9), anxiety/fear-related symptoms (range 0–12), and traumatic stress symptoms (range 0–13). The number of symptoms reported were then summed for each scale, with higher scores indicating more serious symptom profiles. Experiences of lifetime victimization were measured using the GAIN General Victimization Scale (GAIN GVS), 53 which was also summed with higher scores indicating more severe lifetime victimization experiences. Regarding childhood stressful events, participants completed the Adverse Childhood Experiences Questionnaire (ACEs; summed items for number of experiences).54 For descriptions of each of these scales for the larger sample of JCOIN participants, see Annett and colleagues.55
MOUD provider feedback. MOUD provider feedback on the telehealth clinical assessment session was assessed using a standardized feedback form (developed by clinical staff) completed at the end of each telehealth psychosocial assessment with each participant. The first section of this form consisted of 10 questions to ascertain clinical engagement – defined as how well the telehealth session facilitated rapport between the provider and the study participant as well as client engagement. Specifically, providers were asked, “During your session with the JCOIN participant today, how well did the use of telehealth facilitate your ability to do the following…” Providers were then given a list of five characteristics of engagement in the psychosocial assessment and asked to rate each on a scale of 0 (not at all) to 10 (a great deal). Providers were also asked to rate five statements about how well they thought the use of telehealth facilitated participant engagement in the session, using a scale of 1–10 (1 = very low, 10 = very high; see Table 2). Responses to these 10 questions asking about perceptions of both provider and client engagement in the clinical assessment session were averaged to create a total clinical engagement score (α = .98), where higher scores were indicative of more engagement from both the provider and the client, as well as supportive, favorable ratings of the use of telehealth to achieve engagement.
Table 2
Summary of items on provider feedback forms for telehealth assessment ratings
| M (SD) (N = 487) |
General MOUD Provider Feedback Questions |
Rate how well telehealth facilitated your ability to…(range 0–10) | |
Conduct the psychosocial assessment | 9.1 (1.2) |
Discuss sensitive topics | 8.7 (1.5) |
Establish rapport | 8.9 (1.4) |
Introduce stages of change talk | 8.5 (1.7) |
Obtain sufficient information to inform an OUD diagnosis | 9.4 (1.0) |
Rate the use of telehealth for facilitating the participant's… (range1-10) | |
Ability to talk about her problems | 8.8 (1.4) |
Ability to disclose critical historical information | 8.8 (1.4) |
Ability to provide evidence of OUD symptoms | 9.4 (0.9) |
Interest in OUD treatment | 9.1 (1.2) |
Openness to the possibility to change | 9.1 (1.2) |
Clincal Engagement Total score (range 0–10) | 9.0 (1.2) |
Telehealth-Related Questions |
Face-to-Face Comparability (range 0–10) | 9.1 (1.3) |
Technology Issues (range 0–10) | 0.5 (1.7) |
The second section of the MOUD provider feedback form consisted of items to assess perceptions of comparability between telehealth and face-to-face (FTF) assessments, as well as the impact of technology issues on the assessment. To assess FTF comparability, providers were asked, “Overall, how would you compare your intake assessment today using telehealth with an intake assessment you typically conduct in a face-to-face interview?” Providers responded on a scale from 0 (not at all as good as face-to-face) to 10 (exactly as good as face-to-face). Providers were then asked specifically about any technology issues that might have impacted the session including, “Overall, did any technical issues with the telehealth session today related to the technology, internet connection, or anything else impact the session?” (coded as 0 = no, 1 = yes). If providers responded yes, they were then asked, “If yes, to what extent did technology issues impact the overall assessment process using telehealth?” Providers responded on a scale from 1 (slightly) to 10 (extremely disruptive). Provider responses to these final two questions were combined into one item response (technology issues) for which providers who responded ‘no’ to the initial question about technical issues were coded as a ‘0’ on the question asking about the extent of impact of technology issues on the assessment to minimize missing data.
Procedure
Recruitment. A detailed overview of the larger JCOIN protocol and participant recruitment including random selection procedures can be found in Staton et al. 30 and Staton et al. 46 Women with a history of OUD who were incarcerated were randomly selected, screened either face-to-face or via Zoom® videoconferencing (depending on the jail’s COVID-19 restrictions) for study inclusion criteria, and consented for research participation. Screening questions included the DSM-5 OUD Checklist and NM-ASSIST to assess opioid use severity prior to incarceration. A NM-ASSIST opioid score of 4+ (identified as being at moderate risk with potential benefit from receiving an intervention) or a DSM-5 OUD Checklist score of 2 + were used as the cutoff score for study enrollment. Following study screening and eligibility determination, participants were asked to complete baseline data collection to assess their lifetime and recent opioid use, high-risk behaviors such as injection drug use and history of non-fatal overdose, history of CLS involvement, mental health, and other family/social factors. Data collection took about 88 minutes on average (SD = 28.8, range 30–221), and participants were paid $45 for their time.
Random assignment. Following the baseline data collection, women were randomly assigned to one of two PreTreatment Telehealth intervention groups: 1) PreTreatment Telehealth Only (n = 299), or 2) PreTreatment Telehealth + Peer Navigation (n = 301). PreTreatment Telehealth was defined as the initial psychosocial assessment, MOUD education, and re-entry planning session conducted between a woman with a history of OUD who was currently incarcerated and a community MOUD treatment provider in preparation for jail release and community treatment engagement. In each intervention condition, the research coordinator worked closely with each provider and each jail facility to schedule the telehealth session based on the provider’s clinical schedule and the availability of rooms at the jail. Sessions were also scheduled based on a priority of projected release dates from jail. Once a session was scheduled, the study coordinator forwarded study paperwork to the provider in preparation for the session which included screening assessment forms, baseline data collection summary report, locator form, an authorization for release of information, and other relevant agency intake forms.
Intervention delivery. Intervention sessions were scheduled within a week of baseline data collection (ranging from the same day of data collection to within 6 days after enrollment). On the day of the scheduled telehealth session, a JCOIN study staff member visited the jail, met the study participant in the designated private office, and set up the computer and webcam for telehealth. In cases where facilities had a COVID-19 restriction protocol in place preventing staff from physically accessing the jail, designated jail staff would escort the participant to the room and set up the telehealth computer and camera and research staff would log on for the beginning of the remote session to facilitate a warm hand-off to the provider. In both types of cases, the participant was reminded about confidentiality before the telehealth session and no jail staff were present during the telehealth session. Headphones were also available upon participant request to ensure additional confidentiality.
PreTreatment Telehealth Only. In each intervention condition, the PreTreatment Telehealth session opened with an overview of agency services and a review of agency forms and documentation needed to ensure the woman could be enrolled as a client in community services upon her release from jail. Agencies were provided with a sample assessment form to confirm assessment content and verify consistency across agencies, but the content of the PreTreatment Telehealth session was purposefully not scripted for the study. Providers were encouraged to complete their usual first appointment psychosocial assessment, which was the traditional standard of care at each of the agencies. Providers were asked to specifically assess any facilitating factors or barriers (Medicaid re-enrollment, other insurance coverage, transportation, childcare, etc.) that may affect the woman’s participation in community services as part of re-entry planning. If providers became concerned about anything the participant reported during the assessment, they let participants know that they had the option to complete a medical release form to enable research staff to make a referral to the jail medical staff.
Providers closed the telehealth session with general education about MOUD and a transitional re-entry plan for accessing community services at the agency, including the first appointment day/time for after release. Locator information was verified to stay in touch with the participant following jail release, and the participant was encouraged to stay in touch with the provider following release to begin treatment in the community. Contact information for the provider and the agency, as well as a detailed referral guide for community resources, were left in the participant’s property at the jail by JCOIN study staff to be available at release.
Peer Navigation. Participants in both study experimental conditions received PreTreatment Telehealth. In addition, women randomized to one experimental arm also had the opportunity to meet with a peer navigator via telehealth to assess re-entry needs and resources following release to facilitate treatment entry and to build recovery capital.47 The overall goals of the JCOIN Peer Navigation sessions were to identify potential barriers and obstacles for sustaining recovery during the critical re-entry period from jail to the community and discuss strategies for linkage to treatment and recovery support services, as well as how peers could serve as mentors, guides, and companions to women during this transition. Telehealth sessions between the peer navigators and study participants were scheduled by the JCOIN research coordinator, and ideally scheduled right after the PreTreatment Telehealth sessions for convenience at the jail. Peer navigators were also sent participants’ summary paperwork in advance of the session to prepare resources.
On the day of the scheduled telehealth appointment, peer navigators focused on two primary goals: (1) introduction and rapport building, and (2) orientation to the JCOIN Peer Navigation services. The peer navigator introduced herself as a person in long-term recovery who has “been there” and explained that she was a certified peer support specialist working with a recovery community organization. As appropriate, the peer navigator shared her own experience being in treatment, perhaps being on MOUD, or having been incarcerated, to build rapport. The peer navigator explained that she understood from personal experience that there are barriers to staying in recovery, but also supportive services that could help, and explained the plan for her to continue to work with the woman during community re-entry for 12 weeks.
Following the overview of JCOIN Peer Navigation Services, the peer pavigator talked with the participant about barriers and facilitating factors associated with recovery and goals once she is released from jail. During the session, participants typically selected up to three goals they deemed as most important upon re-entry and talked about short-term and long-term strategies to meet those goals. At the conclusion of the session, the peer navigator asked the participant if there was anything else she wanted to discuss prior to ending the session. If not, locator information was verified to stay in touch after jail release and resources following jail release were shared (either during the call and/or left in the participant’s property to access after jail release).
Analytic Plan
This study used a convergent mixed-methods approach, including simultaneous analysis of both qualitative and quantitative data, to describe an innovative telehealth intervention for linking incarcerated women with OUD with community MOUD treatment. To meet the first study objective (describe general perceptions of service providers on the use of telehealth), qualitative responses to the open-ended questions collected from MOUD providers and recovery staff at study mid-point (50% of enrollment complete) were analyzed using a deductive analysis approach56 to specifically identify themes related to positive and negative perceptions of telehealth. Interview transcripts were reviewed by a graduate research assistant (MML) and the study's staff scientist (MT). MML identified instances of positive and negative telehealth perceptions within transcripts and developed thematic groupings, which were reviewed by MT and the study principal investigator (MS). Feedback from MT and MS was used to refine thematic groupings and selected quotations, which were used as the basis for the results presented below.
To meet the second study objective to examine (relationship between participant-level characteristics and MOUD provider perceptions of clinical engagement and FTF comparability during the clinical assessment, quantitative data were analyzed), descriptive statistics were first computed for all quantitative study variables of interest using univariate descriptive analyses in IBM SPSS 27.0. Of the 600 participants enrolled in the experimental arms of the study, 529 completed a telehealth session with a MOUD provider. Noncompletion was due to release (n = 54) or transfer (n = 7) before the scheduled session or declining to meet with the provider (n = 10). One additional participant completed a session but did not have a feedback form submitted from the provider. Missing data from completed forms were addressed using case-wise deletion, resulting in an additional 41 participants being excluded from analysis. The final sample for this analysis consisted of 487 participants.
Analyses examining the relationships between participant-level characteristics (including demographic, substance use, and mental health variables) and MOUD provider feedback scores used Spearman’s rho and t-tests to assess bivariate associations, followed by two multivariate linear regression models. Multivariate models included only independent variables that were significant at the bivariate level. Results from preliminary ANOVA analyses indicated significant differences in clinical engagement and FTF comparability by MOUD provider and jail site (all p < .001). Thus, in both linear regression models, jail site, provider, and telehealth technology issues were included as controls to allow for examination of the independent contribution of participant-level factors on the dependent variables of clinical engagement (Model 1) and FTF comparability (Model 2). Issues of multicollinearity were assessed using variance inflation factors (VIFs). All VIFs were less than 4.1. Heteroscedasticity issues that arose for each regression model were corrected by applying robust standard errors. Influential cases were assessed using Cook’s Distance, however no issues with influential cases were found.