The multi-site, prospective, interventional, 2-arm randomized controlled trial (NCT04121754) of the safety and efficacy of the InTandem neurorehabilitation system enrolled 87 participants between September 2019 and January 2022. The trial was approved by the Institutional Review Boards for each participating center as follows: Advarra for Carolinas Medical Center, Boston University Charles River Campus IRB (which oversaw activities at both Boston University and Spaulding Rehabilitation Hospital), IRB of the Icahn School of Medicine at Mount Sinai, Johns Hopkins Medicine IRB, Kessler Foundation IRB, Northwestern University IRB, and UNC at Chapel Hill Non-Biomedical IRB. Written informed consent was secured for all participants. All procedures were in accordance with institutional guidelines.
Inclusion and exclusion criteria
Inclusion criteria for the trial consisted of the following: ≥50 years of age, greater than six months post-stroke, a baseline speed ≥0.50 m/s and <0.80 m/s, gait asymmetry observed by the study investigator, able and willing to consent, no cognitive impairment as evidenced in score ≤1 on question 1b and a 0 on question 1c on the NIH Stroke Scale, and ability to safely participate in protocol-defined sessions of 30-minute duration. Exclusion criteria for the trial consisted of the following: participating in another trial to evaluate an investigational drug at the time of enrollment, previous completion of the trial, unable or unwilling to provide informed consent, unable to participate in protocol-defined sessions without the use of assistive devices (e.g., a cane or walker), a baseline walking speed >0.80 m/s, known history of neurologic (excluding stroke) injury, more than 2 falls in the previous month, active participation in another walking rehabilitation intervention (e.g., physical therapy), use of an external lower limb prosthetic (i.e., artificial limb), hearing impairment that prevents interaction with the InTandem system, self-report of orthopedic surgery in the last year, severe aphasia and/or a speech/language disorder that limits the ability to express needs and comprehend instructions, comorbidities that prevent participation in a rehabilitative walking intervention, or vulnerable populations deemed inappropriate for participation in the trial.
Data Collection Overview
Trial data were collected at a baseline screening assessment, during each intervention session, and at a trial closing visit. The baseline screening consisted of administration of NIH Stroke Scale question 1b and 1c and the collection of basic demographic and medical history data. Medical history data were reviewed throughout the trial to identify changes. The 10-meter walk test (10mWT; comfortable speed) was used to measure the trial’s primary endpoint and was conducted at the baseline screening, the trial closing visit, and to start and end each intervention session. AEs were collected at each trial visit, or volunteered by the participant between trial visits, and captured on a standard form. The standard AE form collected a description of the event, the onset and resolution dates (or if the event was ongoing), the severity, management/treatment, outcome, and determination of the relationship to the intervention.
Primary Endpoint Data Collection
The trial’s primary endpoint was a between-group difference in the change in self-selected comfortable walking speed, as measured using the 10mWT (i.e., post-intervention 10mWT speed – pre-intervention 10mWT speed). The 10mWT is a timed walk test on a 10-meter walkway, with only the middle 6 meters timed. The 10mWT speed is the average walking speed from three separate 10mWT trials and is computed in meters per second (m/s). Assistive devices (i.e., cane, crutch, walker, and/or functional electrical stimulation device) were not allowed during 10mWT assessments; however, lower limb orthoses and braces were permitted if necessary for safety. Participants were blinded to the results of their 10mWT.
The primary endpoint analysis used a pre-intervention 10mWT speed collected no more than 14 days before the first session. If scheduling challenges required more than 14 days between the baseline assessment and the first session, the 10mWT speed measured immediately prior to the start of the first session was used. The post-intervention 10mWT speed used in the primary endpoint analysis was collected no more than 4 days after the final session. If scheduling challenges required more than 4 days between the trial closing visit and the final session, the 10mWT speed measured immediately prior to the final session was used. If participants did not complete the full 5-week intervention schedule or did not return to complete the trial closing visit, the 10mWT speed used in the intent-to-treat analysis was the 10mWT speed measured immediately prior to the final session completed.
Randomization
Eligible participants were randomized to one of two intervention arms: InTandem or a treatment-matched Active Control. Randomization was performed through the Electronic Data Capture (EDC) system (Castor, New York, New York) without stratification using block randomization with randomly selected block sizes to ensure approximately equal group sizes. Trial investigators and participants were not blinded to randomization. InTandem was supplied to trial sites by MedRhythms, Inc. as the MR–001 neurorehabilitation system (Portland, ME).
Trial Design Overview
This randomized controlled trial was conducted in clinical settings under the supervision of clinical investigators to evaluate safety and efficacy relative to a treatment-matched Active Control group. Because InTandem is designed for independent use in the home, a separate study has been designed to evaluate its independent set-up and operation (manuscript In Press 36).
Regardless of intervention arm assignment, all participants were scheduled to complete 15 intervention sessions over a 5-week period, at a frequency of 3 sessions per week, and with each session consisting of 30 minutes of walking. A complete session was defined as 15-to–30 minutes of walking. Participants were not allowed to use assistive devices during the intervention session but were allowed to take rest breaks as needed or when investigators believed that a rest break was necessary. Because sessions ended automatically after 30 minutes, rest breaks counted towards each intervention session (i.e., a 5-minute rest break resulted in 25 minutes for intervention).
All intervention sessions occurred on an overground track or hallway of at least 100 feet in length. In addition, the space used for intervention sessions could not have any discernible background music or audible distractions that could compete with the auditory intervention. Though no cueing or walking instructions were provided to study participants during training, all study participants were provided general instructions at the start of each intervention session (see Appendix Afor the language recommended in the clinical trial protocol). During each intervention session, physiological parameters (i.e., heart rate, blood pressure, and/or respiration rate) were monitored according to each site’s standard procedures, or at an investigator’s discretion to ensure safety of each study participant. If a study participant’s measurements fell outside of the acceptable parameters set by the site or the study participant’s physician, the intervention session could be paused or terminated based on a collaborative decision made by the study participant and investigator.
If required, participants were allowed to restart their intervention schedule after a washout period (n = 6). The minimum washout period required was equal to the duration of intervention weeks already completed. Following the washout period, trial eligibility was re-evaluated. Only trial data collected after the washout period were used in the trial’s primary analyses.
InTandem System and Intervention
InTandem consists of a touchscreen device locked with a preloaded proprietary software application, a headset for delivery of the rhythmic auditory stimulus, two shoe-worn inertial sensors, and charging equipment (Figure 1). To produce the individualized and progressive intervention, personalized audio cues are embedded into time-shifted music based on real-time decisions made by closed-loop control algorithms that continuously assess the gait data collected by the inertial sensors.
InTandem’s closed-loop control of music includes two real-time algorithm components that operate in parallel. The first component assesses the user’s ability to entrain to the target tempo based on real-time measurements of step-to-beat alignment, defined as the ratio of the user’s walking cadence (i.e., steps per minute) to the tempo of the time-shifted music. Here “time-shifted” refers to both: (1) stabilization of the natural variability (if any) of the song’s original tempo and (2) the within-session adaptive tempo increases or decreases used to individualize the intervention. More specifically, the initial target tempo is set to the user’s baseline cadence, as measured by the inertial sensors during an un-cued baseline walk, with subsequent modulation of the target tempo based on assessments made by the second algorithm component during the intervention. The second component assesses the user’s gait symmetry and variability based on real-time sensor input during the intervention, with symmetry measured as a ratio of interlimb stance and swing times, and variability measured as the coefficient of variation of stride times.
The entrainment and gait quality values from the two components are then compared to proprietary thresholds, which the algorithm uses to make two decisions. The first decision made is if it’s appropriate to modulate the song tempo—doing so requires concurrence by both components that (1) the user is sufficiently entrained and (2) their gait quality is appropriate for progression; only if both criteria are achieved is it considered safe to increase the tempo. The specific criteria used to make these determinations are based on the developer’s clinical experience delivering rhythmic auditory stimulation interventions, which were further refined during development to accommodate walking in real-world settings.The second decision made is if the user requires the addition of a synchronized rhythm track to the music to enhance the beat salience. When the rhythm track is introduced, the volume of the music adjusts so that the user hears more of the rhythm track relative to the music. Once the user is entraining and their gait symmetry and variability is within acceptable ranges, the rhythm track is then removed. If a user does not entrain, even with the added rhythm track, the music of the tempo will decrease until the user is entraining. The cascade of decisions that tailor the intervention to a person’s gait on a given day allows for personalized treatment with every session.
The music used in the trial was screened to ensure therapeutic suitability. This process ensured that the music met requirements for beat prominence and tempo. More specifically, the music included with the InTandem system is a core part of the intervention; not every piece of music is fit for purpose. Using a proprietary screening process, we assess high and low level features of the audio content, such as average tempo (what cadences could this song work for?), time signature (is the song in duple or triple meter?), duration of song (is it too long or short of a song?), and beat strength (how prominent is the beat?), in addition to other feature analyses. Through this process, a song is either accepted or rejected for use in InTandem.
At the conclusion of each session, an automated voiceover instructed the user to walk for a brief period without music to allow for data collection without the auditory stimulus. No other instruction was provided at each session.
Active Control
The Active Control intervention was matched to the InTandem intervention in number, duration, and frequency of sessions. Like InTandem sessions, Active Control sessions consisted of 30 minutes of overground walking practice supervised by clinical investigators. Though Active Control participants did not wear the InTandem system, they did wear inertial sensors on their shoes to enable recording gait data during each session.
COVID–19 Considerations
The trial was disrupted by the COVID–19 PHE. In brief, an unplanned interim analysis was conducted during the research shutdown, requiring revision of the statistical plan. More specifically, alpha was adjusted from 0.05 to 0.025. Moreover, according to guidance from FDA, the impact of COVID–19 on the trial data was examined by assessing the comparability of participants enrolled before versus during the COVID–19 PHE. The investigation revealed an effect of COVID–19 that was reasonably explained by a non-random change in trial management at one center, and ultimately required administrative removal of 8 individuals to resolve the observed effect of COVID–191.
Statistical Analyses
Safety was described as the frequency, severity, and relatedness of treatment-emergent AEs. An AE was defined as any untoward or unfavorable physical or psychological occurrence and included any abnormal sign, symptom, or disease temporally associated with participation in the research. Descriptive statistics are reported using means and standard deviations (SD) for continuous variables and proportions for categorical variables, unless noted otherwise. A 2 x 2 General Linear Mixed Model (GLMM) was used to evaluate differences in the treatment effect between groups (i.e., a Treatment x Time interaction), which allowed for nesting participants within Centers. Effects of interest in the model included Treatment (InTandem vs. Active Control), Time (Pre-intervention vs. Post-intervention), and the Treatment x Time interaction. Box-Cox and Shapiro-Wilk tests were used to evaluate linearity and normality. Extreme outliers and influential cases were screened for and removed.35 Robust standard errors were used to account for violations of normality. A compound symmetric covariance matrix was used to model the correlation structure among residuals and Satterthwaite Approximation was used to adjust the degrees of freedom for significance testing.
For the study primary endpoint of a change in gait speed overtime between groups, this study was originally powered (power = 0.80) to detect a moderately large to large effect (d = 0.64 to 0.82) for a plausible range of Intraclass correlation coefficients (ICCs), (r = 0.05 to r = 0.20), and conservative estimates of the correlation among repeated measures (r = 0.4 to r = 0.6) for n = 66 and alpha = 0.05.
Between-group differences in the number of responders were evaluated using Chi-Square (χ2) tests. Responders were defined using two criteria: (1) a post-intervention change in 10mWT speed that surpassed the 0.16 m/s minimal clinically importance difference (MCID)31 or (2) both a post-intervention change larger than 0.16 m/s and a final post-intervention speed above 0.80 m/s.32 To account for an unplanned interim trial analysis during the COVID–19 Public Health Emergency (PHE), alpha was lowered to 0.025.
In addition to the primary endpoint analyses, an exploratory time-course of change analysis was conducted using a 2 x 17 x 2 GLMM. This analysis tested between-group differences in the treatment effect using all 10mWT speed data collected. The model tested three main effects: Treatment (InTandem vs. Active Control), Time (Baseline, Session 1, …, Session 15, and Closing), and Trial (pre- vs. post- session walking speed), and their two-way interactions. Alpha was set to 0.05 for this analysis.
[1]Eight individuals were found to have been recruited into the trial during the COVID-19 PHE shortly after first completing another walking intervention trial. The washout period imposed between the two competing trials was discovered to be inconsistent with the precedent set in the InTandem trial protocol for a washout period. This deviated recruitment strategy during the COVID-19 PHE was considered an unanticipated event that affected only these eight participants; their administrative removal resulted in COVID-19 no longer affecting the trial data.