Study Protocol for a Cluster, Randomized, Controlled Community Effectiveness Trial of the Early Start Denver Model (ESDM) Compared to Community Early Behavioral Intervention (EBI) in Community Programs serving Young Autistic Children: Partnering for Autism: Learning more to improve Services (PALMS)

doi:10.21203/rs.3.rs-4870288/v1

Download PDF

Study protocol

Study Protocol for a Cluster, Randomized, Controlled Community Effectiveness Trial of the Early Start Denver Model (ESDM) Compared to Community Early Behavioral Intervention (EBI) in Community Programs serving Young Autistic Children: Partnering for Autism: Learning more to improve Services (PALMS)

https://doi.org/10.21203/rs.3.rs-4870288/v1

This work is licensed under a CC BY 4.0 License

Journal Publication

published 28 Sep, 2024

Read the published version in BMC Psychology →

You are reading this latest preprint version

Background

The rising number of children identified with autism has led to exponential growth in for-profit applied behavior analysis (ABA) agencies and the use of highly structured approaches that may not be developmentally appropriate for young children. Multiple clinical trials support naturalistic developmental behavior interventions (NDBIs) that integrate ABA and developmental science and are considered best practices for young autistic children. The Early Start Denver Model (ESDM) is a comprehensive NDBI shown to improve social communication outcomes for young autistic children in several controlled efficacy studies. However, effectiveness data regarding NDBI use in community-based agencies are limited.

Methods

This study uses a community-partnered approach to test the effectiveness of ESDM compared to usual early behavioral intervention (EBI) for improving social communication and language in autistic children served by community agencies. This is a hybrid type 1 cluster-randomized controlled trial with 2 conditions: ESDM and EBI. In the intervention group, supervising providers will receive training in ESDM; in the control group, they will continue EBI as usual. We will enroll and randomize 100 supervisors (50 ESDM, 50 EBI) by region. Each supervisor enrolls 3 families of autistic children under age 5 (n = 300) and accompanying behavior technicians (n = 200). The primary outcome is child language and social communication at 6 and 12 months. Secondary outcomes include child adaptive behavior, caregiver use of ESDM strategies, and provider intervention fidelity. Child social motivation and caregiver fidelity will be tested as mediating variables. ESDM implementation determinants will be explored using mixed methods.

Discussion

This study will contribute novel knowledge on ESDM effectiveness, the variables that mediate and moderate child outcomes, and engagement of its mechanisms in community use. We expect results from this trial to increase community availability of this model and access to high-quality intervention for young autistic children, especially those who depend on publicly funded intervention services. Understanding implementation determinants will aid scale-up of effective models within communities.

Trail Registration:

Clinicaltrials.gov identifier number NCT06005285. Registered on August 21, 2023.

Protocol Version: Issue date 6 August 2024; Protocol amendment number: 02

Autism

early intervention

early start Denver model

NDBI

community implementation

Autism as an ongoing significant public health concern

Autism Spectrum Disorder (autism) continues to be one of the most common forms of neurodevelopmental disability worldwide, with US estimates of 1 in 36 children.[1] Autism presents a significant public health challenge in that the average per capita lifetime costs of challenges associated with an autism diagnosis in the US exceeds $3 million. The societal costs are over $7 trillion and are projected to rise to $14 trillion by 2029.[2, 3] High-quality, evidence-based early intervention has the potential to improve child outcomes by reducing intellectual impairment and improving social communication and language skills[4–7] In addition, research suggests that the cost of early evidence-based intervention may be offset by reduced costs of special education and other intervention across the lifespan.[8–10] The most frequently used early intervention for autistic children under age 5 is behavioral therapy.[11] A recent survey reports approximately 40% of autistic children in the US receive intensive behavior therapy (17–67% depending upon region).[12] However, current data come primarily from controlled efficacy studies with strict inclusion criteria, highly trained providers and limited sample diversity.[13]

Because of increasing demand due to rising prevalence, consumer knowledge, and improved insurance coverage, the US has seen a proliferation in the number of for-profit autism community-based agencies (CBAs) offering intervention. Since the Affordable Care Act (2010), 47 states have mandates for insurance funding of autism interventions based on Applied Behavior Analysis (ABA). For a variety of reasons, including initial studies from several decades ago, structured interventions based on ABA are most often used in CBAs.[14] CBAs are estimated to serve over 50,000 autistic people and generate $1.07 billion in revenues annually. They serve many historically underrepresented autistic children, including those living in low-income communities. However, the fast growth in number of CBAs belies the lack of effectiveness research for their services. This lack of the necessary evidence-base to support current community practice raises serious public health concerns about the cost, effectiveness, and quality of community early autism intervention. This is especially true for children of color.[15]

Need for improvement in community-based early intervention services for autistic children.

Systematic reviews and meta-analyses of randomized efficacy trials find positive effects of both highly-structured, ABA-based early interventions, and naturalistic developmental behavioral interventions (NDBIs) on developmental outcomes for young children with autism.[16–18] Discrete Trial Teaching (DTT), a highly-structured intervention based on ABA principles, was one of the first identified early interventions for autism.[19] DTT has a clear, structured curriculum and highly scripted teaching strategies. It is adult-directed and uses massed trial-based learning and external motivation to teach skills across domains. DTT is the primary comprehensive strategy taught in a majority of BCBA and technician training programs and therefore represents the primary strategy provided by CBAs.[20] Most effectiveness studies for the DTT model are either case-control studies or quasi-experimental with a few randomized controlled design studies.[21–24] Structured ABA programs often demonstrate better outcomes for children than eclectic models or waitlist controls; however, results are inconsistent[25, 26] and effect sizes are consistently smaller than in efficacy trials.[27–29]

In the past 25 years since the initial non-randomized DTT efficacy trial,[30] intervention sciences has evolved to bring developmental science into early intervention via the NDBIs.[31] NDBIs combine developmental science with ABA principles to include developmentally appropriate learning targets and teaching strategies, including those that integrate child learning into daily activities to build well-generalized child learning. Additionally, these developmentally appropriate practices respect young children’s interests, choices, and initiative, and focus on children’s own motivations to support child-directed learning. The NDBI evidence base includes multiple randomized trials testing NDBIs,[32–35] which are established best practice for young autistic children,[36] supported by systematic reviews and meta-analyses reporting positive child outcomes.[7, 37] [38]

In addition to being effective, NDBIs facilitate inclusion through their use of typical, developmentally appropriate practices.[39, 40] Additionally, autistic adults have raised concerns regarding the ethics of traditional ABA approaches that focus on compliance, suppression of characteristically autistic behaviors, and “curing” autism, fearing that such approaches pathologize autism and may cause harm to autistic people.[41] While views vary widely, many neurodiversity advocates support person-centered, respectful intervention focusing on skill building and improving quality of life.[42] NDBIs use a strengths-based approach focused on child choices and preferences to support child learning, especially in social communication and language. NDBIs have potential to better align early intervention with the goals of autistic individuals.[43] However, NDBIs have a paucity of effectiveness trials in CBAs with the few existing studies flawed by lack of experimental designs,[44] a focus on school settings,[45–47] or low-intensity, parent-implemented studies.[48, 49]

Currently, CBAs rarely implement NDBI models, instead using highly structured DTT strategies not developmentally appropriate for young children, [50]^,[51] due in part to lack of knowledge and quality training. A recent survey of behavior therapists found that few recognize or understand how to use NDBIs in practice [20].[20] Given the strengths of NDBI, the large numbers of CBAs serving young autistic children, and their lack of NDBI knowledge, there is a clear need for effectiveness testing with diverse children in community care to determine if NDBIs support child learning and progress and family use and satisfaction.

Need for effectiveness testing of NDBI to meet this need.

One NDBI developed for autistic children under age 5 is the Early Start Denver Model (ESDM) [31]. ESDM is a comprehensive model that aims to increase children’s social motivation and social learning opportunities, decrease their developmental delays, and enhance social communication. ESDM uses a data-based approach and empirically supported ABA and developmental teaching practices embedded in everyday activities. ESDM integrates ABA with developmental, relationship- and play-based practices to create an integrated approach that is individualized while also being standardized and manualized. ESDM fits within the seven dimensions that define ABA practice[52–54] and meets the criteria of the Professional and Ethical Compliance Code for Behavior Analysts[55] and additional parameters in the ABA Treatment of ASD Practice Guidelines.[56]

ESDM is one of the very few comprehensive early interventions validated and replicated in multiple, randomized trials.[32, 35, 57] A recent meta-analysis found significant effects of ESDM on cognition and language compared to usual care.[4] ESDM is effective for autistic children across a wide range of learning styles and abilities and is flexible enough to be used in many contexts by different types of providers and caregivers. While the evidence-base is strong, in these studies ESDM has been delivered by highly trained providers at university-based research sites. Exclusion criteria in some trials eliminated participants based on severe caregiver mental health conditions, geographic location, limited English, and child characteristics (e.g., IQ < 35, genetic comorbidities).[58]

To date, there have been no effectiveness trials of the comprehensive ESDM protocol in community settings. However, a recent review found that ESDM has more evidence to support its use with participants from culturally and linguistically diverse backgrounds than any other NDBI.[59] Two feasibility studies suggest community effectiveness when treatment is provided by ESDM-certified staff.[60, 61] A recent randomized feasibility trial of an adapted model (Community ESDM; C-ESDM) in low resource settings demonstrated the feasibility of training community providers to coach caregivers in ESDM and found significant skill gains in provider and caregiver use of ESDM strategies. However, perhaps due to very low intensity, there were no significant differences in the amount of child gain between groups.[48] A recent randomized trial with a broad inclusion criteria that examined the use of C-ESDM in 16 community agencies in Canada involving 49 children found that families receiving C-ESDM reported higher quality of life, intervention satisfaction, and self-efficacy than the comparison group. Children in the C-ESDM group made greater gains in receptive language and faster gains in joint attention and language with greater effect sizes than the comparison group.[62] These feasibility studies show the promise of ESDM for the community and highlight the need for a full-scale effectiveness trial.

Advancing the science of intervention mechanisms through an ESDM effectiveness trial.

Child social motivation and Systematic Caregiver Coaching are the main variables in the hypothesized model of change underlying ESDM.[63] Social motivation theory has been used to explain an underlying mechanism of social communication challenges in autism.[64, 65]. Dawson posits that a biological disruption of social motivation results in decreased social attention and social learning beginning in the first year of life, potentially contributing to the developmental delays in learning, social communication, social cognition and social interests observed in autism. Studies have identified early differences in social motivation between autistic and neurotypical individuals in behavioral manifestation, physiology and neurobiology from infancy on.[66, 67][68] A recent meta-analysis showed that, in over 6000 participants, autistic individuals showed reduced social orienting compared to neurotypical peers.[69] Limited social orienting has a negative impact on language learning,[70–73] and early social motivation in autistic toddlers predicts language 2 years later.[74][63]These studies have led researchers to identify social motivation as a potential mediator of response to early intervention and an important mechanism to target in early treatment.[63]

Social motivation has thus been suggested as the underlying mechanism of change in ESDM.[75] Given the plasticity of brain development in the first few years of life and its proclivity for social communication and language learning in this period, ESDM was developed to differentially support social attention, engagement, communication and social motivation to very young autistic children by pairing developmentally appropriate learning with children’s preferred people, activities, and materials. Caregivers learn to use different strategies that better support learning and social engagement for their autistic children. Thus, the ESDM intervention approach heightens the value of social engagement in a way that fits the child’s learning style and supports child social attention for learning. These additional social learning experiences are thought to stimulate further neural development and connectivity resulting in accelerated learning rates overall and improved growth and development of early social communication. This study represents the largest examination of ESDM or any other NDBI yet conducted and will provide additional data about whether ESDM activates the proposed mechanism – social motivation – to improve social communication and language outcomes in autistic children.

ESDM’s strong emphasis on systematic caregiver coaching facilitates child outcomes by allowing caregivers, with whom children may have the highest social motivation, to embed ESDM strategies throughout daily family routines. Coaching caregivers in strategies that increase social motivation can increase learning opportunities and child engagement beyond the treatment session. Inclusion of caregivers in intervention is best practice[76], and fidelity to intervention practices predicts child outcomes in programs with both provider- and caregiver-implemented components.[77, 78] CBA programs typically include some coaching related to behavior concerns rather than teaching intervention strategies.[79] Therefore, having a systematic method of teaching caregivers to use ESDM strategies may increase access to intervention further activating the social motivation mechanism and improve child outcomes The importance of caregiver coaching is further supported by the positive relationship between caregiver fidelity and child outcomes across multiple studies.[77, 80] Therefore, we aim to understand the mediating role of caregiver NDBI fidelity and child outcomes across both groups in this diverse community sample.

Using implementation science to maximize efficiency and relevance of the ESDM trial.

If ESDM is effective for autistic children in the community, and acceptable to community providers and caregivers, the next target should be scaling up for broader implementation. This study will use the Exploration, Adoption/Preparation, Implementation, Sustainability (EPIS) framework,[81] a multi-level, multi-phase, process and determinant framework to collect preliminary implementation data. This framework both describes the process of translating research into practice and allows for identification of factors that influence implementation outcomes. The EPIS framework is relevant for understanding the process and determinants of service implementation in public service systems for young autistic children (see Fig. 1). EPIS specifies both the critical role of intervention characteristics and the inner and outer context factors on implementation, while attention to client diversity and potential needs for adaptations across levels. Thus, using an implementation science framework can reduce inequities in healthcare delivery.[82]

The current project uses a hybrid type 1 randomized controlled design to examine ESDM effectiveness and to gather data on implementation determinants. This study will test the effectiveness of ESDM for improving social communication and language (primary), adaptive behavior, goal progress and quality of life (secondary) outcomes in a diverse community sample of autistic children. Our research question include: (1) Compared to usual EBI, do children in the ESDM condition demonstrate significantly increased growth rates in social communication and language? (2) Do caregivers in the ESDM condition have greater increases in use of general NDBI strategies and greater caregiver competence than those in EBI? (3) Does ESDM engage the treatment mechanisms of child social motivation and caregiver fidelity within both treatment groups? (4) Do variable such as caregiver education, child race/ethnicity and provider adherence to ESDM fidelity moderate child progress in both groups? We will use the EPIS framework to gather data on ESDM Implementation outcomes including acceptability, feasibility, appropriateness (including for children), cultural responsivity, CBA provider ESDM fidelity, and caregiver engagement.

Design & Randomization

This study uses a parallel 2-arm, hybrid type 1 (effectiveness/implementation) cluster randomized controlled trial design. The two arms are ESDM and EBI. We will recruit a multilevel sample (Fig. 2), including 20 CBAs, 20 regional managers, 100 Regional Teams (program supervisor and technicians: average of 1 supervisor and 2 technicians per team) and 300 child/caregiver dyads (2–4 per team). Regional Managers from participating regions will complete baseline and follow-up surveys and semi-structured interviews. We will recruit as many supervisors per region as possible with an expected mean of 5 per region. We will recruit as many technicians per region as possible, with replacement to account for high turnover, with an expected mean of 2 per supervisor.

CBAs throughout the US will be recruited, through emails, presentations at conferences and social media, to increase diversity and generalizability. Interested CBA leaders will be invited to meet with the study team. Those CBAs expressing interest and meeting inclusion criteria (see below) will be enrolled in the study. The randomization unit is by region. Within each CBA, regions will be randomized to either receive training in ESDM or continue usual early behavioral intervention (EBI). We chose to randomize at the region level to prevent potential contamination across providers and children, as our community partners indicated that children often receive treatment from multiple providers within a region. Using covariate constrained randomization, regions will be randomized so each CBA is represented in both ESDM and EBI. The variables considered in the constrained randomization include insurance mix (proportion of clients with Medicaid < 0.5 or ≥ 0.5) and size (number of autistic children under age 5 < 20 or ≥ 20). The statistical consultant with generate the randomization and reveal to the appropriate members of the study team. Members of the study team involved in assessments will remain unaware of the intervention assignment.

A cascading recruitment strategy will be used to first recruit agencies and then supervisors within participating regions. Supervisors will then recruit children and families and the technicians working with those children. Recruitment at each level will be facilitated through videos and handouts explaining the study and the processes. The research team will present to interested supervisors at team meetings. Supervisors will receive a handout and link to a video to share with technicians and families. Interested technicians and families will set up a time to talk with the research team about the study to determine interest.

This study was approved by the institutional review board at the University of California, Davis, protocol number 203076-2. This study is funded by the National Institute of Mental Health (NIMH; R01MH131703 and supported by the MIND Institute Intellectual and Developmental Disabilities Research Center (IDDRC) funded by the National Institute of Child Health and Human Development (NICHD; P50 HD103526).

Participants

Community-Based Agencies. Eligibility criteria for autism CBA include: (a) serve at least 10 children on the autism spectrum under age 5 annually; (2) have at least 2 regions that can be randomized, and (3) accept Medicaid or equivalent payment (e.g., funding for low-income families through public service systems).

Supervisor Participants. Supervisors will be recruited from enrolled agencies. To be eligible, supervisors must plan to be employed by the agency for at least 12 months, supervise programs for autistic children under age 5, supervise at least two technicians and have not had previous ESDM training.

Technician Participants. Technicians supervised by a participating supervisor and working with an enrolled child/family will be recruited. Inclusion criteria include planning to be employed at the agency for at least 12 months and have not had previous ESDM training.

Child / Family participants. All child clients meeting eligibility criteria with a participating supervisor will be referred to the study and randomly selected for recruitment by the research team, with an expected average of 3 (range 2–4) per supervisor. Inclusion criteria include being under age 4 at program entry, having a current diagnosis of autism or being served by the agency due to high likelihood of autism. The family must speak English or Spanish and plan to receive intervention for at least 7 months. We will confirm autism diagnosis through record review. Payors typically require that children enter treatment with a cognitive assessment and an Autism Diagnostic Observation Scale (ADOS-2).[83] For children under three who do not have a confirmed autism diagnosis we will complete the Telemedicine-based Autism Evaluation Tool for Toddlers and Young Children (TELE-ASD-PEDS)[84] found to be feasible and effective at assessing autism over telehealth.[85, 86]

Clinical Intervention and Community Training

Clinical Intervention.

Treatment will be conducted in the community context of the CBAs serving autistic children under age 5. They accept payment through insurance (public or private) or contracts with public agencies (e.g., Department of Developmental Services). CBA structure typically involves treatment teams that include a supervising clinician with a Master’s degree and credentials such as a BCBA, and 2–10 technicians. Supervisors conduct assessments, develop, and monitor treatment programs, provide caregiver coaching, and train and supervise technicians. Technicians have approximately 40 hours of training in autism treatment and standardized supervision based on payor and board requirements; they conduct 1:1 intervention sessions with the child. Treatment intensity varies based on child need, family preference and payor requirements; however, most agencies provide 10–30 hours per child per week of intervention which has been shown to be effective for this age group.[87]

Early Start Denver Model (ESDM). The Early Start Denver Model[75, 88] focuses on teaching inside children’s play and care activities, carried out within a joint activity structure.[89] Adults follow children’s leads into activities, embed teaching objectives inside the activity, use the play or child’s activity goal as the reward, and build targeted skills by applying ESDM teaching strategies from developmental science and ABA principles. ESDM uses a developmental curriculum that defines the skills to be taught in each area of development based on each child’s strengths and needs. Core features of ESDM include child preferred materials and activities, use of both developmental strategies and naturalistic ABA strategies, a focus on teaching developmentally appropriate, well-generalized functional skills, caregiver involvement, and a focus on positive social interactions embedded within everyday activities. ESDM uses decision trees to determine when and how to vary the primary, child-centered teaching practices to assure child progress. ESDM Fidelity Tools measure the quality of implementation (see below). Providers in regions randomized to ESDM will receive ESDM training as described below.

Usual Early Behavioral Intervention (EBI). Treatment as usual will vary based on the agency. However, a majority of CBAs use Discrete Trial Teaching (DTT) based on the Lovaas model.[19] DTT involves 10 components described in numerous research publications[90]: capturing child physical and visual attention, adult presentation of the stimuli and instruction (antecedent), child behavior, adult reinforcement, correction procedures, 3–5 second interstimulus interval between trials, behavior-specific praise, and data recording. The use of DTT and NDBI strategies will be measured across both groups (see below) to characterize interventions delivered. Providers in regions randomized to continue EBI will continue service as usual.

Caregiver participation. Most CBAs include caregivers in some way because caregiver involvement is required by most funders. Providers in the EBI group will work with parents as usual. Providers in the ESDM condition will receive training in ESDM caregiver coaching strategies and will be asked to conduct caregiver coaching in the strategies at least monthly. Providers in the ESDM group will have training in use of “Help is in Your Hands” (HIIYH; www.helpisinyourhands.org), an online program for parents that includes 4 modules focused on video examples of families using the strategies during daily routines. Modules cover: (1) Increasing Children’s Attention to People; (2) Increasing Children’s Communication; (3) Creating Joint Activity Routines; (4) ABCs of learning. HIIYH includes the core elements of ESDM which align with the 11 essential common elements shared across NDBIs.

CBA Provider Training.

Working with our CBA partners, we determined that the best training approach for this trial would be using our experienced ESDM trainers to train CBA supervisors using a combination of synchronous and asynchronous methods. Trainer fidelity to the training model will be tracked. Technicians will receive asynchronous didactic trainings combined with coaching and feedback from their CBA supervisors (who will receive support from the project ESDM team).

Supervisor Training. Training will begin with a series of asynchronous, interactive (e.g., quizzes and activities), web-based lessons, followed by online coaching of supervisors by the project team through video review of their ESDM implementation and both technician and caregiver coaching. Supervisors will be trained to fidelity in all aspects of the ESDM model: assessment, goal development, data collection and intervention strategies. They will be trained to fidelity in ESDM coaching strategies to be used with both caregivers and technicians. Supervisors will use on-line ESDM parent training videos, Help is in Your Hands (HIIYH), and the ESDM caregiver manual[91] for caregiver coaching. After reaching ESDM fidelity with their trainer, supervisors will attend several web-based monthly peer supervision meetings with other participating supervisors that will include ongoing fidelity checks, to assure their continued development of ESDM delivery skills (see Table 1).

Table 1

Structure of the Early Start Denver Model (ESDM) Training Plan
Overview	Content & Format	Hours
ESDM Training for Supervisors
What is the Early Start Denver Model	Introduction to ESDM theory and strategies, curriculum checklist, goal development, data collection. Format: asynchronous, interactive, video examples	2.5
ESDM Techniques and Strategies	Integrating joint activity routines. How to design and conduct an ESDM session; joint activity routines Format: asynchronous, interactive, video examples	2.5
Implementing Joint Activity Routines	Provider practices ESDM strategies (following child interest; sensitivity, themes etc.). Format: synchronous group video review	2*
Developing intervention plans	Using the ESDM Curriculum checklist for assessing learning strengths and needs. Using the checklist to create an intervention plan.	3
Practice assessment and plan development	Practice conducting and coding curriculum checklist with feedback and developing goals until fidelity is met. Format: group video review, document review	2*
ESDM Coaching	Coaching during ESDM sessions until ESDM Fidelity is met. Format: Synchronous or video review	2*
Adult learning and providing coaching	Adult learning strategies to support successful coaching of technicians and caregivers in ESDM. Format: asynchronous	1
Practice with technician coaching	Using strategies to coach technicians	1*
Caregiver Coaching	Introduction to caregiver coaching strategies incorporating Help is in Your Hands Modules. Session preparation; collaborative coaching Format: asynchronous, interactive, video examples	7
Caregiver Coaching Feedback	Review of goal development and documentation; fidelity; Review of provider coaching caregiver sessions with ESDM trainer until fidelity is met. Format: Group video review	12*
Monthly Learning Collaborative	ESDM trainers host monthly learning collaborative for supervisors; Participants will provide case presentation, code ESDM fidelity and discuss challenges and successes.	1 mo
ESDM Training for Technicians
ESDM Introduction for Practice	Introduction to ESDM strategies and data collection. Format is asynchronous and includes interactive components and video examples.	2
ESDM Intervention Training	Technicians will receive coaching and feedback from supervisors in accordance with the timing of training at their agency.	varies
Just-in-Time (JIT) Micro Trainings	Access to JIT video modules (2–5 min) featuring ESDM examples matching age and goals of their current children. Modules can be viewed prior to treatment sessions to increase fidelity. Supervisors will assign at least 1 module per week for the first 8 weeks of training.	varies
*additional coaching provided as needed to meet fidelity

Technician Training. Technicians will complete asynchronous didactic training that includes an introduction to ESDM principles, strategies, and data collection. Supervisors will coach them in use of ESDM strategies using their agencies’ supervision model. Technicians will also view just-in-time (JIT) microlearning modules: specific 3 to 5-minute lessons featuring a child of similar age, skill level and goals, just prior to an intervention session. Using JIT microlearning is an effective way to teach complex strategies.[92, 93] JIT learning provides immediate information when it is needed by delivering content in manageable units that fit technicians’ clinical schedules. Each JIT microlearning provides ideas for learning activities to teach a specific goal and brief information about how autistic children learn. A library of JIT videos will be made available and assigned to technicians by their supervisor. See Table 1 for the technician training plan.

Training Materials. Supervisors will receive three ESDM manuals: the core treatment manual,[94] a manual written for caregivers[91], and a manual on coaching caregivers in ESDM.[91] They will also receive access to HIIYH videos, caregiver coaching materials, a fidelity checklist for technicians, access to an ESDM goal bank, data collection tools, and access to JIT modules.

Fidelity to the ESDM Training Model. To assess fidelity to the ESDM training model, we will measure three training variables: (1) supervisor and technician completion of online training modules, JIT modules, and training activities will be tracked via the web-based training system; (2) supervisor participation in coaching and supervision activities, including receiving feedback and fidelity ratings from project staff for the curriculum assessment administration and scoring, goal development, ESDM implementation, caregiver coaching and technician coaching; and (3) trainer ESDM fidelity scores based on 25% of their ESDM Trainer coaching and supervision sessions coded by project staff. Supervisors who do not meet fidelity standards will receive supervision until they meet fidelity standards.

Treatment Fidelity Measures.

We will assess supervisor ESDM fidelity at multiple levels: child skill assessment and goal development, ESDM strategy use, data practices, and coaching others. Supervisors and technicians will be coded on ESDM Strategy Use. Scoring sheets and the fidelity measures are available from the first author.

ESDM Progress Tracking and Goal Development. Supervisors will be scored on assessment and goal fidelity (curriculum checklist described below) on the ESDM Certification Rating System (CRS). Once using ESDM, they will submit curriculum checklists and objectives for each child enrolled in the study.

Caregiver and Technician Coaching. A modified version of the Coaching Practices Rating Scale (CPRS)[95] will evaluate supervisors’ fidelity to coaching strategies. Supervisors in both groups will submit one caregiver session and one technician supervision video per month for the duration of the study to examine fidelity. Each of the 13 fidelity items will be rated on a binary scale of present or absent, and these scores will be summed for a total of 13 possible points. Intraclass correlation coefficients in prior studies indicated high reliability: ICC = 0.92 (CI: 0.71–0.98).

ESDM Strategy Use Fidelity. The ESDM Fidelity Checklist[75] will assess use of ESDM practices. The ESDM Fidelity Checklist consists of 13 items: (a) management of child attention; (b) ABC teaching format; (c) instructional techniques; (d) modulating child affect/arousal; (e) management of unwanted behavior; (f) use of turn-taking/dyadic engagement; (g) child motivation is optimized; (h) adult use of positive affect; (i) adult sensitivity and responsivity; (j) multiple varied communicative functions; (k) adult language; (l) joint activity and elaboration; and (m) transition between activities.

Use of NDBI Strategies. To understand treatment differentiation between the ESDM and EBI groups we will code the use of NDBI strategies across groups. To examine differentiation between the interventions in a more valid and unbiased manner than simply using ESDM codes across conditions we will use the eight-item NDBI-Fi measure[96] developed to capture common elements across NDBI interventions. This measure has adequate reliability, sensitivity to change, and concurrent, convergent, and discriminative validity. We will use the total score and examine differences by strategy type, responsiveness, and directives, consistent with recent studies.[97]

Use of Discrete Trial Teaching (DTT) Strategies. To understand the quality of intervention in the EBI condition we will use a fidelity tool from Rogers et al., 2021 to measure correct implementation of typical EBI teaching using discrete trial strategies. The fidelity tool measures the correct implementation of 9 components using a 5-point Likert scale applied to randomly selected 20-minute sections of recorded treatment sessions (Yoder P, McEachin J, Wallace E, Leaf R, 2014, unpublished). Discrete Trial Training Fidelity of Treatment Rating). During instruction, children typically have blocks of teaching trials interspersed with short breaks that include therapist interactions. Treatment blocks will be coded with the DTT and NDBI tools. Breaks will be coded using the NDBI tool.

Providers will upload intervention and coaching videos throughout participation in the study which will be coded for the above fidelity by trained research team members naïve to study arm.

Procedures and Measures

Child and family level outcomes will be assessed at three time points by trained assessors naïve to intervention condition: Baseline (BL), 6 months, and 12 months post BL. Outcome data will be collected by administering a brief battery of measures via distance technology that includes interview and survey and assessments with caregivers and video recordings. All assessors will be experienced MA or PhD level clinicians and supervised by a licensed clinical psychologist with over 20 years of experience in assessing young autistic children. All data will be entered directly into secure computer systems. Interviewers and video coders will be naive to group status (ESDM or EBI). The primary outcome will be child social communication and language (caregiver report and observational coding). Secondary outcomes are: (1) adaptive behavior and cognitive gains, (2) progress toward goals; (3) quality of life; (3) caregiver use of NDBI strategies; (4) increases in caregiver competence. We will assess engagement of the identified treatment mechanisms: child social motivation and caregiver use of NDBI strategies. Measures, constructs, and timing are listed in Table 2. Commonly used measures are described briefly. Newer or less standard measures are described in more detail.

Participant retention will be facilitated by frequent contact with the research team, gift cards for measure completion, birthday cards sent to children and assessment reports. If child participants leave the agency we will still attempt to obtain measures at each timepoint.

Table 2. Assessments

Domain	Measure and description	Method	Timing
Domain	Measure and description	Method	T1	T2	T3
Characterization Measures
Demographics	Family Demographic Questionnaire	Caregiver Survey	X
Devel Level	Devel. Profile -4^th Ed, Cognitive	Caregiver Survey	X
Treatment Type and Intensity	Ongoing Services Survey	Caregiver Interview	X	X	X
Primary Outcomes
Language & Social Communication	Vineland Adapt Beh Scales 3 Communication Subscale	Caregiver Interview	X	X	X
Language & Social Communication	APPL	Direct Observation	X	X	X
Secondary Outcomes
Adaptive Behavior	Vineland Adap Beh Scales 3	Caregiver Interview	X	X	X
Quality of Life	CarerQoL; PEDSQL	Caregiver Survey	X	X	X
Caregiver Fidelity	NDBI-Fi	Direct Observation	X	X	X
Social Communication	Brief Observation of Social Change (BOSCC)	Direct Observation	X	X	X
Early Intervention Support and Processes	Family Outcomes Survey-Revised; Measure of Processes of Care	Self-Report		X	X
Potential Intervention Side Effects	Emotion Dysregulation Inventory-Young Children (EDI-YC) short form	Caregiver Survey	X	X	X
Treatment Mechanisms
Social Motivation	PDDBI Social Approach Scale	Caregiver Survey	X	X	X
Social Motivation	JERI	Direct Observation	X	X	X
Caregiver Fidelity	NDBI-Fi	Direct Observation	X	X	X

T1=baseline; T2=6 months; T3=12 months.

Characterization Measures

Treatment Type and Intensity. Caregivers will complete an interview regarding intervention services received during the study period. In addition, we will track the number of CBA-provided treatment hours and caregiver coaching attendance via agency records.

Cognitive Level. The Developmental Profile-4 (DP-4)[98] Cognitive Scale is a standardized caregiver interview measure that produces norm-referenced scores for the cognitive domain. Test-retest reliability for the Cognitive scale is .83; internal consistency .82 to .94. Construct validity was verified with comparison of established measures (cognitive scale = .57).

Primary Child Outcomes: Social Communication and Language

We will examine the effect of ESDM training on children’s social-communication and language using observational coding and caregiver report.

The Assessment of Phase of Preschool Language (APPL )[99] operationalizes research-based language development stages.[100] Language phases are derived from spoken language or augmentative communication systems and standardized assessments. The APPLE characterizes expressive language domains: phonology, vocabulary, grammar, and pragmatics. For each domain, the APPL outlines the range of demonstrated skills that could meet criteria for each phase: Phase 1: Preverbal; Phase 2: First Words; Phase 3: Word Combinations, Phase 4: Sentences, or Phase 5: Complex Language. The APPL has strong interrater reliability and good construct validity A Language samples will be obtained from transcriptions of child-caregiver interactions recorded at each timepoint (see video collection). The APPL has been used to examine change in language level in multiple autism studies.

Vineland Communication Domain. The Vineland Adaptive Behavior Scales-3 (VABS-3)[101] consists of four domains of adaptive behavior: communication, daily living skills, socialization, and motor skills. It has been validated with children with developmental disabilities The scales yield normative standard scores (M = 100; SD = 15) that can be used for comparison across groups. The communication domain will be used to examine overall change in communication in the natural environment. The Vineland Interview edition will be used to obtain parent report of adaptive skills.

Secondary Outcomes

Adaptive Behavior. Vineland Adaptive Behavior Scales-3 (VABS-3)[101] domains of adaptive behavior: daily living skills, socialization, and motor skills will be examined as secondary outcomes.

Caregiver and Child Quality of Life. The CarerQoL [102]assesses perceived caregiver quality of life across seven dimensions. The Pediatric Quality of Life Inventory (PedsQL)[103] assesses children’s quality of life across four domains based on caregiver report and has been validated in an autism population.[104]

Brief Observation of Social Communication Change (BOSCC; [105]. The BOSCC consists of 15 items coded based on video observations on a 6-point scale ranging from 0 (the characteristic is not present) to 5 (the characteristic is present and it significantly impairs functioning). Thus, higher scores indicate more autism characteristics. Items 1–8 focus on SC, while items 9–12 capture Restricted and Repetitive Behaviors (RRBs). The BOSCC results in Social Communication (i.e., eye contact, facial expressions, gestures, vocalizations, integration of vocal and non-vocal communication, frequency/function of social overtures, frequency/quality of social responses, engagement in activities/interaction, and play with objects) and RRB domain totals (unusual sensory interests, hand/finger or other complex mannerisms, and unusually repetitive interests/stereotyped behaviors). The Core total combines the SC and RRB scores. We will not be targeting autistic characteristics in our project. We will include the BOSCC as a secondary measure of social communication to facilitate comparison across studies.

Early Intervention Support and Processes. The Family Outcomes Survey-Revised (FOS-R)[106] is a 41-item measure uses a 5-item Likert scale to assess parents’ perceived strengths and needs as they relate to the early intervention support they receive. The FOS-R has good internal consistency in English (subscales ranging from 0.73 to0.95 for Cronbach’s alpha). [106] The Measure of Processes of Care—20 (MPOC—20) [107] measures how family-centered parents perceive their child’s intervention services. The 20-item scale asks parents to rate how much people who work with their child (a) enable partnership, (b) provide general information, (c) provide specific information about their child, (d) coordinate comprehensive care for the child and family, and (e) are respectful and supportive. The scale has good internal consistency with coefficients ranging from 0.83 to 0.90 [107]

Intervention Side Effects & Harm. Emotion Dysregulation Inventory-Young Children (EDI-YC) [108] short form measures emotion dysregulation with two scales, reactivity and dysphoria. Reactivity is characterized by rapidly escalating, intense, labile negative affect and difficulty downregulating that affect. Dysphoria is characterized by poor up regulation of positive emotion. This 14-item scale has been used with children on the autism spectrum. The measure has good validity and is supported by expert review. If children have > 1sd of change in this measure over time or providers or parents report regression the research team and data safety and monitoring board will assess for discontinuing or modifying the intervention and/or study participation.

Treatment Mechanisms Variables

Social Motivation and Caregiver NDBI Fidelity. Social motivation will be measured in two ways and those assessments will be used to examine proximal and distal changes to the intervention mechanism and its role as a moderator.

Pervasive Developmental Disorder Behavior Inventory (PDDBI)[109] examines characteristics of autism in children between 18 months and 12.5 years through caregiver reports. It has high internal consistency (0.84–0.97), inter-rater reliability (ICC = 0.75–0.93), and good construct validity. The Social Approach subscale will provide a distal measures of social motivation (treatment mechanism) and includes 36 items representing all three behavioral manifestations of social motivation. Studies using the Social Approach subscale report good consistency (α = 0.94) and test–retest reliability of 0.93.[110, 111]

Joint Engagement Rating Inventory (JERI )[112] will be a proximal, objectively rated measure of child social motivation during adult/child interactions. The JERI is widely used to examine child behavior in autism studies and has high validity and reliability. One score per code will be assigned to each CPP observation (see below) and averaged across the 3 activities for analyses.

Caregiver NDBI Fidelity. Caregiver-child interaction videos (see below) will be coded using the NDBI-Fi Checklist (see Fidelity measures and video collection).

Video Data Collection.

Video data will be collected for outcomes at three time points using the Communication Play Protocol (CPP).[113] The CPP produces video records of three 5-minute semi-structured scenes that focus on requesting, social interacting, and shared commenting. We will collect two CPP videos at each time point, one with the caregiver and one with a provider that does not know the child and is naïve to condition. Video data will be coded using the (1) APPL for children language outcomes; (2) JERI to assess social motivation; and (3) and NDBI-fi to examine caregiver use of ESDM/NDBI strategies.

Video Coding Procedures

Trained coders naïve to group, timepoint, and study aims will code video measures to avoid bias. Each coder will be trained in one scoring system to reliability (80% agreement over 3 videos). For each measure, a random sample of 20% of sessions will be double coded for inter-rater reliability throughout coding. If agreement drops below 80%, training will be provided until agreement is achieved.

Analytic Plan

In this trial, there are several levels of clustering: repeated observations are nested within the child/caregiver, the child/caregiver is nested within the team, teams are nested within the region, and regions are nested within CBAs. Therefore, we will use a modeling strategy that includes random intercepts for region and/or CBA, team, and random child/caregiver effects (intercept, slopes, as appropriate). All primary analyses will be conducted on an intent-to-treat basis using a generalized linear mixed-effects models framework [109], which can accommodate continuous, binary, and count outcomes through an appropriate choice of link function. Preliminary analyses will involve examining the outcomes and covariates to verify their appropriateness, identifying patterns of missing data, and conducting a multivariate outlier analysis. Model validation will be carried out using both analytical and graphical techniques to check core assumptions such as linearity, distribution, and homoscedasticity. Transformations of outcome variables will be considered if suggested by the model validation analyses. All analyses will include available relevant biological variables, including child or caregiver sex and age and baseline characteristics if there is any evidence of randomization imbalance in them. Randomization should produce intervention and control groups that are comparable and balanced. As a first-order check on confounding, we will examine the success of randomization by comparing baseline characteristics of children, caregivers, and providers assigned to the two study arms. Where clinically significant differences are apparent, child-, caregiver-, and provider-specific covariates will be added to the statistical models as fixed predictors to examine whether the intervention effect is robust in their presence.

Primary and Secondary Outcomes. The analytic approach for each primary and secondary outcome measure will follow the same general model-building strategy. For outcomes assessed at baseline, 6 months, and 12 months, the models will include fixed effects for time (baseline, 6-, and 12-months), group, and their interaction, as well as covariates (e.g., child/caregiver sex, age, etc.) and random effects for child/caregiver, team, or region to account for clustering. The interaction between time and group will directly test the hypothesis that participants in the ESDM group show greater improvement than those in the EBI group. In all models, we will consider adding relevant covariates related to child/caregiver or provider-level characteristics if randomization at the region level did not ensure comparability between the two groups.

[114]

Moderation Analyses. Moderation analyses will explore the differential effectiveness of the two interventions by maternal level of education (as a proxy for SES), child race/ethnicity, and technician ESDM fidelity. We will build upon the primary models with treatment group by time effects by incorporating interaction terms for moderators of interest and conducting sub-group analyses. For each target moderator (e.g., maternal education), we will add the 3-way treatment group by time by moderator interaction term (and all lower-order 2-way and main effects) to determine whether differences between treatment groups in change over time for a given outcome variable are modified by target moderators. A significant 3-way interaction effect will indicate the presence of treatment effect heterogeneity between subgroups. Following this, we will conduct simple effect analysis to estimate treatment effect differences (i.e., difference in changes over time between arms) within each subgroup. For adherence to ESDM fidelity at the technician level, we expect substantial differences between treatment groups, and plan to investigate this as a moderator of all child outcomes.

Mediation Analyses. Conceptually, social motivation (measured by PDDBI and JERI) and caregiver NDBI fidelity can be viewed as an intermediated outcome (mediator, M). The intervention may affect the primary outcomes indirectly through a pathway of the mediator (M). To test the mediated effect (or mechanism of change), we will conduct a mediation analysis by extending the generalized mixed effects models specified for assessing treatment group differences in primary outcome variables by adding continuous ratings of social motivation and parent fidelity, respectively, as predictors to the model describing language improvement. The mediation analysis will follow a standard series of steps: (1) Test for the direct effect of the treatment group on the primary outcome variable as represented by the time by treatment group interaction effects (i.e., the primary model); (2) Test for the time by treatment group interaction effect using the measure of social motivation (or parent fidelity, respectively) as the dependent variable in an analogous mixed effects model to assess the coefficient for group differences in change over time in the target mediator; (3) Return to the model in step 1 and add the main effect of time-varying social motivation scores (or parent fidelity, respectively) in predicting outcome scores to assess the direct relationship between the target mediator and outcome while controlling for the time by treatment group effect on outcome; (4) Calculate the degree and significance of the indirect effect using Monte Carlo simulations of the estimated coefficients and their respective standard errors.

Missing Data. Our protocols include numerous provisions to minimize the amount of missing data, and our team has achieved high retention rates in previous work. However, some data will inevitably be missing. We will use standard methods to evaluate missing data assumptions and to determine alternative analytic strategies if needed. One of three approaches will be used: First, if the proportion of missing data is small and there is evidence that data are missing at random (MAR), all available data will be analyzed using the maximum-likelihood estimation procedures described above. Second, if the proportion of missing data is nontrivial with evidence that data are MAR, multiple imputations for repeated measurements will be used to generate complete data. Third, if there is evidence of a non-MAR mechanism for missing data, pattern mixture models will be used to evaluate and control for the missing data pattern.

Power Considerations. Given that the proposed analyses for primary outcomes will employ mixed effects modeling of clustered data to assess differences in changes from baseline between treatment groups, power analyses were conducted using Monte Carlo simulations of multi-level models in SAS. Expected fixed effect values for effects of interest (e.g., treatment group by time interactions) were obtained from prior research on ESDM treatments and developmental change. We assumed a range of plausible intraclass correlation coefficient (ICC) values for the random effects of child/caregiver dyad (0.3 to 0.5), team (0.1 to 0.25), and region (0.05 to 0.1) based on previous community intervention studies and pilot data and accounted for a 10% dropout rate. We used a type I error level of 5%.

Under each scenario, our proposed sample size of 300 children/caregivers, 100 teams, and 20 centers would provide at least 80% power to detect a standardized improvement in children’s social communication and language of d = 0.6. We assumed that 10% of children would not contribute any data; however, the participants who dropped out would have provided some data and will contribute to the analyses. Therefore, our calculations are conservative.

Procedures and Measures Addressing our Exploratory Implementation Aim

We will measure implementation during the three EPIS phases: adoption (recruitment), implementation (ESDM training and delivery), and predicted sustainment (after the research study). We will measure acceptability, appropriateness, and feasibility of the intervention, and provider, family, and organizational characteristics to identify determinants of ESDM implementation. We will use a combination of surveys and structured interviews (see Table 3).

Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), & Feasibility of Intervention Measure (FIM)[115] determine the extent to which a participant believes an intervention is acceptable, appropriate, and feasible and have strong internal consistency (AIM α = .89; IAM α = .87; FIM α = .89). All participating providers and caregivers will complete these scales every six months during participation. Total score on each scale will be used.

Adaptations to Evidence-Based Practices Scale (AES) [116] is a 6-item scale assessing provider adaptations to EBPs delivered. Providers rate six items using a 5-point Likert scale (0 “not at all,” 4 “a very great extent”) to indicate the extent to which they made each type of adaptation when delivering a specified EBP, including (a) modifying the presentation of EBP strategies, (b) shortening or condensing the pacing of the EBP, (c) lengthening or extending the pacing of the EBP, (d) integrating supplemental content or strategies, (e) removing or skipping components, and (d) adjusting the order of sessions or components.

Table 3

Implementation Measures
Construct	Measure/Indicator
Adoption	Decision to participate in effectiveness study (yes/no)
Implementation	ESDM provider adherence measures [ESDM Fidelity; NDBI Fidelity]; Adaptations to Evidence-Based Practice Scale
Sustainment	Ongoing use of ESDM [PRESS; interviews with managers and providers]
ESDM Appropriateness, Feasibility, Acceptability	Perceived fit of ESDM with agency, provider, and family [AIM; interviews] Caregiver engagement in intervention [session attendance]
Provider Characteristics	Perceived self-efficacy [Autism Self-Efficacy Scale] Provide background experience, previous EBP training
Organization Characteristics	Financing structure and reimbursement; # autistic clients under age 5; Implementation Climate Survey

Provider Report of Sustainment Scale (PRESS)[117] captures provider report of continued use of an intervention. The PRESS has good psychometric properties across multiple interventions and service systems and strong construct validity.

Autism Self-Efficacy Scale for Teachers (ASSET)[118] is a 30-item self-report measure of providers’ beliefs about their ability to implement appropriate teaching strategies when working with autistic children. We adapted the measure for use with community providers who rate their efficacy in carrying out several different assessment, intervention, and evidence-based practices relevant to autism early intervention. Providers rate their self-efficacy using a scale from 0 (cannot do at all) to 100 (highly certain can do). The total score is calculated as the mean score across the 30 items. Scale internal consistency is .96.

The Implementation Climate Scale (ICS)[119, 120] measures employees’ shared perceptions of the policies, practices, procedures, and behaviors that are expected, rewarded, and supported to facilitate effective EBI implementation. The ICS has good psychometric properties across several settings including good internal consistency and good construct validity.

Implementation Interview

Semi-structured interviews will be conducted with regional managers, supervisors, technicians, and caregivers to gather additional information on ESDM feasibility, usability, acceptability, fit (including cultural fit with family needs) and plans for sustainment. We will conduct interviews with a subset of participants until we reach saturation (approximately 30 in each group). Facilitators will follow a semi-structured interview guide.[121, 122]

Data Analysis (exploratory). Descriptive data regarding feasibility, acceptability and fit and qualitative interview data will be examined every 6 months. These data will be used iteratively through the implementation phase of the trial to make culturally relevant adaptations to the intervention. Adaptations will be carefully logged and tracked and resulting outcomes monitored using recommended methods. We will explore descriptive statistics for the various measures of organizational and provider characteristics and participation and will use predictive models (with multi-level modeling as above) to understand appropriateness, feasibility, and acceptability in the ESDM treatment group. Given that measures of implementation (e.g., provider fidelity) are important for understanding the feasibility of scaling ESDM to CBAs, we will analyze such implementation measures as dependent variables and examine other variables in Table 3 (e.g., organization characteristics,

perceived fit) as predictors of individual provider variability in fidelity.

Qualitative Data analysis. NVivo QSR 11[123] will be used for qualitative analyses. A framework-driven analytic approach will guide the coding process.[124, 125] Coders will use an iterative coding and review process informed by grounded theory. [126]

Integration of Qualitative and Quantitative Analyses. A sequential Quan > QUAL mixed method design will be employed.[127] The primary functions of the mixed-methods analyses will be convergence and expansion.

Power Analysis. Given that all proposed analyses will employ complex multi-level modelling to measure differences in rates of change between treatment groups, power analyses were conducted using Monte Carlo simulations of multi-level models in SAS and Mplus. Expected fixed effect values for effects of interest (e.g., treatment group by time interactions) were obtained from our prior research of ESDM treatments and developmental change. We assumed a range of plausible ICC values for the random effects of participant dyad (based on pilot data), team, and region (based on prior community intervention studies)[128, 129] and accounted for 10% dropout. provides in depth details showing that for primary outcome variables proposed in Aim 1, the proposed sample size of 270 (accounting for 10% attrition) will provide adequate power to detect standardized group differences between the active intervention (ESDM) and treatment as usual (EBI) at the primary endpoint (12 months) as small as d = 0.6. We show via simulations that the study is adequately powered to test the mediation models for social motivation and parent fidelity (see Statistical Design and Power).

This project is one of the first large-scale, randomized hybrid effectiveness trials of an autism early intervention. The large and diverse sample will allow us to examine how well ESDM conducted by CBAs activates the hypothesized mechanism of the intervention, social motivation. Understanding how social motivation works to determine response to NDBI will allow for improvement of intervention strategies that enhance social motivation to facilitate improved outcomes. Examining the role of social motivation in a diverse community sample of toddlers and young children on the autism spectrum will inform the social motivation hypothesis of autism, which, to date, has only been tested in research samples. Additionally, the relationship between caregiver fidelity and child outcomes has not been examined in a large, diverse sample that may have varying cultural values regarding intervention delivery.

The impact of the study is likely to be greater because the project utilizes partnerships with family members, autistic adults, and CBAs to develop both the proposal and to carry out the project, assuring relevance of the research questions to the community and increase the potential for uptake of the intervention.[130] Our community partners assure us that this adapted ESDM training and intervention model fits with the current CBA intervention and financing structure. By engaging an extensive network of CBAs supporting autistic children as the intervention deliverers, positive findings can readily generalize to other CBAs and increase access to diverse regions and children.

The proposal is responsive to the neurodiversity perspective. When used correctly, ESDM builds in respect for children’s interests and preferences with a strengths-based approach. ESDM emphasizes the importance of responsive, sensitive relationships between adults and children and on outcomes associated with development, quality of life, and adaptation instead of reduction of unwanted behaviors and “normalization”. The developmentally and culturally appropriate naturalistic interactions of ESDM have the potential to increase the acceptability of early intervention and increase adoption by families concerned about the long-term effects of ABA on their child’s emotional well-being.

The effectiveness trial methodology will be harnessed to examine implementation determinants to facilitate scale up. Hybrid Type 1 trials allow implementation determinants to be identified more comprehensively and earlier than in a sequential model.[131] This study uses an established implementation framework, EPIS, to facilitate effective prospective design to support future scale-up studies with diverse populations. Implementation data can be used iteratively through the implementation phase of the trial to make culturally relevant adaptations to the intervention. Adaptations, which will be carefully logged and tracked, and resulting outcomes monitored using recommended methods [132]will increase the scalability of the intervention.

Results of the project will be disseminated to several different audiences using methods specifically designed to reach each of them. Target audiences are community-based agencies, researchers and their students, state and community program administrators and providers, and parents and funders. A project website will describe the project and provide tools and information for all audiences and a method for requesting more information about the study for interested community agencies. The website will include infographics and lay abstracts of study presentation and publications. Data will be presented through conference presentations, social media, journal articles, lay publications and presentations to policy makers and funders. All publications will be made publicly available through the University of California and PubMed Central.

CBA Community Based Agency

EBI Early Behavioral Intervention

ESDM Early Start Denver Model

NDBI Naturalistic Developmental Behavior Intervention

Ethics approval and consent to participate. This study was approved by the institutional review board at the University of California, Davis, protocol number 203076-2. Specific strategies for consent and confidentiality can be obtained from the PI upon request.

Consent for publication. Not applicable

Availability of data and materials. Data will be available through the NIMH Data Archive. Descriptive/raw data will be submitted semi-annually, and additional data will be submitted at the time of publication. In addition, all datasets developed for the study will be available from the corresponding author upon reasonable request.

Competing interests. Aubyn Stahmer, Sarah Dufek and Ana-Maria Iosif declare no competing interests. Conflicts of interest for Sally Rogers involve royalties from publications, training programs, and lectures related to the Early Start Denver Model.

Funding. This study is funded by the National Institute of Mental Health (NIMH; R01MH131703 and supported by the MIND Institute Intellectual and Developmental Disabilities Research Center (IDDRC) funded by the National Institute of Child Health and Human Development (NICHD; P50 HD103526). These funding sources were not involved in the design of this study and will not participate in its execution, analysis, data interpretation, or decision to submit the results.

Authors' contributions. ACS, SD, and SJR conceived the study, participated in its design and coordination, and drafted the manuscript. AMI participated in the design of the study and developed the statistical analysis plan. All authors reviewed and edited the manuscript. All authors read and approved the final manuscript.

Committees. This study includes a community advisory board who reviews study protocol, recruitment material and processes, study processes etc., and make recommendations to the research team to support culturally responsive and family-centered research protocol. This study includes a data safety and monitoring board who reviews study enrollment, procedures, protocol deviations and adverse events bi-annual and reports to the institutional review board and funder. A complete list of committee members and activities can be obtained from the PI.

Acknowledgements. We thank our community program collaborators Jocelyn Thompson and Melissa Willa for their input into the project processes and training protocol to ensure feasibility in community systems. Thank you to our community advisory committee for supporting development of the final measures and protocol to support neurodiversity affirming procedures. Thank you to the MIND ESDM training team who developed the intervention training protocol for community providers including Dr. Marie Rocha, Rachel Balitsky, and Vanessa Avilla-Pons. Thank you to Amanda Castillas, Walter Cervantes, Julia Sherman, and Dr. Sarah Vejnoska for supporting development of study protocol, training materials recruitment tools and assessment procedures. Special thanks to Deeniece Hatten for providing overall administrative management of the project and developing recruitment procedures to support the needs of diverse families.

Autism Prevalence Higher. According to Data from 11 ADDM Communities | CDC Online Newsroom | CDC [Internet]. [cited 2024 Jul 28]. https://www.cdc.gov/media/releases/2023/p0323-autism.html
Rogge N, Janssen J. The Economic Costs of Autism Spectrum Disorder: A Literature Review. J Autism Dev Disord. 2019;49:2873–900.
Cakir J, Frye RE, Walker SJ. The lifetime social cost of autism: 1990–2029. Res Autism Spectr Disord. 2020;72:101502.
Fuller EA, Oliver K, Vejnoska SF, Rogers SJ. The Effects of the Early Start Denver Model for Children with Autism Spectrum Disorder: A Meta-Analysis. Brain Sciences. 2020, Vol 10, Page 368. 2020;10:368.
Fuller EA, Kaiser AP. The Effects of Early Intervention on Social Communication Outcomes for Children with Autism Spectrum Disorder: A Meta-analysis. J Autism Dev Disorders 2019. 2019;50(5):50:1683–700.
Hampton LH, Kaiser AP. Intervention effects on spoken-language outcomes for children with autism: a systematic review and meta-analysis. J Intellect Disabil Res. 2016;60:444–63.
Sandbank M, Bottema-Beutel K, Crowley S, Cassidy M, Dunham K, Feldman JI, et al. Project AIM: Autism intervention meta-analysis for studies of young children. Psychol Bull. 2020;146:1–29.
Chasson GS, Harris GE, Neely WJ. Cost comparison of early intensive behavioral intervention and special education for children with autism. J Child Fam Stud. 2007;16:401–13.
Butter EM, Wynn J, Mulick JA. Early intervention: Critical to autism treatment. Pediatr Ann. 2003;32:677–84.
Rogge N, Janssen J. The Economic Costs of Autism Spectrum Disorder: A Literature Review. J Autism Dev Disord. 2019;49:2873–900.
Payakachat N, Tilford JM, Kuhlthau KA. Parent-Reported Use of Interventions by Toddlers and Preschoolers With Autism Spectrum Disorder. Psychiatr Serv. 2018;69:186–94.
Mire SS, Hughes KR, Manis JK, Goin-Kochel RP. Autism Treatment: Families’ Use Varies Across U.S. Regions: https://doi.org/101177/1044207318766597. 2018;29:97–107.
Smith KA, Gehricke JG, Iadarola S, Wolfe A, Kuhlthau KA. Disparities in service use among children with autism: A systematic review. Pediatrics. American Academy of Pediatrics; 2020.
Williams ME, Harley EK, Quebles I, Poulsen MK. Policy and Practice Barriers to Early Identification of Autism Spectrum Disorder in the California Early Intervention System. J Autism Dev Disord. 2021;51:3423–31.
Smith KA, Gehricke JG, Iadarola S, Wolfe A, Kuhlthau KA. Disparities in service use among children with autism: A systematic review [Internet]. Pediatrics. American Academy of Pediatrics; 2020 [cited 2021 Jan 28]. https://pubmed.ncbi.nlm.nih.gov/32238530/
Murza KA, Schwartz JB, Hahs-Vaughn DL, Nye C. Review Joint attention interventions for children with autism spectrum disorder: a systematic review and meta-analysis. 51:236–51.
Reichow B. Overview of Meta-Analyses on Early Intensive Behavioral Intervention for Young Children with Autism Spectrum Disorders.
Sandbank M, Bottema-Beutel K, Woynaroski T. Intervention Recommendations for Children with Autism in Light of a Changing Evidence Base. JAMA Pediatr. American Medical Association; 2021. pp. 341–2.
Lovaas OI. Behavioral treatment and normal educational and intellectual functioning of young autistic children. J Consult Clin Psychol. 1987;55:3–9.
Hampton LH, Sandbank MP. Keeping up with the evidence base: Survey of behavior professionals about Naturalistic Developmental Behavioral Interventions: https://doi.org/101177/13623613211035233. 2021.
Sheinkopf SJ, Siegel B. Home based behavioral treatment of young children with autism. J Autism Dev Disord. 1998;28:15–23.
Luiselli JK, Cannon BO, Ellis JT, Sisson RW. Home-Based Behavioral Interventions for Young Children With Autism/Pervasive Developmental Disorder: a Preliminary Evaluation of Outcome in Relation to Child Age and Intensity of Service Delivery. Autism. 2000;4:426–38.
Bibby P, Eikeseth S, Martin NT, Mudford OC, Reeves D. Progress and outcomes for children with autism receiving parent-managed intensive interventions. Res Dev Disabil. 2002;23:81–104.
Smith T, Buch GA, Gamby TE. Parent-directed, intensive early intervention for children with pervasive developmental disorder. Res Dev Disabil. 2000;21:297–309.
Magiati I, Charman T, Howlin P. A two-year prospective follow-up study of community-based early intensive behavioural intervention and specialist nursery provision for children with autism spectrum disorders. J Child Psychol Psychiatry. 2007;48:803–12.
Magiati I, Moss J, Charman T, Howlin P. Patterns of change in children with Autism Spectrum Disorders who received community based comprehensive interventions in their pre-school years: a seven year follow up study. Res Autism Spectr Disord. 2011;5:1016–27.
Flanagan HE, Perry A, Freeman NL. Effectiveness of large-scale community-based Intensive Behavioral Intervention: A waitlist comparison study exploring outcomes and predictors. Res Autism Spectr Disord. 2012;6:673–82.
Cohen H, Amerine-Dickens M, Smith T. Early intensive behavioral treatment: Replication of the UCLA Model in a community setting. J Dev Behav Pediatr. 2006;27:S145–55.
Waters CF, Dickens MA, Thurston SW, Lu X, Smith T. Sustainability of Early Intensive Behavioral Intervention for Children With Autism Spectrum Disorder in a Community Setting. Behav Modif. 2020;44:3–26.
Lovaas OI. Behavioral treatment and normal educational and intellectual functioning of young autistic children. J Consult Clin Psychol. 1987;55:3–9.
Schreibman L, Dawson G, Stahmer AC, Landa R, Rogers SJ, McGee GG et al. Naturalistic Developmental Behavioral Interventions: Empirically Validated Treatments for Autism Spectrum Disorder. J Autism Dev Disord. 2015;45.
Dawson G, Rogers S, Munson J, Smith M, Winter J, Greenson J, et al. Randomized, controlled trial of an intervention for toddlers with autism: The Early Start Denver Model. Pediatrics. 2010;125:e17–23.
Gengoux GW, Abrams DA, Schuck R, Millan ME, Libove R, Ardel CM et al. A pivotal response treatment package for children with autism spectrum disorder: An RCT. Pediatrics. 2019;144.
Kasari C, Lawton K, Shih W, Barker TV, Landa R, Lord C, et al. Caregiver-mediated intervention for low-resourced preschoolers with autism: an RCT. Pediatrics. 2014;134:e72–9.
Rogers S, Estes A, Lord C. et. A multisite randomized controlled two-phase trial of the Early Start Denver Model compared to treatment as usual. J Am Acad Child Adolesc Psychiatry. 2019;58:853–65.
Zwaigenbaum L, Bauman ML, Choueiri R, Kasari C, Carter A, Granpeesheh D, et al. Early Intervention for Children With Autism Spectrum Disorder Under 3 Years of Age: Recommendations for Practice and Research. Pediatrics. 2015;136:S60–81.
Tiede G, Walton KM. Meta-analysis of naturalistic developmental behavioral interventions for young children with autism spectrum disorder: https://doi.org/101177/1362361319836371. 2019;23:2080–95.
Song J, Reilly M, Reichow B. Overview of Meta-Analyses on Naturalistic Developmental Behavioral Interventions for Children with Autism Spectrum Disorder. J Autism Dev Disord [Internet]. 2024 [cited 2024 Jul 28]; https://pubmed.ncbi.nlm.nih.gov/38170431/
Robinson SE. Teaching paraprofessionals of students with autism to implement pivotal response treatment in inclusive school settings using a brief video feedback training package. Focus Autism Other Dev Disabl. 2011;26:105–18.
Hardan AY, Gengoux GW, Berquist KL, Libove RA, Ardel CM, Phillips J et al. A randomized controlled trial of Pivotal Response Treatment Group for parents of children with autism. J Child Psychol Psychiatry. 2015.
Chapman R. Neurodiversity and the Social Ecology of Mental Functions. Perspectives on Psychological Science; 2021.
den Houting J, Neurodiversity. An insider’s perspective. Autism. 2019;23:271–3.
Schuck RK, Tagavi DM, Baiden KMP, Dwyer P, Williams ZJ, Osuna A et al. Neurodiversity and Autism Intervention: Reconciling Perspectives Through a Naturalistic Developmental Behavioral Intervention Framework. Journal of Autism and Developmental Disorders. 2021. 2021;1–21.
Smith IM, Flanagan HE, Ungar WJ, D’entremont B, Garon N, Den Otter J, et al. Comparing the 1-Year Impact of Preschool Autism Intervention Programs in Two Canadian Provinces. Autism Res. 2019;12:667–81.
Mandell D, Shin S, Stahmer AC, Xie M, Marcus SE. A randomized comparative effectiveness trial fo two school-base autism interventions. Autism.
Shire SY, Chang Y-C, Shih W, Bracaglia S, Kodjoe M, Kasari C. Hybrid implementation model of community-partnered early intervention for toddlers with autism: a randomized trial. 2016.
Vernon H, Proctor D, Bakalovski D, Moreton J. Simulation tests for cervical nonorganic signs: a study of face validity. J Manipulative Physiol Ther. 2010;02/02:33:20–8.
Rogers SJ. Stahmer UCDavis Meagan Talbott UCDavis Gregory Young UCDavis Elizabeth Fuller UCDavis A. Feasibility of Delivering Parent-Implemented NDBI Interventions in Low Resource Regions. A Pilot Randomized Controlled Study; 2020.
Stahmer AC, Rieth SR, Dickson KS, Feder J, Burgeson M, Searcy K et al. Project ImPACT for Toddlers: Pilot outcomes of a community adaptation of an intervention for autism risk. Autism. 2020;24.
Pickard K, Meza R, Drahota A, Brikho B. They’re Doing What? A Brief Paper on Service Use and Attitudes in ASD Community-Based Agencies. J Ment Health Res Intellect Disabil. 2018;11:111.
Schwartz IS, Sandall SR, McBride BJ, Boulware G-L, Project DATA. (Developmentally appropriate treatment for autism): An inclusive school based approach to educating young children with autism. Top Early Child Spec Educ. 2004;24:156–68.
Vivanti G, Stahmer A. Early intervention for autism: Are we prioritizing feasibility at the expenses of effectiveness? A cautionary note. Autism. 2018;22:770–3.
Professional Behavior Analysts Association of [Internet]. 2017. Available from: www.APBAHome.net.
Association of Professional Behavior Analysts. Identifying Applied Behavior Analysis Interventions. 2017. Report No.: www.apbahome.net.
Behavior Analyst Certification Board. Professional and ethical compliance code for behavior analysts. Littleton, CO; 2014.
Council of Autism Service Providers. Applied behavior analysis treatment of autism spectrum disorder: Practice guidelines for healthcare funders, 2nd Ed and managers. 2020.
Rogers SJ, Yoder P, Estes A, Warren Z, McEachin J, Munson J, et al. A Multisite Randomized Controlled Trial Comparing the Effects of Intervention Intensity and Intervention Style on Outcomes for Young Children With Autism. J Am Acad Child Adolesc Psychiatry. 2021;60:710–22.
Mirenda P, Colozzo P, Smith V, Kroc E, Kalynchuk K, Rogers SJ et al. A Randomized, Community-Based Feasibility Trial of Modified ESDM for Toddlers with Suspected Autism. J Autism Dev Disord. 2022.
Hampton LH. Improving preemptive intervention approaches for children with a high likelihood for autism. Conference for Research Innovations in Early Intervention. San Diego, CA.
Holzinger D, Laister D, Vivanti G, Barbaresi WJ, Fellinger J. Feasibility and Outcomes of the Early Start Denver Model Implemented with Low Intensity in a Community Setting in Austria. J Dev Behav Pediatr. 2019;40:354–63.
Vivanti G, Dissanayake C, Duncan E, Feary J, Capes K, Upson S, et al. Outcomes of children receiving Group-Early Start Denver Model in an inclusive versus autism-specific setting: A pilot randomized controlled trial. Autism. 2019;23:1165–75.
Mirenda P, Colozzo P, Smith V, Kroc E, Kalynchuk K, Rogers SJ et al. A Randomized, Community-Based Feasibility Trial of Modified ESDM for Toddlers with Suspected Autism. J Autism Dev Disord. 2022.
Dawson G, Bernier R, Ring RH. Social attention: A possible early indicator of efficacy in autism clinical trials. J Neurodev Disord. 2012;4:1–12.
Mundy P. Joint attention and social-emotional approach behavior in children with autism. Dev Psychopathol. 1995;7:63–82.
Chevallier C, Kohls G, Troiani V, Brodkin ES, Schultz RT. The social motivation theory of autism. Trends Cogn Sci. 2012;16:231–9.
Osterling JA, Dawson G, Munson JA. Early recognition of 1-year-old infants with autism spectrum disorder versus mental retardation. Dev Psychopathol. 2002;14:239–51.
Geurts HM, Luman M, Van Meel CS. What’s in a game: the effect of social motivation on interference control in boys with ADHD and autism spectrum disorders. J Child Psychol Psychiatry. 2008;49:848–57.
Kohls G, Chevallier C, Troiani V, Schultz RT. Social ‘wanting’ dysfunction in autism: neurobiological underpinnings and treatment implications. J Neurodevelopmental Disorders 2012. 2012;4:1.
Hedger N, Dubey I, Chakrabarti B. Social orienting and social seeking behaviors in ASD. A meta analytic investigation. Neurosci Biobehav Rev. 2020;119:376–95.
Camarata S, Yoder P. Language transactions during development and intervention: theoretical implications for developmental neuroscience. Int J Dev Neurosci. 2002;20:459–65.
Kim H, Ahn J, Lee H, Ha S, Cheon KA. Differences in Language Ability and Emotional-Behavioral Problems according to Symptom Severity in Children with Autism Spectrum Disorder. Yonsei Med J. 2020;61:880.
Kuhl PK, Coffey-Corina S, Padden D, Dawson G. Links between social and linguistic processing of speech in preschool children with autism: behavioral and electrophysiological measures. Dev Sci. 2005;8:F1–12.
Dawson G, Toth K, Abbott R, Osterling J, Munson J, Estes A, et al. Early Social Attention Impairments in Autism: Social Orienting, Joint Attention, and Attention to Distress. Dev Psychol. 2004;40:271–83.
Su PL, Rogers SJ, Estes A, Yoder P. The role of early social motivation in explaining variability in functional language in toddlers with autism spectrum disorder. Autism [Internet]. 2021 [cited 2022 Jan 11];25:244–57. https://journals.sagepub.com/doi/full/10.1177/1362361320953260
Rogers SJ, Dawson G. Early start denver model for young children with autism: Promoting language, learning, and engagement. Guildford; 2010.
Zwaigenbaum L, Bauman ML, Stone WL, Yirmiya N, Estes A, Hansen RL et al. Early Identification of Autism Spectrum Disorder: Recommendations for Practice and Research. Pediatrics [Internet]. 2015 [cited 2024 Aug 5];136 Suppl 1:S10–40. https://pubmed.ncbi.nlm.nih.gov/26430168/
Zitter A, Rinn H, Szapuova Z, Avila-Pons VM, Kirsty ·, Coulter L et al. Does Treatment Fidelity of the Early Start Denver Model Impact Skill Acquisition in Young Children with Autism? J Autism Dev Disord [Internet]. https://doi.org/10.1007/s10803-021-05371-4
Rogers SJ, Estes A, Lord C, Vismara L, Winter J, Fitzpatrick A, et al. Effects of a brief Early Start Denver Model (ESDM)–based parent intervention on toddlers at risk for autism spectrum disorders: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2012;51:1052–65.
Ingersoll BR. Teaching Social Communication A Comparison of Naturalistic Behavioral and Development, Social Pragmatic Approaches for Children With Autism Spectrum Disorders. 2010; http://jpbi.sagepub.com
Rogers SJ, Estes A, Vismara L, Munson J, Zierhut C, Greenson J et al. Enhancing Low-Intensity Coaching in Parent Implemented Early Start Denver Model Intervention for Early Autism: A Randomized Comparison Treatment Trial. J Autism Dev Disord [Internet]. 2019 [cited 2024 Aug 5];49:632–46. https://pubmed.ncbi.nlm.nih.gov/30203308/
Aarons G, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidnece-based practice implementation in public service sectors. Adm Policy Mental Health Mental Health Serv. 2011;38:4–23.
Baumann AA, Cabassa LJ. Reframing implementation science to address inequities in healthcare delivery. BMC Health Serv Res. 2020;20.
Lord C, Rutter M, DiLavore PC, Risi S, Gotham K, Bishop SL, et al. Autism diagnostic observation schedule–2nd edition (ADOS-2). Los Angeles, CA: Western Psychological Services; 2012.
Corona LL, Weitlauf AS, Hine J, Berman A, Miceli A, Nicholson A, et al. Parent Perceptions of Caregiver-Mediated Telemedicine Tools for Assessing Autism Risk in Toddlers. J Autism Dev Disord. 2020;51:476–86.
Stainbrook JA, Weitlauf AS, Juárez AP, Taylor JL, Hine J, Broderick N, et al. Measuring the service system impact of a novel telediagnostic service program for young children with autism spectrum disorder. Autism. 2019;23:1051–6.
Juárez AP, Weitlauf AS, Nicholson A, Pasternak A, Broderick · Neill, Hine J et al. Early Identification of ASD Through Telemedicine: Potential Value for Underserved Populations. 2018;48:2601–10.
Rogers SJ, Yoder P, Estes A, Warren Z, McEachin J, Munson J, et al. A Multisite Randomized Controlled Trial Comparing the Effects of Intervention Intensity and Intervention Style on Outcomes for Young Children With Autism. J Am Acad Child Adolesc Psychiatry. 2021;60:710–22.
Dawson G, Rogers S, Munson J, Smith M, Winter J, Greenson J, et al. Randomized, controlled trial of an intervention for toddlers with autism: The Early Start Denver Model. Pediatrics. 2010;125:e17–23.
Ratner N, Bruner J. Games, social exchange and the acquisition of language. J Child Lang. 1978;5:391–401.
Sarokoff RA, Sturmey P. The effects of behavioral skills training on staff implementation of discrete-trial teaching. J Appl Behav Anal. 2004;37:535–8.
Rogers SJ, Dawson Geraldine, Vismara LA. An early start for your child with autism: using everyday activities to help kids connect, communicate, and learn. 2012;342.
Zhang J, West RE. Designing Microlearning Instruction for ProfessionalDevelopment Through a Competency Based Approach. TechTrends. 2020;64:310–8.
Javorcik T, Polasek R. Comparing the Effectiveness of Microlearning and eLearning Courses in the Education of Future Teachers; Comparing the Effectiveness of Microlearning and eLearning Courses in the Education of Future Teachers. 2019 17th International Conference on Emerging eLearning Technologies and Applications (ICETA). 2019.
Rogers SJ, Dawson G. Early start denver model for young children with autism: Promoting language, learning, and engagement. Guildford; 2010.
Rush M’DD, Shelden LL. Insights into Early Childhood and Family Support Practices Validity of the Coaching Practices Rating Scale CASE inPoint. 2006.
Frost KM, Brian J, Gengoux GW, Hardan A, Rieth SR, Stahmer A, et al. Identifying and measuring the common elements of naturalistic developmental behavioral interventions for autism spectrum disorder: Development of the NDBI-Fi. Autism. 2020;24:2285–97.
Sone BJ, Kaat AJ, Roberts MY. Measuring parent strategy use in early intervention: Reliability and validity of the Naturalistic Developmental Behavioral Intervention Fidelity Rating Scale across strategy types. Autism. 2021;25:2101–11.
Alpern GD. (DP^TM-4) Developmental Profile 4. 2020.
Flanagan HE, Smith IM, Davidson F. The Assessment of Phase of Preschool Language: Applying the language benchmarks framework to characterize language profiles and change in four- to five-year-olds with autism spectrum disorder: https://doi.org/101177/2396941519864084. 2019;4:239694151986408.
Tager-Flusberg H, Rogers S, Cooper J, Landa R, Lord C, Paul R, et al. Defining Spoken Language Benchmarks and Selecting Measures of Expressive Language Development for Young Children With Autism Spectrum Disorders. J Speech Lang Hear Res. 2009;52:643–52.
Vineland Adaptive Behavior Scales. | Third Edition [Internet]. [cited 2022 Feb 7]. https://www.pearsonassessments.com/store/usassessments/en/Store/Professional-Assessments/Behavior/Adaptive/Vineland-Adaptive-Behavior-Scales-%7C-Third-Edition/p/100001622.html
Brouwer WBF, Van Exel NJA, Van Gorp B, Redekop WK. The CarerQol instrument: A new instrument to measure care-related quality of life of informal caregivers for use in economic evaluations.
Varni J. Pediatric Quality of Life Inventory (PedsQL). 2022.
Katsiana A, Strimpakos N, Ioannis V, Kapreli E, Sofologi M, Bonti E et al. Health-related Quality of Life in Children with Autism Spectrum Disorder and Children with Down Syndrome. Mater Sociomed [Internet]. 2020 [cited 2024 Jul 28];32:93–8. https://pubmed.ncbi.nlm.nih.gov/32843854/
Lord C, GR, HA, KSH, MK, BK, CT CC. & DS. Brief Observation of Social Communication Change (BOSCC). Copyright in progress. 2020.
Bailey DB, Raspa M, Olmsted MG, Novak SP, Sam AM, Humphreys BP et al. Development and Psychometric Validation of the Family Outcomes Survey-Revised. http://dx.doi.org/101177/1053815111399441 [Internet]. 2011 [cited 2024 Jul 29];33:6–23. https://journals.sagepub.com/doi/10.1177/1053815111399441
King S, King G, Rosenbaum P. Evaluating Health Service Delivery to Children With Chronic Conditions and Their Families: Development of a Refined Measure of Processes of Care (MPOC – 20). Children’s Health Care [Internet]. 2004 [cited 2024 Jul 29];33:35–57. https://www.tandfonline.com/doi/abs/10.1207/s15326888chc3301_3
Day TN, Mazefsky CA, Yu L, Zeglen KN, Neece CL, Pilkonis PA. The Emotion Dysregulation Inventory-Young Child: Psychometric Properties and Item Response Theory Calibration in 2- to 5-Year-Olds. J Am Acad Child Adolesc Psychiatry [Internet]. 2024 [cited 2024 Jul 29];63:52–64. https://pubmed.ncbi.nlm.nih.gov/37422108/
Cohen IL, Schmidt-Lackner S, Romanczyk R, Sudhalter V. The PDD Behavior Inventory: A rating scale for assessing response to intervention in children with pervasive developmental disorder. J Autism Dev Disord. 2003;33:31–45.
Cohen IL. Criterion-related validity of the PDD Behavior Inventory. J Autism Dev Disord. 2003;33:47–53.
Cohen IL, Gomez TR, Gonzalez MG, Lennon EM, Karmel BZ, Gardner JM. Parent PDD behavior inventory profiles of young children classified according to autism diagnostic observation schedule-generic and autism diagnostic interview-revised criteria. J Autism Dev Disord. 2010;40:246–54.
Adamson LB, Bakeman R. The Communication Play Protocol: Capturing Variations in Language Development. Perspect ASHA Spec Interest Groups. 2016;1:164–71.
McCullagh P, Nelder JA. Generalized Linear Models. 2nd ed. Chapman and Hall; 1989.
Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12:1–12.
Lau A, Barnett M, Stadnick N, Saifan D, Regan J, Wiltsey Stirman S, et al. Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded childrens mental health services. J Consult Clin Psychol. 2017;85:664–75.
Moullin JC, Sklar M, Ehrhart MG, Green A, Aarons GA. Provider REport of Sustainment Scale (PRESS): development and validation of a brief measure of inner context sustainment. Implementation Science [Internet]. 2021 [cited 2022 Feb 6];16:1–10. https://implementationscience.biomedcentral.com/articles/10.1186/s13012-021-01152-w
Ruble LA, Toland MD, Birdwhistell JL, McGrew JH, Usher EL. Preliminary Study of the Autism Self-Efficacy Scale for Teachers (ASSET). Res Autism Spectr Disord. 2013;7:1151–9.
Ehrhart MG, Aarons Ga, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9:157.
Ehrhart MG, Aarons GA, Farahnak LR. Going above and beyond for implementation: the development and validity testing of the Implementation Citizenship Behavior Scale (ICBS). Implement Sci. 2015;10:65.
Gibbs A. Focus groups. Social Res Update. 1997;19.
Merton RK, Kendall PL. The focused interview. Am J Sociol. 1946;51:541–57.
Qualitative Data Analysis Software. | NVivo [Internet]. [cited 2022 Feb 9]. https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home
Hamilton AB, Finley EP. Qualitative methods in implementation research: An introduction. Psychiatry Res. 2019;280:112516.
Shire SY, Chang Y-C, Shih W, Bracaglia S, Kodjoe M, Kasari C. Hybrid implementation model of community-partnered early intervention for toddlers with autism: a randomized trial. 2016.
Glaser B, Strauss A. The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine; 1967.
Palinkas LA, Aarons GA, Horwitz S, Chamberlain P, Hurlburt M, Landsverk J. Mixed method designs in implementation research. Adm Policy Ment Health. 2011;38:44–53.
Stahmer AC, Rieth SR, Dickson KS, Feder J, Burgeson M, Searcy K et al. Project ImPACT for Toddlers: Pilot outcomes of a community adaptation of an intervention for autism risk. Autism. 2020;24.
Stahmer AC, Suhrheinrich J, Rieth SR, Roesch S, Vejnoska S, Chan J et al. A Waitlist Randomized Implementation Trial of Classroom Pivotal Response Teaching for Students with Autism. Focus on autism and other developmental disorders. 2022.
Wells KB, Staunton A, Norris KC, Bluthenthal R, Chung B, Gelberg L et al. Building an academic-community partnered network for clinical services research: the Community Health Improvement Collaborative (CHIC). Ethn Dis. 2006/05/10. 2006;16:S3-17.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Med Care. 2012;50:217–26.
Wiltsey Stirman S, Miller CJ, Toder K, Calloway A. Development of a framework and coding system for modifications and adaptations of evidence-based interventions. [cited. 2018 Jan 1]; http://www.implementationscience.com/content/8/1/65

Competing interest reported. Aubyn Stahmer, Sarah Dufek and Ana-Maria Iosif declare no competing interests. Conflicts of interest for Sally Rogers involve royalties from publications, training programs, and lectures related to the Early Start Denver Model.

Download PDF

Journal Publication

published 28 Sep, 2024

Read the published version in BMC Psychology →

Editorial decision: Revision requested
18 Sep, 2024
Editor assigned by journal
07 Aug, 2024
Submission checks completed at journal
07 Aug, 2024
First submitted to journal
06 Aug, 2024

You are reading this latest preprint version

Study Protocol for a Cluster, Randomized, Controlled Community Effectiveness Trial of the Early Start Denver Model (ESDM) Compared to Community Early Behavioral Intervention (EBI) in Community Programs serving Young Autistic Children: Partnering for Autism: Learning more to improve Services (PALMS)

Status:

Journal Publication

Version 1

Abstract

Figures

Background

Autism as an ongoing significant public health concern

Methods

Design & Randomization

Participants

Clinical Intervention and Community Training

Procedures and Measures

Characterization Measures

Primary Child Outcomes: Social Communication and Language

Secondary Outcomes

Treatment Mechanisms Variables

Analytic Plan

Procedures and Measures Addressing our Exploratory Implementation Aim

Discussion

Abbreviations

Declarations

References

Additional Declarations

Status:

Journal Publication

Version 1