Study Design
The MAGNET Project will enrol 1,200 families with children aged between 4 and 18 years of age. Children who are typically developing, as well as those with elevated ASD, ADHD, or ASD+ADHD symptoms will be recruited to ensure both ends of the ASD-ADHD spectra are appropriately sampled. In addition, unaffected and affected siblings of probands will be recruited. A dimensional enhancement approach to sampling will be taken, as it augments clinical samples with non-clinical participants and those exhibiting subthreshold symptoms (Cuthbert, 2014; Krueger & Bezdjian, 2009). This sampling strategy combines the strengths and offsets the weaknesses of categorical and dimensional approaches to psychopathology research by increasing statistical power whilst maintaining clinical validity and enabling direct comparisons with existing diagnostic classifications systems (Cuthbert, 2014; Helzer, Kraemer, & Krueger, 2006). The MAGNET Protocol comprehensively phenotypes all children and siblings, irrespective of case-control status, for behavioural and neurocognitive constructs that are central to ASD and ADHD symptomatology and align with RDoC and HiTOP frameworks (e.g. internalising and externalising symptoms, attention and cognitive control, arousal, reward, working memory, perception, social processes, and sensorimotor processes). The battery uniquely captures dimensional traits across ASD-ADHD spectra using a range of symptom, parent-report, neurocognitive, and direct behavioural observation measures to capture the target domains from multiple perspectives. This approach will provide a rich source of data unconfounded by informant bias and method bias, with the opportunity to model the correspondence and complex interactions of information obtained from multiple informants (Achenbach, 2006; De Los Reyes, Salas, Menzer, & Daruwala, 2013; De Los Reyes, Thomas, Goodman, & Kundey, 2013; Patrick et al., 2013; Perkins, Latzman, & Patrick, 2020; Podsakoff, MacKenzie, & Podsakoff, 2012).
Targeted sampling through hospitals, schools, private practice clinicians, and social media across Victoria, Australia will allow for a broad and representative distribution of socioeconomic status (SES) and symptom presentation. Currently the MAGNET Project is in an open recruitment phase. The MAGNET Project will actively recruit females and children with mild-severe intellectual disability, as these children are typically under-represented, or excluded from, studies of ASD and ADHD. The study has been piloted on control and clinical children aged 4 to 17 years of age (see Table 1 for preliminary demographic and clinical data) to assist in deciding appropriate age and cognitive ranges for tasks and minimum dataset requirements. See Figure 1 for an overview of the MAGNET Project study protocol (see supplementary material 1 for the MAGNET Project Protocol).
Table 1.
Preliminary demographic and clinical data for the MAGNET Project for N=216 participants across Controls, Probands and Siblings.
|
Controls
|
Probands
|
Sibling Unaffected
|
Sibling Affected
|
Total
|
Total
|
33
|
95
|
56
|
32
|
216
|
Diagnosis
|
ASD
|
-
|
34
|
-
|
8
|
42
|
ADHD
|
-
|
25
|
-
|
7
|
32
|
ASD/ADHD
|
-
|
27
|
-
|
4
|
31
|
Sus. ASD/ADHD
|
-
|
9
|
-
|
13
|
22
|
Sex
|
Male
|
15
|
69
|
18
|
17
|
119
|
Female
|
18
|
26
|
38
|
15
|
97
|
Notes. ASD = Autism Spectrum Disorder. ADHD = Attention-Deficit/Hyperactivity Disorder. Sus. = suspected. Age = average age in months.
Participant eligibility
Children with a diagnosis of ASD and/or ADHD provide the clinical report from their clinician with evidence of diagnosis. Children who are under investigation, or queried for, ASD and/or ADHD are required to have a clinician (paediatrician, psychologist, and/or general practitioner) currently managing their care. Siblings of probands must share two biological parents with the proband. The healthy control children are required to have no neurodevelopmental diagnosis, and no first-degree relative with a diagnosis of ASD and/or ADHD.
Probands and siblings with comorbidities such as anxiety, depression, oppositional defiant disorder (ODD), and conduct disorder (CD) are not excluded. As a large proportion of children with ASD and ADHD experience comorbid disorders, exclusion of these disorders may engender a sample that is not representative of the target population. Where possible, one or both biological parents complete a battery of questionnaires examining ASD and ADHD symptomatology, mental health, and quality of life. Exclusion criteria for all children include known genetic (e.g. Fragile X, Angelman’s Syndrome) or environmental (e.g. traumatic brain injury, foetal alcohol syndrome) causes. A peri/prenatal environment questionnaire retrospectively captures maternal alcohol and drug use, medication, illness/infection, and complications during the pregnancy and delivery. Retrospective information on the child’s development, including developmental milestones and regression is obtained via parent-report. As the questionnaire battery is extensive, at least one parent/caregiver is required to speak English. Parents complete approximately 3 hours of online questionnaires, and one (control families) or two (clinical families) 3-hour research visits at Monash University to complete the testing protocol.
All children undergo case review by a registered psychologist and paediatrician, and speech pathologist if available, to determine a ‘best clinical estimate’ of that child’s current diagnostic status. A best clinical estimate will be given for ASD, ADHD, comorbid ASD/ADHD, intellectual disability (ID), CD, and ODD (see supplementary material 2). The best clinical estimate will not be used as exclusion criteria for the study. Children who do not meet thresholds for ASD and/or ADHD will still provide useful information about the dimensionality of ASD and ADHD symptoms. Children with an estimated full-scale intelligence quotient (FSIQ) in the range for ID (IQ ≤ 70) as measured using standardised psychometric assessment (see Table 2) are administered a minimum dataset protocol (see supplementary material 3), but will attempt additional tasks from the battery wherever possible.
Ethnicity. Single-nucleotide polymorphisms (SNPs) may vary between ethnic populations and potentially cause false positive results in genetic association studies. To avoid the potential impact of population stratification only children with four grandparents of European ancestry are invited to complete the genetic component of the protocol.
Siblings. Only full biological siblings will be eligible to take part in the study. Within simplex families, that is, families where only one child has an ASD and/or ADHD diagnosis, the child with the ASD/ADHD diagnosis is nominated as the proband. In multiplex families, families where more than one child has an ASD and/or ADHD diagnosis, the eldest child is denoted as the proband and younger children are designated as affected or unaffected siblings. Unaffected siblings of ASD/ADHD probands have no diagnosis of ASD/ADHD, are not under investigation for ASD/ADHD, and are not assigned a neurodevelopmental disorder diagnostic category during their best clinical estimate review.
Medication.
The child’s current and previous medication history, medication prescriber (e.g. paediatrician, general practitioner), and reasons for any medication changes, will be recorded.
Children who are taking medication remain on their medication during Visit 2 when their relevant Wechsler and Autism Diagnostic Observation Schedule – Second Edition (ADOS-2) assessments are completed (see supplementary material 4 for clinical assessment protocol). However children taking stimulant or non-stimulant medication for ADHD including methylphenidate, lisdexamfetamine, or dexamfetamine are required to withdraw from their medication 48 – 72 hours prior to completing the neurocognitive test battery during Visit 1 (Chamberlain et al., 2011; Mostofsky, Lasker, Cutting, Denckla, & Zee, 2001). Participants taking guanfacine or antipsychotics (e.g. risperidone, aripiprazole) do not withdraw for any component of the protocol as abrupt withdrawal from these medications may be associated with adverse side effects (Howland, 2010; Strange, 2008; Zamboulis & Reid, 1981). Children taking melatonin are not required to withdraw prior to participating.
Phenotyping overview
Each of the measures or tasks included were selected as gold standard measures that are widely used, have biological plausibility, and show robust effect sizes when differentiating controls from either ASD or ADHD (See Table 2 for the MAGNET Project symptom and environmental phenotyping measures, and Table 3 for neurocognitive phenotyping measures).
The components of the MAGNET protocol intended to measure phenotypic dimensions relevant to ASD were chosen in consultation and collaboration with the European Autism Interventions - A Multicentre Study for Developing New Medications – Longitudinal European Autism Project (EU-AIMS [LEAP]) study team (Isaksson et al., 2018; Loth et al., 2017). The EU-AIMS (LEAP) study is a European multi-centre study that aims to identify risk factors contributing to differences in brain development, social difficulties and other core ASD symptoms. Through aligning parts of the MAGNET and EU-AIMS (LEAP) protocols, the MAGNET project will also act as a replication site for the EU-AIMS (LEAP) study. The addition of measures for dimensional phenotyping of ADHD symptoms and relevant neurocognitive traits are unique to the MAGNET project and make ours the first large-scale family-based project to take a truly transdiagnostic approach to understanding ASD and ADHD (see supplementary material 1 for MAGNET protocol summary).
Characterisation of ASD, ADHD and comorbid symptoms
Dimensional ASD symptomatology is measured through parent-report measures capturing social communication (Autism Quotient - Child [AQ-C], Auyeung, Baron-Cohen, Wheelwright, & Allison, 2008; Child Communication Checklist - Second Edition [CCC-2], Bishop, 2003; Social Responsive Scale - Second Edition [SRS-2], Constantino, 2011), social competence (Child Behaviour Checklist [CBCL], Achenbach & Edelbrock, 1983), restricted, repetitive, and stereotyped behaviours (Constantino, 2011; The Childhood Routines Inventory - Revised [CRI-R], Evans, Uljarević, Lusk, Loth, & Frazier, 2017), and autism symptomatology overall (Auyeung et al., 2008; Constantino, 2011). Dimensional traits central to ADHD are captured through parent-report questionnaires, and an in-house observation checklist for ADHD behaviours completed during ADOS-2 coding. Parent rated measures of attention and inattention (Strengths and Weaknesses of ADHD Symptoms and Normal Behaviour [SWAN]; Arnett et al., 2013; Conners’ Parent Rating Scale - Revised [CPRS-R]; Conners, Sitarenios, Parker, & Epstein, 1998; Development and Wellbeing Assessment [DAWBA], Goodman, Ford, Richards, Gatward, & Meltzer, 2000), hyperactivity (Aberrant Behaviour Checklist [ABC], Aman & Singh, 1986; Strengths and Difficulties Questionnaire [SDQ], Goodman, 1997; Goodman et al., 2000), impulsivity, and overall ADHD symptomatology (Conners et al., 1998), are comprehensively assessed, alongside an additional measure of attention appropriate for children with intellectual disability (Scale of Attention in Intellectual Disability [SAID], Freeman, Gray, Taffe, & Cornish, 2015). Teachers are invited to complete the SRS-2, SDQ, and Conners’ Teacher Rating Scale – Revised (Conners, 1997), although completion rates are typically lower than for parent report. Height, weight, head circumference, and joint mobility and hypomobility (Beighton & Horan, 1969) are also recorded for every child.
Comorbidities. Comorbidities commonly observed in ASD and ADHD are captured in all children, including anxiety (Child Behaviour Checklist [CBCL], Achenbach & Rescorla, 2001; Spence Children’s Anxiety Scale [SCAS], Spence, 1998) and depression (Achenbach & Rescorla, 2001; Goodman et al., 2000; Childhood Depression Inventory - Second Edition [CDI-2], Kovacs & Beck, 1977; Smucker, Craighead, Craighead, & Green, 1986). Conduct problems and oppositional defiant problems are also indexed (Achenbach & Rescorla, 2001; Conners et al., 1998; Goodman et al., 2000). Level of current cognitive function is determined using age appropriate Wechsler intelligence scales (Wechsler, 2011, 2012a, 2012b, 2016). See supplementary material 4 for clinical assessment protocol.
Adaptive behaviours and quality of life
Adaptive behaviour (Vineland Adaptive Behaviour Scale - Third Edition [VABS-3]; Sparrow, Cicchetti, & Saulnier, 2016) and quality of life (Child Health and Illness Profile - Child Edition [CHIP-CE], Riley et al., 2004) are measured in all children through parent-report questionnaires.
Language assessment.
Language profiles in ASD are heterogeneous, ranging from non-verbal (Gerenser, 2009) to superior linguistic abilities (Kim et al., 2014). Although language impairments are not a hallmark diagnostic criteria for ADHD, both linguistic and pragmatic deficits are commonly part of the symptom presentation (Bellani, Moretti, Perlini, & Brambilla, 2011). Recent empirical records on the co-occurrence of language impairments in ASD and ADHD have identified impairments in structural and pragmatic aspects of language in both the groups (Baixauli-Fortea, Miranda Casas, Berenguer-Forner, Colomer-Diago, & Roselló-Miranda, 2019; Kuijper, Hartman, Bogaerds-Hazenberg, & Hendriks, 2017; Norbury, Gemmell, & Paul, 2014; Sciberras et al., 2014). Despite the presence of language difficulties in ASD and ADHD, and indeed, in a number of other neurodevelopmental disorders and psychopathology, language constructs are not currently included in RDoC or HiTOP frameworks. Thus, the inclusion of language assessments in the MAGNET Project protocol will provide a novel and unique contribution to these nosologies.
A standardised screening measure for language difficulties (Clinical Evaluation of Language Fundamentals - Fifth Edition [CELF-5]: Screening Test; Wiig, Secord, & Semel, 2013) is administered to all enrolled children over 5 years of age. Children with a diagnosis of ASD and/or ADHD or those who are under investigation for these disorders, and control children who fall below criterion on the screening measure for language difficulties, are administered the Australian adaptation of the Clinical Evaluation of Language Fundamentals - Fifth Edition (CELF-5; Age group 5 to 21 years; Coret & McCrimmon, 2015; Wiig, Semel, & Secord, 2017) or Clinical Evaluation of Language Fundamentals – Preschool Edition (CELF-P2; Age group 3 to 6 years 11 months; Semel, Wiig, & Secord, 2004). This clinician-administered assessment provides a comprehensive global measure of language abilities, and characterises structural and pragmatic language in children.
The Preschool Language Scale – Fifth Edition (PLS-5; Zimmerman, Steiner, & Pond, 2011) is administered to younger minimally verbal children. The PLS-5 incorporates information from clinical observation, direct measurement and parent report to assess domains of attention, play, gesture, vocal development, social communication, semantics, language structure, integrative language skills and emergent literacy skills in children from birth to 7 years 11months. A parent administered, Children's Communication Checklist 2 (Bishop, 2003) measures both structural (language form / content) and pragmatic traits of communication impairment in children. The CCC-2 includes an overall measure of communication skills and a Social Interaction Deviance Composite (SIDC) which indexes the strength of relationships between the social domains of communication and structural components of language, thereby aiming to attain and identify traits associated with pragmatic language difficulties. With poorer overall language performance and SIDC linked to ASD traits (Bishop, 2003), these measures provide valuable information when differentiating comorbid presentations of language impairment in neurodevelopmental disorders. The SRS-2 also provides a parent-reported index of social communication. Recordings from the ADOS-2 provide high-resolution natural speech and language samples. See supplementary material 4 for clinical assessment protocol.
Measures of Neurocognition
We assess the domains of sustained attention, inhibition, cognitive control, arousal, reward, working memory, perception, social processes, and sensorimotor processes with the view to utilising neurocognitive data to discover neurobiological correlates of novel ASD-ADHD data-driven clusters. The tasks chosen are widely used, have biological plausibility and show robust effects sizes when differentiating clinical cases from controls. See Table 2 for the MAGNET Project neurocognitive phenotyping measures. Supplementary material 5 summarises the MAGNET Project’s neurocognitive assessment protocol.
Neurocognitive tasks.
The neurocognitive tasks will be completed on a desktop computer and touchscreen laptops. Amsterdam Neuropsychological Tasks (ANT), Psytools, PsychoPy and STOP-IT software programmes were used for task administration (De Sonneville, 1999; Delosis, 2018; Peirce, 2007; Verbruggen, Logan, & Stevens, 2008).
Response inhibition, sustained attention and cognitive control. Response inhibition refers to the ability to withhold or cancel a motor response (Chambers, Garavan, & Bellgrove, 2009). Sustained attention, or vigilance, can be defined as the ability to maintain engagement in a task over a prolonged period of time (Fortenbaugh, Degutis, & Esterman, 2018). This component of attention is thought to be mediated by top down, or endogenous processes, and is controlled by internal goals (Morandini et al., 2020). These cognitive functions are measured using a Go/No-Go and Stop Signal Task which are standard measures of top-down/endogenous sustained attention and response inhibition. Response inhibition is indexed through stop-signal reaction time (SSRT) and the percentage of failed attempts to inhibit a response on tasks. Longer stop signal reaction times and commission errors indicate poor inhibition and more omission errors and are indicative of poorer sustained attention (Verbruggen & Logan, 2008). Response inhibition and sustained attention deficits are central to the conceptualisation of ADHD (Barkley, 1997; M. A. Bellgrove, Hawi, Gill, & Robertson, 2006; Quay, 1997; Wodka et al., 2007; Wright et al., 2014), with some support for deficits in ASD (Barneveld et al., 2013; Chien et al., 2015; Johnston, Madden, Bramham, & Russell, 2011; Schmitt et al., 2019; van der Plas et al., 2016). Further, these deficits are heritable, with unaffected siblings of ADHD probands demonstrating response inhibition and sustained attention difficulties (Chien et al., 2017; Friedman et al., 2016; Schachar et al., 2005; Slaats-Willemse et al., 2005). Similarly, reduced inhibitory control has been demonstrated to be familial in ASD families (Schmitt et al., 2019).
Arousal. Arousal can be understood as an individual’s state of reactivity, and although arousal is intimately linked with constructs like attention, the neural correlates of these processes are largely distinct (Coull, 1998). Arousal will be examined by deriving measures of intra-individual variability in response times across tasks of sustained attention and response inhibition, as suboptimal arousal is thought to underpin intra-individual variability in ADHD (M. A. Bellgrove et al., 2006; M. a Bellgrove et al., 2005; Castellanos et al., 2005; Sergeant, 2000). Increased response time variability is a hallmark feature of neurocognitive performance in ADHD (Bellgrove et al., 2005; Johnson, Kelly, et al., 2008a; Johnson et al., 2008, 2007; Shallice et al., 2002) and is familial (Kuntsi et al., 2010; Nigg, Blaskey, Stawicki, & Sachek, 2004). Variability in response time is thought to be a marker for dysfunction in the frontal areas of the brain (M. a Bellgrove, Hester, & Garavan, 2004; MacDonald, Nyberg, & Bäckman, 2006), which is consistent with theories of hypo-arousal and fronto-striatal dysfunction in ADHD (Cupertino et al., 2020; Satterfield, Cantwell, & Satterfield, 1974). Although children with ASD show similar response time variability to typically developing children (Johnson et al., 2007), variability in response time appears to index ADHD symptomatology across diagnostic boundaries as children with comorbid ASD and ADHD show similar variability to those with ADHD (Tye et al., 2016). Thus, response time variability as a proxy measure for arousal shows promise for effectively stratifying children with ASD, ADHD and ASD-ADHD.
Reward sensitivity. Reward sensitivity refers to the tendency to respond more strongly to incentives, or rewards, and is a process implicated in decision making. ADHD is associated with divergent decision making, differing sensitivity to reward, and elevated risk-taking behaviour (Dekkers, Popma, Agelink van Rentergem, Bexkens, & Huizenga, 2016; Johansen et al., 2002; Luman, Tripp, & Scheres, 2010; Ziegler et al., 2016). Effect sizes for decision making difficulties are comparable to the attention difficulties seen in ADHD (Mowinckel et al., 2015). Altered reward processing in ADHD is well-studied, and posited as central to the disorder (Taurines et al., 2012). Children with ADHD show poorer decision making as they have difficulty adjusting their responses in the face of changing levels of risk (D. R. Coghill et al., 2014; Groen, Gaastra, Lewis-Evans, & Tucha, 2013; Sørensen et al., 2017). Biological plausibility is evidenced with correlative neuroimaging in ADHD of under activation in brain regions associated with decision making (i.e. ventral and dorsolateral prefrontal cortex, and insula; Broche-Pérez, Herrera Jiménez, & Omar-Martínez, 2016; Ernst et al., 2003) and hypo-responsiveness in neural circuitry involved with reward anticipation (i.e. ventral striatal circuitry; Scheres, Milham, Knutson, & Castellanos, 2007). Dopamine is one of the neurotransmitters implicated in decision making and reward, and indeed, dopamine deficiency is a leading hypothesis in ADHD (Ziegler et al., 2016). Together, a task engaging decision making, reward sensitivity, and risk-taking behaviour is a well-positioned ADHD trait for discovery of clusters.
In ASD, there is evidence for aberrant reward processing, but to a lesser extent than that observed in ADHD (Kohls et al., 2011; Taurines et al., 2012). Children with ASD showed increased activation in the anterior cingulate cortex during reward achievement compared to controls (Schmitz et al., 2008). This region is thought to be involved with self-monitoring of performance in line with reward feedback (Bloom & Hynd, 2005; Rogers et al., 2004) and risk assessment (Bush, Luu, & Posner, 2000). However, there is some evidence to suggest ASD and control groups perform similarly on goal-directed decision making tasks in the context of explicit reward (Faja, Murias, Beauchaine, & Dawson, 2013) and have similar sensitivity to monetary reward (Demurie, Roeyers, Baeyens, & Sonuga-Barke, 2011; Stavropoulos & Carver, 2014), with no difference in neural activation while processing reward (Larson, South, Krauskopf, Clawson, & Crowley, 2011). The less definitive evidence in ASD may indicate that only a subgroup of these children may in fact have altered reward processing and decision making.
To assess decision making, reward sensitivity, and risk-taking, the New Cambridge Gambling Task (Cambridge Cognition, 2018a) will be used. It allows for delineation of risk-taking behaviours from impulsivity, and explicitly states the probability for each trial. Unlike other gambling tasks (e.g. Iowa Gambling Task), explicit statement of probability reduces the working memory load, thus reducing confounds of additional working memory deficits.
Probabilistic reversal learning. Broadly, cognitive flexibility is a component of executive function that encompasses adaptability at a behavioural level and is studied from a variety of perspectives such as set shifting, task-switching, and reversal learning (Cools, 2015). More specifically, contingency-related cognitive flexibility is the adaptation of behaviour after negative feedback, typically measured using probabilistic reversal learning paradigms. In typical development, contingency-related cognitive flexibility specifically is associated with the orbitofrontal cortex, parietal cortex, and subcortical connections (Fineberg et al., 2014). Impairments in contingency-related cognitive flexibility are seen in ASD (Corbett et al., 2009; D’Cruz et al., 2013) and ADHD probands (Itami & Uno, 2002; Willcutt, Doyle, Nigg, Faraone, & Pennington, 2005), with impairments also observed in unaffected first degree relatives of ASD probands (Schmitt et al., 2019). In ASD, cognitive inflexibility has been associated with restricted, repetitive, and stereotyped behaviours (D’Cruz et al., 2013; Lopez, Lincoln, Ozonoff, & Lai, 2005; Miller, Ragozzino, Cook, Sweeney, & Mosconi, 2015). Neuroimaging findings demonstrate aberrant activation of networks during cognitive flexibility tasks in children with ASD (Uddin, 2020) and fronto-striatal function, which is implicated in cognitive flexibility, is thought to be impaired in ADHD (Casey et al., 1997; Durston et al., 2003). In the MAGNET Project contingency-related cognitive flexibility will be measured using a probabilistic reversal learning paradigm with positive and negative feedback (Loth et al., 2017; van Ouden et al., 2013). The number of trials required to shift to a new response choice, perseverative errors, and regressive errors index cognitive inflexibility.
Table 2. The MAGNET Project Symptom Phenotyping Measures.
Tasks
|
Attention
|
Working Memory
|
Speech & Language
|
Social Processes
|
Cognitive Control
|
Reward
|
Sensori-motor
|
Perception
|
WISC-V/WPPSI-IV/WAIS-IV/WAIS-II
|
X
|
X
|
X
|
|
X
|
X
|
X
|
X
|
Dimensional measures of ASD traits
|
ADOS-2 + 3DI
|
X
|
|
X
|
X
|
X
|
|
|
|
Childhood & Adult Routines Inventory
|
|
|
|
X
|
|
|
|
|
Autism Quotient
|
X
|
|
|
X
|
X
|
|
X
|
X
|
Social Responsiveness Scale
|
|
|
X
|
X
|
|
|
X
|
|
Dimensional measures of ADHD traits
|
Conners’ Parent Rating Scale – Revised
|
X
|
X
|
|
X
|
X
|
X
|
|
|
SWAN
|
X
|
X
|
|
|
|
X
|
|
|
Scale of Attention in Intellectual Disability
|
X
|
X
|
|
|
|
X
|
|
|
Comorbid Symptoms
|
Aberrant Behaviour Checklist
|
|
X
|
|
|
|
X
|
|
|
Child Behaviour Checklist
|
|
|
X
|
X
|
|
|
|
|
DAWBA
|
X
|
|
X
|
X
|
X
|
X
|
X
|
|
Children’s Communication Checklist 2
|
|
|
X
|
X
|
|
|
|
|
CELF-5
|
X
|
X
|
X
|
X
|
X
|
|
X
|
X
|
CELF-P2
|
X
|
X
|
X
|
|
X
|
|
X
|
X
|
PLS-5
|
X
|
X
|
X
|
|
X
|
|
|
|
PEP-3
|
X
|
X
|
X
|
X
|
X
|
|
X
|
X
|
Strengths and Difficulties Questionnaire
|
X
|
|
|
X
|
|
X
|
|
|
Spence Childhood Anxiety Scale
|
|
|
|
X
|
|
|
|
|
Childhood Depression Inventory
|
|
|
|
X
|
|
|
|
|
Beck Depression Inventory
|
|
|
|
X
|
|
|
|
|
Beck Anxiety Inventory
|
|
|
|
X
|
|
|
|
|
Domain general rating scales
|
Child Health and Illness Profile
|
|
|
X
|
X
|
|
|
|
X
|
WHO Quality of Life Questionnaire
|
|
|
X
|
X
|
|
|
|
X
|
Vineland Adaptive Behaviour Scale
|
X
|
X
|
X
|
X
|
X
|
|
X
|
X
|
Note. WISC-V = Wechsler Intelligence Scale for Children – Fifth Edition. WPPSI-IV = Wechsler Preschool and Primary Scale of Intelligence – Fourth Edition. WAIS-IV = Wechsler Adult Intelligence Scale – Fourth Edition. SWAN = Strengths and Weaknesses of ADHD symptoms and Normal Behaviour. DAWBA = Development and Well-Being Assessment. CELF-5 = Clinical Evaluation of Language Fundamentals - Fifth edition. CELF-P2 = Clinical Evaluation of Language Fundamentals – Preschool-2. PLS-5 = Preschool Language Scales – Fifth Edition. PEP-3 = Psychoeducation Profile – Third Edition. WHO = World Health Organisation.
Table 3. The MAGNET Project Neurocognitive Phenotyping Measures.
Neurocognitive Tasks
|
Attention
|
Working Memory
|
Speech & Language
|
Social Processes
|
Cognitive Control
|
Reward
|
Sensori-motor
|
Perception
|
Go/No-Go
|
X
|
|
|
|
X
|
|
|
|
Stop Signal Task
|
X
|
|
|
|
X
|
|
X
|
|
Reflexive saccade task
|
|
|
|
|
|
|
X
|
X
|
Anti-saccades
|
X
|
|
X
|
|
X
|
|
X
|
X
|
Sinusoidal pursuit
|
X
|
|
|
|
|
|
X
|
X
|
Step-ramp pursuit
|
|
|
|
|
|
|
X
|
X
|
Spatial Working Memory
|
X
|
X
|
|
|
|
|
|
X
|
Probabilistic Reversal Learning
|
X
|
X
|
|
|
X
|
X
|
|
|
Cambridge Gambling Task
|
X
|
|
|
|
X
|
X
|
|
|
Facial Recognition Task
|
X
|
X
|
|
X
|
|
|
|
X
|
Karolinska Directed Emotional Faces
|
|
|
X
|
X
|
|
|
|
X
|
Reading the Mind in the Eyes
|
X
|
|
X
|
X
|
|
|
|
X
|
Continuous False Belief task
|
|
|
X
|
X
|
|
|
|
|
Note. WISC-V = Wechsler Intelligence Scale for Children – Fifth Edition.
Working memory. Internationally, the definitions of working memory are contentious, with working memory and short-term memory sometimes still used interchangeably. Some conceptualise working memory as the process of holding information in the mind for a short period of time, which can also be thought of as short-term memory (Gleitman, Fridlund, & Reisberg, 1999). Others understand working memory, also referred to as executive memory, as the ability to maintain and manipulate information, where this manipulation may have low or high executive demands (Baddeley, 1986; Daneman & Carpenter, 1980). Tasks are then modality specific, using verbal or visual stimuli. The MAGNET Project’s conceptualisation of working memory aligns with executive memory that has high and low executive demands. Verbal and visual working memory difficulties are seen in both ASD and ADHD (Dowson et al., 2004; Kercood, Grskovic, Banda, & Begeske, 2014; Martinussen, Hayden, Hogg-Johnson, & Tannock, 2005; Schoechlin & Engel, 2005; Schuh & Eigsti, 2012; Seng et al., 2020), with deficits becoming more pronounced as the cognitive load increases (Rhodes et al., 2004, 2005; Seng et al., 2020; Steele, Minshew, Luna, & Sweeney, 2007; Vogan, Francis, Morgan, Smith, & Taylor, 2018). These difficulties on working memory tasks with higher cognitive load correspond with atypical neural processing in children with ASD (Rahko et al., 2016; Vogan et al., 2018), providing biological plausibility for working memory performance as a neurocognitive marker of ASD. Further, unaffected siblings of children with ASD and ADHD showed more impaired verbal and visuospatial working memory performance than typically developing controls (Bidwell, Willcutt, DeFries, & Pennington, 2007; Oerlemans et al., 2013; Seng et al., 2020). The verbal and visuospatial working memory divergence seen in unaffected siblings of children with ASD and ADHD positions working memory as a good candidate endophenotype (Flint & Munafò, 2007; Miller & Rockstroh, 2013). Verbal (Wechsler, 2008, 2016; Wiig et al., 2013, 2017) and visuospatial (Cambridge Cognition, 2018b, 2018c) working memory tasks which increase in cognitive load across trials allows us to index working memory capacity across the broad range of cognitive abilities captured in the study.
Social Processes.
Emotion recognition. Emotion recognition is the ability to correctly identify another person’s emotion based on their facial expression and is crucial for effective social communication. Emotion recognition difficulties in children with ASD are a consistent and robustly replicated finding (Harms et al., 2010; Uljarevic & Hamilton, 2013). Atypical processing of emotions is also thought to be familial, with unaffected relatives of individuals with ASD also showing less severe, but still significant emotion recognition difficulties (das Neves et al., 2011; Oerlemans et al., 2014). Although emotion recognition is not as extensively researched in ADHD, there is some evidence for emotion recognition divergence in these children (Aspan et al., 2014; Bora & Pantelis, 2016; Demopoulos, Hopkins, & Davis, 2013; Waddington et al., 2018b). Emotion recognition in the MAGNET project is conceptualised, and measured, as the ability to recognise both simple and complex emotional states (Baron‐Cohen, Jolliffe, Mortimore, & Robertson, 1997; Goeleven, De Raedt, Leyman, & Verschuere, 2008).
Theory of Mind. Theory of Mind (ToM) is the ability to understand and attribute mental states to oneself and to others and understand that others can have different mental states to yourself. Profound difficulties with understanding others’ thoughts and intentions in day-to-day life are common in ASD (Peterson et al., 2009). These difficulties with ToM have been linked to genetic anomalies associated with ASD (Rodrigues, Saslow, Garcia, John, & Keltner, 2009). False-belief tasks are widely used for assessing ToM and individuals with ASD typically show egocentric biases when completing these tasks compared to their typically developing peers (Begeer, Bernstein, van Wijhe, Scheeren, & Koot, 2012). These difficulties are less definitive in high functioning individuals with ASD however, with some able to successfully complete continuous false-belief tasks (Scheeren, de Rosnay, Koot, & Begeer, 2013). The ability of such a task to separate different individuals with ASD positions it well to stratify these individuals. Conversely, the findings within ADHD are currently heterogeneous. More research is necessary to understand whether these deficits are present in only a subset of these children (Pineda-Alhucema, Aristizabal, Escudero-Cabarcas, Acosta-López, & Vélez, 2018).
Oculomotor measures
Saccade and pursuit eye movement abnormalities have the potential to reliably distinguish ASD and ADHD children from controls (Johnson et al., 2016). Oculomotor abnormalities can arise as the result of abnormalities in a range of well-mapped neural circuitry throughout the brain, spanning motion sensitive visual area V5, parietal and frontal areas supporting visual attention and sensorimotor transformation, basal ganglia, brainstem and cerebellar circuitry (Johnson et al., 2016). Oculomotor control is ideal to measure in children, as it is quick, and affords sensitive, high-resolution recording, and requires minimal-to-no language comprehension for children to perform. Sensorimotor measures from ocular motor tasks include accuracy, motor dynamics (e.g. velocity profiles), initial eye acceleration in response to the onset of a visual target or target movement and integration of visual feedback in motor responses. The anti-saccade task, completed in children eight years and over, also provides a measure of how attentional processes and inhibition interface with oculomotor control (Everling & Fischer, 1998; Hutton & Ettinger, 2006; Klein & Foerster, 2001; Munoz & Everling, 2004). Other studies in schizophrenia and bipolar disorder have found unique relationships between genes associated with nervous system development and function and with sensorimotor processing and pursuit maintenance (Lencer et al., 2017). See supplementary material 6 for oculomotor testing protocol.
Brain structure and function
Large-scale neuroimaging studies have identified robust structural differences associated with ASD and ADHD, demonstrating both common and disorder-specific brain alterations. In both ASD and ADHD, cases showed reduced subcortical volumes (Hoogman et al., 2017; Van Rooij et al., 2018) and cortical thinning in temporal regions (Hoogman et al., 2019; Van Rooij et al., 2018). Reduced surface areas were specific to ADHD (Hoogman et al., 2019), whereas ASD showed increased cortical thickness in frontal regions (Van Rooij et al., 2018). Evidence regarding differences in diffusion weighted imaging (DWI) and resting state fMRI (rs-fMRI) are based on smaller studies demonstrating wide-spread alterations in fractional anisotropy (Di, Azeez, Li, Haque, & Biswal, 2018; van Ewijk, Heslenfeld, Zwiers, Buitelaar, & Oosterlaan, 2012) and less consistent changes in rsfMRI (Lau, Leung, & Lau, 2019; Zhou et al., 2019).
Structural and functional brain imaging (resting state fMRI) will be collected to determine if neurobiological differences exist as a function of symptom-based data-driven clusters. All scans will be performed using Siemens Skyra 3T scanner following previously established protocols (Oldham et al., 2020; Sabaroedin et al., 2019). Data processing pipelines will include extensive correction for in-scanner motion (Oldham et al., 2020; Parkes, Fulcher, Yücel, & Fornito, 2018) which is the most prevalent MRI artefact in paediatric populations.
Genetics
Saliva is collected from all probands, affected and unaffected biological siblings, biological parents of probands, and healthy controls for DNA extraction (see supplementary material 7 for DNA collection and extraction protocol). DNA will be subjected to array-based genotyping (e.g. Illumina Global Screen Array for GWAS) and/or whole genome sequencing, as funding allows. Because our study sample size has limited power to reliably detect novel associations with DNA variants, we will capitalise on existing publicly available data and consortia science in the following ways. First, we will derive Polygenic Risk Scores (PGRS; Choi & O’Reilly, 2019; Euesden, Lewis, & O’Reilly, 2015) for ASD and ADHD using international datasets as the base dataset (Demontis et al., 2019; Grove et al., 2019) and our entire sample of probands as the target dataset. We will estimate the relationships between polygenic risk scores for ADHD and/or ASD and each of our symptom-based data-driven clusters. Second, our family-based design is optimal for whole genome sequencing and will allow us to determine whether patterns of inherited versus de novo mutations differentially cluster across the data-driven clusters. Again, we acknowledge the limited power of our sample for whole genome sequencing, and will join collaborative efforts (e.g. PGC; iPSYCH; Autism Speaks MSSNG Project; EU-Aims; Province of Ontario Neurodevelopmental Network [POND]).
Parent phenotyping
Both biological parent’s complete self-report dimensional measures of ASD (Autism Quotient - Adults [AQ-A, Broadbent, Galic, & Stokes, 2013; SRS-2, Constantino, 2011; Adult Routines Inventory [ARI], Evans et al., 2017) and ADHD symptomatology (SWAN, Arnett et al., 2013; Conners' Adult ADHD Rating Scale, Conners, Erhardt, & Sparrow, 1999; SDQ, Goodman, 1997). Parent’s complete self-report measures of depression (Beck Depression Inventory [BDI], Beck, Ward, Mendelson, & Erbaugh, 1961), anxiety (Beck Anxiety Inventory [BAI], Beck, Epstein, Brown, & Steer, 1988), and a quality of life measures (World Health Organisation Quality of Life Measure [WHOQOL-BREF], WHOQOL Group, 1996) as parents of children with ASD and ADHD can experience poorer mental health and quality of life outcomes compared to parents with typically developing children (Green et al., 2015; Kvist, Nielsen, & Simonsen, 2013; Walton, 2019).
Database access
All raw data is stored on a central database with access only granted to current members of the research team who have personalised login details. Oculomotor and neuroimaging data are downloaded to local devices from the central database for cleaning, pre-processing, and analysis. Currently, access to the MAGNET Project’s data is only granted for members of the MAGNET research team and our collaborators from the EU-AIMS (LEAP) study (Loth et al., 2017). Genotyping information will be made available to international research consortia, such as the PGC, where participant consent for sharing has been given. Upon completion of the project, the MAGNET Project data set will be changed to open access. Consent for sharing neuroimaging data will be in line with recommendations from the Open Brain Consent working group (Open Brain Consent, 2020).
Planned statistical analysis
A combination of supervised psychometric analyses and unsupervised clustering approaches will be used to converge on data-driven homogeneous ASD-ADHD clusters embedded within biologically-relevant dimensions based on previously derived factor score estimates (Borsboom, Rhemtulla, Cramer, Maas, & Scheffer, 2016; Feczko et al., 2019). By using multiple measures of target constructs to create latent variable phenotypes, we can maximise our study’s statistical power and strengthen the representation of our key constructs (van der Sluis et al., 2010). Obtaining information from multiple informants controls for informant bias, whilst discrepancies between informant reports provides additional sources of information relevant to developmental psychopathology that can be the subject of further analysis (De Los Reyes, Salas, et al., 2013; De Los Reyes, Thomas, et al., 2013). Moreover, the MAGNET Project’s representative sample and measures are important prerequisites for robust clustering methods to avoid model overfitting and poor reproducibility (Bzdok, Altman, & Krzywinski, 2018; Rashid & Calhoun, 2020).
Dimension reduction strategies, such as exploratory factor analysis and exploratory structural equation modelling (Asparouhov & Muthén, 2009; Costello & Osborne, 2005; Marsh, Morin, Parker, & Kaur, 2014), or multidimensional item response theory (Reckase, 2009), will be used on each participant’s raw scores to first identify their factor or scale score estimates representing their standing on these latent dimensions. Unbiased feature selection and optimising latent model fit in this step, prior to later clustering analyses, can reduce the interference of variance from extraneous noise. It is also acknowledged that there may be clustering and nesting within the data based on sampling (e.g. participants from the same family) and testing (e.g. testing sessions, assessors) procedures (Clarke, 2008; McNeish, 2014). Subsequent analyses will account for these effects, though the choice of correction method will depend on the characteristics of our final dataset.
Factor mixture modelling is one possible supervised clustering method that we will employ for our subtyping analyses. Factor mixture modelling can uncover homogeneous clusters within continuous and categorical data embedded within dimensional models of psychopathology by utilising probabilistic modelling techniques (Borsboom et al., 2016; Lubke & Muthén, 2005; Miettunen, Nordström, Kaakinen, & Ahmed, 2016). The flexibility of factor mixture modelling permits the testing and comparison of multiple models with varying numbers of a priori specified clusters. Alternatively, where unsupervised machine learning techniques may be better suited for addressing specific research questions, community detection is one possible approach. This method combines graph theoretic analyses to detect homogeneous communities/clusters (i.e. highly connected sets of nodes). By ensuring that the algorithm achieves a connected graph, our analyses will parsimoniously account for all participants. These approaches empirically unify the theoretical grounding of MAGNET’s research questions with the power of cutting-edge data-driven analysis techniques. Moreover, both techniques are diagnosis-naïve, thus allowing MAGNET to fully embrace the transdiagnostic features of our biobehavioural subtypes. Normative modelling can also be incorporated to better understand heterogeneity, wherein inter-individual differences are mapped in reference to a normative sample, to help map typical development, as well as understanding true deviations from the norm (Marquand, Rezek, Buitelaar, & Beckmann, 2016). Finally, although MAGNET aims towards data-driven clusters using symptom and behavioural data, the potential utility of incorporating neurocognitive or genetic components in defining clusters will not be overlooked (Clementz et al., 2016; Fair, Bathula, Nikolas, & Nigg, 2012).
|