Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-22T16:01:57.708Z Has data issue: false hasContentIssue false

Deep learning identifies robust gender differences in functional brain organization and their dissociable links to clinical symptoms in autism

Published online by Cambridge University Press:  15 February 2022

Kaustubh Supekar*
Affiliation:
Department of Psychiatry & Behavioral Sciences, Stanford University, USA
Carlo de los Angeles
Affiliation:
Department of Psychiatry & Behavioral Sciences, Stanford University, USA
Srikanth Ryali
Affiliation:
Department of Psychiatry & Behavioral Sciences, Stanford University, USA
Kaidi Cao
Affiliation:
Department of Computer Science, Stanford University, USA
Tengyu Ma
Affiliation:
Department of Computer Science, Stanford University, USA
Vinod Menon
Affiliation:
Department of Psychiatry & Behavioral Sciences, Stanford University, USA; Department of Neurology & Neurological Sciences, Stanford University, USA and Wu Tsai Neurosciences Institute, Stanford University, USA
*
Correspondence: Kaustubh Supekar. Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

Autism spectrum disorder (ASD) is a highly heterogeneous disorder that affects nearly 1 in 189 females and 1 in 42 males. However, the neurobiological basis of gender differences in ASD is poorly understood, as most studies have neglected females and used methods ill-suited to capture such differences.

Aims

To identify robust functional brain organisation markers that distinguish between females and males with ASD and predict symptom severity.

Method

We leveraged multiple neuroimaging cohorts (ASD n = 773) and developed a novel spatiotemporal deep neural network (stDNN), which uses spatiotemporal convolution on functional magnetic resonance imaging data to distinguish between groups.

Results

stDNN achieved consistently high classification accuracy in distinguishing between females and males with ASD. Notably, stDNN trained to distinguish between females and males with ASD could not distinguish between neurotypical females and males, suggesting that there are gender differences in the functional brain organisation in ASD that differ from normative gender differences. Brain features associated with motor, language and visuospatial attentional systems reliably distinguished between females and males with ASD. Crucially, these results were observed in a large multisite cohort and replicated in a fully independent cohort. Furthermore, brain features associated with the motor network's primary motor cortex node predicted the severity of restricted/repetitive behaviours in females but not in males with ASD.

Conclusions

Our replicable findings reveal that the brains of females and males with ASD are functionally organised differently, contributing to their clinical symptoms in distinct ways. They inform the development of gender-specific diagnoses and treatment strategies for ASD, and ultimately advance precision psychiatry.

Type
Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © The Author(s), 2022. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists

Gender differences in autism

Autism spectrum disorder (ASD) is a pervasive and highly heterogeneous neurodevelopmental condition. It is becoming increasingly apparent that systematic disentangling of this high heterogeneity is crucial for developing more precise diagnosis and targeted treatment strategies for ASD. Gender is a key source of heterogeneity in ASD. Indeed, one of the most consistent findings of epidemiological research is that ASD is diagnosed less frequently in females than in males, with a ratio of 1 to 4.Reference Fombonne1 Additionally, converging evidence from behavioural studies suggests that females are less severely affected, especially in the restricted and repetitive behaviours (RRB) symptom domain, than males.Reference Supekar and Menon2 Yet, there is limited research examining the neurobiological differences between females and males with ASD.Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4 Additionally, how gender differences in neurobiology relate to gender differences in the clinical symptomatology of the disorder is also not known.Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4 Such knowledge is critical both for understanding the aetiology of this heterogeneous disorder and for determining neuroprotective mechanisms in females.Reference Lai, Lombardo, Auyeung, Chakrabarti and Baron-Cohen5 These knowledge gaps are partly because extant brain imaging studies have primarily focused on males and neglected females or used mixed samples involving a small number of females,Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4 making it difficult to assess gender-related effects with adequate statistical power. Furthermore, extant studies have relied on conventional univariate approaches that are ill-equipped to capture robust neurobiological gender differences, necessitating the development of new computational approaches.Reference Walsh, Wallace, Gallegos and Braden3

Study aims

The first aim of our study was to determine whether neurobiology, in particular functional brain organisation, differed between females and males with ASD. The number of studies examining gender differences in ASD at the brain level is minimal,Reference Ruigrok and Lai4 and the findings from these studies have been largely inconsistent: some studies have reported gender differences in functional brain organisation in ASD, whereas others have not found any.Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4 Critically, the findings from these studies remain poorly replicated, likely because of the small numbers of participants, especially female participants.Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4

To address this, we examine, to the best of our knowledge, one of the largest functional brain imaging data-sets to date of females and males with ASD obtained from multiple sites across the world—Autism Brain Imaging Data Exchange (ABIDE)Reference Di Martino, Yan, Li, Denio, Castellanos and Alaerts6—along with the data we have collected,Reference Supekar, Ryali, Mistry and Menon7 as well as an independent Child Mind Institute-Health Brain Network (CMI-HBN) cohort,Reference O'Connor, Potler, Kovacs, Xu, Ai and Pellman8 using a novel explainable artificial intelligenceReference Gunning, Stefik, Choi, Miller, Stumpf and Yang9 (XAI)-based framework.

The field of XAI in recent years has been revolutionised by deep neural networks (DNNs).Reference LeCun, Bengio and Hinton10 DNNs, however, have been far less successful in classification/differentiation of groups using functional brain imaging data.Reference Durstewitz, Koppe and Meyer-Lindenberg11 In fact, no study has employed DNNs to differentiate between females and males with ASD using functional brain imaging data.Reference Walsh, Wallace, Gallegos and Braden3,Reference Ruigrok and Lai4 This is because of the many challenges associated with applying DNNs to brain imaging data (see Supplementary Introduction available at https://doi.org/10.1192/bjp.2022.13 for details). To address these challenges, we developed a novel spatiotemporal DNN (stDNN) model, which takes as its input functional magnetic resonance imaging (fMRI) time series data from brain regions of interest and models the underlying dynamic spatiotemporal characteristics of brain activity to differentiate between females with ASD and males with ASD (Fig. 1 and Supplementary Fig. 1).

Fig. 1 Schematic overview of multicomponent explainable artificial intelligence (XAI) framework for discovering neurobiological patterns/fingerprints that distinguish between females and males with autism spectrum disorder (ASD) and predict the severity of clinical symptoms. Key steps include: Steps 1, 2: data extraction; Step 3, 4: classification; Steps 5, 6: feature identification. i.e. predictive feature weights (‘fingerprints’) across brain regions; and Step 7: prediction of clinical symptom severity.

ADI-R, autism diagnostic interview-revised; Avg, average; F, filter; fMRI, functional magnetic resonance imaging; Nc, number of brain regions; Nt, number of time points; ReLU, rectified linear unit; S, stride; stDNN, spatiotemporal deep neural network.

A key idea of our approach is to discover latent spatiotemporal dynamics for classification from brain data without the need for explicit feature engineering. Another novel feature of our stDNN model is the use of a one-hot encoding scheme that addresses multisite heterogeneity in fMRI data that is common to data-sharing consortia such as ABIDE. The one-hot encoding scheme enabled the creation of a single stDNN model that handles heterogeneous data while learning robust representations for simultaneously classifying and identifying robust neurobiologically meaningful features that distinguish females and males with ASD. Yet another novel aspect of our stDNN is its use of a label-distribution-aware margin (LDAM) lossReference Cao, Wei, Gaidon, Arechiga, Ma and H12 during model training. DNNs fare poorly when the data-set suffers from heavy class imbalance, such as in the present case owing to well-known male bias of ASD.Reference Fombonne1 To improve DNN performance in such scenarios, we designed a theoretically principled LDAM loss motivated by minimising a margin-based generalisation bound, which we have previously shown to outperform the conventional cross-entropy loss under class-imbalance conditions.Reference Cao, Wei, Gaidon, Arechiga, Ma and H12

We applied our stDNN model with LDAM loss function to the multisite ABIDEReference Di Martino, Yan, Li, Denio, Castellanos and Alaerts6 combined with StanfordReference Supekar, Ryali, Mistry and Menon7 task-free fMRI data. We hypothesised that stDNN would be able to accurately distinguish between females and males with ASD in the ABIDE/Stanford cohort.

To address growing concerns about reproducibility in neuroscience, we next applied our stDNN model with LDAM loss to CMI-HBN cohort task-free fMRI data.Reference O'Connor, Potler, Kovacs, Xu, Ai and Pellman8 It should be noted that the CMI-HBN cohort data was not used for training the stDNN model, and therefore it is a fully independent data-set for demonstrating the generalisability of the stDNN ASD gender classification model. This is a crucial step in which most approaches are widely known to fail.Reference Durstewitz, Koppe and Meyer-Lindenberg11

We hypothesised that stDNN trained on ABIDE/Stanford cohort would be able to accurately distinguish between females and males with ASD in the fully independent CMI-HBN cohort. To determine the specificity of gender differences in functional brain organisation in ASD, we assessed whether the stDNN model trained to distinguish between females and males with ASD could also distinguish between neurotypical females and neurotypical males. We further hypothesised that the stDNN ASD gender classification model would not be able to accurately distinguish between neurotypical females and neurotypical males, reflecting unique patterns of gender differences in ASD.Reference Supekar and Menon2

The second aim of our study was to determine which aspects/features of functional brain organisation differed between females and males with ASD. Conventional DNN approaches are black box models, which provide no insight into which brain features are important for classification, nor whether the features are neurobiologically interpretable in the context of previous research of gender differences in ASD.Reference Durstewitz, Koppe and Meyer-Lindenberg11 We address this gap by using an integrated gradients methodReference Sundararajan, Taly and Yan13 for identifying neurobiologically meaningful features that distinguish between females and males with ASD. This method ranks brain features that distinguish between females and males with ASD. We hypothesised that integrated gradients would reveal functional organisation patterns that are different between females and males with ASD in multiple brain areas, particularly those belonging to the motor and language networks.Reference Supekar and Menon2 We further predicted that the patterns of ASD gender differences in functional brain organisation would differ from the normative/typical gender difference patterns.Reference Supekar and Menon2

The third aim of our study was to examine the relationship between the functional brain organisation patterns that differ in females and males with ASD and their symptom severity. To our knowledge, no previous study has examined functional brain features that robustly predict clinical symptoms in females and males with ASD separately without using feature engineering. We hypothesised that the brains of females and males with ASD would be functionally organised in ways that contribute differently to their clinical symptoms.Reference Supekar and Menon2

Method

Participants

ABIDE

We leveraged neuroimaging and phenotypic data from ABIDEReference Di Martino, Yan, Li, Denio, Castellanos and Alaerts6 (Supplementary Table 1, Supplementary Fig. 2, see Supplementary Methods for details).

Stanford

An independent cohort of participants recruited and scanned at Stanford UniversityReference Supekar, Ryali, Mistry and Menon7 was used to further increase the number of females with ASD in our sample (Supplementary Table 1, Supplementary Fig. 3, see Supplementary Methods for details).

Written informed consent was obtained from the participant's legal guardian. The study protocol was approved by the Stanford University Institutional Review Board. Specifically, the ABIDE data was combined with the Stanford data to form the ABIDE/Stanford cohort, which served as the primary cohort.

CMI-HBN

An independent cohort of participants from CMI-HBNReference O'Connor, Potler, Kovacs, Xu, Ai and Pellman8 was used to demonstrate the robustness of our findings. (Supplementary Table 2, Supplementary Fig. 4, see Supplementary Methods for details).

stDNN model

We developed an innovative stDNN model to extract informative functional brain dynamics features that accurately distinguish between females and males with ASD (see Supplementary Methods for details). Briefly, our stDNN model consists of two 1D-convolutional block layers, a ‘temporal averaging’ operation, and then a sigmoid output layer (Supplementary Fig. 1). Pre-processed regional fMRI time series from 246 brain regions defined in the Brainnetome atlas were given as input to the first 1D-convolutional block layer. To account for site-related heterogeneity, site information encoded with a one-hot encoding scheme was given as an input to the final layer. stDNN classified participants in the two groups by minimising a LDAM loss function.

Fivefold cross-validation ASD gender classification analysis of ABIDE/Stanford cohort data

To prevent bias and account for low variance, we conducted a fivefold cross-validation to evaluate the performance (accuracy, precision, recall, and the harmonic mean of precision and recall (F1)) of our stDNN model in classifying ASD females versus ASD males (Fig. 2; see Supplementary Methods for details).

Fig. 2 Fivefold cross-validation procedure for testing and validation of females with autism spectrum disorder (ASD) versus males with ASD classification using the ABIDE/Stanford cohort. The five models are then used for independently testing females with ASD versus males with ASD classification in the Child Mind Institute-Health Brain Network (CMI-HBN) cohort.

Note that these models are not trained on the CMI-HBN cohort. ADI-R, autism diagnostic interview-revised; Avg, average; CV, cross-validation.

ASD gender classification analysis of CMI-HBN cohort data using fivefold ABIDE/Stanford cohort ASD gender classification models

For reporting the performance of our stDNN for the CMI-HBN cohort, we used each of the five stDNN models trained on different subsets of the ABIDE/Stanford cohort (Fig. 2; see Supplementary Methods for details).

Neurotypical gender classification analysis of ABIDE/Stanford cohort data using fivefold ABIDE/Stanford cohort ASD gender classification models

To examine the specificity of our stDNN ASD gender classification model, we investigated whether the stDNN model trained to distinguish between females with ASD and males with ASD can distinguish between neurotypical females and neurotypical males in the ABIDE/Stanford cohort (see Supplementary Methods for details).

Fivefold cross-validation neurotypical gender classification analysis of ABIDE/Stanford cohort data

We conducted a fivefold cross-validation to evaluate the performance (accuracy, precision, recall, F1) of our de novo trained stDNN model in classifying neurotypical females versus neurotypical males (see Supplementary Methods for details).

Identifying brain features underlying ASD gender classification

We used an integrated gradients-based feature attribution approachReference Sundararajan, Taly and Yan13 (see Supplementary Methods for details) to identify brain features that discriminated between females with ASD and males with ASD.

Clinical symptom prediction in females and males with ASD

We investigated the relationship between stDNN-identified neurobiological features (that distinguished between females and males with ASD) with the severity of clinical symptoms in females with ASD and males with ASD separately. Spearman correlations between the autism diagnostic interview-revised (ADI-R)Reference Lord, Rutter and Le Couteur14 domain scores and the brain features derived from each of the five stDNN models were computed (see Supplementary Methods for details).

Control analyses

We performed several control analyses to demonstrate that our findings are robust to head motion-related confounds (see Supplementary Methods for details).

Results

Classification of ASD females versus ASD males in the ABIDE/Stanford cohort

We first trained our stDNN on the multisite ABIDE cohort data combined with data we acquired at Stanford (ASD cohort n = 678) (Supplementary Table 1). To assess the performance of our stDNN model, we used a fivefold cross-validation procedure in which 80% of the sample was used for training and the other 20% of the sample was used for validation (Fig. 2). stDNN achieved an average accuracy of 86.0% (s.d. = 1.65%) across the five folds, and an average precision of 0.86 (s.d. = 0.02), recall of 0.86 (s.d. = 0.02) and F1 score of 0.83 (s.d. = 0.02) (Supplementary Table 3). Additional analyses confirmed that the observed results were robust to potential confounds such as head motion (see Supplementary Results for details). These results demonstrate that stDNN can accurately distinguish females with ASD from males with ASD in a multisite cohort, and, furthermore, does so in a robust and consistent manner across cross-validation folds.

Classification of ASD females versus ASD males in an independent CMI-HBN cohort

We then evaluated the performance of our stDNN model on an independent cohort of females with ASD and males with ASD obtained from CMI-HBN (ASD cohort n = 95) (Supplementary Table 2). Importantly, the stDNN was not trained on the CMI-HBN data. We evaluated five models corresponding to each of the folds in the cross-validation as described above (Fig. 2). stDNN achieved an average accuracy of 83.4% (s.d. = 3.67%) across the five folds, and an average precision of 0.85 (s.d. = 0.01), recall of 0.83 (s.d. = 0.04) and F1 score of 0.84 (s.d. = 0.02) (Supplementary Table 4). These results demonstrate that stDNN can accurately distinguish females with ASD from males with ASD in an independent cohort without additional training.

Classification of neurotypical females versus neurotypical males

To examine the specificity of our stDNN ASD gender classification model, we investigated whether the stDNN model trained to distinguish between females with ASD and males with ASD can distinguish between neurotypical females and neurotypical males in the ABIDE/Stanford cohort (neurotypical cohort n = 976) (Supplementary Table 1). For the neurotypical females versus neurotypical males classification, the stDNN model trained on the ABIDE/Stanford ASD data achieved an accuracy of 66.7% (s.d. = 0.75%) across the five folds, and an average precision of 0.64 (s.d. = 0.01), recall of 0.67 (s.d. = 0.01) and F1 score of 0.60 (s.d. = 0.02) (Supplementary Table 5).

These classification metric values were much lower than those obtained by a de novo trained stDNN model on ABIDE/Stanford neurotypical data, which achieved an accuracy of 77.8% (s.d. = 0.38%), across the five folds, and an average precision of 0.78 (s.d. = 0.01), recall of 0.77 (s.d. = 0.01) and F1 score of 0.78 (s.d. = 0.02) (Supplementary Table 6).

These results point to a unique pattern of gender differences in ASD.

Identification of brain features underlying ASD gender classification in the ABIDE/Stanford cohort

We then used an integrated gradients procedureReference Sundararajan, Taly and Yan13 to compute the feature attributes underlying the ASD female class label in the ABIDE/Stanford cohort. This analysis yields a measure of feature strength associated with females with ASD versus males with ASD classification in each brain region and at each time point. The integrated gradients procedure was applied to the stDNN model that is trained to distinguish between females with ASD and males with ASD using ASD data from the ABIDE/Stanford cohort. This procedure also identifies an individual fingerprint of predictive features in each participant (Fig. 3, see Supplementary Results for details).

Fig. 3 (a) t-distributed stochastic neighbour embedding (tSNE) plot of spatiotemporal deep neural network (stDNN)-derived individual feature attribution maps/fingerprints of 30 representative females with ASD and 30 representative males with ASD from the ABIDE/Stanford cohort, demonstrating the clustering of females with ASD and males with ASD. (b) stDNN-derived individual feature attribution maps/fingerprints in three females with ASD from the ABIDE/Stanford cohort. (c) tSNE plot of stDNN-derived individual feature attribution maps/fingerprints of 10 representative females with ASD and 30 males with ASD from the Child Mind Institute-Health Brain Network (CMI-HBN) cohort, demonstrating the clustering of females with ASD and males with ASD. (d) stDNN-derived individual feature attribution maps/fingerprints in three females with ASD from the CMI-HBN cohort.

To identify brain areas that contributed the most to classification, we computed the median of feature scores across the five folds and thresholded them – top 5% of features – based on the distribution of feature scores across all time points and regions. This resulted in the identification of a distributed set of brain areas including the primary motor cortex, supplementary motor area, parietal and lateral occipital cortex, and middle and superior temporal gyri as brain areas that contribute most significantly to predicting the ASD female class label (Fig. 4 and Supplementary Table 7). These brain areas were distinct from those that contributed most significantly to predicting the neurotypical female class label (see Supplementary Results for details).

Fig. 4 (a) Feature attribution map showing the top 5% features that underlie females with ASD versus males with autism spectrum disorder (ASD) classification in the ABIDE/Stanford cohort. Spatiotemporal deep neural network (stDNN) with integrated gradients identified brain features that distinguish females with ASD from males with ASD. The algorithm automatically identified distinguishing features in the primary motor cortex and the supplementary motor area, which anchor the motor network, middle and superior temporal gyri, which anchor the language network, as well as the visuospatial attentional system (see Supplementary Table 7 for a detailed listing of brain areas and predictive feature weights). (b) Visualisation of (unthresholded) feature weights across the whole brain in the ABIDE/Stanford cohort. (c) Feature attribution map showing the top 5% features showing replication of predictive motor network, language network, and visuospatial attention features in the Child Mind Institute-Health Brain Network (CMI-HBN) cohort (see Supplementary Table 8 for a detailed listing of brain areas and predictive feature weights). (d) Visualisation of (unthresholded) feature weights across the whole brain in the CMI-HBN cohort.

Additional analyses confirmed that the observed results were robust to potential confounds such as head motion (see Supplementary Results for details). These results demonstrate that stDNN together with integrated gradients procedures automatically identifies discriminating features without the need for ad hoc feature engineering procedures.

Identification of brain features underlying ASD gender classification in the CMI-HBN cohort

We then used the same procedures as described in the previous section to determine predictive feature attributes in each female participant with ASD in the CMI-HBN cohort. This analysis revealed individualised brain ‘fingerprints’ (Fig. 3, see Supplementary Results for details), and identified the primary motor cortex, supplementary motor area, parietal and lateral occipital cortex, and middle and superior temporal gyri as the brain areas that contributed most significantly to predicting the ASD female class label (Fig. 4 and Supplementary Table 8).

These results demonstrate that stDNN together with integrated gradients procedures automatically identifies similar discriminating features as in the ABIDE/Stanford cohort, again without the need for ad hoc feature engineering procedures.

Predicting clinical symptoms using brain features

We investigated whether stDNN-identified brain features could predict the severity of clinical symptoms in females and males with ASD. The primary motor cortex was the only brain region whose features predicted ADI-R RRB scores (P < 0.01; false discovery rate-corrected) in females with ASD. No such relationship was observed in males with ASD or for the social and communication domains in either females or males with ASD, demonstrating the specificity of findings related to RRB phenotypic features in females with ASD.

Discussion

Main findings

By using one of the largest functional brain imaging cohorts of females and males with ASD and leveraging exciting recent advances in XAI, we examined neurobiological gender differences in ASD. To our knowledge, this is the first use of a XAI-based approach for uncovering robust neurobiological gender differences in ASD. Our XAI-based approach is also a significant advance over previous approaches to find gender differences in ASD using functional brain imaging data (see Supplementary Discussion for details). Our novel XAI-based stDNN model, which uses spatiotemporal convolution on fMRI data to distinguish between groups, achieved consistently high classification accuracy in distinguishing between females and males with ASD. Notably, the stDNN model trained to distinguish between females and males with ASD could not distinguish between neurotypical females and males, suggesting that there are gender differences in the functional brain organisation in ASD and these gender differences are different from normative gender differences.

Brain features associated with motor, language and visuospatial attentional systems reliably distinguished females with ASD from males with ASD. Crucially, these results were observed in the large multisite ABIDE/Stanford cohort and replicated in a fully independent CMI-HBN cohort. Furthermore, brain features associated with the primary motor cortex node of the motor network emerged as a robust predictor of the severity of RRBs in females with ASD but not in males with ASD. Taken together, these results, elaborated below, provide novel and robust insights into the neurobiology of gender differences in ASD and their relation to the core clinical symptoms of the disorder.

Interpretation of our findings

The first key finding of our study is that females with ASD have a functional brain organisation that differs significantly from males with ASD. Gender differences in functional brain organisation in ASD reported to date have been mixed and, to the best of our knowledge, no studies have attempted model-based validation and replication of findings. stDNN allowed us to perform cross-validation analysis, a powerful approach for validating research findings, and its use for demonstrating generalisation and reproducibility is now increasingly advocated in psychiatry.Reference Bzdok and Meyer-Lindenberg15 Notably, stDNN also allowed us to develop a model based on one data-set (ABIDE/Stanford) and test it on another ‘independent’ data-set (CMI-HBN) without further training. This is a crucial step in which most approaches in other domains are widely known to fail.Reference Bzdok and Meyer-Lindenberg15

Our stDNN model learned functional brain organisation patterns that could distinguish between females and males with ASD with a high cross-validation classification accuracy in the multisite ABIDE/Stanford cohort, despite the considerable heterogeneity in data acquisition protocols and a wide range in age (mean age = 13.2 years, s.d. = 5.9) and symptom profiles. Notably, stDNN achieved a high classification accuracy in an independent CMI-HBN cohort (mean age = 11.8 years, s.d. = 3.9) that was not used in the training of stDNN. These results further demonstrate robust gender differences in functional brain organisation in ASD.

stDNN also enabled us to seamlessly determine whether functional brain patterns that distinguished between females and males with ASD could also classify by gender in data from neurotypical peers. We found that the stDNN model trained to distinguish between females and males with ASD could not distinguish between neurotypical females and males. These results point to unique neurofunctional patterns of gender differences in ASD.

The second main finding of our study is the identification of functional brain features that distinguish between females and males with ASD. Our stDNN-based integrated gradients analysis identified the primary motor cortex and supplementary motor area, which anchor the motor network, as brain areas whose dynamical functional properties most clearly distinguished between females and males with ASD in both cohorts. Aberrancies in the extended motor network have been consistently reported in ASD, when compared with neurotypical individuals.Reference Floris and Howells16 An open unaddressed question is whether these same brain areas also show gender-specific differentiation, which our findings help resolve in a robust manner across multiple cohorts. This question is important because aberrancies in key nodes of the motor network and their dynamic functional interactions have been linked to fine and gross motor deficits in ASD,Reference Floris and Howells16 and there is increasing evidence for gender differences in motor deficits in ASD.Reference Uljarevic, Jo, Frazier, Scahill, Youngstrom and Hardan17

Previous studies have reported ASD-related gender differences in grey matter morphometry of the motor network, albeit using small sample sizes.Reference Supekar and Menon2 Our findings, using a large sample of females and males with ASD, extend these results by providing novel and robust evidence that the functional brain organisation of the motor system, which has been consistently shown to differ between ASD and their neurotypical peers, is also different between females and males with ASD.

In both cohorts, our analysis also identified bilateral middle and superior temporal gyri, which anchor the language system, as brain areas whose features clearly distinguished between females and males with ASD. Impairments in temporal cortex areas associated with language processing are a prominent feature of ASD.Reference Lord, Brugha, Charman, Cusack, Dumas and Frazier18,Reference Ecker, Bookheimer and Murphy19 Language systems anchored in the middle and superior temporal gyri facilitate speech processing and semantic comprehension, processes known to be impaired in ASD.Reference Tager-Flusberg20

Surprisingly, our analysis also identified the dorsal parietal cortex as a brain area whose features distinguished between females and males with ASD in both cohorts. Specific loci included the superior parietal lobule and the adjoining posterior human intraparietal area 3 (hIP3) subdivision of the intraparietal sulcus, which play a crucial role in visuospatial attention.Reference Uddin, Supekar, Amin, Rykhlevskaia, Nguyen and Greicius21,Reference Corbetta and Shulman22 Moreover, these parietal areas, encompassing the dorsal visual stream pathway, have strong connections with the lateral occipital gyrusReference Uddin, Supekar, Amin, Rykhlevskaia, Nguyen and Greicius21 whose features also distinguished between females and males with ASD. Together, these regions constitute key elements of the dorsal and ventral visual pathways involved in attending to the location of objects in space.Reference Milner and Goodale23 This finding of gender-related differences is noteworthy because of conflicting evidence in the extant literature about co-occurring parietal and lateral occipital cortex impairments in ASD.Reference Lord, Brugha, Charman, Cusack, Dumas and Frazier18,Reference Ecker, Bookheimer and Murphy19

Taken together, these results identify gender differences in motor and language systems that are known to be impaired in the disorder as well as dorsal parietal and lateral occipital cortex regions that have not been reported previously in the literature as being affected in ASD. Interestingly, although default mode network and salience network aberrancies have been consistently reported in ASD,Reference Padmanabhan, Lynch, Schaer and Menon24,Reference Uddin, Supekar, Lynch, Khouzam, Phillips and Feinstein25 gender differences were not reliably observed in these regions, suggesting that aberrancies in the default mode network and salience network may be common to females and males with ASD. More broadly, our findings suggest that brain characteristics of gender differences in ASD overlap only partly with overall brain aberrancies in ASD, emphasising the convergent and distinct underlying mechanisms of gender differences in the disorder.

These observations parallel findings from neuroanatomical studies that suggest that the overall ASD neuroanatomy in females and males does not simply differ quantitatively in the same brain regions/circuitries but also differs qualitatively.Reference Hammill, Lerch, Taylor, Ameis, Chakravarty and Szatmari26 The extent to which abnormalities in the brain systems identified in the present study differentially have an impact on the acquisition of motor, visuospatial and social communication skills in females and males with ASD remains to be investigated.

A third important finding of our study is that we found that the primary motor cortex node of the motor network was the only brain area whose dynamic functional circuitry predicted scores on the RRB domain of the ADI-R. They were not related to the scores on the social and communication scores of the ADI-R, indicating domain-specific effects associated with RRBs – a core clinical phenotype of ASD that has been most consistently reported to differ between genders.Reference Supekar and Menon2 Surprisingly, these relationships were observed in females, but not in males, with ASD. The neurofunctional mechanisms underlying the heterogeneity of RRB symptoms in males with ASD remain to be investigated. A potential avenue for investigation might be to examine the relationship between RRBs in males with ASD and the functional organisation of other components of the motor network, including the basal ganglia and cerebellum, which we recently found to be predictive of repetitive motor behaviours in a predominantly male ASD sample.Reference Supekar, Ryali, Mistry and Menon7

Implications

Our findings reveal that the brains of females and males with ASD are functionally organised differently, contributing to their clinical symptoms in distinct ways. Our discovery of robust neurobiological gender differences in ASD psychopathology has the potential to transform our understanding of the diverse aetiologies of the disorder, as well as inform the development of gender-specific diagnosis and treatment strategies. Our approach, in general, provides new XAI-based tools for investigating the robust neurobiological bases of psychiatric disorders and the accompanying clinical symptoms, with the potential to inform precision psychiatry.

Supplementary material

To view supplementary material for this article, please visit http://doi.org/10.1192/bjp.2022.13

Data availability

Data that support the findings of this study are openly available in ABIDE and CMI-HBN. The Stanford cohort data examined in the study are available from the corresponding author, K.S., upon reasonable request.

Acknowledgments

We greatly appreciate the contributions of the children and their parents as well as the ABIDE and CMI-HBN initiatives without which this work would not be possible.

Author contributions

K.S.: conceived and designed the study, performed the data analysis, interpreted the findings and wrote the manuscript. C.d.l.A.: assisted with data analysis. S.R.: designed the stDNN model. K.C. and T.M.: contributed LDAM methods for data analysis. V.M.: conceived and designed the study, supervised the acquisition of Stanford cohort data, interpreted the findings and critically edited the manuscript.

Funding

This work was supported by a NARSAD Young Investigator Award (K.S.), a Stanford Innovator Award (K.S.), and grants from the Stanford Maternal and Child Health Research Institute through the Transdisciplinary Initiatives Program and the Taube Maternal and Child Health Research Fund as well as the Uytengsu-Hamilton 22q11 Neuropsychiatry Research Program (K.S., V.M.) and by grants from the National Institutes of Health (K.S., AG072114), (V.M., MH084164), (V.M., MH121069), and a Google Faculty Award (T.M.), Sloan Fellowship (T.M.), and grants from JD.com (T.M.) and the National Science Foundation (T.M., IIS 2045685). K.S. is a Taube Family Endowed Transdisciplinary Investigator for Maternal Child Health.

Declaration of interest

T.M. reports grant support from JD.com, Toyota Research Institute, Google and NSF IIS 2045685 during the conduct of this study. The other authors have nothing to disclose. All authors report no biomedical financial interests or potential conflicts of interest.

References

Fombonne, E. Epidemiology of pervasive developmental disorders. Pediatr Res 2009; 65: 591–8.10.1203/PDR.0b013e31819e7203CrossRefGoogle ScholarPubMed
Supekar, K, Menon, V. Sex differences in structural organization of motor systems and their dissociable links with repetitive/restricted behaviors in children with autism. Mol Autism 2015; 6: 50.10.1186/s13229-015-0042-zCrossRefGoogle ScholarPubMed
Walsh, MJM, Wallace, GL, Gallegos, SM, Braden, BB. Brain-based sex differences in autism spectrum disorder across the lifespan: a systematic review of structural MRI, fMRI, and DTI findings. Neuroimage Clin 2021; 31: 102719.10.1016/j.nicl.2021.102719CrossRefGoogle ScholarPubMed
Ruigrok, ANV, Lai, MC. Sex/gender differences in neurology and psychiatry: autism. Handb Clin Neurol 2020; 175: 283–97.10.1016/B978-0-444-64123-6.00020-5CrossRefGoogle ScholarPubMed
Lai, MC, Lombardo, MV, Auyeung, B, Chakrabarti, B, Baron-Cohen, S. Sex/gender differences and autism: setting the scene for future research. J Am Acad Child Adolesc Psychiatry 2015; 54: 1124.10.1016/j.jaac.2014.10.003CrossRefGoogle ScholarPubMed
Di Martino, A, Yan, CG, Li, Q, Denio, E, Castellanos, FX, Alaerts, K, et al. The autism brain imaging data exchange: towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol Psychiatry 2014; 19: 659–67.10.1038/mp.2013.78CrossRefGoogle ScholarPubMed
Supekar, K, Ryali, S, Mistry, P, Menon, V. Aberrant dynamics of cognitive control and motor circuits predict distinct restricted and repetitive behaviors in children with autism. Nat Commun 2021; 12: 3537.10.1038/s41467-021-23822-5CrossRefGoogle ScholarPubMed
O'Connor, D, Potler, NV, Kovacs, M, Xu, T, Ai, L, Pellman, J, et al. The Healthy Brain Network Serial Scanning Initiative: a resource for evaluating inter-individual differences and their reliabilities across scan conditions and sessions. Gigascience 2017; 6: 114.Google ScholarPubMed
Gunning, D, Stefik, M, Choi, J, Miller, T, Stumpf, S, Yang, G-Z. XAI—Explainable artificial intelligence. Sci Rob 2019; 4(37): eaay7120Google ScholarPubMed
LeCun, Y, Bengio, Y, Hinton, G. Deep learning. Nature 2015; 521: 436–44.10.1038/nature14539CrossRefGoogle ScholarPubMed
Durstewitz, D, Koppe, G, Meyer-Lindenberg, A. Deep neural networks in psychiatry. Mol Psychiatry 2019; 24: 1583–98.10.1038/s41380-019-0365-9CrossRefGoogle Scholar
Cao, K, Wei, C, Gaidon, A, Arechiga, N, Ma, T. Learning imbalanced datasets with label-distribution-aware margin loss. Advances in Neural Information Processing Systems 32 (ed. H, Wallach, et al. ). Curran Associates, Inc., 2019.Google Scholar
Sundararajan, M, Taly, A, Yan, Q. Axiomatic attribution for deep networks. In International Conference on Machine Learning 2017; 33193328.Google Scholar
Lord, C, Rutter, M, Le Couteur, A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord 1994; 24(5): 659–85.10.1007/BF02172145CrossRefGoogle ScholarPubMed
Bzdok, D, Meyer-Lindenberg, A. Machine learning for precision psychiatry: opportunities and challenges. Biol Psychiatry Cogn Neurosci Neuroimaging 2018; 3: 223–30.Google ScholarPubMed
Floris, DL, Howells, H. Atypical structural and functional motor networks in autism. Prog Brain Res 2018; 238: 207–48.10.1016/bs.pbr.2018.06.010CrossRefGoogle ScholarPubMed
Uljarevic, M, Jo, B, Frazier, TW, Scahill, L, Youngstrom, EA, Hardan, AY. Using the big data approach to clarify the structure of restricted and repetitive behaviors across the most commonly used autism spectrum disorder measures. Mol Autism 2021; 12: 39.10.1186/s13229-021-00419-9CrossRefGoogle ScholarPubMed
Lord, C, Brugha, TS, Charman, T, Cusack, J, Dumas, G, Frazier, T, et al. Autism spectrum disorder. Nat Rev Dis Primers 2020; 6: 5.10.1038/s41572-019-0138-4CrossRefGoogle ScholarPubMed
Ecker, C, Bookheimer, SY, Murphy, DG. Neuroimaging in autism spectrum disorder: brain structure and function across the lifespan. Lancet Neurol 2015; 14: 1121–34.10.1016/S1474-4422(15)00050-2CrossRefGoogle ScholarPubMed
Tager-Flusberg, H. Defining language phenotypes in autism. Clin Neurosci Res 2006; 6: 219–24.10.1016/j.cnr.2006.06.007CrossRefGoogle Scholar
Uddin, LQ, Supekar, K, Amin, H, Rykhlevskaia, E, Nguyen, DA, Greicius, MD, et al. Dissociable connectivity within human angular gyrus and intraparietal sulcus: evidence from functional and structural connectivity. Cereb Cortex 2010; 20: 2636–46.10.1093/cercor/bhq011CrossRefGoogle ScholarPubMed
Corbetta, M, Shulman, GL. Spatial neglect and attention networks. Annu Rev Neurosci 2011; 34: 569–99.10.1146/annurev-neuro-061010-113731CrossRefGoogle ScholarPubMed
Milner, AD, Goodale, MA. Two visual systems re-viewed. Neuropsychologia 2008; 46: 774–85.10.1016/j.neuropsychologia.2007.10.005CrossRefGoogle ScholarPubMed
Padmanabhan, A, Lynch, CJ, Schaer, M, Menon, V. The default mode network in autism. Biol Psychiatry Cogn Neurosci Neuroimaging 2017; 2: 476–86.Google ScholarPubMed
Uddin, LQ, Supekar, K, Lynch, CJ, Khouzam, A, Phillips, J, Feinstein, C, et al. Salience network-based classification and prediction of symptom severity in children with autism. JAMA Psychiatry 2013; 70: 869–79.10.1001/jamapsychiatry.2013.104CrossRefGoogle ScholarPubMed
Hammill, C, Lerch, JP, Taylor, MJ, Ameis, SH, Chakravarty, MM, Szatmari, P, et al. Quantitative and qualitative sex modulations in the brain anatomy of autism. Biol Psychiatry Cogn Neurosci Neuroimaging 2021; 6: 898909.Google ScholarPubMed
Figure 0

Fig. 1 Schematic overview of multicomponent explainable artificial intelligence (XAI) framework for discovering neurobiological patterns/fingerprints that distinguish between females and males with autism spectrum disorder (ASD) and predict the severity of clinical symptoms. Key steps include: Steps 1, 2: data extraction; Step 3, 4: classification; Steps 5, 6: feature identification. i.e. predictive feature weights (‘fingerprints’) across brain regions; and Step 7: prediction of clinical symptom severity.ADI-R, autism diagnostic interview-revised; Avg, average; F, filter; fMRI, functional magnetic resonance imaging; Nc, number of brain regions; Nt, number of time points; ReLU, rectified linear unit; S, stride; stDNN, spatiotemporal deep neural network.

Figure 1

Fig. 2 Fivefold cross-validation procedure for testing and validation of females with autism spectrum disorder (ASD) versus males with ASD classification using the ABIDE/Stanford cohort. The five models are then used for independently testing females with ASD versus males with ASD classification in the Child Mind Institute-Health Brain Network (CMI-HBN) cohort.Note that these models are not trained on the CMI-HBN cohort. ADI-R, autism diagnostic interview-revised; Avg, average; CV, cross-validation.

Figure 2

Fig. 3 (a) t-distributed stochastic neighbour embedding (tSNE) plot of spatiotemporal deep neural network (stDNN)-derived individual feature attribution maps/fingerprints of 30 representative females with ASD and 30 representative males with ASD from the ABIDE/Stanford cohort, demonstrating the clustering of females with ASD and males with ASD. (b) stDNN-derived individual feature attribution maps/fingerprints in three females with ASD from the ABIDE/Stanford cohort. (c) tSNE plot of stDNN-derived individual feature attribution maps/fingerprints of 10 representative females with ASD and 30 males with ASD from the Child Mind Institute-Health Brain Network (CMI-HBN) cohort, demonstrating the clustering of females with ASD and males with ASD. (d) stDNN-derived individual feature attribution maps/fingerprints in three females with ASD from the CMI-HBN cohort.

Figure 3

Fig. 4 (a) Feature attribution map showing the top 5% features that underlie females with ASD versus males with autism spectrum disorder (ASD) classification in the ABIDE/Stanford cohort. Spatiotemporal deep neural network (stDNN) with integrated gradients identified brain features that distinguish females with ASD from males with ASD. The algorithm automatically identified distinguishing features in the primary motor cortex and the supplementary motor area, which anchor the motor network, middle and superior temporal gyri, which anchor the language network, as well as the visuospatial attentional system (see Supplementary Table 7 for a detailed listing of brain areas and predictive feature weights). (b) Visualisation of (unthresholded) feature weights across the whole brain in the ABIDE/Stanford cohort. (c) Feature attribution map showing the top 5% features showing replication of predictive motor network, language network, and visuospatial attention features in the Child Mind Institute-Health Brain Network (CMI-HBN) cohort (see Supplementary Table 8 for a detailed listing of brain areas and predictive feature weights). (d) Visualisation of (unthresholded) feature weights across the whole brain in the CMI-HBN cohort.

Supplementary material: File

Supekar et al. supplementary material

Supekar et al. supplementary material

Download Supekar et al. supplementary material(File)
File 1.1 MB
Submit a response

eLetters

No eLetters have been published for this article.