Hostname: page-component-cd9895bd7-lnqnp Total loading time: 0 Render date: 2024-12-26T13:35:07.833Z Has data issue: false hasContentIssue false

Psychometric concerns with the 10-item Autism-Spectrum Quotient (AQ10) as a measure of trait autism in the general population

Subject: Psychology and Psychiatry

Published online by Cambridge University Press:  05 March 2020

Emily C. Taylor
Affiliation:
Department of Psychology, University of Bath, Bath, BA2 7AY, United Kingdom
Lucy A. Livingston
Affiliation:
Social, Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, SE5 8AF, United Kingdom
Rachel A. Clutterbuck
Affiliation:
Department of Psychology, University of Bath, Bath, BA2 7AY, United Kingdom
Punit Shah*
Affiliation:
Department of Psychology, University of Bath, Bath, BA2 7AY, United Kingdom
*
*Corresponding author: E-mail: [email protected]

Abstract

The 10-item Autism-Spectrum Quotient (AQ10) is a self-report questionnaire used in clinical and research settings as a diagnostic screening tool for autism in adults. The AQ10 is also increasingly being used to quantify trait autism along a unitary dimension and correlated against performance on other psychological/medical tasks. However, its psychometric properties have yet to be examined when used in this way. By analysing AQ10 data from a large non-clinical sample of adults (n = 6,595), we found that the AQ10 does not have a unifactorial factor structure, and instead appears to have several factors. The AQ10 also had poor internal reliability. Taken together, whilst the AQ10 has important clinical utility in screening for diagnosable autism, it may not be a psychometrically robust measure when administered in non-clinical samples from the general population. Therefore, we caution against its use as a measure of trait autism in future research.

Type
Research Article
Information
Result type: Supplementary result
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© The Author(s) 2020

Introduction

Autism-Spectrum Quotient (AQ) tools, widely used in psychiatry and psychology, exist in several long and short forms. The 10-item AQ (AQ10; Allison et al., Reference Allison, Auyeung and Baron-Cohen2012) is the shortest and recommended by the National Institute for Health and Care Excellence as a screening tool for autism in adults (National Institute for Health and Care Excellence, 2012) as it is sensitive to diagnosable autism. It is widely used in research and clinical practice to this end, and therefore it is crucial that the psychometric properties of this measure are robust and continually evaluated when used in new contexts and (clinical) populations. Recently, there has been an increased use of the AQ10 in large-scale studies to measure autistic traits in the general population. Specifically, overall AQ10 scores are being used to quantify the number of autistic traits/tendencies self-reported by an individual, and then correlated with their performance on other tasks (e.g., social psychological skill [Gollwitzer et al., Reference Gollwitzer, Martel, McPartland and Bargh2019]).

Objective

In such research, it is assumed that the AQ10 measures a unitary construct, i.e., trait autism, yet its unifactorial structure was neither tested when the measure was developed, nor following its administration in recent research. There are also concerns regarding its reliability when administered in non-clinical samples (e.g., Jia et al., Reference Jia, Steelman and Jia2019). Therefore, we examined the AQ10’s factor structure and internal reliability, supplementing the original article on its development (Allison et al., Reference Allison, Auyeung and Baron-Cohen2012) and Gollwitzer et al.’s (Reference Gollwitzer, Martel, McPartland and Bargh2019) recent research that used the AQ10 as a measure of trait autism in the general population.

Methods

Using Gollwitzer et al.’s (Reference Gollwitzer, Martel, McPartland and Bargh2019) openly accessible data (Gollwitzer, Reference Gollwitzer2019) – comprising a very large sample of adults (n = 6,595) that had completed the AQ10 in addition to other measures – the following analyses were performed. First, confirmatory factor analysis, with maximum-likelihood estimation, tested whether a 1-factor (i.e., unifactorial) solution was a good fit to the questionnaire data. This was the critical test of whether the AQ10 is a unitary measure of trait autism. Second, parallel analysis, with oblique Promax rotation, explored if there was more than one factor present in the questionnaire data. Finally, we used several approaches to quantify the internal reliability of the AQ10. Together, we conducted this study to examine the psychometric properties of the AQ10 specifically as a measure of trait autism in the general population.

Results

The confirmatory factor analysis indices indicated that a unifactorial model poorly fit the data, with all metrics failing to meet recommended guidelines (see Hooper et al., Reference Hooper, Coughlan and Mullen2008) for ‘good’ model fit (Table 1).

Table 1. Factor Analysis Fit Indices for AQ10.

Conversely, parallel analysis showed that a four-factor solution (Table 2 and Figure 1) was more appropriate, with fit indices indicating good model fit (see Table 1).

Table 2. Parallel Analysis Item Loadings of AQ10 Items.

Note. Table shows item loadings of ten items. (R) denotes items that are reverse scored. Item loadings greater than 0.4 are presented in bold.

Figure 1. Scree Plot for Parallel Analysis of AQ10, which suggests that a 4-factor solution was the best fit to the data (Produced using JASP 0.11.1).

Finally, the AQ10 had poor internal reliability, with all metrics <0.7, which was unsurprising given the weak interitem correlations between the questions (Table 3).

Table 3. AQ10 Reliability Statistics.

Discussions

The results suggest that the AQ10 does not have a unifactorial structure. Rather, it appears to have multiple factors, likely because its items were drawn from 5 different subscales of the full AQ (Baron-Cohen et al., Reference Baron-Cohen, Wheelwright, Skinner, Martin and Clubley2001). Therefore, its factor structure neither reflects autism conceptualised as a unitary construct, nor the dyad of social-communicative and rigid and repetitive impairments that underpin diagnosable autism (American Psychiatric Association, 2013). Given that we also found it has poor reliability, this study indicates that the AQ10 may not be a psychometrically robust measure of autism in non-clinical samples from the general population.

Conclusions

The present study is the largest psychometric analysis of the AQ10 to date. However, given the absence of socio-demographic data, it was not possible to conduct further analyses of interest (e.g., measurement invariance in males versus females). Therefore, although the AQ10 is a clinically robust screening tool for diagnosable autism, we caution against its use as a measure of trait autism in the general population until further research is conducted on its psychometric properties. We recommend that, until such research is conducted, AQ10 users should examine and report its psychometric properties, so this questionnaire can be evaluated and refined accordingly.

Author Contributions

ECT and PS conceived the study. ECT, RC, and PS analysed the data. ECT, LAL, and PS wrote the article.

Funding Information

ECT is support by a Whorrod Scholarship, RC by the Economic and Social Research Council, and LAL by the Medical Research Council.

Conflicts of Interest

All authors declare no conflicts of interest.

Data Availability Statement

The data used in the study are available from https://osf.io/4pd2m/?view_only=db1650b2e86240ddb7a6158a96f6abf5

References

Allison, C., Auyeung, B., & Baron-Cohen, S. (2012). Toward brief “red flags” for autism screening: The short autism spectrum quotient and the short quantitative checklist in 1,000 cases and 3,000 controls. J Am Acad Child Adolesc Psychiatr, 51, 202212.CrossRefGoogle ScholarPubMed
National Institute for Health and Care Excellence (2012). Autism spectrum disorder in adults: diagnosis and management (Guideline No. CG142). Retrieved from www.nice.org.uk/CG142.Google Scholar
Gollwitzer, A., Martel, C., McPartland, J. C., & Bargh, J. A. (2019). Autism spectrum traits predict higher social psychological skill. Proc Natl Acad Sci USA, 116, 1924519247.CrossRefGoogle ScholarPubMed
Jia, R., Steelman, Z. R., & Jia, H. H. (2019). Psychometric assessments of three self-report autism scales (AQ, RBQ-2A, and SQ) for General Adult Populations. J Autism Dev Disord, 49, 19491965.CrossRefGoogle ScholarPubMed
Gollwitzer, A. (2019). “Data for autism spectrum traits predict higher social psychological skill; Study1OpenSourceNoID” https://osf.io/4pd2m/?view_only=db1650b2e86240ddb7a6158a96f6abf5, August 8, 2019.Google Scholar
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electr J Bus Res Methods, 6, 5360.Google Scholar
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001). The autism-spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. J Autism DevDisord, 31, 517.CrossRefGoogle ScholarPubMed
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th). Washington, D.C: American Psychiatric Association.Google Scholar
Figure 0

Table 1. Factor Analysis Fit Indices for AQ10.

Figure 1

Table 2. Parallel Analysis Item Loadings of AQ10 Items.

Figure 2

Figure 1. Scree Plot for Parallel Analysis of AQ10, which suggests that a 4-factor solution was the best fit to the data (Produced using JASP 0.11.1).

Figure 3

Table 3. AQ10 Reliability Statistics.

Reviewing editor:  Christine Payne NYU Langone Medical Center, Child and Adolescent Psychiatry, New York, New York, United States, 10016-4576
This article has been accepted because it is deemed to be scientifically sound, has the correct controls, has appropriate methodology and is statistically valid, and met required revisions.

Review 1: Psychometric concerns with the 10-item Autism-Spectrum Quotient (AQ10) as a measure of trait autism in the general population

Conflict of interest statement

Reviewer declares none

Comments

Comments to the Author: This is a valuable contribution to the literature. It would benefit from being more succinct in the introduction and discussion, and referencing previous reliability and validity findings. Could include comment on 4-factor structure appearing meaningful, i.e. Factor 4 items ‘Theory of Mind’ sub-scale.

Presentation

Overall score 4.1 out of 5
Is the article written in clear and proper English? (30%)
4 out of 5
Is the data presented in the most useful manner? (40%)
5 out of 5
Does the paper cite relevant and related articles appropriately? (30%)
3 out of 5

Context

Overall score 4.5 out of 5
Does the title suitably represent the article? (25%)
5 out of 5
Does the abstract correctly embody the content of the article? (25%)
5 out of 5
Does the introduction give appropriate context? (25%)
3 out of 5
Is the objective of the experiment clearly defined? (25%)
5 out of 5

Analysis

Overall score 5 out of 5
Does the discussion adequately interpret the results presented? (40%)
5 out of 5
Is the conclusion consistent with the results and discussion? (40%)
5 out of 5
Are the limitations of the experiment as well as the contributions of the experiment clearly outlined? (20%)
5 out of 5

Review 2: Psychometric concerns with the 10-item Autism-Spectrum Quotient (AQ10) as a measure of trait autism in the general population

Conflict of interest statement

Reviewer declares none

Comments

Comments to the Author: The paper presents an interesting analysis of the psychometric properties of the AQ. It has a valuable contribution to make to researchers who may use the AQ10 as a measure of autistic traits within non-autistic populations. All sections are written very concisely without losing clarity, and the paper is written in an accessible style.

Presentation

Overall score 5 out of 5
Is the article written in clear and proper English? (30%)
5 out of 5
Is the data presented in the most useful manner? (40%)
5 out of 5
Does the paper cite relevant and related articles appropriately? (30%)
5 out of 5

Context

Overall score 5 out of 5
Does the title suitably represent the article? (25%)
5 out of 5
Does the abstract correctly embody the content of the article? (25%)
5 out of 5
Does the introduction give appropriate context? (25%)
5 out of 5
Is the objective of the experiment clearly defined? (25%)
5 out of 5

Analysis

Overall score 5 out of 5
Does the discussion adequately interpret the results presented? (40%)
5 out of 5
Is the conclusion consistent with the results and discussion? (40%)
5 out of 5
Are the limitations of the experiment as well as the contributions of the experiment clearly outlined? (20%)
5 out of 5