Introduction
Attention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental disorder characterized by pervasive and persistent symptoms of inattention, hyperactivity and impulsivity, affecting individuals across the life cycle (Matte et al. Reference Matte, Rohde and Grevet2012). Research and clinical data have documented that a significant proportion of children affected by the disorder continues to present ADHD symptoms and associated impairment during adulthood (Faraone et al. Reference Faraone, Biederman, Spencer, Mick, Murray, Petty, Adamson and Monuteaux2006; Barkley, Reference Barkley2010; Das et al. Reference Das, Cherbuin, Butterworth, Anstey and Easteal2012). The two most comprehensive estimates of ADHD prevalence in adults suggest prevalence rates between 2.5% and 3.4% (Fayyad et al. Reference Fayyad, de Graaf, Kessler, Alonso, Angermeyer, Demyttenaere, de Girolamo, Haro, Karam, Lara, Lepine, Ormel, Posada-Villa, Zaslavsky and Jin2007; Simon et al. Reference Simon, Czobor, Bálint, Mészáros and Bitter2009).
The diagnostic criteria for ADHD were not tested in adults in the field trials for DSM-IV (Matte et al. Reference Matte, Rohde and Grevet2012), and ADHD was not among the disorders assessed in DSM-5 field trials in adults (Batstra & Frances, Reference Batstra and Frances2012). The DSM-5 criteria for ADHD kept the bidimensional structure of ADHD and the same list of symptoms, but proposed modifications that might impact on the ADHD diagnostic definition for adults, including: (a) a reduction in the number of required symptoms (cut-off point) in both ADHD dimensions (inattention and hyperactivity/impulsivity) from six to five in adults; (b) raising the age at onset from 7 to 12 years, and removing the requirement of impairment from this criterion; and (c) the addition of new clinical examples for symptoms. DSM-5 also proposed modifications that are relevant for all age ranges, such as defining pervasiveness as the presence of several ADHD symptoms (instead of impairment) in two or more settings, and the removal of autism/pervasive developmental disorder (PDD) as a specific exclusion (for a more comprehensive discussion on the rationale for these modifications, see Matte et al. Reference Matte, Rohde and Grevet2012). These proposed changes in ADHD diagnostic criteria raised major concerns about potentially negative consequences, such as inflating prevalence rates of the disorder, overdiagnosis and overtreatment (Regier et al. Reference Regier, Narrow, Clarke, Kraemer, Kuramoto, Kuhl and Kupfer2013).
There are no epidemiological studies with non-referred subjects testing DSM-5 proposed changes. These studies are crucial for a proper evaluation of the prevalence rates and the natural distribution of the ADHD phenotype in the general population (Goodman et al. Reference Goodman, Lahey, Fielding, Dulcan, Narrow and Regier1997). Additionally, information about how the specific diagnostic criteria impact on ADHD prevalence would be clinically useful, considering that ADHD is best conceptualized as a dimensional disorder (Willcutt et al. Reference Wilcutt, Nigg, Pennington, Solanto, Rohde, Tannock, Loo, Carlson, McBurnett and Lahey2012). The performance of individual symptoms is even more relevant, considering that clinicians often match the patient's symptoms against a prototype based on some but not all diagnostic criteria, rather than using full DSM operational diagnostic criteria for making diagnoses (Maj, Reference Maj2011; Jablensky, Reference Jablensky2012).
Thus, our main objective was to assess the prevalence of ADHD according to DSM-5 criteria in a large, non-referred, representative population of young adults. We also addressed the individual impact of new criteria (such as the extension of the age of onset to 12 years and lower symptom cut-offs) on ADHD prevalence rates. In addition, because DSM-5 criteria displayed some rewording and new clinical examples for ADHD symptoms in adults, we also tested: (a) the factorial solution that provides the best fit for the DSM-5 ADHD symptoms, (b) the association of DSM-5 ADHD symptoms with clinical impairment, and (c) the best number (cut-off point) of DSM-5 ADHD symptoms to identify impaired adults in both ADHD dimensions.
Method
Participants
Participants in this study were young adults followed in the 1993 Pelotas Birth Cohort Study. Pelotas is a southern Brazilian city with around 327 000 inhabitants. A full description of the methodology is presented elsewhere (Victora et al. Reference Victora, Hallal, Araújo, Menezes, Wells and Barros2008). In brief, all 5249 live births in the city in 1993 whose mothers agreed to participate in the longitudinal study were considered eligible. The data used in this study were collected in 2011–2012, when the subjects were 18–19 years old. This follow-up assessment comprised all subjects who were located among the initial participants. The Institutional Review Board of the Federal University of Pelotas approved the study. Written informed consent was obtained from all subjects.
Measures
Trained psychologists performed the entire diagnostic evaluation with the subjects. A general psychiatric assessment was performed with the Mini International Neuropsychiatric Interview (MINI), a short semi-structured diagnostic interview for DSM-IV and ICD-10 psychiatric disorders that provided prevalence estimates of common mental disorders. Because of logistic issues (i.e. the psychiatric interview was part of a larger follow-up assessment), only some MINI sections were performed. The most prevalent mood (major depression and bipolar) and anxiety (agoraphobia, social phobia, general anxiety) disorders were assessed. The MINI has a previously validated Portuguese version (Amorim, Reference Amorim2003). In primary health care in Brazil, the MINI exhibited κ values of 0.65–0.85, a sensitivity of 0.75–0.92 and a specificity of 0.90–0.99 when using the SCID applied by a psychiatrist as a parameter (Marques & Zuardi, Reference Marques and Zuardi2008). Sociodemographic variables were collected at the same interview.
The ADHD assessment was performed with a structured interview that included 18 questions about DSM-5 ADHD symptoms (one question for each symptom). These questions were formulated exactly as proposed by the DSM-5 ADHD working group and were freely available during 2011 and 2012 at www.dsm5.org. Thus, we present here the performance of the current DSM-5 diagnostic criteria for ADHD (APA, 2013). DSM-5 defines ADHD in adults as the presence of at least five of nine symptoms of inattention and/or five of nine symptoms of hyperactivity/impulsivity. ADHD symptoms must cause clinical impairment, several of them must be present in more than one setting, and their age at onset should be before age 12 years.
The DSM-5 ADHD symptoms were rated as present or absent. Considering that this was a large population study, we initially applied a screening questionnaire using the same structure as the World Health Organization Adult ADHD Self-Report Scale (ASRS) screener for all subjects. The ASRS includes six questions about ADHD symptoms (four inattention items: ‘Does not follow through’, ‘Difficulty organizing tasks’, ‘Forgetful’, ‘Reluctant to engage in “mental” tasks’; and two hyperactivity items: ‘Fidgets’ and ‘On the go’). In a previous population study, the ASRS had 68.7% sensitivity, 99.5% specificity and 97.9% total classification accuracy, considering blind clinical assessment as the gold standard and using a cut-off of 4/6 screening symptoms (Kessler et al. Reference Kessler, Adler, Ames, Demler, Faraone, Hiripi, Howes, Jin, Secnik, Spencer, Ustun and Walters2005). In our questionnaire, those six ASRS questions were adapted to the exact DSM-5 wording. To enhance sensitivity, any subject with two or more positive questions among the six was considered screening positive, and answered 12 additional questions about the 12 remaining ADHD symptoms, along with other questions about additional criteria (symptom pervasiveness, age at onset before 12 years old, and clinical impairment). To assess symptom pervasiveness, subjects were asked if they presented symptoms in at least two of the three main settings: home, social and work/school environments. To assess the presence of ADHD symptoms before age 12, we asked ‘Did you have several of these symptoms before age 12?’ Clinical impairment specifically related to ADHD was measured using a question answered by the subjects at the end of the ADHD section of the assessment interview. The question asked was: ‘How much impairment your ADHD symptoms cause to your life?’ The options for answer were: none (0), mild impairment (1), moderate impairment (2), or severe impairment (3). For the current analyses, the presence of clinical impairment was operationally defined as having a score of 2 (moderate) or 3 (severe).
This strategy for assessing impairment was chosen to mimic approaches in clinical settings, in which clinicians tend to rely on the subject's general perception of impairment instead of on extensive evaluations of correlates of functioning. Thus, clinicians tend to assess ADHD impairment based on patient's perceptions (Rösler et al. Reference Rösler, Retz, Thome, Schneider, Stieglitz and Falkai2006). Although the threshold for defining impairment is subjective and individual, clinicians diagnose ADHD even in cases without substantial impairment. Thus, the threshold of self-report moderate impairment tends to be conservative.
Data analytic strategy: description of the sample
Sociodemographic and co-morbidity patterns were assessed both for DSM-5 ADHD cases and for subjects without ADHD. These two groups were compared using appropriate univariate tests.
Assessment of ADHD prevalence and exploration of the impact of individual diagnostic criteria on ADHD prevalence rates
The consequences of using different symptom thresholds on ADHD prevalence rates were explored by calculating the proportion of subjects that would be defined as ADHD cases according to several potential symptomatic cut-offs. We also applied the ADHD additional criteria consecutively to examine their individual impact on ADHD prevalence rates. For these prevalence assessments, we used data from the entire sample; the subjects who screened negative for ADHD (less than two out of six positive screening questions) were assumed to be negative for ADHD. Moreover, we estimated a comparison between DSM-IV and DSM-5 ADHD prevalence in our sample. This was an indirect comparison because we could not assess either ADHD symptoms with DSM-IV wording or the presence of impairment of symptoms before 7 years (as DSM-IV required). To derive an ADHD diagnosis according to DSM-IV criteria, we considered data from this sample using the 6/9 cut-point proposed by DSM-IV. To deal with age-of-onset criterion modification while avoiding the effect of recall bias in a cross-sectional study asking for the exact date of beginning ADHD symptoms, we relied on a previous study documenting an increase of 0.1% in ADHD prevalence rates with this DSM criterion B modification. It is important to note that this rate was obtained in a longitudinal assessment (Polanczyk et al. Reference Polanczyk, Caspi, Houts, Kollins, Rohde and Moffitt2010). Thus, we estimated the DSM-IV prevalence in this sample as the ADHD prevalence for the 6/9 cut-point with an additional 0.1% discount.
Assessment of the factor solution that provides the best fit for ADHD symptoms
The factor structure of the 18 DSM-5 ADHD symptoms was tested with confirmatory factor analysis (CFA) in the subsample that screened positive for ADHD (at least 2/6 positive screening questions) and completed the entire ADHD assessment. Several CFA models were fitted to the data: (a) a one-factor model; (b) a correlated two-factor model; (c) a correlated three-factor model; (d) a second-order two-factor model; (e) a second-order three-factor model; (f) a bifactor model with one general and two specific factors; (g) a bifactor model with one general and three specific factors; and (h) an incomplete bifactor model with one general and two specific factors (in this model the hyperactivity factor is suppressed as all hyperactivity symptoms are explained by the general ADHD factor). This strategy allowed us to determine which factor solution provided the best fit for DSM-5 ADHD symptoms. CFA models were fitted to polychoric correlations among the symptoms using the weighted least squares means and variance adjusted (WLSMV) estimator implemented in Mplus 7.0 (Muthén & Muthén, Reference Muthén and Muthén2012). The goodness of fit was assessed using the following fit indices: χ 2, the weighted root mean square residual (WRMR), the Comparative Fit Index (CFI), the Tucker–Lewis Index (TLI) and the root mean square error of approximation (RMSEA). To demonstrate good fit to the data, an estimated model should have a WRMR ⩽0.9 (Muthén & Muthén, Reference Muthén and Muthén2012), RMSEA ⩽0.06 and CFI and TLI ⩾0.95 (Hu & Bentler, Reference Hu and Bentler1999). We compared nested models directly using the robust chi-square difference test with mean and variance adjusted test statistics (Asparouhov & Muthén, Reference Asparouhov and Muthén2006). We also provided the differences between models with regard to Akaike information criterion (ΔAIC) and Bayesian information criterion (ΔBIC), using the robust maximum likelihood estimator (MLE). Lower values for AIC and BIC indicate a better fit. Values of ΔAIC and ΔBIC ⩽10 indicate overwhelming support for the models with lower values (Burnham, Reference Burnham2004). To reduce the number of statistical comparisons, we first identified the best models within the correlated models (including the unidimensional model), the bifactor models and the second-order models. We then compared the best models from each kind of factor structure.
Assessment of the association of ADHD symptoms with clinical impairment
A three-step approach was implemented to examine which individual DSM-5 ADHD symptoms are the best predictors of moderate to severe clinical impairment. These analyses were also performed only in the subsample that screened positive for ADHD. First, the bivariate association between symptoms and clinical impairment was assessed with the χ 2 test and unadjusted odds ratio (OR) estimates, which allowed ranking the DSM-5 symptoms according to their OR related to clinical impairment. Second, a binary stepwise logistic regression model was performed, considering clinical impairment as the dependent variable and all DSM-5 ADHD symptoms as independent variables. This analysis depicted how many, and which, DSM-5 symptoms were independently associated with clinical impairment after controlling for the other DSM-5 symptoms. Third, all-possible-subsets (APS) logistic regression analysis was used to confirm the set of DSM-5 symptoms that best predicted clinical impairment. The APS analysis helped to select the best subset from a larger set of predictors. In such situations, different subsets might have almost equivalent associations with the outcome, and conventional stepwise regression analysis might select a suboptimal subset because of minor differences in bivariate associations. The APS analysis avoids this problem as it generates results for a large number of different models with a fixed number of predictors, which were determined by the earlier stepwise logistic regression analysis. The APS analysis also ranks the best subsets according to their association with the outcome (using χ 2 values as ranking criteria). Once the ranking of subsets is known, the researcher can select the predictors that are more consistent across the top-ranked subsets. In our APS analyses, we followed the procedures of Kessler et al. (Reference Kessler, Green, Adler, Barkley, Chatterji, Faraone, Finkelman, Greenhill, Gruber, Jewell, Russo, Sampson and Van Brunt2010) but used clinical impairment as the dependent variable instead of ADHD diagnosis.
Assessment of the best number of ADHD symptoms (cut-off point) to identify clinical impairment
Receiver-operating characteristic (ROC) analyses tested which would be the best cut-off (i.e. the best balance between sensitivity and specificity assuming an equal chance of false-positive and false-negative errors in selecting the optimal cut-point) for the number of DSM-5 ADHD symptoms to predict clinical impairment, for both inattention and hyperactivity/impulsivity dimensions. For these analyses, we initially assumed that those with no positive symptom among the six screening symptoms would be negative for the remaining 12 symptoms. To test this assumption, we simulated the performance of the screening questions in a real dataset that had all the 18 symptoms without any skipping rule for a sample of children from the same Brazilian region (n = 1255; 6–12-year-olds) (Salum et al. unpublished observations). For children with no positive symptoms in the questions that were part of the screening instrument, the vast majority (86.9%) had no additional symptoms. Thus, we included subjects with no positive symptoms in the screening instrument in our first set of ROC analyses. However, we did not include subjects with one positive symptom among the six screening items in this first set of analyses because predictions of the number of other positive symptoms and impairment from the symptoms would be impossible. Next, we performed the same analyses only in the ADHD screening positive subsample.
For all analyses, a 5% significance level for two-tailed test was adopted, unless stated otherwise. The analyses were performed in SAS version 9.0 (APS analysis), Signal Detection Software ROC4 (ROC analyses), Mplus version 7.0 (CFA) and IBM SPSS version 20 (other analyses).
Results
Description of the sample
All subjects were in the age range between 18 and 19 years at the time of the interview. A total of 4106 cohort members were located (81.4% of the initial sample), and 4000 subjects provided information on ADHD, co-morbidities and sociodemographics. Of these, 1329 subjects (33.2% of this study sample) screened positive for ADHD and provided information about all ADHD criteria. Sociodemographic and co-morbidity profiles for ADHD cases and subjects without ADHD are shown in Table 1.
Table 1. Sociodemographics and co-morbidity profile of DSM-5 ADHD cases and subjects without ADHD (n=4000)
ADHD, Attention-deficit/hyperactivity disorder; n.a., not applicable; s.d., standard deviation.
a ADHD cases are subjects with at least five of nine inattention and/or five of nine hyperactivity symptoms + symptom onset before age 12 + symptoms in more than one setting + moderate or severe impairment related to ADHD symptoms.
b Statistical difference between ADHD and non-ADHD groups (p < 0.05). For the 66 ADHD subjects with inattentive presentation, mean ± s.d. of number of hyperactivity/impulsivity symptoms was 2.65 ± 1.2. For the 18 ADHD subjects with hyperactive/impulsive presentation, mean ± s.d. of number of inattention symptoms was 3.22 ± 0.9.
Assessment of ADHD prevalence and exploration of the impact of individual diagnostic criteria on ADHD prevalence rates
According to full DSM-5 criteria, the prevalence of ADHD was 3.55% [95% confidence interval (CI) 2.98–4.12]. The prevalence of inattentive, hyperactive/impulsive and combined presentations was 1.65, 0.45 and 1.45% respectively. The effects on ADHD prevalence rates of using different symptom cut-off points for assigning a diagnosis are displayed in Table 2. This table also shows the impact on prevalence rates of sequentially applying the ADHD additional criteria. In general, the most significant decrease in ADHD prevalence was determined by age-at-onset criterion, which had a larger effect on prevalence rates than the symptom cut-off or the impairment criteria. Note that ADHD prevalence rates had overlapping CIs with four, five or six symptom cut-offs (Table 2). If severe (rather than at least moderate) clinical impairment was used as an ADHD additional criterion, the prevalence of ADHD would be 1.4% (95% CI 1.04–1.76%). The ADHD prevalence rate with at least six symptoms in any dimension was estimated to be 2.9% (95% CI 2.38–3.42%) in our sample (Table 2). Discounting the impact of the modification of age-at-onset criterion estimated at 0.1%, we would end up with a DSM-IV ADHD prevalence rate of about 2.8%. We also ran secondary analyses comparing the three groups (subjects without ADHD, ADHD cases based on both DSM-IV and DSM-5, and new ADHD cases based only on DSM-5 criteria) with regard to male/female ratio, impairment and co-morbidity. There are no differences between the two groups of cases on impairment (p = 0.73) and both groups differed from the subjects without ADHD (p < 0.001). Both groups of cases also presented similar male/female ratios (39.3% versus 40%) and rates of co-morbidity with anxiety disorders (37.1% and 40%). However, new cases identified only by DSM-5 had a higher prevalence of co-morbid mood disorders (16% and 7.7%).
Table 2. Prevalence (95% CI) of ADHD across several symptom cut-offs and sequential application of additional ADHD criteria (n = 4000)
ADHD, Attention-deficit/hyperactivity disorder; CI, confidence interval.
a Impairment related to the ADHD symptoms.
Additional data for subjects presenting with five of nine inattentive + five of nine hyperactive/impulsive symptoms are available upon request.
Assessment of the factor solution that provides the best fit for ADHD symptoms
The data fit indexes for several factorial models tested in CFA are presented in Table 3. The model with the best factor structure for DSM-5 symptoms was the bifactor model with one general factor and two specific factors (RMSEA 0.045, 90% CI 0.040–0.049; CFI 0.875; TLI 0.837; WRMR 1.492). The most important implication from these findings is that a general factor substantially influences all of the ADHD symptoms whereas the specific factors account for additional variance related to inattention and hyperactivity/impulsivity.
Table 3. Confirmatory factor analysis (CFA) of 18 DSM-5 ADHD symptoms with fit indexes for different models of ADHD and model comparison (n = 1329)
ADHD, Attention-deficit/hyperactivity disorder; FP, free parameters; df, degrees of freedom; RMSEA, root mean square error of approximation; CI, confidence interval; CFI, Comparative Fit Index; TLI, Tucker–Lewis Index; WRMR, weighted root mean square residual; AIC, Akaike information criterion; BIC, Bayesian information criterion.
Parameters were estimated using mean and variance adjusted weighted least squares (WLSMV), except for AIC and BIC, which were estimated using the robust maximum likelihood estimator (MLE). Δχ 2 represents the robust chi-square difference test with mean and variance adjusted test statistics. ΔAIC and ΔBIC represent the difference between AIC and BIC for each model comparison: values ⩾10 indicate overwhelming support for the model with the lower AIC and BIC values. Bold values indicate the model that provided the best fit for the data.
Assessment of the association of ADHD symptoms with clinical impairment
The results for the performance of the 18 DSM-5 symptoms in predicting moderate to severe clinical impairment are presented in Table 4. According to the unadjusted OR ranking, there were four inattention symptoms among the top-five predicting items. In the conventional logistic regression analysis, seven symptoms (five inattention and two hyperactivity items) remained as independent predictors of clinical impairment (adjusted R 2 = 0.123). In the APS regression, five inattention (‘Difficulty sustaining attention’, ‘Difficulty organizing tasks’, ‘Easily distracted’, ‘Loses objects’, ‘Fails to give close attention to details’) and only two hyperactivity symptoms (‘On the go’, ‘Gets up’) were present in more than half of the top-10 subsets of seven symptoms. In all the analyses, inattention items performed better than hyperactivity/impulsivity items in predicting clinical impairment.
Table 4. Association of individual DSM-5 ADHD symptoms with clinical impairment (n = 1329)
ADHD, Attention-deficit/hyperactivity disorder; OR, odds ratio; CI, confidence interval; APS, all possible subsets; n.s., non-significant association between ADHD symptom and clinical impairment.
These analyses were performed only for the 1329 subjects who screened positive for ADHD (at least two positive screening questions) and provided information on all 18 ADHD symptoms. Bold values indicate the 7 symptoms that were more consistent across the top-10 ranked subsets of n=7 symptoms in APS regression. According to this criterion, these highlighted symptoms would be the best predictors of impairment.
a Impairment related to the ADHD symptoms. Unadjusted ORs from the χ 2 test. Adjusted ORs from conventional binary regression analysis. APS results display the number of times the symptoms appear among the top-10 ranked subsets of seven symptoms (according to general χ 2).
Assessment of the best number of ADHD symptoms (cut-off point) to identify clinical impairment
ROC analyses were performed with both inattention and hyperactivity/impulsivity symptoms, considering the presence of moderate to severe clinical impairment as the gold standard. In the model including subjects with no positive symptoms in the screening instrument, the best inattention cut-off for predicting clinical impairment was four symptoms [sensitivity 88% and specificity 70.9%; area under the curve (AUC) for the ROC analysis 0.860, 95% CI 0.845–0.875]. For hyperactivity/impulsivity, the best cut-off was one symptom (sensitivity 96% and specificity 61%; AUC 0.819, 95% CI 0.802–0.837). When only the ADHD screening positive subjects were included, the best inattention cut-off for predicting clinical impairment was five symptoms (sensitivity 73.4% and specificity 49.8%; AUC 0.658, 95% CI 0.629–0.688). For hyperactivity/impulsivity, the best cut-off was four symptoms (sensitivity 54.2% and specificity 61.4%; AUC 0.588, 95% CI 0.558–0.619). The sensitivity and specificity for other cut-off points are available upon request.
Discussion
As far as we are aware, this is the first comprehensive evaluation of DSM-5 ADHD criteria in a large, representative, population-based sample of adult subjects. In general, our results suggest that the new DSM-5 ADHD criteria would determine a 27% increase in the prevalence rate of ADHD, compared with DSM-IV criteria (3.55% v. 2.8%). However, the new criteria did not impact substantially on the factor structure of the disorder. In addition, our data support previous DSM-IV findings suggesting that inattentive symptoms are core in the ADHD diagnostic definition in adults, and that there are potential benefits in lowering the symptomatic threshold for diagnosing ADHD in adults.
Our clinical and sociodemographic data concur with previous findings. The developmental decrease in hyperactive symptoms determines that ADHD inattentive is often the most frequent clinical presentation seen in clinical and epidemiological samples of adults (Grevet et al. Reference Grevet, Bau, Salgado, Fischer, Kalil, Victor, Garcia, Sousa, Rohde and Belmonte-de-Abreu2006; Barkley, Reference Barkley2010). Although Kessler et al. (Reference Kessler, Adler, Barkley, Biederman, Conners, Demler, Faraone, Greenhill, Howes, Secnik, Spencer, Üstün, Walters and Zaslavsky2006) have found a male/female ratio of around 1.6, previous studies in adults did not find consistent gender effects, as seen in children (Kooij et al. Reference Kooij, Buitelaar, van den Oord, Furer, Rijnders and Hodiamont2005). As in our study, a preponderance of females was detected when the DSM-IV symptomatic cut-off was reduced from 6/9 to 4/9 in a population study in The Netherlands (Kooij et al. Reference Kooij, Buitelaar, van den Oord, Furer, Rijnders and Hodiamont2005). Our co-morbidity rates with anxiety and mood disorder were lower than those detected by Kessler et al. (Reference Kessler, Adler, Ames, Demler, Faraone, Hiripi, Howes, Jin, Secnik, Spencer, Ustun and Walters2005), probably reflecting the fact that we assessed young adults differently; the study by Kessler et al. assessed individuals up to 44 years of age. Although the lack of significant difference in academic achievement between cases and subjects without ADHD in our study might reflect the young age of the adults assessed, Kessler et al. (Reference Kessler, Adler, Ames, Demler, Faraone, Hiripi, Howes, Jin, Secnik, Spencer, Ustun and Walters2005) also did not find a significant difference in education in the National Comorbidity Survey Replication (NCS-R). However, other studies have found a lower academic achievement for subjects with ADHD (e.g. Ebejer et al. Reference Ebejer, Medland, van der Werf, Gondro, Henders, Lynskey, Martin and Duffy2012).
When all additional criteria (symptom pervasiveness, age at onset before age 12 years, and moderate/severe impairment) besides symptom threshold were used, the prevalence of ADHD ranged from 2.9% (with a cut-off of six symptoms in any dimension) to 3.8% (with a four-symptom cut-off). These prevalence rates are not very different from the rates found in previous DSM-IV-based population studies in the USA. A telephone survey of 966 adults (Faraone & Biederman, Reference Faraone and Biederman2005) found a 2.9% prevalence of ADHD. A rate of ADHD of 4.4% was reported in a US nationally representative household survey with 3199 adults (Kessler et al. Reference Kessler, Adler, Barkley, Biederman, Conners, Demler, Faraone, Greenhill, Howes, Secnik, Spencer, Üstün, Walters and Zaslavsky2006). International estimates of ADHD prevalence in adults were also in the same range (Simon et al. Reference Simon, Czobor, Bálint, Mészáros and Bitter2009). In a comprehensive assessment in 10 different countries with 11 422 adults, a mathematical model of multiple imputations was used to derive a pooled ADHD prevalence of 3.4% (Fayyad et al. Reference Fayyad, de Graaf, Kessler, Alonso, Angermeyer, Demyttenaere, de Girolamo, Haro, Karam, Lara, Lepine, Ormel, Posada-Villa, Zaslavsky and Jin2007). However, lower prevalence rates have been found in some studies (Kooij et al. Reference Kooij, Buitelaar, van den Oord, Furer, Rijnders and Hodiamont2005; Medina-Mora et al. Reference Medina-Mora, Borges, Lara, Benjet, Blanco, Fleiz, Villatoro, Rojas and Zambrano2005; Ebejer et al. Reference Ebejer, Medland, van der Werf, Gondro, Henders, Lynskey, Martin and Duffy2012). These lower rates are closer to the rates that our study found when severe impairment was required as an additional criterion for ADHD (1.4%). Because of differences in methodology, comparisons among different prevalence studies are always difficult (see Polanczyk et al. Reference Polanczyk, de Lima, Horta, Biederman and Rohde2007). The relevant issue here is that, by using the same methodology and in the same sample, we found an estimated increase of 27% in the prevalence rate of ADHD on going from DSM-IV to DSM-5. It is important to note that ADHD cases by the definition assumed in this study reported at least moderate impairment caused by the symptoms, independently of the diagnostic system used. In addition, ADHD cases defined only by DSM-5 did not present a significantly different impairment score than those identified by both DSM versions. Thus, DSM-5 criteria might be extending the diagnosis to people suffering with the disorder who were not assigned a place in the classification system according to the previous DSM-IV. Future studies need to address how to decide where to put the diagnostic threshold in dimensional disorders such as ADHD, where investigations have been documenting for a long time that the linear increase in symptoms seems to determine augmentation of impairment (Fergusson et al. Reference Fergusson, Lynskey and Horwood1997).
Our results also underscore the importance of addressing all ADHD criteria, not just symptom count. In particular, the impact of applying the DSM-5 age-at-onset criterion on reducing ADHD prevalence is relevant: considering only a five-symptom cut-off in any dimension, the ADHD endorsement rate would be 23.7% (95% CI 22.38–25.02). Adding the age-at-onset criterion alone (without other additional criteria) would decrease this rate to 5.4% (95% CI 4.7–6.1). As expected, a similar result emerged for the impairment criterion: adding the moderate impairment criterion alone would increase the endorsement rate to 15.1% (95% CI 13.99–16.21). These additional criteria were more relevant for making the prevalence closer to the one expected than any potential variations in symptom cut-off criterion. Taken together, these results might serve as clinical rationale for emphasizing the importance of carefully addressing ADHD additional criteria (especially age at onset and impairment) during the diagnostic evaluation.
CFAs with the DSM-5 symptoms found a bifactor model with one general and two specific factors as the best fit for the data. A bifactor model was also the best fit in many DSM-IV-based previous studies (Dumenci et al. Reference Dumenci, McConaghy and Achenbahj2004; Toplak et al. Reference Toplak, Pitch, Flora, Iwenofu, Ghelani, Jain and Tannock2009, Reference Toplak, Sorge, Flora, Chen, Banaschewski, Buitelaar, Ebstein, Eisenberg, Franke, Gill, Miranda, Oades, Roeyers, Rothenberger, Sergeant, Sonuga-Barke, Steinhausen, Thompson, Tannock, Asherson and Faraone2012; Martel et al. Reference Martel, von Eye and Nigg2010, Reference Martel, Roberts, Gremillion, von Eye and Nigg2011; Gibbins et al. Reference Gibbins, Toplak, Flora, Weiss and Tannock2012; Normand et al. Reference Normand, Flora, Toplak and Tannock2012; Ullebø et al. Reference Ullebø, Breivik, Gillberg, Lundervold and Posserud2012), suggesting that the proposed rewording and new clinical examples would not change the expected factorial structure of ADHD symptoms. This model is in line with multiple pathway conceptions of the disorder (Nigg et al. Reference Nigg, Willcutt, Doyle and Sonuga-Barke2005) and better explains symptomatic overlap/distinctiveness and stability/change, accounting more clearly for disorder heterogeneity.
Regarding the performance of DSM-5 symptoms in predicting ADHD-related impairment, the three-step approach yielded consistent results, suggesting that inattention symptoms, as a group, are more closely associated with impairment than hyperactivity/impulsivity symptoms. This pattern does not seem to be influenced by a higher endorsement rate for inattention symptoms. If we rank the 18 ADHD symptoms according to their frequency in ADHD patients, the seven symptoms significantly associated with impairment are ranked as follows: 1st, 3rd, 5th, 8th, 11th, 12th and 16th. Thus, it does not seem that those significantly associated with impairment were only distributed in the first ranks of frequency. To analyze this issue statistically, we assessed the correlation of the 18 symptom ranks in terms of frequency with their ranks in terms of the number of times they appeared as part of the top-10 subsets of seven symptoms predicting impairment in APS analyses. No significant association was found (p > 0.10). These results stress the relevance of inattention as a predictor of clinical impairment in adults. Although the specific list varies across studies, inattentive symptoms as a group are usually reported as the best predictors of ADHD-related impairment in previous investigations. Barkley et al. (Reference Barkley, Murphy and Fischer2008) reported that the five ADHD symptoms with the strongest associations with the presence of any impairment were inattentive symptoms. A population-based study by Das et al. (Reference Das, Cherbuin, Butterworth, Anstey and Easteal2012) also documented that inattentive symptoms were the most strongly associated with clinical impairment.
Our ROC analyses, independently of the strategy used, found that a lower symptom threshold than the one proposed by DSM-IV determined the best balance between sensitivity and specificity for predicting at least moderate impairment for both inattention and hyperactivity/impulsivity dimensions. These findings concur with previous DSM-IV-based studies suggesting that a lower threshold of symptoms might be adequate in adult ADHD samples (Murphy & Barkley, Reference Murphy and Barkley1996; Solanto et al. Reference Solanto, Marks, Wasserstein and Mitchell2012). Kooij et al. (Reference Kooij, Buitelaar, van den Oord, Furer, Rijnders and Hodiamont2005) reported that subjects with four or more DSM-IV symptoms in any ADHD dimension were significantly more impaired than subjects with fewer symptoms in a large, population-based sample in The Netherlands. Moreover, an investigation by Hoogman et al. (Reference Hoogman, Rijpkema, Janss, Brunner, Fernandez, Buistelaar, Franke and Arias-Vásquez2012) suggested similar brain volumetric measures in adults presenting with a lower symptom threshold of four symptoms and subjects with six or more symptoms in any ADHD dimension. Both groups differed from those with fewer ADHD inattentive or hyperactive/impulsive symptoms.
Our study has some strengths and also methodological limitations related to logistic issues. To the best of our knowledge, this is the first population study assessing DSM-5 ADHD criteria. We assessed young adults, and all previous DSM-IV and DSM-5 field trials in adults have not addressed ADHD. Our data were derived from a large, representative, population-based sample. Finally, we implemented assessment methods that could mimic clinical assessment in the real world, as far as possible in an epidemiological investigation. Regarding limitations, our subjects were all 18–19 years old and our data might not be fully generalized to older adults. Our diagnostic process was performed only with the subjects and did not aggregate information from significant others, a strategy that could have minimized the risk of under-reporting ADHD symptoms, and might have improved the reliability of our retrospective assessment of ADHD symptoms before age 12. Our impairment measure was based only on the subject's perspective; a rater-derived score based on functional correlates was not used. It is important to bear in mind that previous investigations have found high agreement between self and parent information for ADHD diagnosis in adults (see Murphy & Schachar, Reference Murphy and Schachar2000), and clinicians tend to see young adult patients without parents and to rely on self-perception about impairment more than on scales. Thus, we are confident that our strategy of assessment adequately mimics the scenario seen in a clinical setting. However, our data are probably more applicable to scenarios where diagnosis relies on self-report. We could not assess some important ADHD co-morbidities, such as other externalizing disorders, anti-social personality disorder or substance-use disorder. Moreover, we used a screening tool for ADHD, and 2671 subjects (66.8% of the total sample) presented a negative screening for the disorder and therefore answered only the six screening questions. This high proportion of screening-negative subjects posed some difficulties to our data analyses. Those analyses that required information about individual symptoms (CFA, association between individual symptoms and impairment) had to be performed only with the subsample that screened positive and provided complete information about all ADHD symptoms (n = 1329). For our prevalence assessment, we assumed that those who screened negative for ADHD did not have the disorder. This assumption allowed us to assess the prevalence of ADHD for the entire population sample, but it is theoretically possible (although clinically unlikely) that our approach missed some ADHD cases. To deal with this possibility, we performed a mathematical modeling for imputing data for the 1833 subjects who had only one screening positive symptom based on the patterns of response of those that had two screening positive symptoms and therefore provided information on all 18 symptoms (data available upon request). The prevalence rate found was slightly higher, as expected (3.9%, 95% CI 3.3–4.5). Finally, the AUC for our ROC analyses when only the ADHD screening positive subsample was included showed a diagnostic performance substantially lower than that detected when the entire sample was considered (i.e. individuals in the lower extreme of the symptomatic presentation are not excluded). In other words, these analyses are more likely to reflect the clinical reality of differentiating clinical cases from those with some level of symptoms including subthreshold cases.
Overall, our findings suggest that the DSM-5 changes in ADHD criteria determine a 27% increase in ADHD prevalence rates in adults, even when all diagnostic criteria (particularly age-at-onset and impairment criteria) are included in the evaluation process. The results reinforce the notion that using new wording and clinical examples would not change either the expected factorial structure of ADHD symptoms or the stronger association between inattention and clinical impairment found in adults. Moreover, our study reinforces the view that a lower cut-off point for the number of inattentive and/or hyperactive/impulsive symptoms is more suitable for adult patients.
Acknowledgments
This work was partially supported by research grants from: the National Council for Scientific and Technological Development (CNPq, Brazil) and the Hospital de Clinicas de Porto Alegre (HCPA), Porto Alegre, Brazil. E. H. Grevet received a governmental CNPq post-doctoral fellowship and C. Kieling and G. A. Salum received governmental CAPES/FAPERGS post-doctoral fellowships. The Welcome Trust supports the Pelotas Birth Cohort Study. The European Union and the Brazilian National Program for Centers of Excellence (PRONEX – CNPq) funded the initial phases of the study.
Declaration of Interest
L. A. Rohde was on the speakers’ bureau/advisory board and/or acted as consultant for Eli-Lilly, Janssen-Cilag, Novartis and Shire in the past 3 years. The ADHD and Juvenile Bipolar Disorder Out-patient Programs chaired by L. A. Rohde received unrestricted educational and research support from the following pharmaceutical companies in the past 3 years: Eli-Lilly, Janssen-Cilag, Novartis and Shire. He receives authorship royalties from Oxford Press and ArtMed. He has also received travel awards for taking part in the 2014 APA meeting from Shire. C. Kieling took part in two meetings on ADHD sponsored by Novartis and Shire in 2010 and 2011 and in a meeting on the promotion of editorial capacity among editors from low-income and middle-income countries sponsored by Deva in 2010. E. H. Grevet was on the speakers’ bureau for Shire in the past 3 years and took part in one meeting on ADHD sponsored by Shire in 2014.
Open access
