Introduction
Attentional problems are common and are associated with multiple psychiatric disorders.Reference Piani, Maggioni, Delvecchio and Brambilla 1 –Reference Pironti, Lai and Müller 6 Attention deficit hyperactivity disorder (ADHD) may reflect the most extreme version of attentional problems, but the complaint of inattention may suggest a disorder other than ADHD. Major depressive disorder, substance use disorders, and a host of anxiety disorders have attentional difficulties as one of their common features.Reference Piani, Maggioni, Delvecchio and Brambilla 1 –Reference Schachar, Dupuis and Anagnostou 5 There has been little research, however, regarding the degree to which attention may be problematic across multiple disorders, using objective measures. The issue is important because tests of sustained attention, commonly referred to as continuous performance tasks (CPTs), are seeing increasing use as “decision-making” tools in the context of ADHD management.
Although there are a handful of paper–pencil measures by which we can assess attention,Reference Treviño, Zhu and Lu 7 attentional difficulties can also be measured using computer-based instruments such as the Rapid Visual Information Processing (RVP) task, a widely used computerized test of visual sustained attention.Reference Coull, Frith, Frackowiak and Grasby 8 Such tests are not diagnostic of particular disorders. For example, cognitive tests lack sufficient positive predictive power to differentiate ADHD from non-ADHDReference Bijlenga, Ulberstad, Thorell, Christiansen, Hirsch and Kooij 9 , Reference Wasserman and Wasserman 10 and are inferior to questionnaires or clinical assessments in this regard.Reference Biederman, Petty and Fried 11 , Reference Lambek, Tannock, Dalsgaard, Trillingsgaard, Damm and Thomsen 12 Many patients do not have observable deficits on such tasks.Reference Biederman, Petty and Fried 11 , Reference Lambek, Tannock, Dalsgaard, Trillingsgaard, Damm and Thomsen 12 However, computerized cognitive tasks do have the advantage of being objective and of being able to quantify distinct cognitive domains likely to be relevant to day-to-day functioning.
Therefore, the aims of this study were to examine sustained attention across a range of psychiatric disorders using this CPT. We hypothesized that multiple psychiatric disorders, particularly ADHD, would be associated with pronounced attentional problems in young adults.
Methods
Participants
Totally, 576 young adult participants (aged 18–29 years) were enrolled from a study in young adults, from general community settings. Study inclusion criteria were participants had gambled at least five times in the past year (since this was part of a wider longitudinal study that was enriched for gambling), and they were able to be interviewed in person. Exclusion criteria for this study were hearing or vision problems that made performing cognitive tasks difficulty, and an inability to understand and consent to the study. Participants were recruited in the Minneapolis and Chicago metropolitan areas using media advertisements. Each participant received a $50 gift card to an online store as compensation. The Institutional Review Board of the University of Chicago approved the study and the consent statement. The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008.
Assessments
Demographic variables, including age, gender, and highest level of education completed, were recorded for all participants. Subjects received a psychiatric evaluation, which included the Mini International Neuropsychiatric Inventory,Reference Sheehan, Lecrubier and Sheehan 13 the Minnesota Impulsive Disorders Interview (which screens for compulsive buying, kleptomania, trichotillomania, skin picking disorder, pyromania, intermittent explosive disorder, compulsive sexual behavior, and binge eating disorder),Reference Piani, Maggioni, Delvecchio and Brambilla 1 Reference Ros-Cucurull, Palma-Álvarez and García-Raboso 4 , Reference Chamberlain and Grant 15 ADHD World Health Organization Screening Tool Part A (ASRS v1.1),Reference Kessler, Adler and Ames 16 and the Structured Clinical Interview for Gambling Disorder.Reference Grant, Steinberg, Kim, Rounsaville and Potenza 17 For the ADHD definition, in keeping with standard recommendations,Reference Kessler, Adler and Ames 16 endorsement of at least four of six ADHD symptoms on the ASRS Part A was deemed indicative of this disorder. In the ADHD group, 100% endorsed symptom item 1 to some extent, 98.7% item 2, 98.7% item 3, 96% item 4, 90.7% item 5, and 90.7% item 6. As such, the group can be considered to have the full gamut of ADHD symptom types, as indexed by this tool.
In addition to diagnostic measures, participants underwent computerized testing using the RVP task, a test measuring sustained attention that has been widely used in the literature.Reference Coull, Frith, Frackowiak and Grasby 8 RVP is a type of CPT paradigm, commonly used in ADHD. For the RVP, participants are requested to detect patterns of number target sequences (eg, 2-4-6). A white box is shown in the center of the screen containing single digits from 2 to 9 in a random order at a rate of 100 digits per minute. Once the participants see the target sequence they must respond by using the press pad as quickly as possible. Target sequences occurred at the rate of four every 30 seconds, and the computer calculated both the number of presses to target within a period of 1.5 seconds after presentation. The sustained attention measures on this task are target sensitivity (a measure of the subject’s ability to distinguish targets and non-targets), and the proportion of targets successfully detected.Reference Sahakian, Jones, Levy, Gray and Warburton 18
Data analysis
Only psychiatric disorders endorsed by at least 1% of the participants (ie, at least 5 people) were included for analysis. The profile of attentional impairment for disorders was quantified by calculating z-scores relative to normative data from those participants in the study who did not have mental disorders (hereafter referred to as controls). Z-scores in this context are equivalent to Cohen’s D and so reflect effect sizes. By convention, 0.3 would be small, 0.5 medium, and 0.8 large effect sizes.
Results
The sample comprised 576 participants, mean (standard deviation) age of 22.2 (3.6) years, and 377 (65.5%) being female. Of the 576 participants, 424 individuals (73.6%) had completed college education or higher.
Figure 1 shows the disorders associated with impairment in sensitivity index compared to controls. Those participants with social phobia, obsessive-compulsive disorder (OCD), bulimia nervosa, and intermittent explosive disorder showed the greatest impairment versus controls, all with effect sizes of at least 0.8. Those with probable ADHD exhibited impairment but not to the degree of these other disorders. PTSD and compulsive sexual behavior were both associated with intact (or even superior) sustained attention.
Figure 1. Profile of sustained attention problems across the range of neuropsychiatric disorders. Top panel shows z-scores for sensitivity index impairment in patient groups as compared to controls. Lower panel shows z-scores for target detection impairment in patient groups as compared to controls. The dotted lines indicate threshold for large effect size deficits (0.8 or higher).
Target detection was impaired across multiple disorders, but OCD and binge eating disorder exhibited the most pronounced impairment (effect sizes of >0.8). PTSD and compulsive sexual behavior were again associated with normal (or even superior) target detection performance (Figure 1).
Discussion
This is the first study that we are aware of that has used a validated, trans-diagnostic task of sustained attention across multiple disorders in a diverse, non-treatment seeking sample of young adults. This study showed that OCD exhibited the greatest problems of sustained attention, with social phobia and eating disorders (bulimia nervosa and binge eating disorder) exhibiting pronounced difficulties as well. All of these disorders showed greater problems with sustained attention than probable ADHD. These findings may be clinically important as primary doctors and psychiatrics should not assume a diagnosis of ADHD based on a complaint of attentional problems. Based on these data, a chief complaint of attentional problems should elicit a thorough psychiatric examination with a focus on such disorders as OCD, social phobia, and eating disorders.
These data may also have clinical including treatment implications. In the case of ADHD, a stimulant is an established first-line pharmacological intervention.Reference Cortese, Adamo and Del Giovane 19 In the case of social phobia or OCD, however, the first-line pharmacological treatment is a selective serotonin reuptake inhibitor.Reference Williams, Hattingh and Kariuki 20 , Reference Fineberg and Gale 21 Thus, proper diagnosis of the underlying condition giving rise to attention difficulties might result in quite wide ranging differences in treatment. Treatments for most disorders do not focus on sustained attention as a treatment target, notably those associated with the greatest impairment in the current study. Future work should explore the contribution of these deficits to everyday functioning and whether they can be ameliorated in different clinical settings.
Several limitations should be considered. Because this study was conducted in community-recruited participants, the findings may not generalize to clinical populations. For example, clinical populations may perhaps have higher levels of attentional problems than observed herein (although large effect size impairments were found in our study for particular disorders, suggesting this may not be a prominent limitation in the current study). Because the study was cross-sectional, direction of effect cannot be shown (ie, no causal evidence that attentional difficulties lead to these various disorders). Some of the disorders represented have small sample sizes, and so follow-up work in larger samples would be valuable, particularly to more rigorously address links between attention difficulties and the other symptoms defining the various disorders. The cognitive profiles are presented as the patients actually performed on the cognitive task. Comorbidities are common in all the disorders considered and indeed these disorders often overlap with each other.Reference Geller 22 Psychoactive substance use (illicit or legitimate prescribed medication) use may also be common, though this was a non-treatment seeking sample. The study was neither designed nor powered to address the impact of comorbidities or psychoactive substances on the observed cognitive profiles, and this should be examined in future work, which will require larger sample sizes and different methodological approaches.
Conclusion
Impairment in sustained attention appears to be a feature of multiple psychiatric disorder. Given this finding, clinicians need to be cautious about simply diagnosing ADHD when a person complains of attentional problems. A thorough psychiatric evaluation may be warranted in such cases and clinicians should be aware of the common disorders such as OCD, social phobia, and eating disorders that are often associated with impairments in sustained attention.
Financial support
This research was funded by the National Center for Responsible Gaming (NCRG) Center of Excellence grant. S.R.C.’s role in this study was funded by a Wellcome Trust Clinical Fellowship (nos. 110049/Z/15/Z and 110049/Z/15/A). For the purpose of open access, the author has applied a CC BY public copyright license to any Author Accepted Manuscript version arising from this submission.
Author contributions
Conceptualization: J.E.G., S.R.C.; Data curation: J.E.G., S.R.C.; Formal analysis: S.R.C.; Funding acquisition: J.E.G.; Investigation: J.E.G., S.R.C.; Methodology: J.E.G., S.R.C.; Project administration: J.E.G.; Resources: J.E.G.; Supervision: J.E.G.; Validation: J.E.G.; Writing—original draft: J.E.G.; Writing—review and editing: J.E.G., S.R.C.
Disclosures
J.E.G. has received research grants from Otsuka and Biohaven Pharmaceuticals. He receives yearly compensation from Springer Publishing for acting as Editor-in-Chief of the Journal of Gambling Studies and has received royalties from Oxford University Press, American Psychiatric Publishing, Inc., Norton Press, and McGraw Hill. S.R.C. receives a stipend from Elsevier for editorial work.
Open access
