Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-23T04:50:51.491Z Has data issue: false hasContentIssue false
  • English
  • Français

Reliability and Validity of Composite Scores from the NIH Toolbox Cognition Battery in Adults

Published online by Cambridge University Press:  24 June 2014

Robert K. Heaton ,
Natacha Akshoomoff ,
David Tulsky ,
Dan Mungas ,
Sandra Weintraub ,
Sureyya Dikmen ,
Jennifer Beaumont ,
Kaitlin B. Casaletto ,
Kevin Conway  and
Jerry Slotkin
...Show all authors
Robert K. Heaton*
Affiliation:
Department of Psychiatry, University of California, San Diego, California
Natacha Akshoomoff
Affiliation:
Department of Psychiatry, University of California, San Diego, California
David Tulsky
Affiliation:
Departments of Rehabilitation Medicine, Orthopedic Surgery, and General Medicine, New York University Langone Medical Center, New York; and Spinal Cord Injury, Kessler Foundation, West Orange, New Jersey
Dan Mungas
Affiliation:
Department of Neurology, University of California, Davis, California
Sandra Weintraub
Affiliation:
Cognitive Neurology and Alzheimer’s Disease Center and Department of Psychiatry and Behavioral Sciences, Northwestern Feinberg School of Medicine, Chicago, Illinois
Sureyya Dikmen
Affiliation:
Department of Rehabilitation Medicine, University of Washington, Seattle, Washington
Jennifer Beaumont
Affiliation:
Department of Medical Social Sciences, Northwestern University, Chicago, Illinois
Kaitlin B. Casaletto
Affiliation:
San Diego State University/University of California, San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California
Kevin Conway
Affiliation:
National Institute on Drug Abuse, Rockville, Maryland
Jerry Slotkin
Affiliation:
Department of Medical Social Sciences, Northwestern University, Chicago, Illinois
Richard Gershon
Affiliation:
Department of Medical Social Sciences, Northwestern University, Chicago, Illinois
*
Correspondence and reprint requests to: Robert K. Heaton, Department of Psychiatry, UCSD School of Medicine, 9500 Gilman Drive, La Jolla, CA 92093-0603. E-mail: [email protected]
Get access Rights & Permissions [Opens in a new window]

Abstract

This study describes psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) Composite Scores in an adult sample. The NIHTB-CB was designed for use in epidemiologic studies and clinical trials for ages 3 to 85. A total of 268 self-described healthy adults were recruited at four university-based sites, using stratified sampling guidelines to target demographic variability for age (20–85 years), gender, education, and ethnicity. The NIHTB-CB contains seven computer-based instruments assessing five cognitive sub-domains: Language, Executive Function, Episodic Memory, Processing Speed, and Working Memory. Participants completed the NIHTB-CB, corresponding gold standard validation measures selected to tap the same cognitive abilities, and sociodemographic questionnaires. Three Composite Scores were derived for both the NIHTB-CB and gold standard batteries: “Crystallized Cognition Composite,” “Fluid Cognition Composite,” and “Total Cognition Composite” scores. NIHTB Composite Scores showed acceptable internal consistency (Cronbach’s alphas=0.84 Crystallized, 0.83 Fluid, 0.77 Total), excellent test–retest reliability (r: 0.86–0.92), strong convergent (r: 0.78–0.90) and discriminant (r: 0.19–0.39) validities versus gold standard composites, and expected age effects (r=0.18 crystallized, r=−0.68 fluid, r=−0.26 total). Significant relationships with self-reported prior school difficulties and current health status, employment, and presence of a disability provided evidence of external validity. The NIH Toolbox Cognition Battery Composite Scores have excellent reliability and validity, suggesting they can be used effectively in epidemiologic and clinical studies. (JINS, 2014, 20, 1–11)

Keywords

Neuropsychological assessmentMemoryExecutive FunctionAttentionCognitive assessmentCognitive screener
Type
Special Series
Information
Journal of the International Neuropsychological Society , Volume 20 , Issue 6 , July 2014 , pp. 588 - 598
Copyright
Copyright © The International Neuropsychological Society 2014 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Akshoomoff, N., Beaumont, J.L., Bauer, P.J., Dikmen, S., Gershon, R., Mungas, D., … Heaton, R.K. (2013). NIH Toolbox Cognitive Function Battery (CFB): Composite scores of crystallized, fluid, and overall cognition. In: P.D. Zelazo & P.J. Bauer (Eds.), National Institutes of Health Toolbox-Cognitive Function Battery (NIH Toolbox CFB): Validation for Children between 3 and 15 years. Society for Research in Child Development Monographs 78(4), 119–132.Google Scholar
Benedict, R. (1997). Brief Visuospatial Memory Test-revised. Odessa, FL: Psychological Assessment Resources, Inc.Google Scholar
Byrd, D.A., Miller, S.W., Reilly, J., Weber, S., Wall, T.L., & Heaton, R.K. (2006). Early environmental factors, ethnicity, and adult cognitive test performance. The Clinical Neuropsychologist, 20, 243–260.CrossRefGoogle ScholarPubMed
Cattell, R.B. (1971). Abilities: Their structure, growth, and action. Cambridge: Cambridge University Press.Google Scholar
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.CrossRefGoogle ScholarPubMed
Cysique, L., Franklin, D., Abramson, I., Ellis, R., Letendre, S., Collier, A., … Heaton, R.K. (2011). Normative data and validation of a regression based summary score for assessing meaningful neuropsychological change. Journal of Clinical and Experimental Neuropsychology, 33(5), 505–522.CrossRefGoogle ScholarPubMed
Delis, D.C., Kramer, J.H., & Kaplan, E. (2001). The Delis-Kaplan Executive Function System. San Antonio, TX: The Psychological Corporation.Google Scholar
Dunn, L.M., & Dunn, L.M. (2007). Peabody Picture Vocabulary Test-Fourth Edition (PPVT-4). Circle Pines, MN: American Guidance Services.Google Scholar
Gronwall, D.M. (1977). Paced auditory serial-addition task: A measure of recovery from concussion. Perceptual and Motor Skills, 44, 367–373.CrossRefGoogle ScholarPubMed
Heaton, R.K., Chelune, G.J., Talley, J.L., Kay, G.G., & Curtiss, G. (2004). Wisconsin card sorting test manual. Odessa FL: Psychological Assessment Resources, Inc.Google Scholar
Heaton, R.K., Miller, S.W., Taylor, J.T., & Grant, I. (2004). Revised comprehensive norms for an expanded Halstead-Reitan Battery: Demographically adjusted neuropsychological norms for African American and caucasian adults. Lutz, FL: Psychological Assessment Resources, Inc.Google Scholar
Heaton, R.K., Ryan, L., & Grant, I. (2009). Demographic influences and use of demographically corrected norms in neuropsychological assessment. In I. Grant & K.M. Adams (Eds.), Neuropsychological assessment of neuropsychiatric and neuromedical disorders (pp. 127–155). New York: Oxford University Press.Google Scholar
Heaton, R.K., Taylor, M.J., & Manly, J. (2003). Demographic effects and use of demographically corrected norms with the WAIS-III and WMS III. In D.S. Tulsky, D.H. Saklofske, G.J. Chelune, R.K. Heaton, R.J. Ivnik, R. Bornstein, A. Prifitera & M.F. Ledbetter (Eds.), Clinical interpretation of the WAIS-III and WMS-III (pp. 181–210). San Diego, CA: Academic Press.CrossRefGoogle Scholar
Horn, J.L. (1968). Organization of abilities and the development of intelligence. Psychological Review, 75, 242–259.CrossRefGoogle ScholarPubMed
Horn, J.L. (1970). Organization of data on life-span development of human abilities. In L.R. Goulet & P.B. Baltes (Eds.), Life-span developmental psychology: Research and theory (pp. 423–466). San Diego: Academic Press.CrossRefGoogle Scholar
Horn, J.L., & Cattell, R.B. (1967). Age differences in fluid and crystallized intelligence. Acta Psychologica, 26, 107–129.CrossRefGoogle ScholarPubMed
Li, S.-C., Lindenberger, U., Hommel, B., Aschersleben, G., Prinz, W., & Baltes, P. (2004). Transformations in the couplings among intellectual abilities and constituent cognitive processes across the life span. Psychological Science, 15, 155–163.CrossRefGoogle ScholarPubMed
Matarazzo, J.D. (1972). Wechsler’s measurement and appraisal of adult intelligence (5th ed.). Baltimore, MD: The Williams and Wilkins Company.Google Scholar
Mungas, D., Heaton, R.K., Tulsky, D., Zelazo, P.D., Slotkin, J., Blitz, D., … Gershon, R. (submitted). Factor structure, convergent validity, and discriminant validity of the NIH Toolbox Cognitive Health Battery (NIHTB-CHB) in Adults. Journal of the International Neuropsychological Society.Google Scholar
Mungas, D., Widaman, K., Zelazo, P.D., Tulsky, D., Heaton, R., Slotkin, J., … Gershon, R. (2013). NIH Toolbox Cognitive Function Battery (CFB): Factor structure for 3- to 15- year-olds. In: P.D. Zelazo & P.J. Bauer (Eds.). National Institutes of Health Toolbox-Cognitive Function Battery (NIH Toolbox CFB):validation for children between 3 and 15 years. Ann Arbor, MI: Society for Research in Child Development Monographs, 78(4), 103–118.Google Scholar
Norman, M.A., Moore, D.J., Taylor, M., Franklin, D., Cysique, L., Ake, C., … Heaton, R.K. (2011). Demographically corrected norms for African Americans and Caucasians on the Hopkins Verbal Learning Test-Revised, Brief Visuospatial Memory Test-Revised, Stroop Color and Word Test, and Wisconsin Card Sorting Test 64-Card Version. Journal of Clinical and Experimental Neuropsychology, 33(7), 793–804.CrossRefGoogle ScholarPubMed
Randolph, C. (Ed.) (1998). Repeatable Battery for the Assessment of Neuropsychological Status Manual. San Antonio, TX: The Psychological Corporation.Google Scholar
Rey, A. (1964). L’examen clinique en psychologie. Paris: Presses Universitaires de France.Google Scholar
Sattler, J.M. (2001). Assessment of children: Cognitive applications. San Diego, CA: Jerome M. Sattler, Publisher, Inc.Google Scholar
The Psychological Corporation. (1997). WAIS-III WMS-III Technical Manual. San Antonio, TX: The Psychological Corporation.Google Scholar
Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). San Antonio, TX: The Psychological Corporation.Google Scholar
Weintraub, S., Dikmen, S.S., Heaton, R.K., Tulsky, D.S., Zelazo, P.D., Bauer, P.J., … Gershon, R. (2013). Cognition assessment using the NIH Toolbox. Neurology, 80, S54–S64.CrossRefGoogle ScholarPubMed
Wilkinson, G.S., & Robertson, G.J. (2006). Wide Range Achievement Test 4 professional manual. Lutz, FL: Psychological Assessment Resources.Google Scholar