Hostname: page-component-cd9895bd7-mkpzs Total loading time: 0 Render date: 2024-12-23T12:42:43.015Z Has data issue: false hasContentIssue false

A Defense and Definition of Construct Validity in Psychology

Published online by Cambridge University Press:  01 January 2022

Abstract

Psychologists say a measure has construct validity when it, in fact, measures the construct it is intended to measure. Construct validity is both an important notion in psychological research methods and the source of much confusion and debate among psychologists. I argue that this confusion arises, in part, because of a failure to distinguish between construct validity, a feature of measures relative to a construct, and construct legitimacy, a feature of the construct itself. I propose a prescriptive account of construct validity on the basis of this distinction, then provide evidence for my account through two examples from research psychology.

Type
Cognitive Sciences
Copyright
Copyright © The Philosophy of Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

To contact the author, please write to: Washington University in St. Louis, 1 Brookings Drive, St. Louis, MO 63130; e-mail: [email protected].

References

Anastasi, Anne. 1950. “The Concept of Validity in the Interpretation of Test Scores.” Educational and Psychological Measurement 10 (1): 6778..CrossRefGoogle Scholar
Ari, Csilla, and D’Agostino, Dominic P.. 2016. “Contingency Checking and Self-Directed Behaviors in Giant Manta Rays: Do Elasmobranchs Have Self-Awareness?Journal of Ethology 34 (2): 167–74..CrossRefGoogle Scholar
Brown, Culum. 2014. “Fish Intelligence, Sentience and Ethics.” Animal Cognition 18 (1): 117..CrossRefGoogle ScholarPubMed
Campbell, Donald T., and Fiske, Donald W.. 1959. “Convergent and Discriminant Validation by the Multitrait-Multimethod Matrix.” Psychological Bulletin 56 (2): 81105..CrossRefGoogle ScholarPubMed
Cronbach, Lee J., and Meehl, Paul E.. 1955. “Construct Validity in Psychological Tests.” Psychological Bulletin 52 (4): 281302..CrossRefGoogle ScholarPubMed
De Houwer, Jan, Teige-Mocigemba, Sarah, Spruyt, Adriaan, and Moors, Agnes. 2009. “Implicit Measures: A Normative Analysis and Review.” Psychological Bulletin 135 (3): 347–68..CrossRefGoogle ScholarPubMed
Fazio, Russell H., and Olson, Michael A.. 2014. “The MODE Model: Attitude-Behavior Processes as a Function of Motivation and Opportunity.” In Dual-Process Theories of the Social Mind, ed. Sherman, Jeffrey W., Gawronski, Bertram, and Trope, Yaacov, 155–71. New York: Guilford.Google Scholar
Feest, Uljana. 2017. “Construct Validity in Psychological tests—the Case of Implicit Social Cognition.” Presented at Washington University in St. Louis.Google Scholar
Feighner, John P., and Herbstein, Jessica. 1987. “Diagnostic Validity.” In Issues in Diagnostic Research, ed. Last, Cynthia and Hersen, Michel, 121–40. Boston: Springer.Google Scholar
Gawronski, Bertram, and Bodenhausen, Galen V.. 2006. “Associative and Propositional Processes in Evaluation: An Integrative Review of Implicit and Explicit Attitude Change.” Psychological Bulletin 132 (5): 692731..CrossRefGoogle ScholarPubMed
Gottfredson, Linda, and Saklofske, Donald H.. 2009. “Intelligence: Foundations and Issues in Assessment.” Canadian Psychology/Psychologie canadienne 50 (3): 183–95..CrossRefGoogle Scholar
Greenwald, Anthony G., Banaji, Mahzarin R., and Nosek, Brian A.. 2015. “Statistically Small Effects of the Implicit Association Test Can Have Societally Large Effects.” Journal of Personality and Social Psychology 108 (4): 553–61..CrossRefGoogle ScholarPubMed
Greenwald, Anthony G., McGhee, Debbie E., and Schwartz, Jordan L. K.. 1998. “Measuring Individual Differences in Implicit Cognition: The Implicit Association Test.” Journal of Personality and Social Psychology 74 (6): 1464–80..CrossRefGoogle ScholarPubMed
John, Oliver P., and Soto, Christopher J.. 2007. “The Importance of Being Valid: Reliability and the Process of Construct Validation.” In Handbook of Research Methods in Personality Psychology, ed. Robins, Richard W., Fraley, R. Chris, and Krueger, Robert F., 461–94. New York: Guilford.Google Scholar
McDermott, K. B. 2000. “Implicit Memory.” In The Encyclopedia of Psychology, ed. Kazdin, A. E., 231–34. New York: Oxford University Press.Google Scholar
Messick, Samuel. 1995. “Validity of Psychological Assessment: Validation of Inferences from Persons’ Responses and Performances as Scientific Inquiry into Score Meaning.” American Psychologist 50 (9): 741–49..CrossRefGoogle Scholar
Nosek, Brian A. 2005. “Moderators of the Relationship between Implicit and Explicit Evaluation.” Journal of Experimental Psychology: General 134 (4): 565–84..Google ScholarPubMed
Nosek, Brian A., and Banaji, Mahzarin R.. 2009. “Implicit Attitude.” In The Oxford Companion to Consciousness, ed. Bayne, Tim, Cleeremans, Axel, and Wilken, Patrick, 8485. Oxford: Oxford University Press.Google Scholar
Nosek, Brian A., and Greenwald, Anthony G.. 2009. “(Part of) the Case for a Pragmatic Approach to Validity: Comment on De Houwer, Teige-Mocigemba, Spruyt, and Moors (2009).” Psychological Bulletin 135 (3): 373–76..CrossRefGoogle Scholar
Poldrack, Russell A. 2006. “Can Cognitive Processes Be Inferred from Neuroimaging Data?Trends in Cognitive Sciences 10 (2): 5963..CrossRefGoogle ScholarPubMed
Poldrack, Russell A., and Yarkoni, Tal. 2016. “From Brain Maps to Cognitive Ontologies: Informatics and the Search for Mental Structure.” Annual Review of Psychology 67:587612.CrossRefGoogle ScholarPubMed
Roediger, Henry L. III. 2003. “Reconsidering Implicit Memory.” In Rethinking Implicit Memory, ed. Bowers, Jeffrey S. and Marsolek, Chad J., 318. Oxford: Oxford University Press.Google Scholar
Smith, Gregory T. 2005. “On Construct Validity: Issues of Method and Measurement.” Psychological Assessment 17 (4): 396408..CrossRefGoogle Scholar
Sullivan, Jacqueline Anne. 2016. “Construct Stabilization and the Unity of the Mind-Brain Sciences.” Philosophy of Science 83 (5): 662–73..CrossRefGoogle Scholar
Thünken, Timo, Waltschyk, Nadine, Bakker, Theo C. M., and Kullmann, Harald. 2009. “Olfactory Self-Recognition in a Cichlid Fish.” Animal Cognition 12 (5): 717–24..CrossRefGoogle Scholar
Warrington, Elizabeth K., and Weiskrantz, Lawrence. 1970. “Amnesic Syndrome: Consolidation or Retrieval?Nature 228 (5272): 628–30..CrossRefGoogle ScholarPubMed