No CrossRef data available.
Article contents
An accelerating crisis: Metascience is out-reproducing psychological science
Published online by Cambridge University Press: 10 February 2022
Abstract
Scientific claims are selected in part for their ability to survive. Scientists can pursue an r-strategy of broad, easy-to-spread ideas, or a K-strategy of stress-tested, bulletproof statements. The “generalizability crisis” is an exquisite mutation that allows dull, K-strategic methodology articles to spread nearly as quickly as the fast-breeding, r-strategic memes of pop-psychology.
- Type
- Open Peer Commentary
- Information
- Copyright
- Copyright © The Author(s), 2022. Published by Cambridge University Press
References
Giovanni, S., Deniz Aksayli, N., Semir Tatlidil, K., Tatsumi, T., Gondo, Y., & Gobet, F. (2019). Near and far transfer in cognitive training: A second-order meta-analysis. Collabra: Psychology, 5(1), 18. doi: https://doi.org/10.1525/collabra.203.Google Scholar
Glickstein, M. (2006). Golgi and Cajal: The neuron doctrine and the 100th anniversary of the 1906 Nobel Prize. Current Biology, 16(5), R147–R151. https://doi.org/10.1016/j.cub.2006.02.053.CrossRefGoogle ScholarPubMed
Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3), 61–83; discussion 83–135. doi:10.1017/S0140525X0999152X. Epub 2010 Jun 15. PMID: 20550733.CrossRefGoogle ScholarPubMed
Koen, J. D., Aly, M., Wang, W. C., & Yonelinas, A. P. (2013). Examining the causes of memory strength variability: Recollection, attention failure, or encoding variability? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(6), 1726.Google ScholarPubMed
Pianka, E. (1970). On r- and K-selection. The American Naturalist, 104(940), 592–597. Retrieved February 25, 2021, from http://www.jstor.org/stable/2459020.CrossRefGoogle Scholar
Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., … Engle, R. W. (2013). No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study. Journal of Experimental Psychology: General, 142(2), 359–379. https://doi.org/10.1037/a0029082.CrossRefGoogle ScholarPubMed
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspectives on Psychological Science, 4(3), 274–290.CrossRefGoogle ScholarPubMed
Wundt, W. H. (1883). Ueber psychologische methoden. (On psychological methods). Philosophische Studien, 1, 1–38.Google Scholar
Target article
The generalizability crisis
Related commentaries (38)
A crisis of generalizability or a crisis of constructs?
Addressing a crisis of generalizability with large-scale construct validation
An accelerating crisis: Metascience is out-reproducing psychological science
Causal analysis as a bridge between qualitative and quantitative research
Causal complexity demands community coordination
Citizen science can help to alleviate the generalizability crisis
Disentangling paradigm and method can help bring qualitative research to post-positivist psychology and address the generalizability crisis
Exposing and overcoming the fixed-effect fallacy through crowd science
From description to generalization, or there and back again
Generalizability challenges in applied psychological and organizational research and practice
Generalizability in mixed models: Lessons from corpus linguistics
Generalizability, transferability, and the practice-to-practice gap
Impact on the legal system of the generalizability crisis in psychology
Improving the generalizability of infant psychological research: The ManyBabies model
Increasing generalizability via the principle of minimum description length
Is formalism the key to resolving the generalizability crisis? An experimental economics perspective
Lessons from behaviorism: The problem of construct-led science
Look to the field
Measurement practices exacerbate the generalizability crisis: Novel digital measures can help
Mechanistic modeling for the masses
Mismatch between scientific theories and statistical models
Observing effects in various contexts won't give us general psychological theories
Psychologists should learn structural specification and experimental econometrics
Publishing fast and slow: A path toward generalizability in psychology and AI
Random effects won't solve the problem of generalizability
Science with or without statistics: Discover-generalize-replicate? Discover-replicate-generalize?
Separate substantive from statistical hypotheses and treat them differently
The cost of crisis in clinical psychological science
The crisis from above: Gatekeepers need better standards
The four different modes of psychological explanation, and their proper evaluative schemas
The role of generalizability in moral and political psychology
The stimulus-response crisis
The “‘Crisis’ Crisis” in psychology
There is no generalizability crisis
There is no psychology without inferential statistics
We need to be braver about the generalizability crisis
We need to think more about how we conduct research
Without more theory, psychology will be a headless rider
Author response
Replies to commentaries on the generalizability crisis