Hostname: page-component-78c5997874-xbtfd Total loading time: 0 Render date: 2024-11-17T19:10:37.873Z Has data issue: false hasContentIssue false
  • English
  • Français

Don't characterize replications as successes or failures

Published online by Cambridge University Press:  27 July 2018

Andrew Gelman
Andrew Gelman*
Affiliation:
Department of Statistics, Columbia University, New York, NY 10027. [email protected]://www.stat.columbia.edu/~gelman
Get access Rights & Permissions [Opens in a new window]

Abstract

No replication is truly direct, and I recommend moving away from the classification of replications as “direct” or “conceptual” to a framework in which we accept that treatment effects vary across conditions. Relatedly, we should stop labeling replications as successes or failures and instead use continuous measures to compare different studies, again using meta-analysis of raw data where possible.

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 41 , 2018 , e128
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Gelman, A. (2013) I'm negative on the expression “false positives.” Blog post. Available at: http://andrewgelman.com/2013/11/07/nix-expression-false-positives/.Google Scholar
Gelman, A. (2016b) The time-reversal heuristic – A new way to think about a published finding that is followed up by a large, preregistered replication (in context of Amy Cuddy's claims about power pose). Blog post. Available at: http://andrewgelman.com/2016/01/26/more-power-posing/.Google Scholar
Gelman, A. & Carlin, J. B. (2014) Beyond power calculations: Assessing Type S (sign) and Type M (magnitude) errors. Perspectives on Psychological Science 9:641–51.Google Scholar
McShane, B. B., Gal, D., Gelman, A., Robert, C. & Tackett, J. L. (2017) Abandon statistical significance. Technical report, Northwestern University. Available at: https://arxiv.org/abs/1709.07588.Google Scholar
Schmidt, S. (2009) Shall we really do it again? The powerful concept of replication is neglected in the social sciences. Review of General Psychology 13:90–100.Google Scholar
Simmons, J. & Simonsohn, U. (2015) Power posing: Reassessing the evidence behind the most popular TED talk. Blog post. Available at: http://datacolada.org/37.Google Scholar
Tracy, J. L. & Beall, A. T. (2014) The impact of weather on women's tendency to wear red or pink when at high risk for conception. PLoS One 9(2):e88852.Google Scholar