Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-05T03:03:40.706Z Has data issue: false hasContentIssue false

Enhancing research credibility when replication is not feasible

Published online by Cambridge University Press:  27 July 2018

Robert J. MacCoun*
Affiliation:
School of Law, Department of Psychology, and Freeman-Spogli Institute, Stanford University, Stanford, CA 94305. [email protected]://law.stanford.edu/directory/robert-j-maccoun/

Abstract

Direct replications are not always affordable or feasible, and for some phenomena they are impossible. In such situations, methods of blinded data analysis can help minimize p-hacking and confirmation bias, increasing our confidence in a study's results.

Type
Open Peer Commentary
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Berk, R. A., Campbell, A., Klap, R. & Western, B. (1992) The deterrent effect of arrest in incidents of domestic violence: A Bayesian analysis of four field experiments. American Sociological Review 57:698708.Google Scholar
Cortina, J. M., Aguinis, H. & DeShon, R. P. (2017) Twilight of dawn or of evening? A century of research methods in the Journal of Applied Psychology. Journal of Applied Psychology 102(3):274–90.Google Scholar
Klein, J. R. & Roodman, A. (2005) Blind analysis in nuclear and particle physics. Annual Review of Nuclear and Particle Physics 55:141–63.Google Scholar
Lipsey, M. W. & Wilson, D. B. (1993) The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis. American Psychologist 48:1181–209.Google Scholar
MacCoun, R. J. & Perlmutter, S. (2015) Hide results to seek the truth. Nature 526:187–89.Google Scholar
MacCoun, R. J. & Perlmutter, S. (2017) Blind analysis as a correction for confirmatory bias in physics and in psychology In: Psychological science under scrutiny: Recent challenges and proposed solutions, ed. Lilienfeld, S. O. & Waldman, I., pp. 297322. Wiley.Google Scholar
Robertson, C. T. & Kesselheim, A. S. (2016) Blinding as a solution to bias: Strengthening biomedical science, forensic science, and law. Academic.Google Scholar