Hostname: page-component-586b7cd67f-rdxmf Total loading time: 0 Render date: 2024-11-25T10:32:27.434Z Has data issue: false hasContentIssue false
  • English
  • Français

Making prepublication independent replication mainstream

Published online by Cambridge University Press:  27 July 2018

Warren Tierney ,
Martin Schweinsberg  and
Eric Luis Uhlmann
Warren Tierney
Affiliation:
Kemmy Business School, University of Limerick, Castletroy, Limerick V94 T9PX, Ireland. [email protected]://ie.linkedin.com/in/warrentierney
Martin Schweinsberg
Affiliation:
ESMT Berlin, 10178 Berlin, Germany. [email protected]://www.esmt.org/person/martin-schweinsberg
Eric Luis Uhlmann
Affiliation:
Organisational Behaviour Area, INSEAD, 138676, Singapore. [email protected]://socialjudgments.com/
Get access Rights & Permissions [Opens in a new window]

Abstract

The widespread replication of research findings in independent laboratories prior to publication is suggested as a complement to traditional replication approaches. The pre-publication independent replication approach further addresses three key concerns from replication skeptics by systematically taking context into account, reducing reputational costs for original authors and replicators, and increasing the theoretical value of failed replications.

Type
Open Peer Commentary
Information
Behavioral and Brain Sciences , Volume 41 , 2018 , e153
Copyright
Copyright © Cambridge University Press 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Berman, J. S. & Reich, C. M. (2010) Investigator allegiance and the evaluation of psychotherapy outcome research. European Journal of Psychotherapy and Counselling 12:11–21.Google Scholar
Bohannon, J. (2014) Replication effort provokes praise – and ‘bullying’ charges. Science 344:788–89.Google Scholar
Chartier, C. R. (2017) The psychological science accelerator: A distributed laboratory network. Blog post. Available at: https://christopherchartier.com/2017/09/21/the-psychological-science-accelerator-a-distributed-laboratory-network.Google Scholar
Dreber, A., Pfeiffer, T., Almenberg, J., Isaksson, S., Wilson, B., Chen, Y., Nosek, B. A. & Johannesson, M. (2015) Using prediction markets to estimate the reproducibility of scientific research. Proceedings of the National Academy of Sciences of the United States of America 112:15343–47.Google Scholar
Dunlap, K. (1926) The experimental methods of psychology. In: Psychologies of 1925, ed. Murchison, C., pp. 331–53. Clark University Press.Google Scholar
Everett, J. A. & Earp, B. D. (2015) A tragedy of the (academic) commons: Interpreting the replication crisis in psychology as a social dilemma for early-career researchers. Frontiers in Psychology 6:1–4.Google Scholar
Kahneman, D. (2014) A new etiquette for replication. Social Psychology 45(4):310–11.Google Scholar
Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251):aac4716. Available at: http://doi.org/10.1126/science.aac4716.Google Scholar
Popper, K. R. (1959) Logic of scientific discovery. Basic.Google Scholar
Schnall, S. (2014a) An experience with a registered replication project. Blog post. Available at: http://www.psychol.cam.ac.uk/cece/blog#anchor-2.Google Scholar
Schnall, S. (2014b) Further thoughts on replications, ceiling effects and bullying. Blog post. Available at: http://www.psychol.cam.ac.uk/cece/blog.Google Scholar
Schnall, S. (2014c) Social media and the crowd-sourcing of social psychology. Blog post. Available at: http://www.psychol.cam.ac.uk/cece/blog.Google Scholar
Schooler, J. (2011) Unpublished results hide the decline effect. Nature 470:37.Google Scholar
Schooler, J. (2014) Metascience could rescue the ‘replication crisis’. Nature 515:9.Google Scholar
Schweinsberg, M., Madan, N., Vianello, M., Sommer, S. A., Jordan, J., Tierney, W., Awtrey, E., Zhu, L. L., Diermeier, D., Heinze, J. E., Srinivasan, M., Tannenbaum, D., Bivolaru, E., Dana, J., Davis-Stober, C. P., du Plessis, C., Gronau, Q. F., Hafenbrack, A. C., Liao, E. Y., Ly, A., Marsman, M., Murase, T., Qureshi, I., Schaerer, M., Thornley, N., Tworek, C. M., Wagenmakers, E.-J., Wong, L., Anderson, T., Bauman, C. W., Bedwell, W. L., Brescoll, V., Canavan, A., Chandler, J. J., Cheries, E., Cheryan, S., Cheung, F., Cimpian, A., Clark, M. A., Cordon, D., Cushman, F., Ditto, P. H., Donahue, T., Frick, S. E., Gamez-Djokic, M., Hofstein Grady, R., Graham, J., Gu, J., Hahn, A., Hanson, B. E., Hartwich, N. J., Hein, K. Inbar, Y., Jiang, L., Kellogg, T., Kennedy, D. M., Legate, N., Luoma, T. P., Maibuecher, H., Meindl, P., Miles, J., Mislin, A., Molden, D. C., Motyl, M., Newman, G., Ngo, H. H., Packham, H., Ramsay, P. S., Ray, J. L., Sackett, A. M., Sellier, A.-L., Sokolova, T., Sowden, W., Storage, D., Sun, X., Van Bavel, J. J., Washburn, A. N., Wei, C., Wetter, E., Wilson, C. T., Darrous, S.-C. & Uhlmann, E. L. (2016) The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. Journal of Experimental Social Psychology 66:55–67.Google Scholar
Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, A., Thornley, N., Madan, N., Vianello, M., Awtrey, E., Zhu, L. L., Diermeier, D., Heinze, J. E., Srinivasan, M., Tannenbaum, D., Bivolaru, E., Dana, J., Davis-Stober, C. P., du Plessis, C., Gronau, Q. F., Hafenbrack, A. C., Liao, E. Y, Ly, M. M., Murase, T., Schaerer, M., Tworek, C. M., Wagenmakers, E-J., Wong, L., Anderson, T., Bauman, C. W., Bedwell, W. L., Brescoll, V., Canavan, A., Chandler, J. J., Cheries, E., Cheryan, S., Cheung, F., Cimpian, A., Clark, M. A., Cordon, D., Cushman, F., Ditto, P. H., Amell, A., Frick, S. E., Gamez-Djokic, M., Hofstein Grady, R., Graham, J., Gu, J., Hahn, A., Hanson, B. E., Hartwich, N. J., Hein, K., Inbar, Y., Jiang, L., Kellogg, T., Legate, N., Luoma, T. P., Maibeucher, H., Meindl, P., Miles, J., Mislin, A., Molden, D. C., Motyl, M., Newman, G., Ngo, H. H., Packhan, H., Ramsay, P. S., Ray, J. L., Sackett, A. M., Sellier, A.-L., Sokolova, T., Sowden, W., Storage, D., Sun, X., Van Bavel, J. J., Washburn, A. N., Wei, C., Wetter, E., Wilson, C. T., Darroux, S.-C. & Uhlmann, E. L. (2016) Data from a pre-publication independent replication initiative examining ten moral judgement effects. Nature Scientific Data 3:160082. Available at: http://doi.org/10.1038/sdata.2016.82.Google Scholar