Martin Schweinsberg, Nikhil Madan, Michelangelo Vianello, S. Amy Sommer, Jennifer Jordan, Warren Tierney, Eli Awtrey, Luke Lei Zhu, Daniel Diermeier, Justin E. Heinze, Malavika Srinivasan, David Tannenbaum, Eliza Bivolaru, Jason Dana, Clintin P. Davis-Stober, Christilene du Plessis, Quentin F. Gronau, Andrew C. Hafenbrack, Eko Yi Liao, Alexander Ly, Maarten Marsman, Toshio Murase, Israr Qureshi, Michael Schaerer, Nico Thornley, Christina M. Tworek, Eric-Jan Wagenmakers, Lynn Wong, Tabitha Anderson, Christopher W. Bauman, Wendy L. Bedwell, Victoria Brescoll, Andrew Canavan, Jesse J. Chandler, Erik Cheries, Sapna Cheryan, Felix Cheung, Andrei Cimpian, Mark A. Clark, Diana Cordon, Fiery Cushman, Peter H. Ditto, Thomas Donahue, Sarah E. Frick, Monica Gamez-Djokic, Rebecca Hofstein Grady, Jesse Graham, Jun Gu, Adam Hahn, Brittany E. Hanson, Nicole J. Hartwich, Kristie Hein, Yoel Inbar, Lily Jiang, Tehlyr Kellogg, Deanna M. Kennedy, Nicole Legate, Timo P. Luoma, Heidi Maibuecher, Peter Meindl, Jennifer Miles, Alexandra Mislin, Daniel C. Molden, Matt Motyl, George Newman, Hoai Huong Ngo, Harvey Packham, Philip S. Ramsay, Jennifer L. Ray, Aaron M. Sackett, Anne-Laure Sellier, Tatiana Sokolova, Walter Sowden, Daniel Storage, Xiaomin Sun, Jay J. Van Bavel, Anthony N. Washburn, Cong Wei, Erik Wetter, Carlos T. Wilson, Sophie-Charlotte Darroux, Eric Luis Uhlmann
This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed. © 2015 The Authors
INSEAD, Singapore, France; University of Padova, Italy; HEC Paris, France; University of Groningen, Netherlands; University of Washington, United States; University of Manitoba, Canada; University of Chicago, United States; University of Michigan, United States; Harvard University, United States; Yale University, United States; University of Missouri, United States; Rotterdam School of Management, Erasmus University, Netherlands; University of Amsterdam, Netherlands; Católica Lisbon School of Business and Economics, Portugal; Macau University of Science and Technology, Macao; Roosevelt University, United States; IE Business School, IE University, Spain; University of Illinois at Urbana-Champaign, United States; Illinois Institute of Technology, United States; University of California, Irvine, United States; University of South Florida, United States; Mathematica Policy Research, Institute for Social Research, University of Michigan, United States; University of Massachusetts Amherst, United States; Michigan State University, United States; University of Hong Kong, Hong Kong; American University, United States; Northwestern University, United States; University of Southern California, United States; Monash University, Australia; Social Cognition Center Cologne, University of Cologne., Germany; University of Illinois at Chicago, United States; University of Toronto, Canada; University of Washington Bothell, United States; Université Paris Ouest Nanterre la Défense, France; New York University, United States; University of St. Thomas, United States; Beijing Normal University, China; Stockholm School of Economics, Sweden
