Julia M. Rohrer, Warren Tierney, Eric L. Uhlmann, Lisa M. DeBruine, Tom Heyman, Benedict Jones, Stefan C. Schmukle, Raphael Silberzahn, Rebecca M. Willén, Rickard Carlsson, Richard E. Lucas, Julia Strand, Simine Vazire, Jessica K. Witt, Thomas R. Zentall, Christopher F. Chabris, Tal Yarkoni
Science is often perceived to be a self-correcting enterprise. In principle, the assessment of scientific claims is supposed to proceed in a cumulative fashion, with the reigning theories of the day progressively approximating truth more accurately over time. In practice, however, cumulative self-correction tends to proceed less efficiently than one might naively suppose. Far from evaluating new evidence dispassionately and infallibly, individual scientists often cling stubbornly to prior findings. Here we explore the dynamics of scientific self-correction at an individual rather than collective level. In 13 written statements, researchers from diverse branches of psychology share why and how they have lost confidence in one of their own published findings. We qualitatively characterize these disclosures and explore their implications. A cross-disciplinary survey suggests that such loss-of-confidence sentiments are surprisingly common among members of the broader scientific population yet rarely become part of the public record. We argue that removing barriers to self-correction at the individual level is imperative if the scientific community as a whole is to achieve the ideal of efficient self-correction. © The Author(s) 2021.
International Max Planck Research School on the Life Course, Max Planck Institute for Human Development, Berlin, Germany; Department of Psychology, University of Leipzig, Germany; Department of Organizational Behavior, INSEAD, Singapore; Institute of Neuroscience and Psychology, University of Glasgow, Germany; Laboratory of Experimental Psychology, KU Leuven, Germany; Institute of Psychology, Leiden University, Germany; Sussex Business School, University of Sussex, Germany; Institute for Globally Distributed Open Research and Education (IGDORE), Germany; Department of Psychology, Linnaeus University, Germany; Department of Psychology, Michigan State University, United States; Department of Psychology, Carleton College, United States; Melbourne School of Psychological Sciences, University of Melbourne, Australia; Department of Psychology, Colorado State University, United States; Department of Psychology, University of Kentucky, United States; Autism and Developmental Medicine Institute, Geisinger Health System, Danville, PA, United States; Department of Psychology, University of Texas at Austin, United States