Response to Comment on "Estimating the reproducibility of psychological science"

Christopher J Anderson; Štěpán Bahník; Michael Barnett-Cowan; Frank A Bosco; Jesse Chandler; Christopher R Chartier; Felix Cheung; Cody D Christopherson; Andreas Cordes; Edward J Cremata; Nicolas Della Penna; Vivien Estel; Anna Fedor; Stanka A Fitneva; Michael C Frank; James A Grange; Joshua K Hartshorne; Fred Hasselman; Felix Henninger; Marije van der Hulst; Kai J Jonas; Calvin K Lai; Carmel A Levitan; Jeremy K Miller; Katherine S Moore; Johannes M Meixner; Marcus R Munafò; Koen I Neijenhuijs; Gustav Nilsonne; Brian A Nosek; Franziska Plessow; Jason M Prenoveau; Ashley A Ricker; Kathleen Schmidt; Jeffrey R Spies; Stefan Stieger; Nina Strohminger; Gavin B Sullivan; Robbie C M van Aert; Marcel A L M van Assen; Wolf Vanpaemel; Michelangelo Vianello; Martin Voracek; Kellylynn Zuni

doi:10.1126/science.aad9163

Response to Comment on "Estimating the reproducibility of psychological science"

Christopher J Anderson
, Štěpán Bahník
, Michael Barnett-Cowan
, Frank A Bosco
, Jesse Chandler
, Christopher R Chartier
, Felix Cheung
, Cody D Christopherson
, Andreas Cordes
, Edward J Cremata
, Nicolas Della Penna
, Vivien Estel
, Anna Fedor
, Stanka A Fitneva
, Michael C Frank
, James A Grange
, Joshua K Hartshorne
, Fred Hasselman
, Felix Henninger
, Marije van der Hulst

Kai J Jonas, Calvin K Lai, Carmel A Levitan, Jeremy K Miller, Katherine S Moore, Johannes M Meixner, Marcus R Munafò, Koen I Neijenhuijs, Gustav Nilsonne, Brian A Nosek, Franziska Plessow, Jason M Prenoveau, Ashley A Ricker, Kathleen Schmidt, Jeffrey R Spies, Stefan Stieger, Nina Strohminger, Gavin B Sullivan, Robbie C M van Aert, Marcel A L M van Assen, Wolf Vanpaemel, Michelangelo Vianello, Martin Voracek, Kellylynn Zuni

USA. [email protected]
University of Würzburg
University of Waterloo
Virginia Commonwealth University
University of Michigan, Ann Arbor
Ashland University
Michigan State University
Southern Oregon University
Institute of Psychology
University of Southern California
The Australian National University
Technical University of Braunschweig
Parmenides Stiftung
Queen's University Kingston
Stanford University
Keele University
Boston College
Radboud University Nijmegen
University of Koblenz-Landau
Erasmus University Rotterdam
University of Amsterdam
University of Helsinki
Occidental College
Willamette University
Arcadia University
University of Potsdam
University of Bristol
Vrije Universiteit Amsterdam
Karolinska Institutet
Center for Open Science Charlottesville
University of Cambridge
Loyola University
University of California Office of the President
Wesleyan University
University of Konstanz
Yale University
Coventry University
Tilburg University
KU Leuven
University of Padova
University of Vienna
Adams State University

Research output: Contribution to journal › Article › Academic › peer-review

Abstract

Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

Original language	English
Pages (from-to)	1037
Journal	Science
Volume	351
Issue number	6277
DOIs	https://doi.org/10.1126/science.aad9163
Publication status	Published - 2016

Keywords

Behavioral Research
Psychology
Publishing
Research
Comment
Journal Article
Research Support, Non-U.S. Gov't

Access to Document

10.1126/science.aad9163

responseFinal published version, 228 KBLicence: Taverne

Cite this

Anderson, C. J., Bahník, Š., Barnett-Cowan, M., Bosco, F. A., Chandler, J., Chartier, C. R., Cheung, F., Christopherson, C. D., Cordes, A., Cremata, E. J., Della Penna, N., Estel, V., Fedor, A., Fitneva, S. A., Frank, M. C., Grange, J. A., Hartshorne, J. K., Hasselman, F., Henninger, F., ... Zuni, K. (2016). Response to Comment on "Estimating the reproducibility of psychological science". Science, 351(6277), 1037. https://doi.org/10.1126/science.aad9163

@article{a06d7c702bf44ce8a77b0919546b0eba,

title = "Response to Comment on {"}Estimating the reproducibility of psychological science{"}",

abstract = "Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.",

keywords = "Behavioral Research, Psychology, Publishing, Research, Comment, Journal Article, Research Support, Non-U.S. Gov't",

author = "Anderson, \{Christopher J\} and {\v S}t{\v e}p{\'a}n Bahn{\'i}k and Michael Barnett-Cowan and Bosco, \{Frank A\} and Jesse Chandler and Chartier, \{Christopher R\} and Felix Cheung and Christopherson, \{Cody D\} and Andreas Cordes and Cremata, \{Edward J\} and \{Della Penna\}, Nicolas and Vivien Estel and Anna Fedor and Fitneva, \{Stanka A\} and Frank, \{Michael C\} and Grange, \{James A\} and Hartshorne, \{Joshua K\} and Fred Hasselman and Felix Henninger and \{van der Hulst\}, Marije and Jonas, \{Kai J\} and Lai, \{Calvin K\} and Levitan, \{Carmel A\} and Miller, \{Jeremy K\} and Moore, \{Katherine S\} and Meixner, \{Johannes M\} and Munaf{\`o}, \{Marcus R\} and Neijenhuijs, \{Koen I\} and Gustav Nilsonne and Nosek, \{Brian A\} and Franziska Plessow and Prenoveau, \{Jason M\} and Ricker, \{Ashley A\} and Kathleen Schmidt and Spies, \{Jeffrey R\} and Stefan Stieger and Nina Strohminger and Sullivan, \{Gavin B\} and \{van Aert\}, \{Robbie C M\} and \{van Assen\}, \{Marcel A L M\} and Wolf Vanpaemel and Michelangelo Vianello and Martin Voracek and Kellylynn Zuni",

note = "Copyright {\textcopyright} 2016, American Association for the Advancement of Science.",

year = "2016",

doi = "10.1126/science.aad9163",

language = "English",

volume = "351",

pages = "1037",

journal = "Science",

issn = "0036-8075",

publisher = "American Association for the Advancement of Science",

number = "6277",

}

Anderson, CJ, Bahník, Š, Barnett-Cowan, M, Bosco, FA, Chandler, J, Chartier, CR, Cheung, F, Christopherson, CD, Cordes, A, Cremata, EJ, Della Penna, N, Estel, V, Fedor, A, Fitneva, SA, Frank, MC, Grange, JA, Hartshorne, JK, Hasselman, F, Henninger, F, van der Hulst, M, Jonas, KJ, Lai, CK, Levitan, CA, Miller, JK, Moore, KS, Meixner, JM, Munafò, MR, Neijenhuijs, KI, Nilsonne, G, Nosek, BA, Plessow, F, Prenoveau, JM, Ricker, AA, Schmidt, K, Spies, JR, Stieger, S, Strohminger, N, Sullivan, GB, van Aert, RCM, van Assen, MALM, Vanpaemel, W, Vianello, M, Voracek, M & Zuni, K 2016, 'Response to Comment on "Estimating the reproducibility of psychological science"', Science, vol. 351, no. 6277, pp. 1037. https://doi.org/10.1126/science.aad9163

TY - JOUR

T1 - Response to Comment on "Estimating the reproducibility of psychological science"

AU - Anderson, Christopher J

AU - Bahník, Štěpán

AU - Barnett-Cowan, Michael

AU - Bosco, Frank A

AU - Chandler, Jesse

AU - Chartier, Christopher R

AU - Cheung, Felix

AU - Christopherson, Cody D

AU - Cordes, Andreas

AU - Cremata, Edward J

AU - Della Penna, Nicolas

AU - Estel, Vivien

AU - Fedor, Anna

AU - Fitneva, Stanka A

AU - Frank, Michael C

AU - Grange, James A

AU - Hartshorne, Joshua K

AU - Hasselman, Fred

AU - Henninger, Felix

AU - van der Hulst, Marije

AU - Jonas, Kai J

AU - Lai, Calvin K

AU - Levitan, Carmel A

AU - Miller, Jeremy K

AU - Moore, Katherine S

AU - Meixner, Johannes M

AU - Munafò, Marcus R

AU - Neijenhuijs, Koen I

AU - Nilsonne, Gustav

AU - Nosek, Brian A

AU - Plessow, Franziska

AU - Prenoveau, Jason M

AU - Ricker, Ashley A

AU - Schmidt, Kathleen

AU - Spies, Jeffrey R

AU - Stieger, Stefan

AU - Strohminger, Nina

AU - Sullivan, Gavin B

AU - van Aert, Robbie C M

AU - van Assen, Marcel A L M

AU - Vanpaemel, Wolf

AU - Vianello, Michelangelo

AU - Voracek, Martin

AU - Zuni, Kellylynn

PY - 2016

Y1 - 2016

N2 - Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

AB - Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.

KW - Behavioral Research

KW - Psychology

KW - Publishing

KW - Research

KW - Comment

KW - Journal Article

KW - Research Support, Non-U.S. Gov't

U2 - 10.1126/science.aad9163

DO - 10.1126/science.aad9163

M3 - Article

C2 - 26941312

SN - 0036-8075

VL - 351

SP - 1037

JO - Science

JF - Science

IS - 6277

ER -

Response to Comment on "Estimating the reproducibility of psychological science"

Abstract

Keywords

Access to Document

Fingerprint

Cite this