Data Sharing in PLOS ONE: An Analysis of Data Availability Statements
Only about 20% of statements indicate that data are deposited in a repository, which the PLOS policy states is the preferred method. More commonly, authors state that their data are in the paper itself or in the supplemental information, though it is unclear whether these data meet the level of sharing required in the PLOS policy.
Peer reviewers have the right to view the data and code that underlie a work if it would help in the evaluation, even if these have not been provided with the submission. Yet few referees exercise this right.
Where Do the Numbers Published in Scientific Articles Come From?
Study attempts to reproduce values reported in 35 articles published in the journal Cognition revealed analysis pipelines peppered with errors. Elements of a reproducible workflow that may help to mitigate these problems in future research are outlined.
Many efforts are underway to promote data sharing in psychology, however it is currently unclear if the in-principle benefits of data availability are being realized in practice. In a recent study, we found that a mandatory open data policy introduced at the journal Cognition led to a substantial increase in available data, but a considerable portion of this data was not reusable. For data to be reusable, it needs to be clearly structured and well-documented. Open data alone will not be enough to achieve the benefits envisioned by proponents of data sharing.
Practical Tools and Strategies for Researchers to Increase Replicability
This publication provides an overview of some practical tools and strategies that researchers can implement in their own workflow to increase replicability and the overall quality of psychology research.
Reproducibility and Replication - University of Zurich Center for Reproducible Science Kickoff Workshop
A strategic kick-off workshop on Reproducibility and Replication with the goal to define the optimal set-up of the activities of the newly opened Center for Reproducible Science (CRS) at the University of Zurich.
Most papers fail to report many aspects of the experiment and analysis that we may not with advantage omit - things that are crucial to understanding the result and its limitations and to repeating the work. Instead of arguing about whether results hold up, we should strive to provide enough information for others to repeat the experiments.
Reproducibility failures occur even in fields such as mathematics or computer science that do not have statistical problems or issues with experimental design. Suggested policy changes ignore a core feature of the process of scientific inquiry that occurs after reproducibility failures: the integration of conflicting observations and ideas into a coherent theory.
A Remedy for Broken Science, or an Attempt to Undercut It?
Reproducibility issues pose serious challenges for scientific communities. But what happens when those issues get picked up by political activists? A report from the National Association of Scholars takes on the reproducibility crisis in science. Not everyone views the group’s motives as pure.
The Irreproducibility Crisis of Modern Science: Causes, Consequences, and the Road to Reform
This study by the National Association of Scholars examines the different aspects of the reproducibility crisis of modern science. The report also includes a series of policy recommendations, scientific and political, for alleviating the reproducibility crisis.