In the 21st Century, research is increasingly data- and computation-driven. Researchers, funders, and the larger community today emphasize the traits of openness and reproducibility. In March 2017, 13 mostly early-career research leaders who are building their careers around these traits came together with ten university leaders (presidents, vice presidents, and vice provosts), representatives from four funding agencies, and eleven organizers and other stakeholders in an NIH- and NSF-funded one-day, invitation-only workshop titled “Imagining Tomorrow’s University.” Workshop attendees were charged with launching a new dialog around open research – the current status, opportunities for advancement, and challenges that limit sharing.
The workshop examined how the internet-enabled research world has changed, and how universities need to change to adapt commensurately, aiming to understand how universities can and should make themselves competitive and attract the best students, staff, and faculty in this new world. During the workshop, the participants re-imagined scholarship, education, and institutions for an open, networked era, to uncover new opportunities for universities to create value and serve society. They expressed the results of these deliberations as a set of 22 principles of tomorrow's university across six areas: credit and attribution, communities, outreach and engagement, education, preservation and reproducibility, and technologies.
Psychology's Replication Crisis Has Made The Field Better
Psychology’s replication crisis has changed the field. Today, authors are voluntarily posting their data, replication attempts are published in top journals, and researchers are increasing their sample sizes and committing to data collection and analysis plans in advance.
Progress has been made towards reducing the 85% of wasted effort in medical research-and the huge amounts of money misspent and harm caused to patients - but there's still a long way to go, say Paul Glasziou and Iain Chalmers.
Data Sharing in PLOS ONE: An Analysis of Data Availability Statements
Only about 20% of statements indicate that data are deposited in a repository, which the PLOS policy states is the preferred method. More commonly, authors state that their data are in the paper itself or in the supplemental information, though it is unclear whether these data meet the level of sharing required in the PLOS policy.
Peer reviewers have the right to view the data and code that underlie a work if it would help in the evaluation, even if these have not been provided with the submission. Yet few referees exercise this right.
Where Do the Numbers Published in Scientific Articles Come From?
Study attempts to reproduce values reported in 35 articles published in the journal Cognition revealed analysis pipelines peppered with errors. Elements of a reproducible workflow that may help to mitigate these problems in future research are outlined.
Many efforts are underway to promote data sharing in psychology, however it is currently unclear if the in-principle benefits of data availability are being realized in practice. In a recent study, we found that a mandatory open data policy introduced at the journal Cognition led to a substantial increase in available data, but a considerable portion of this data was not reusable. For data to be reusable, it needs to be clearly structured and well-documented. Open data alone will not be enough to achieve the benefits envisioned by proponents of data sharing.
Practical Tools and Strategies for Researchers to Increase Replicability
This publication provides an overview of some practical tools and strategies that researchers can implement in their own workflow to increase replicability and the overall quality of psychology research.
Reproducibility and Replication - University of Zurich Center for Reproducible Science Kickoff Workshop
A strategic kick-off workshop on Reproducibility and Replication with the goal to define the optimal set-up of the activities of the newly opened Center for Reproducible Science (CRS) at the University of Zurich.