Reproducible Research and GIScience: an Evaluation Using AGILE Conference Papers
We reviewed current recommendations for reproducible research and translated them into criteria for assessing the reproducibility of articles in the field of geographic information science (GIScience). Results from the author feedback indicate that although authors support the concept of performing reproducible research, the incentives for doing this in practice are too small. Therefore, we propose concrete actions for individual researchers and the GIScience conference series to improve transparency and reproducibility.
Article postulates that a clear definition of use and reuse is needed to establish better metrics for a comprehensive scholarly record of individuals, institutions, organizations, etc. Hence, this article presents a first definition of reuse of research data.
Next in Reproducibility: Standards, Policies, Infrastructure, and Human Factors
What is next for reproducibility? Research communities will need to develop standards of practice, institutions will adopt formal policies, and funding agencies may look to support more infrastructure and tools to enable reproducibility.
Open Call: Become a Frictionless Data Reproducible Research Fellow
The Frictionless Data Reproducible Research Fellows Program, supported by the Sloan Foundation, aims to train graduate students, postdoctoral scholars, and early career researchers how to become champions for open, reproducible research using Frictionless Data tools and approaches in their field.
Threats to reproducibility, recognized but unaddressed for decades, might finally be brought under control. The four horsemen of the reproducibility apocalypse being: publication bias, low statistical power, P-value hacking and HARKing (hypothesizing after results are known).
"Biological Variability Makes Reproducibility More Difficult"
Research findings based on HeLa cells cannot always be reproduced by other scientists. To get to the bottom of this lack of reproducibility, a group of system biologists working with ETH Professor Ruedi Aebersold has embarked on a massive project: molecular cell measurement.
When we reject failure, we create a culture of punishment, artificial rewards, and scientific bias. There are people running analyses and experiments right now which others will have undoubtedly done before, but just not communicated their results.
In the 21st Century, research is increasingly data- and computation-driven. Researchers, funders, and the larger community today emphasize the traits of openness and reproducibility. In March 2017, 13 mostly early-career research leaders who are building their careers around these traits came together with ten university leaders (presidents, vice presidents, and vice provosts), representatives from four funding agencies, and eleven organizers and other stakeholders in an NIH- and NSF-funded one-day, invitation-only workshop titled “Imagining Tomorrow’s University.” Workshop attendees were charged with launching a new dialog around open research – the current status, opportunities for advancement, and challenges that limit sharing.
The workshop examined how the internet-enabled research world has changed, and how universities need to change to adapt commensurately, aiming to understand how universities can and should make themselves competitive and attract the best students, staff, and faculty in this new world. During the workshop, the participants re-imagined scholarship, education, and institutions for an open, networked era, to uncover new opportunities for universities to create value and serve society. They expressed the results of these deliberations as a set of 22 principles of tomorrow's university across six areas: credit and attribution, communities, outreach and engagement, education, preservation and reproducibility, and technologies.
It's Not a Replication Crisis. It's an Innovation Opportunity
Australian cancer researcher Glenn Begley who raised attention to the fact that many published scientific findings cannot be reproduced ,says that he never described it as a replication crisis, beacuse if one takes the funding from the lazy scientists and give it to really good scientists, it is an innovation opportunity.
Psychology's Replication Crisis Has Made The Field Better
Psychology’s replication crisis has changed the field. Today, authors are voluntarily posting their data, replication attempts are published in top journals, and researchers are increasing their sample sizes and committing to data collection and analysis plans in advance.