Poor research design and data analysis encourage false-positive findings. The persistence of poor methods results partly from incentives that favour them, leading to the natural selection of bad science.
Registered Reports: Peer Review Before Results Are Known to Align Scientific Values and Practices
Registered Reports emphasize the importance of the research question and the quality of methodology by conducting peer review prior to data collection. High quality protocols are then provisionally accepted for publication if the authors follow through with the registered methodology.
A New Vision for the Statistical Training of Scientists
Many of today's problems in science are substantially driven by deficits in statistical thinking and data skills that are common across the sciences. This opinion article justifies this position, and offers ways that these deficits might be addressed.
Manipulating the Alpha Level Cannot Cure Significance Testing
When evaluating the strength of the evidence, we should consider auxiliary assumptions, the strength of the experimental design, and implications for applications. To boil all this down to a binary decision based on a p-value threshold is not acceptable.
John Ioannidis discusses the potential effects on clinical research of a 2017 proposal to lower the default P value threshold for statistical significance from .05 to .005 as a means to reduce false-positive findings.
Given that science is the key driver of human progress, improving the efficiency of scientific investigation and yielding more credible and more useful research results can translate to major benefits.
In a profession rewarding productivity in the form of papers and grants, sitting down to deeply read journal articles can feel like wasted time. Professor logs every paper she read over multiple years to gain insight on personal research practices.