Weak Statistical Standards Implicated in Scientific Irreproducibility
By Erika Check Hayden,
Nature
| 11. 11. 2013
The
plague of non-reproducibility in science may be mostly due to scientists’ use of weak statistical tests, as shown by an innovative method developed by statistician Valen Johnson, at Texas A&M University in College Station.
Johnson compared the strength of two types of tests: frequentist tests, which measure how unlikely a finding is to occur by chance, and Bayesian tests, which measure the likelihood that a particular hypothesis is correct given data collected in the study. The strength of the results given by these two types of tests had not been compared before, because they ask slightly different types of questions.
So Johnson developed a method that makes the results given by the tests — the P value in the frequentist paradigm, and the Bayes factor in the Bayesian paradigm — directly comparable. Unlike frequentist tests, which use objective calculations to reject a null hypothesis, Bayesian tests require the tester to define an alternative hypothesis to be tested — a subjective process. But Johnson developed a 'uniformly most powerful' Bayesian test that defines the alternative hypothesis in a standard way...
Related Articles
By Pallab Gosh and Gwyndaf Hughes, BBC News | 06.26.2025
Work has begun on a controversial project to create the building blocks of human life from scratch, in what is believed to be a world first.
The research has been taboo until now because of concerns it could lead to...
Since the “CRISPR babies” scandal in 2018, no additional genetically modified babies are known to have been born. Now several techno-enthusiastic billionaires are setting up privately funded companies to genetically edit human embryos, with the explicit intention of creating genetically modified children.
Heritable genome editing remains prohibited by policies in the overwhelming majority of countries that have any relevant policy, and by a binding European treaty. Support for keeping it legally off limits is widespread, including among scientists...
By Rhys Blakely, The Times | 06.24.2025
Scientists have created fertile mice from male genetic material alone, a breakthrough that could one day open the door to human babies who inherit their genes from two fathers.
The experiment, led by Professor Yanchang Wei at Shanghai Jiao Tong...
By Ron Leuty, San Francisco Business Times | 06.16.2025
23andMe's two-step sale to a nonprofit led by former CEO Anne Wojcicki is nothing more than a dance around California's genetic privacy law, state Attorney General Rob Bonta said in a filing late Monday, one day before a judge will...