Inferential misconceptions and replication crisis

Misinterpretations of the p value and the introduction of bias through arbitrary analytical choices have been discussed in the literature for decades. Nonetheless, they seem to have persisted in empirical research, and criticisms of p value misuses have increased in the recent past due to the non-re...

Full description

Saved in:
Bibliographic Details
Main Authors: Norbert Hirschauer, Oliver Mußhoff, Sven Gruener, Ulrich Frey, Insa Theesfeld, Peter Wagner
Format: Article
Language:English
Published: Milano University Press 2016-12-01
Series:Epidemiology, Biostatistics and Public Health
Online Access:http://ebph.it/article/view/12066
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849315309034405888
author Norbert Hirschauer
Oliver Mußhoff
Sven Gruener
Ulrich Frey
Insa Theesfeld
Peter Wagner
author_facet Norbert Hirschauer
Oliver Mußhoff
Sven Gruener
Ulrich Frey
Insa Theesfeld
Peter Wagner
author_sort Norbert Hirschauer
collection DOAJ
description Misinterpretations of the p value and the introduction of bias through arbitrary analytical choices have been discussed in the literature for decades. Nonetheless, they seem to have persisted in empirical research, and criticisms of p value misuses have increased in the recent past due to the non-replicability of many studies. Unfortunately, the critical concerns that have been raised in the literature are scattered over many disciplines, often linguistically confusing, and differing in their main reasons for criticisms. Misuses and misinterpretations of the p value are currently being discussed intensely under the label “replication crisis” in many academic disciplines and journals, ranging from specialized scientific journals to Nature and Science. In a drastic response to the crisis, the editors of the journal Basic and Applied Social Psychology even decided to ban the use of p values from future publications at the beginning of 2015, a fact that has certainly added fuel to the discussions in the relevant scientific forums. Finally, in early March, the American Statistical Association released a brief formal statement on p values that explicitly addresses misuses and misinterpretations. In this context, we systematize the most serious flaws related to the p value and discuss suggestions of how to prevent them and reduce the rate of false discoveries in the future.
format Article
id doaj-art-cb26cad16a0d43c8821e10d8c24d3fb2
institution Kabale University
issn 2282-0930
language English
publishDate 2016-12-01
publisher Milano University Press
record_format Article
series Epidemiology, Biostatistics and Public Health
spelling doaj-art-cb26cad16a0d43c8821e10d8c24d3fb22025-08-20T03:52:10ZengMilano University PressEpidemiology, Biostatistics and Public Health2282-09302016-12-0113410.2427/1206610799Inferential misconceptions and replication crisisNorbert Hirschauer0Oliver Mußhoff1Sven Gruener2Ulrich Frey3Insa Theesfeld4Peter Wagner5Martin Luther University Halle-WittenbergGeorg-August-University GoettingenMartin Luther University Halle-WittenbergMartin Luther University Halle-WittenbergMartin Luther University Halle-WittenbergMartin Luther University Halle-WittenbergMisinterpretations of the p value and the introduction of bias through arbitrary analytical choices have been discussed in the literature for decades. Nonetheless, they seem to have persisted in empirical research, and criticisms of p value misuses have increased in the recent past due to the non-replicability of many studies. Unfortunately, the critical concerns that have been raised in the literature are scattered over many disciplines, often linguistically confusing, and differing in their main reasons for criticisms. Misuses and misinterpretations of the p value are currently being discussed intensely under the label “replication crisis” in many academic disciplines and journals, ranging from specialized scientific journals to Nature and Science. In a drastic response to the crisis, the editors of the journal Basic and Applied Social Psychology even decided to ban the use of p values from future publications at the beginning of 2015, a fact that has certainly added fuel to the discussions in the relevant scientific forums. Finally, in early March, the American Statistical Association released a brief formal statement on p values that explicitly addresses misuses and misinterpretations. In this context, we systematize the most serious flaws related to the p value and discuss suggestions of how to prevent them and reduce the rate of false discoveries in the future.http://ebph.it/article/view/12066
spellingShingle Norbert Hirschauer
Oliver Mußhoff
Sven Gruener
Ulrich Frey
Insa Theesfeld
Peter Wagner
Inferential misconceptions and replication crisis
Epidemiology, Biostatistics and Public Health
title Inferential misconceptions and replication crisis
title_full Inferential misconceptions and replication crisis
title_fullStr Inferential misconceptions and replication crisis
title_full_unstemmed Inferential misconceptions and replication crisis
title_short Inferential misconceptions and replication crisis
title_sort inferential misconceptions and replication crisis
url http://ebph.it/article/view/12066
work_keys_str_mv AT norberthirschauer inferentialmisconceptionsandreplicationcrisis
AT olivermußhoff inferentialmisconceptionsandreplicationcrisis
AT svengruener inferentialmisconceptionsandreplicationcrisis
AT ulrichfrey inferentialmisconceptionsandreplicationcrisis
AT insatheesfeld inferentialmisconceptionsandreplicationcrisis
AT peterwagner inferentialmisconceptionsandreplicationcrisis